A practical computer adaptive testing model for small-scale scenarios

Educational Technology and Society

Volumn 11, Issue 3, 2008, Pages 259-274

  Tao, Yu Hui ^a   Wu, Yu Lung ^b   Chang, Hsin Yi ^c  

^a NATIONAL UNIVERSITY OF KAOHSIUNG   (Taiwan)

^b I SHOU UNIVERSITY   (Taiwan)

^c Corel Corporation ^*  (Taiwan)

Author keywords

Computer adaptive testing; Item response theory; Sequential probability ratio test; TOEFL

Indexed keywords

EID: 54149108770     PISSN: 11763647     EISSN: 14364522     Source Type: Journal    
DOI: None     Document Type: Article

References (33)

1. Ackerman, T. A. (1989). Unidimensional IRT calibration of compensatory and noncompensatory multidimensional items. Applied Psychological Measurement, 13, 113-127.
2. Bunderson, V., Inouye, D., & Olson, J. (1989). The four generations of computerized educational measurement. In R. L. Linn (Ed.), Educational measurement, New York: Macmillan, 367-407.
3. Chou, C. (2000). Constructing a computer-assisted testing and evaluation system on the World Wide Web - The CATES experience. IEEE Transactions on Education, 43 (3), 266-272.
4. Das, T. K., Ganesan, R., Sikder, A. K., & Kumar, A. (2005). Online end point detection in CMP using SPRT of wavelet decomposed sensor data. IEEE Transactions on Semiconductor Manufacturing, 18 (3), 440-447.
5. ETS (2001). A study of the use of collateral statistical information in attempting to reduce TOEFL® IRT item parameter estimation sample sizes, Report RR-01-11, TOEFL-TR-17, retrieved June 2, 2008, from http://www1.ets.org/portal/site/ets/menuitem.fab2360b1645a1de9b3a0779f1751509/? vgnextoid=69c0197a484f4010VgnVCM10000022f95190RCRD.
6. ETS (2007). ETS Website, retrieved June 1, 2008 from http://www.ets.org.
7. Ferguson, T. S. (1967). Mathematical Statistics: A Decision Theoretic Approach, New York: Academic Press.
8. Frick, T. W. (1989). Bayesian adaptation during computer-based tests and computer-guided practice exercises. Journal of Educational Computing Research, 5 (1), 89-114.
9. Frick, T. W. (1990). A comparison of three decision models for adapting the length of computer-based mastery test. Journal of Educational Computing Research Systems, 5 (1), 89-114.
10. Frick, T. W. (1992). Computerized adaptive mastery tests as expert. Journal of Educational Computing Research Systems, 8 (2), 187-213.
11. Guzman, E., & Conejo, R. (2005). Self-assessment in a feasible, adaptive Web-based testing system. IEEE Transactions on Education, 48 (4), 688-695.
12. Hatzilygeroudis, I., Koutsojannis, C., Papavlasopoulos, C., & Prentzas, J. (2006). Knowledge-based adaptive assessment in a Web-based intelligent educational system. Paper presented at the Sixth International Conference on Advanced Learning Technologies, July 5-7,2006, Kerkrade, The Netherlands.
13. Ho, R. G., & Yen, Y. C. (2005). Design and evaluation of an XML-based platform-independent computerized adaptive testing system. IEEE Transactions on Education, 48 (2), 230-237.
14. Huff, K. L., & Sireci, S. G.. (2001). Validity issues in computer-based testing. Educational Measurement: Issues and Practice, 20 (3), 16-25.
15. Jarman, K. D., Smith, L. E., & Carlson, D. K. (2004). Sequential probability ratio test for long-term radiation monitoring. IEEE Transaction on Nuclear Science, 51 (4), 1662-1666.
16. Kalohn, J. C., & Spray, J. A. (1999). The effective of model misspecification on classification decisions made using a computerized test. Journal of Education Measurement, 36 (1), 47-59.
17. Lord, F. M. (1980). Applications of Item Response Theory to Practice Testing Problems, Hillsdale, NJ: Erlbaum.
18. Olson, J. (1990). Applying computerized adaptive testing schools. Measurement and Evaluation in Counseling and Development, 23 (1), 31-38.
19. Si, F. F., & Schumacker. R. E. (2004). Ability estimation under different item parameterization and scoring models, International Journal of Testing, 4 (2), 137-181.
20. Tartakovsky, A. G, Li, X. R., & Yaralov, G.. (2003). Sequential detection of targets in multichannel systems. IEEE Transactions on Information Theory, 49 (2), 425-445.
21. Thanh Ngoc Bui, T. N., Krishnamurthy, V., & Poor, H. V. (2005). Online Bayesian activity detection in DS/CDMA networks. IEEE Transactions on Signal Processing, 53 (1), 371-375.
22. Taiwan Education Testing Center (2007). Taiwan Education Testing Center Website, Retrieved June 1, 2008 from http://www.edutest.com.tw/about/ index.htm.
23. Taylor, C., Kirsch, I., Eignor, D., & Jamieson, J. (1999). Examining the relationship between computer familiarity and performance on computer-based language tasks. Language Learning, 49, 219-274.
24. Tijms, H. (2004) Understanding Probability: Chance Rules in Everyday Life, Cambridge: Cambridge Univ Press.
25. TOEFL (2005). TOEFL Test and Scores Summary, 2004-2005 Edition, Retrieved June 16, 2008 from http://www.etsliteracy.com/portal/site/ets/ menuitem.fab2360b1645a1de9b3a0779f1751509/?vgnextoid= 69c0197a484f4010VgnVCM10000022f95190RCRD.
26. Wald, A. (1947). Sequential Analysis, New York: John Wiley.
27. Wang, A. C., & Chuang, C. L. (2002). Applicable adaptive testing models for school teachers. Educational Media International, 39(1), 55-59.
28. Wang, F. H. (2006). Application of componential IRT model for diagnostic test in a standard conformant eLearning system. Paper presented at the Sixth International Conference on Advanced Learning Technologies, July 5-7, 2006, Kerkrade, The Netherlands.
29. Welch, R. E., & Frick, T. W. (1993). Computerized adaptive testing in instructional settings. Educational Technology Research and Development, 41 (3), 47-62.
30. Wise, S. L., & Kingsbury, G. G. (2000). Practical issues in developing and maintaining a computerized adaptive testing program. Psicologica, 21, 135-155.
31. Yang, K. M., Ross, R. J., & Kim, S. B. (2005). Constructing different learning paths through e-learning. Paper presented at the International Conference on Information Technology: Coding and Computing, April 4-6, 2005, Las Vegas, Nevada.
32. Yu, M. L. (1992). Introduction to item response theory: item response model and its characteristics. Inservice Education Bulletin, 9 (2), 6-10.
33. th Ed.), New York: Dryden.