A framework for the development of computerized adaptive tests

Practical Assessment, Research and Evaluation

Volumn 16, Issue 1, 2011, Pages 1-9

  Thompson, Nathan A ^a   Weiss, David J ^b  

^a Assessment Systems Corporation   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84856656565     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (44)

1. Bejar, I.I. (1980). A procedure for investigating the unidimensionality of achievement tests based on item parameter estimates. Journal of Educational Measurement, 17, 283-296.
2. Bejar, I.I. (1988). An approach to assessing unidimensionality revisited. Applied Psychological Measurement, 12, 377-379.
3. Bloom B. S. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co. Inc.
4. Bock, R., Gibbons, R., Schilling, S., Muraki, E. Wilson, & Wood, R., (2003) TESTFACT 4 (Computer software). Lincolnwood, IL: Scientific Software International.
5. Castro, F., Suarez, J., & Chirinos, R. (2010). Competencés initial estimation in computer adaptive testing. Paper presented at the first annual conference of the International Association for Computerized Adaptive Testing, Arnhem, The Netherlands.
6. Choi, S.W. (2009). Firestar: Computerized adaptive testing (CAT) simulation program for polytomous IRT Models (Computer software). Applied Psychological Measurement, 33, 644-645.
7. De Ayala, R.J. (2009). The theory and practice of item response theory. New York: Guilford.
8. Eggen, T. J. H. M. (1999). Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23, 249-261.
9. Eggen, T. J. H. M, & Straetmans, G. J. J. M. (2000). Computerized adaptive testing for classifying examinees into three categories. Educational and Psychological Measurement, 60, 713-734.
10. Embretson, S.E., & Reise, S.P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
11. Flaugher, R. (2000). Item Pools. In Wainer, H. (Ed.) Computerized adaptive testing: A Primer. Mahwah, NJ: Erlbaum.
12. Frick, T. (1992). Computerized Adaptive Mastery Tests as Expert Systems. Journal of Educational Computing Research, 8(2), 187-213.
13. Georgiadou, E., Triantafillou, E., Economides, A. (2007). A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005. Journal of Technology, Learning, and Assessment, 5(8). Retrieved August 23, 2010 from http://www.jtla.org.
14. Gibbons, R.D., Weiss, D.J., Kupfer, D.J., Frank, E., Fagiolini, A., Grochocinski, V.J., Bhaumik, D.K., Stover, A., Bock, R.D., Immekus, J.C. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services, 59, 361-368.
15. Han, K. T. (2007). WinGen: Windows software that generates IRT parameters and item responses. Applied Psychological Measurement, 31(5), 457-459.
16. nd ed. New York: Springer.
17. Lee, J, & Weiss, D. J. (2010). Selection of common items in full metric calibration for the development of CAT item banks. Paper presented at the first annual conference of the International Association for Computerized Adaptive Testing, Arnhem, The Netherlands.
18. Lord, F.M. (1980). Applications of Item Response Theory to Practical Testing Problems. Hillsdale NJ: Erlbaum.
19. Lord, F.M. (1986). Maximum likelihood and Bayesian parameter estimation in item response theory. Journal of Educational Measurement, 23, 157-162.
20. Nydick, S. W., & Weiss, D. J. (2009). A hybrid simulation procedure for the development of CATs. In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. Retrieved August 23, 2010 from www.psych.umn.edu/psylabs/CATCentral.
21. Parshall, C. G., Spray, J. A., Kalohn, J. C., & Davey, T. (2006). Practical considerations in computer-based testing. New York: Springer.
22. Pommerich, M., Segall, D.O., & Moreno, K.E. (2009). The nine lives of CAT-ASVAB: Innovations and revelations. In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. Retrieved August 23, 2010 from http://www.psych.umn.edu/psylabs/CATCentral.
23. Reckase, M. D. (1983). A procedure for decision making using tailored testing. In D. J. Weiss (Ed.), New horizons in testing: Latent trait theory and computerized adaptive testing (pp. 237-254). New York: Academic Press.
24. Reckase, M. D. (2003). Item pool design for computerized adaptive tests. Paper presented at annual meeting of the National Council on Measurement in Education, Chicago, IL.
25. Rudner, L. M. (2002). An examination of decision-theory adaptive testing procedures. Paper presented at the annual meeting of the American Educational Research Association, April 1-5, 2002, New Orleans, LA.
26. Rudner, L.M. and Guo, F.M. (in press) Computer adaptive testing for small scale programs and instructional systems. Journal of Applied Testing Technology.
27. Sands, W.A., Waters, B.K. and McBride, J.R. (Eds.) (1997). Computerized adaptive testing. From inquiry to operation. Washington: American Psychological Association.
28. Stocking, M.L., & Lord, F.M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
29. Thompson, N. A. (2007). A practitioner's guide for variable-length computerized classification testing. Practical Assessment Research & Evaluation, 12(1). Available online: http://pareonline.net/getvn.asp?v=12&n=1.
30. Thompson, N.A. (2009a). Item selection in computerized classification testing. Educational and Psychological Measurement, 69, 778-793.
31. van der Linden, W.J. & Glas, C.A.W. (Eds.) (2010). Elements of adaptive testing, (Statistics for Social and Behavioral Sciences Series). New York: Springer.
32. van der Linden, W.J. (2010). How to make adaptive testing more efficient? Paper presented at the first annual conference of the International Association for Computerized Adaptive Testing, Arnhem, The Netherlands.
33. Veldkamp, B.P., & van der Linden, W.J. (2010). Designing item pools for adaptive testing. In van der Linden, W.J. & Glas, C.A.W. (Eds.) (2010). Elements of adaptive testing, (Statistics for Social and Behavioral Sciences Series). New York: Springer.
34. Verschoor, A. (2010). Optimal calibration designs for computerized adaptive testing. Paper presented at the first annual conference of the International Association for Computerized Adaptive Testing, Arnhem, The Netherlands.
35. Vispoel, W.P., Rocklin, T.R., & Wang, T. (1994). Individual differences and test administration procedures: A comparison of fixed-item, computerized adaptive, and self-adapted testing. Applied Measurement in Education, 7, 53-59.
36. Wainer, H. (1993). Some practical considerations when converting a linearly administered test to an adaptive format. Educational Measurement: Issues and Practice, 12, 15-20.
37. Wainer, H. (Ed.) (2000). Computerized adaptive testing: A Primer. Mahwah, NJ: Erlbaum.
38. Waller, N. (1997). MicroFACT (Computer software). Saint Paul, MN: Assessment Systems Corporation.
39. Weiss, D. J. & Kingsbury, G. G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21, 361-375.
40. Weiss, D. J. & Guyer, R. (2010). Manual for CATSim: Comprehensive simulation of computerized adaptive testing. St. Paul MN: Assessment Systems Corporation.
41. Weissman, A. (2004). Mutual information item selection in multiple-category classification CAT. Paper presented at the Annual Meeting of the National Council for Measurement in Education, San Diego, CA.
42. Wise, S. G., & Kingsbury, G.G. (2000). Practical issues in developing and maintaining a computerized adaptive testing program. Psicologia, 21(1), 135-155. http://redalyc.uaemex.mx/pdf/169/16921108.pdf
43. Yoes, M. (1995). An updated comparison of micro-computer based item parameter estimation procedures used with the 3-parameter IRT model. Saint Paul, MN: Assessment Systems Corporation.
44. Yoes, M. (1997). PARDSIM (Computer software). Saint Paul, MN: Assessment Systems Corporation.