Comparing the Performance of Five Multidimensional CAT Selection Procedures With Different Stopping Rules

Applied Psychological Measurement

Volumn 37, Issue 1, 2013, Pages 3-23

  Yao, Lihua ^a  

^a DoD Center Monterey Bay   (United States)

Author keywords

BMIRT; CAT; domain scores; MCAT; MIRT; multidimensional information; multidimensional item response theory; Multidimensional Priority Index; overall scores

Indexed keywords

EID: 84870814419     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621612455687     Document Type: Article

References (29)

1. Chang H.-H.Computers and their impact on state assessment: Recent history and predictions for the future. Lissitz R. W.Jiao H., ed. Charlotte, NC: Information Age Publishing; 2012:195-226.
2. Chang H.-H.,Ying Z.A global information approach to computerized adaptive testing.Applied Psychological Measurement. 1996;20:213-229.
3. Chang H.-H.,Ying Z.A-stratified multistage computerized adaptive testing.Applied Psychological Measurement. 1999;23:211-222.
4. Cheng Y.,Chang H. H.The maximum priority index method for severely constrained item selection in computerized adaptive testing.British Journal of Mathematical and Statistical Psychology. 2009;62:369-383.
5. Choi S. W.,Grady M.,Dodd B. G.A new stopping rule for computerized adaptive testing.Educational and Psychological Measurement. 2011;71:37-73.
6. Dodd B. G.,Koch W. R.,De Ayala R. J.Operational characteristics of adaptive testing procedures using the graded response model.Applied Psychological Measurement. 1989;13:129-143.
7. Dodd B. G.,Koch W. R.,De Ayala R. J.Computerized adaptive testing using the partial credit model: Effects of item pool characteristics and different stopping rules.Educational and Psychological Measurement. 1993;53:61-77.
8. Mulder J.,van der Linden W. J.Multidimensional adaptive testing with optimal design criteria for item selection.Psychometrika. 2009;74:273-296.
9. Reckase M. D.The past and future of multidimensional item response theory.Applied Psychological Measurement. 1997;21:25-36.
10. Reckase M. D.Multidimensional item response theory. New York, NY: Springer; 2009:.
11. Reckase M. D.,McKinely R. L.The discriminating power of items that measure more than one dimension.Applied Psychological Measurement. 1991;15:361-373.
12. Segall D. O.Multidimensional adaptive testing.Psychometrika. 1996;61:331-354.
13. Segall D. O.General ability measurement: An application of multidimensional item response theory.Psychometrika. 2001;66:79-97.
14. Sympson J. B.,Hetter R. D. Paper presented at the Annual Meeting of the Military Testing Association; 1985San Francisco, CA; 1985.
15. van der Linden W. J.Multidimensional adaptive testing with a minimum error-variance criterion.Journal of Educational and Behavioral Statistics. 1999;24:398-412.
16. van der LindenW. J. (2005). Linear models for optimal test design. New York, NY: Springer. Retrieved from http://www.springer.com/statistics/social/book/978-0-387-20272-3.
17. van der Linden W. J.,Veldkamp B. P.Constraining item exposure in computerized adaptive testing with shadow tests.Journal of Educational and Behavioral Statistics. 2004;29:273-291.
18. van der Linden W. J.,Veldkamp B. P.Conditional item-exposure control in adaptive testing using item-ineligibility probabilities.Journal of Educational and Behavioral Statistics. 2007;32:398-417.
19. Veldkamp B. P.,van der Linden W. J.Multidimensional adaptive testing with constraints on test content.Psychometrika. 2002;67:575-588.
20. Computerized adaptive testing: A primer. 2000). Computerized adaptive testing: A primer (2nd ed.). Mahwah, NJ: Erlbaum.Wainer H., ed. Mahwah, NJ: Erlbaum; 2000:.
21. Wang C.,Chang H.-H.,Boughton K.Kullback-Leibler information and its applications in multi-dimensional adaptive testing.Psychometrika. 2011;76:13-39.
22. Wang C.,Chang H.-H.,Huebner A.Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing.Journal of Educational Measurement. 2011;48:255-273.
23. Yao L.Monterey, CA: Defense Manpower Data Center; 2003:.
24. YaoL. (2010a). Multidimensional ability estimation: Bayesian or non-Bayesian. Unpublished manuscript.
25. Yao L.Reporting valid and reliability overall score and domain scores.Journal of Educational Measurement. 2010b;47:339-360.
26. Yao L. Paper presented at the (2011) International Association of Computer Adaptive Testing (IACAT) Conference; 2011aPacific Grove, CA; 2011a.
27. Yao L.Monterey, CA: Defense Manpower Data Center; 2011b:.
28. Yao L.Multidimensional CAT item selection methods for domain scores and composite scores: Theory and Applications.Psychometrika. 2012;77:495-523.
29. Yao L.,Schwarz R. D.A multidimensional partial credit model with associated item and test statistics: An application to mixed-format tests.Applied Psychological Measurement. 2006;30:469-492.