Item Selection in Multidimensional Computerized Adaptive Testing-Gaining Information from Different Angles

Psychometrika

Volumn 76, Issue 3, 2011, Pages 363-384

  Wang, Chun ^a   Chang, Hua Hua ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

continuous entropy; Fisher information; Kullback Leibler information; multidimensional computerized adaptive test; mutual information

Indexed keywords

EID: 79959377958     PISSN: 00333123     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11336-011-9215-7     Document Type: Article

References (44)

1. Anderson, T. W. (1984). An introduction to multivariate statistical analysis (2nd edn.). New York: Wiley.
2. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord, & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 379-479). Reading: Addison-Wesley.
3. Bolt, D. M., & Lall, V. F. (2003). Estimation of compensatory and noncompensatory multidimensional item response models using Markov chain Monte Carlo. Applied Psychological Measurement, 27(6), 395-414.
4. Chaloner, K., & Verdinelli, I. (1995). Bayesian experimental design: A review. Statistical Science, 10, 237-304.
5. Chang, H. H., & Stout, W. (1993). The asymptotic posterior normality of the latent trait in an IRT Model. Psychometrika, 58(1), 37-52.
6. Chang, H. H., & Ying, Z. L. (1996). A global information approach to computerized adoptive testing. Applied Psychological Measurement, 20(3), 213-229.
7. Chang, H. H., & Ying, Z. L. (1999). a-stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23(3), 211-222.
8. Chang, H. H., & Ying, Z. L. (2008). To weight or not to weight? Balancing influence of initial items in adaptive testing. Psychometrika, 73(3), 441-450.
9. Chen, S. Y., Ankenmann, R. D., & Chang, H. H. (2000). A comparison of item selection rules at the early stages of computerized adaptive testing. Applied Psychological Measurement, 24(3), 241-255.
10. Cheng, Y., & Chang, H.-H. (2009). The maximum priority index method for severely constrained item selection in computerized adaptive testing. British Journal of Mathematical and Statistical Psychology, 62, 369-383.
11. Cheng, Y. (2009). When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika, 74(4), 619-632.
12. Cover, T., & Thomas, J. (1991). Elements of information theory. New York: Wiley.
13. Eggen, T. (1999). Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23(3), 249-261.
14. Finkelman, M., Nering, M. L., & Roussos, L. A. (2009). A conditional exposure control method for multidimensional adaptive testing. Journal of Educational Measurement, 46(1), 84-103.
15. Hattie, J. (1981). Decision criteria for determining unidimensionality. Unpublished doctoral dissertation, University of Toronto, Canada.
16. Hooker, G., Finkelman, M., & Schwartzman, A. (2009). Paradoxical results in multidimensional item response theory. Psychometrika, 74(3), 419-442.
17. Lee, Y. H., Ip, E. H., & Fuh, C. D. (2008). A strategy for controlling item exposure in multidimensional computerized adaptive testing. Educational and Psychological Measurement, 68(2), 215-232.
18. Lehmann, E. L., & Casella, G. (1998). Theory of point estimation (2nd ed.). New York: Springer.
19. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale: Erlbaum.
20. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading: Addison-Wesley.
21. Luecht, R. M. (1996). Multidimensional computerized adaptive testing in a certification or licensure context. Applied Psychological Measurement, 20(4), 389-404.
22. Meyer, M. E., & Gokhale, O. (1993). Kullback-Leibler information measure for studying convergence rates of densities and distributions. IEEE Transactions on Information Theory, 39(4), 1401-1404.
23. Mulder, J., & van der Linden, W. J. (2009). Multidimensional adaptive testing with optimal design criteria for item selection. Psychometrika, 74(2), 273-296.
24. Mulder, J., & van der Linden, W. J. (2010). Multidimensional adaptive testing with Kullback-Leibler information item selection. In W. J. van der Linden, & C. A. W. Glas (Eds.), Elements of adaptive testing (pp. 77-101). New York: Springer.
25. Reckase, M. D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9(4), 401-412.
26. Reckase, M. D. (1997). The past and future of multidimensional item response theory. Applied Psychological Measurement, 21(1), 25-36.
27. Reckase, M. D. (2009). Multidimensional item response theory. New York: Springer.
28. Reckase, M. D., & McKinley, R. L. (1991). The discriminating power of items that measure more than one dimension. Applied Psychological Measurement, 15(4), 361-373.
29. Revuelta, J., & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 35(4), 311-327.
30. Renyi, A. (1961). On measures of entropy and information. In Proceedings of the fourth berkeley symposium on mathematical statistics and probability (Vol. 1, pp. 547-561).
31. Runder, L. M. (2002). An examination of decision-theory adaptive testing procedures. Paper presented at the annual meeting of American Educational Research Association, New Orleans, LA.
32. Segall, D. O. (1996). Multidimensional adaptive testing. Psychometrika, 61(2), 331-354.
33. Segall, D. O. (2001). General ability measurement: An application of multidimensional item response theory. Psychometrika, 66(1), 79-97.
34. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423.
35. Sympson, J. B., & Hetter, R. D. (1985). Controlling item-exposure rates in computerized adaptive testing. In Proceedings of the 27th annual conference of the military testing association (Vol. 1, pp. 973-977).
36. van der Linden, W. J. (1996). Assembling tests for the measurement of multiple traits. Applied Psychological Measurement, 20, 373 -388.
37. van der Linden, W. J. (1998). Bayesian item selection criteria for adaptive testing. Psychometrika, 63, 201-216.
38. van der Linden, W. J. (1999). Multidimensional adaptive testing with a minimum error-variance criterion. Journal of Educational and Behavioral Statistics, 24(4), 398-412.
39. Veldkamp, B. P., & van der Linden, W. J. (2002). Multidimensional adaptive testing with constraints on test content. Psychometrika, 67(4), 575-588.
40. Wang, C., Chang, H., & Boughton, K. A. (2011). Kullback-Leibler information and its applications in multi-dimensional adaptive testing. Psychometrika, 76, 13-39.
41. Wang, C., & Chang, H. (2010). Item selection in MCAT-the new application of Kullback-Leibler information. Paper presented at the 2010 international meeting of the psychometric society, Athens, Georgia.
42. Wang, W. C., & Chen, P. H. (2004). Implementation and measurement efficiency of multidimensional computerized adaptive testing. Applied Psychological Measurement, 28(5), 295-316.
43. Weissman, A. (2007). Mutual information item selection in adaptive classification testing. Educational and Psychological Measurement, 67, 41-58.
44. Xu, X., Chang, H., & Douglas, J. (2005). Computerized adaptive testing strategies for cognitive diagnosis. Paper presented at the annual meeting of national council on measurement in education, Montreal, Canada.