Mutual Information Item Selection Method in Cognitive Diagnostic Computerized Adaptive Testing With Short Test Length

Educational and Psychological Measurement

Volumn 73, Issue 6, 2013, Pages 1017-1035

  Wang, Chun ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

cognitive diagnosis; computerized adaptive testing; Kullback Leibler information; mutual information

Indexed keywords

EID: 84886414034     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164413498256     Document Type: Article

References (44)

1. Chang H.,Ying Z.A global information approach to computerized adoptive testing.Applied Psychological Measurement. 1996;20:213-229.
2. Chen P.,Xin T.,Wang C.,Chang H.On-line calibration methods in cognitive diagnostic computerized adaptive testing.Psychometrika. 2012;77:201-222.
3. Chen S. Y.,Ankenmann R. D.,Chang H.A comparison of item selection rules at the early stages of computerized adaptive testing.Applied Psychological Measurement. 2000;24:241-255.
4. Cheng Y.When cognitive diagnosis meets computerized adaptive testing: CD-CAT.Psychometrika. 2009;74:619-632.
5. Cheng Y.,Chang H.The maximum priority index method for severely constrained item selection in computerized adaptive testing.British Journal of Mathematical and Statistical Psychology. 2009;62:369-383.
6. Cover T.,Thomas J.Elements of information theory. New York, NY: Wiley; 1991:.
7. Cui Y.,Gierl M.,Chang H.Evaluating item selection algorithms in computerized adaptive testing for cognitive diagnosis: a simulation study.Journal of Educational Measurement. 2012;49:19-28.
8. de la Torre J.An empirically-based method of Q-matrix validation for the DINA model: Development and applications.Journal of Educational Measurement. 2008;45:343-362.
9. de la Torre J.,Douglas J. A.Higher-order latent trait models for cognitive diagnosis.Psychometrika. 2004;69:333-353.
10. de la Torre J.,Patz R. J.Making the most of what we have: A practical application of multidimensional item response theory in test scoring.Journal of Educational and Behavioral Statistics. 2005;30:295-311.
11. DeCarlo L. T.On the analysis of fraction subtraction data: the DINA model, classification, latent classes, and the Q-matrix.Applied Psychological Measurement. 2011;35:8-26.
12. DiBello L. V.,Stout W.Guest editors' instruction and overview: IRT-based cognitive diagnostic models and related methods.Journal of Educational Measurement. 2007;44:285-291.
13. Eggen T.Item selection in adaptive testing with the sequential probability ratio test.Applied Psychological Measurement. 1999;23:249-261.
14. Haertel E.Using restricted latent class models to map the skill structure of achievement items.Journal of Educational Measurement. 1989;26:333-352.
15. Henson R.,Douglas J.Test construction for cognitive diagnosis.Applied Psychological Measurement. 2005;29:262-277.
16. HuebnerA., (2010). An overview of recent developments in cognitive diagnostic computer adaptive assessments. Practical Assessment, Research & Evaluation, 15(3). Retrieved from http://pareonline.net/getvn.asp?v=15&n=3.
17. Jang E.Towards an adaptive CALL: Natural language processing for diagnostic language assessment. Chapelle C. A.Chung Y.-R.Xu J., ed. Ames: Iowa State University; 2008:117-131.
18. Junker B. W.,Sijtsma K.Cognitive assessment models with few assumptions, and connections with nonparametric item response theory.Applied Psychological Measurement. 2001;25:258-272.
19. Lehmann E. L.,Casella G.Theory of point estimation. 1998). Theory of point estimation (2nd ed). New York, NY: Springer.New York, NY: Springer; 1998:.
20. Leighton J. P.,Gierl M. J.Defining and evaluating models of cognition used in educational measurement to make inferences about examinees' thinking processes.Educational Measurement: Issues and Practice. 2007;27:3-16.
21. Liu H.,You X.,Wang W.,Ding S.,Chang H-H.The development of computerized adaptive testing with cognitive diagnosis for an English achievement test in China.Journal of Classification. in press;:.
22. Liu J.,Xu G.,Ying Z.Data-driven learning of Q-matrix.Applied Psychological Measurement. 2012;36:609-618.
23. Mao X.,Xin T.The application of the Monte Carlo approach to cognitive diagnostic computerized adaptive testing with content constraints.Applied Psychological Methods. 2013;:.
24. Maris E.Estimating multiple classification latent class models.Psychometrika. 1999;64:187-212.
25. Mislevy R. J.,Almond R. G.,Yan D.,Steinberg L. S.Proceedings of the fifteenth conference on uncertainty in artificial intelligence. Laskey K. B.Prade H., ed. San Francisco, CA: Morgan Kaufmann; 1999:.
26. Mulder J.,van der Linden W. J.Elements of adaptive testing. van der Linden W. J.Glas C. A. W., ed. New York, NY: Springer; 2010:77-101.
27. Reckase M. D.Multidimensional item response theory. New York, NY: Springer; 2009:.
28. Roussos L. A.,Templin J. L.,Henson R. A.Skills diagnosis using IRT -based latent class models.Journal of Educational Measurement. 2007;44:293-311.
29. Rupp A. A.,Templin J.,Henson R. J.Diagnostic measurement: Theory, methods, and applications. New York, NY: Guilford Press; 2010:.
30. Shannon C. E.A mathematical theory of communication.Bell System Technical Journal. 1948;27:379-423.
31. Tatsuoka C.Data-analytic methods for latent partially ordered classification models.Journal of the Royal Statistical Society Series C (Applied Statistics). 2002;51:337-350.
32. Tatsuoka C.,Ferguson T.Sequential classification on partially ordered sets.Journal of the Royal Statistical Society Series B. 2003;65:143-157.
33. Tatsuoka K. K.Rule space: An approach for dealing with misconceptions based on item response theory.Journal of Educational Measurement. 1983;20:345-354.
34. Tatsuoka K. K.Cognitively diagnostic assessment. Nichols P. D.Chipman S. F.Brennan R. L., ed. Hillsdale, NJ: Lawrence Erlbaum; 1995:327-361.
35. Templin J. L.,Henson R. A.Measurement of psychological disorders using cognitive diagnosis models.Psychological Methods. 2006;11:287-305.
36. Veldkamp B. P.,van der Linden W. J.Multidimensional adaptive testing with constraints on test content.Psychometrika. 2002;67:575-588.
37. Wang C.,Chang H.-H.Item selection in multidimensional computerized adaptive tests-Gaining information from different angles.Psychometrika. 2011;76:363-384.
38. Wang C.,Chang H.-H.,Douglas J.Combining CAT with cognitive diagnosis: A weighted item selection approach.Behavior Research Methods. 2012;44:95-109.
39. Wang C.,Chang H.-H.,Huebner A.Restrictive stochastic item selection methods in cognitive diagnostic CAT.Journal of Educational Measurement. 2011;48:255-273.
40. Wang W. C.,Chen P. H.,Cheng Y. Y.Improving measurement precision of test batteries using multidimensional item response models.Psychological Methods. 2004;9:116-136.
41. Weiss D. J.Improving measurement quality and efficiency with adaptive testing.Applied Psychological Measurement. 1982;6:473-492.
42. Weissman A.Mutual information item selection in adaptive classification testing.Educational and Psychological Measurement. 2007;67:41-58.
43. Xu X.,Chang H.,Douglas J.Computerized adaptive testing strategies for cognitive diagnosis. Paper presented at the annual meeting of National Council on Measurement in Education; 2003Chicago, IL; 2003.
44. Yamamoto K.HYBRID model of IRT and latent class model. Princeton, NJ: Educational Testing Service; 1989:.