A cognitive diagnosis model for cognitively based multiple-choice options

Applied Psychological Measurement

Volumn 33, Issue 3, 2009, Pages 163-183

  De La Torre, Jimmy ^a,b  

^a RUTGERS UNIVERSITY   (United States)

^b Graduate School Education   (United States)

Author keywords

Cognitive diagnosis; DINA; EM algorithm; Multiple choice; Parameter estimation

Indexed keywords

EID: 65249100652     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621608320523     Document Type: Article

References (36)

1. Baker, F.B. (1992). Item response theory: Parameter estimation techniques. New York: Dekker.
2. Birenbaum, M., Tatsuoka, C., & Xin, T. (2005). Large-scale diagnostic assessment: Comparison of eighth graders' mathematics performance in the United States, Singapore and Israel. Assessment in Education Principles Policy and Practice, 12, 167-181.
3. Briggs, D., Alonzo, A., Schwab, C., & Wilson, M. (2006). Diagnostic assessment with ordered multiple-choice items. Educational Assessment, 11, 33-63.
4. Carlin, B.P., & Louis, T.A. (2000). Bayes and empirical Bayes methods for data analysis. New York: Chapman & Hall.
5. de la Torre, J. (2006, June). Skills profile comparisons at the state level: An application and extension of cognitive diagnosis modeling in NAEP. Paper presented at the International Meeting of the Psychometric Society, Montreal, Canada.
6. de la Torre, J., & Patz, R. (2005). Making the most of what we have: A practical application of multidimensional item response theory in test scoring. Journal of Educational and Behavioral Statistics, 30, 295-311. (Pubitemid 41538935)
7. Doignon, J.P., & Falmagne, J.C. (1999). Knowledge spaces. New York: Springer-Verlag.
8. Doornik, J.A. (2002). Object-oriented matrix programming using Ox (Version 3.1). [Computer software]. London: Timberlake Consultants Press.
9. Embretson, S. (1984). A general latent trait model for response processes. Psychometrika, 49, 175-186.
10. Haertel, E.H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333-352. (Pubitemid 19165268)
11. Haertel, E.H., & Wiley, D.E. (1993). Representations of ability structures: Implications for testing. In N. Frederiksen, R. J. Mislevy, & I. Bejar (Eds.), Test theory for a new generation of tests (pp. 359-384). Hillsdale, NJ: Erlbaum.
12. Halford, G.S., Andrews, G., Dalton, C., Boag, C., & Zielinski, T. (2002). Young children's performance on the balance scale: The influence of relational complexity. Journal of Experimental Child Psychology, 81, 417-445. (Pubitemid 36860458)
13. Jansen, B.R.J., & van der Maas, H.L.J. (2002). The development of children's rule use on the balance scale task. Journal of Experimental Child Psychology, 81, 383-416. (Pubitemid 36860457)
14. Junker, B.W., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258-272. (Pubitemid 33317121)
15. Macready, G.B., & Dayton, C.M. (1977). The use of probabilistic models in the assessment of mastery. Journal of Educational Statistics, 33, 379-416.
16. Mislevy, R. (1995). Probability-based inference in cognitive diagnosis. In P. D. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment (pp. 43-71). Hillsdale, NJ: Erlbaum.
17. National Research Council. (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academies Press.
18. National Research Council. (2003). Strategic education research partnership/Committee on a strategic education research partnership; M. S. Donovan, A. K. Wigdor, and C. E. Snow, Editors. Washington, DC: National Academies Press.
19. Neyman, J., & Scott, E.L. (1948). Consistent estimates based on partially consistent observations. Econometrika, 16, 661-679.
20. Nitko, A.J. (2001). Educational assessment of students (3 rd ed.). Columbus, OH: Merrill Prentice Hall.
21. Osterlind, S.J. (1998). Constructing test items: Multiple choice, constructed-response, performance and other formats (2 nd ed.). Boston: Kluwer Academic.
22. Pellegrino, J.W., Baxter, G.P., & Glaser, R. (1999). Addressing the ''two disciplines'' problem: Linking theories of cognition and learning with assessment and instructional practices. In A. Iran-Nejad & P. D. Pearson (Eds.), Review of research in education (pp. 307-353). Washington, DC. American Educational Research Association.
23. Sadler, P.M. (1998). Psychometric models of student conceptions in science: Reconciling qualitative studies and distractor-driven assessment instruments. Journal of Research in Science Teaching, 35, 265-296. (Pubitemid 128459015)
24. Shultz, T.R., Mareschal, D., & Schmidt, W.C. (1994). Modeling cognitive development on balance scale phenomena. Machine Learning, 16, 57-86.
25. Siegler, R.S. (1976). Three aspects of cognitive development. Cognitive Psychology, 8, 481-520.
26. Siegler, R.S. (1981). Developmental sequences within and between concepts. Monographs of the Society for Research in Child Development, 46 ( 2, Serial No. 189).
27. Stiggins. R.J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83, 758-765.
28. Tatsuoka, C. (2002). Data-analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society Series C (Applied Statistics), 51, 337-350.
29. Tatsuoka, K.K. (1983). Rule-space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354.
30. Tatsuoka, K.K. (1990). Toward an integration of item-response theory and cognitive error diagnosis. In N. Frederiksen, R. Glaser, A. Lesgold, & Safto, M. (Eds.), Monitoring skills and knowledge acquisition (pp. 453-488). Hillsdale, NJ: Erlbaum.
31. Tatsuoka, K.K., Corter, J., & Tatsuoka, C. (2004). Patterns of diagnosed mathematical content and process skills in TIMSS-R across a sample of 20 countries. American Educational Research Journal, 41, 901-906. (Pubitemid 40366992)
32. Thissen, D., & Steinberg, L. (1997). A response model for multiple-choice items. In W. van der Linden & R. Hambleton (Eds.), Handbook of modern item response theory (pp. 51-65). New York: Springer.
33. van der Maas, H.L.J., & Jansen, B R. J. (2003). What response times tell of children's behavior on the balance scale task. Journal of Experimental Child Psychology, 85, 141-177. (Pubitemid 36881053)
34. Wainer, H., Vevea, J.L., Camacho, F., Reeve, B., Rosa, K., Nelson, L., et al. (2001). Augmented scores- ''Borrowing strength'' to compute scores based on small number of items. In D. Thissen & H. Wainer (Eds.), Test scoring (pp. 343-387). Mahwah, NJ: Lawrence Erlbaum.
35. Wiggins, G. (1998). Educative assessment: Designing assessment to inform and improve performance. San Francisco: Jossey-Bass.
36. Wilson, M., & Sloane, K. (2000). From principles to practice: An embedded assessment system. Applied Measurement in Education, 13, 181-208.