31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models

Handbook of Statistics

Volumn 26, Issue , 2006, Pages 979-1030

  DiBello, Louis V ^a   Roussos, Louis A ^a   Stout, William ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 67649364217     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(06)26031-0     Document Type: Review

References (74)

1. Adams R.J., and Wilson M. Formulating the Rasch model as a mixed coefficients multinomial logit. In: Engelhard G., and Wilson M. (Eds). Objective Measurement III: Theory in Practice (1996), Ablex, Norwood, NJ
2. Adams R.J., Wilson M., and Wang W.-C. The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement 21 (1997) 1-23
3. Almond R.G., Steinberg L.S., and Mislevy R.J. A framework for reusing assessment components. In: Yanai H., Okada A., Shigemasu K., Kano Y., and Meulman J.J. (Eds). New Developments in Psychometrics (2003), Springer, Tokyo 281-288
4. Andersen E.B. Estimating latent correlations between repeated testings. Psychometrika 50 (1985) 3-16
5. Anderson J.R., Corbett A.T., Koedinger K.R., and Pelletier R. Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4 (1995) 167-207
6. Birnbaum A. Some latent trait models and their use in inferring an examinee's ability. In: Lord F.M., and Novick M.R. (Eds). Statistical Theories of Mental Test Scores (1968), Addison-Wesley, Reading, MA
7. Cowles M.K., and Carlin B.P. Markov chain Monte Carlo convergence diagnostics: A comparative review. Journal of the American Statistical Association 91 (1996) 883-904
8. de la Torre J., and Douglas J.A. Higher-order latent trait models for cognitive diagnosis. Psychometrika 69 (2004) 333-353
9. DiBello L.V., Stout W.F., and Roussos L.A. Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In: Nichols P.D., Chipman S.F., and Brennan R.L. (Eds). Cognitively Diagnostic Assessment (1995), Erlbaum, Mahwah, NJ 361-389
10. Embretson S.E. Multicomponent latent trait models for test design. In: Embretson S.E. (Ed). Test Design: Developments in Psychology and Psychometrics (1985), Academic Press, New York 195-218
11. Embretson S.E. A multidimensional latent trait model for measuring learning and change. Psychometrika 56 (1991) 495-515
12. Embretson S.E. Multicomponent response models. In: van der Linden W.J., and Hambleton R.L. (Eds). Handbook of Modern Item Response Theory (1997), Springer, New York 305-321
13. Falmagne J.-C. A latent trait theory via a stochastic learning theory for a knowledge space. Psychometrika 54 (1989) 283-303
14. Fischer G.H. The linear logistic model as an instrument in educational research. Acta Psychologica 37 (1973) 359-374
15. Fischer G.H. Logistic latent trait models with linear constraints. Psychometrika 48 (1983) 3-26
16. Fischer G.H. An IRT-based model for dichotomous longitudinal data. Psychometrika 54 (1989) 599-624
17. Gelman A., and Meng X.-L. Model checking and model improvement. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds). Markov Chain Monte Carlo in Practice (1996), Chapman and Hall/CRC, Boca Raton, FL Chapter 11
18. Gelman A., Carlin J.B., Stern H.S., and Rubin D.R. Bayesian Data Analysis (1995), Chapman & Hall, London
19. Gierl, M.J. (1997). An investigation of the cognitive foundation underlying the rule-space model. Doctoral dissertation, University of Illinois at Urbana-Champaign, 1996. Dissertation Abstracts International 57 (08), 5351-B. University Microfilms No. AAC 97-02524
20. Gitomer D.H., and Yamamoto K. Performance modeling that integrates latent trait and class theory. Journal of Educational Measurement 28 (1991) 173-189
21. Haertel E.H. An application of latent class models to assessment data. Applied Psychological Measurement 8 (1984) 333-346
22. Haertel E.H. Continuous and discrete latent structure models of item response data. Psychometrika 55 (1990) 477-494
23. Hagenaars J. Loglinear Models with Latent Variables (1993), Sage Publications, Newbury Park, CA
24. Hartz, S.M. (2002). A Bayesian framework for the Unified Model for assessing cognitive abilities: Blending theory with practicality. Unpublished doctoral dissertation, University of Illinois, Champaign, IL
25. Hartz, S.M., Roussos, L.A. (2005). The Fusion Model for skills diagnosis: Blending theory with practice. ETS Research Report, Educational Testing Service, Princeton, NJ. In press
26. Henson, R.A., Roussos, L., Templin, J.L. (2004) Cognitive diagnostic "fit" indices. Unpublished ETS Project Report, Princeton, NJ
27. Henson, R.A., Roussos, L., Templin, J.L. (2005). Fusion model "fit" indices. Unpublished ETS Project Report, Princeton, NJ
28. Henson, R.A., He, X., Roussos, L.A. (2006). Cognitive diagnosis attribute level discrimination indices. Applied Psychological Measurement. In press
29. Jang, E.E. (2005). A validity narrative: Effects of reading skills diagnosis on teaching and learning in the context of NG TOEFL. Unpublished doctoral dissertation, University of Illinois, Champaign, IL
30. Jang, E.E. (2006). Pedagogical implications of cognitive skills diagnostic assessment for teaching and learning. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA, April
31. Junker, B. (1999). Some statistical models and computational methods that may be useful for cognitively-relevant assessment. Prepared for the Committee on the Foundations of Assessment, National Research Council, November 30, 1999
32. Junker B., and Sijtsma K. Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement 25 (2001) 258-272
33. Kelderman H., and Macready G.B. The use of loglinear models for assessing differential item functioning across manifest and latent examinee groups. Journal of Educational Measurement 27 (1990) 307-327
34. Klein, M., Birenbaum, M., Standiford, S., Tatsuoka, K.K. (1981). Logical error analysis and construction of tests to diagnose student 'bugs' in addition and subtraction of fractions. Tech. Rep. 81- 6-NIE, University of Illinois, CERL, Urbana
35. Linacre J.M. Many-Facet Rasch Measurement (1989), MESA Press, Chicago
36. Lord F.M. Application of Item Response Theory to Practical Testing Problems (1980), Lawrence Erlbaum Associates, Hillsdale, NJ
37. Macready G.B., and Dayton C.M. The use of probabilistic models in the assessment of mastery. Journal of Educational Statistics 2 (1977) 99-120
38. Macready G.B., and Dayton C.M. The nature and use of state mastery models. Applied Psychological Measurement 4 (1980) 493-516
39. Maris E. Estimating multiple classification latent class models. Psychometrika 64 (1999) 187-212
40. Masters G.N. A Rasch model for partial credit scoring. Psychometrika 47 (1982) 149-174
41. Mislevy R.J. Probability-based inference in cognitive diagnosis. In: Nichols P., Chipman S., and Brennan R. (Eds). Cognitively Diagnostic Assessment (1995), Erlbaum, Hillsdale, NJ 43-71
42. Mislevy R.J., and Verhelst H. Modeling item responses when different subjects imply different solution strategies. Psychometrika 55 (1990) 195-215
43. Mislevy R.J., Steinberg L.S., and Almond R.G. On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives 1 (2003) 3-67
44. Mislevy, R.J., Almond, R.G., Lukas, J.F. (2004). A brief introduction to Evidence-Centered Design. CSE Technical Report 632, The National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Center for the Study of Evaluation (CSE), UCLA, Los Angeles, CA
45. Patz R.J., and Junker B. A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics 24 (1999) 146-178
46. Patz R.J., and Junker B. Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics 24 (1999) 342-366
47. Pellegrino J.W., Chudowsky N., and Glaser R. Knowing what Students Know: The Science and Design of Educational Assessment (2001), National Academy Press, Washington, DC
48. Rasch G. On general laws and the meaning of measurement in psychology. In: Neyman J. (Ed). Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability vol. 4 (1961), University of California Press, Berkeley, CA
49. Reckase M.D., and McKinley R.L. The discriminating power of items that measure more than one dimension. Applied Psychological Measurement 15 (1991) 361-373
50. Rost J. Rasch models in latent classes: An integration of two approaches to item analysis. Applied Psychological Measurement 14 (1990) 271-282
51. Roussos, L.A. (1994). Summary and review of cognitive diagnosis models. Unpublished manuscript, University of Illinois
52. Roussos, L., DiBello, L., Stout, W. (2006a). Diagnostic skills-based testing using the Fusion-Model-Based Arpeggio system. In: Cognitively Diagnostic Assessment in Education: Theory and Practice. Cambridge University Press, Cambridge
53. Roussos, L.A., DiBello, L.V., Henson, R.A., Jang, E.E., Templin, J.L. (2006b). Skills diagnosis for education and psychology with IRT-based parametric latent class models. In: Embretson, S., Roberts, J. (Eds.), New Directions in Psychological Measurement with Model-based Approaches. American Psychological Association, Washington, DC
54. Samejima F. A cognitive diagnosis method using latent trait models: Competency space approach and its relationship with DiBello and Stout's unified cognitive-psychometric diagnosis model. In: Nichols P.D., Chipman S.F., and Brennan R.L. (Eds). Cognitively Diagnostic Assessment (1995), Erlbaum, Mahwah, NJ 391-410
55. Sinharay S. Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics 29 (2004) 461-488
56. Sinharay S. Assessing fit of unidimensional IRT models using a Bayesian approach. Journal of Educational Measurement 42 (2005) 375-394
57. Sinharay S. Model diagnostics for Bayesian networks. Journal of Educational and Behavioral Statistics 31 (2006) 1-33
58. Sympson, J.B. (1977). A model for testing with multidimensional items. In: Weiss, D.J. (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. University of Minnesota, Department of Psychology, Psychometric Methods Program, Minneapolis, pp. 82-88
59. Tatsuoka K.K. Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement 20 (1983) 345-354
60. Tatsuoka K.K. Caution indices based on item response theory. Psychometrika 49 (1984) 95-110
61. Tatsuoka K.K. A probabilistic model for diagnosing misconceptions in the pattern classification approach. Journal of Educational Statistics 12 (1985) 55-73
62. Tatsuoka K.K. Toward an integration of item-response theory and cognitive error diagnoses. In: Frederiksen N., Glaser R.L., Lesgold A.M., and Shafto M.G. (Eds). Diagnostic Monitoring of Skill and Knowledge Acquisition (1990), Erlbaum, Hillsdale, NJ
63. Tatsuoka K.K., and Tatsuoka M.M. Bug distribution and pattern classification. Psychometrika 52 (1987) 193-206
64. Tatsuoka K.K., and Tatsuoka M.M. Computerized cognitive diagnostic adaptive testing: Effect on remedial instruction as empirical validation. Journal of Educational Measurement 34 (1997) 3-20
65. Tatsuoka K.K., Linn R.L., and Yamamoto K. Differential item functioning resulting from use of different solution strategies. Journal of Educational Measurement 25 (1988) 301-319
66. Templin, J.L., Henson, R.A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods. In press
67. VanLehn K., Niu Z., Siler S., and Gertner A. Student modeling from conventional test data: A Bayesian approach without priors. In: Goetl B., et al. (Ed). Proceedings of the Intelligent Tutoring Systems Fourth International Conference ITS 98 (1998), Springer-Verlag, Berlin 434-443
68. von Davier, M. (2005). A general diagnostic model applied to language testing data. ETS Research Report: RR-05-16, Educational Testing Service, Princeton, NJ
69. von Davier, M., Yamamoto, K. (2004). A class of models for cognitive diagnosis. Paper presented at the ETS Spearmann Conference, The Inn at Penn, Philadelphia, PA, Invitational Conference, October
70. von Davier, M., DiBello, L., Yamamoto, K. (2006). A shortlist of models for cognitive diagnosis. In: Klieme, E., Leutner, D. (Eds.), Assessment of Competencies in Educational Contexts. Hogrefe & Huber Publishers, Bern. In press
71. Whitely S.E. Multicomponent latent trait models for ability tests. Psychometrika 45 (1980) 479-494 Name is now Embretson, S.E.
72. Wilson M. The ordered partition model: An extension of the partial credit model. Applied Psychological Measurement 16 (1992) 309-325
73. Wilson M., and Adams R.J. Rasch models for item bundles. Psychometrika 60 (1995) 181-198
74. Zhang, Y., Puhan, G., DiBello, L.V., Henson, R.A., Templin, J.L. (2006). Estimating reliability of student profile scores for Next-Generation TOEFL. ETS Research Report series, Educational Testing Service, Princeton, NJ. Submitted for publication