An Illustration of Diagnostic Classification Modeling in Student Learning Outcomes Assessment

International Journal of Testing

Volumn 14, Issue 1, 2014, Pages 49-72

  Jurich, Daniel P ^a   Bradshaw, Laine P ^b  

^a JAMES MADISON UNIVERSITY   (United States)

^b UNIVERSITY OF GEORGIA   (United States)

Author keywords

diagnostic classification models; log linear cognitive diagnosis model; student learning outcomes assessment

Indexed keywords

EID: 84890345113     PISSN: 15305058     EISSN: 15327574     Source Type: Journal    
DOI: 10.1080/15305058.2013.835728     Document Type: Article

References (30)

1. Adam, S. Learning outcomes current development in Europe: Update on issues and the applications of learning outcomes associated with the Bologna process, Paper presented at Bologna Seminar at Heriot-Watt University, Edinburgh, Scotland
2. Akaike, H. 1987. Factor analysis and AIC. Psychometrika, 52: 317 - 332.
3. Barry, C. L., Horst, S. J., Finney, S. J., Brown, A. R. and Kopp, J. P. 2010. Do examinees have similar test-taking effort? A high-stakes question for low-stakes testing. International Journal of Testing, 10: 342 - 363.
4. Bozard, J. L. 2010. Invariance testing in diagnostic classification models. Master's thesis, The University of Georgia. Retrieved from http://ugakr-maint.libs.uga.edu/bitstream/handle/123456789/8156/bozard_jennifer_l_201005_ma.pdf?sequence=1
5. Bradshaw, L. and Cohen, A. Accuracy of multidimensional item response model parameters estimated under small sample sizes, Paper presented at the annual American Educational Research Association conference, Denver, CO.
6. Bradshaw, L., Izsák, A., Templin, J. and Jacobson, E. Diagnosing teachers' understandings of rational number: Building a multidimensional test within the diagnostic classification framework, Educational Measurement Issues and Practices
7. Common Core State Standards Initiative. 2010. The common core state standards for mathematics Washington, DC
8. Fu, J. and Li, Y. An integrated review of cognitively diagnostic psychometric models,. Paper presented at the annual meeting of the National Council on Measurement in Education (NCME), Chicago, IL.
9. Haertel, E. H. 1989. Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26: 333 - 352.
10. Halonen, J., Harris, C. M., Pastor, D. A., Abrahamson, C. E. and Huffman, C. J. 2005. " Assessing general education outcomes in introductory psychology ". In Best practices in teaching introduction to psychology, Edited by: Dunn, D. S. and Chew, S. 195 - 210. Mahwah, NJ: Lawrence Erlbaum Associates.
11. Hambleton, R. K. and Pitoniak, M. J. 2006. " Setting performance standards ". In Educational measurement, 4th ed., Edited by: Brennan, R. L. 433 - 470. Washington, DC: American Council on Education.
12. Henson, R. and Templin, J. 2005. Hierarchical log-linear modeling of the joint skill distribution. Unpublished manuscript
13. Henson, R., Templin, J. and Willse, J. 2009. Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74: 191 - 210.
14. Junker, B. W. and Sijtsma, K. 2001. Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25: 258 - 272.
15. Lee, Y. S., Park, Y. S. and Taylan, D. 2011. A cognitive diagnostic modeling of attribute mastery in Massachusetts, Minnesota, and the U.S. national sample using the TIMSS 2007. International Journal of Testing, 11: 144 - 177.
16. Leighton, J. P. and Gierl, M. J. 2007. Cognitive diagnostic assessment for education: Theory and practices, Cambridge, UK: Cambridge University Press.
17. Macready, G. B. and Dayton, C. M. 1977. The use of probabilistic models in the assessment of mastery. Journal of Educational Statistics, 2: 99 - 120.
18. Muthén, L. K. and Muthén, B. O. 1998-2010. Mplus user's guide (6th ed.), Los Angeles, CA: Muthén & Muthén.
19. Roberts, M. R. and Gierl, M. J. 2010. Developing score reports for cognitive diagnostic assessment. Educational Measurement: Issues and Practice, 29: 25 - 38.
20. Rupp, A. A. 2007. The answer is in the question: A guide for investigating the theoretical potentials and practical limitations of cognitive psychometric models. International Journal of Testing, 7: 95 - 125.
21. Rupp, A. A. and Templin, J. 2008. Unique characteristics of cognitive diagnosis models: A comprehensive review of the current state-of-the-art. Measurement: Interdisciplinary Research and Perspectives, 6: 219 - 262.
22. Rupp, A. A., Templin, J. and Henson, R. 2010. Diagnostic measurement: Theory, methods, and applications, New York, NY: Guilford.
23. Schwarz, G. 1978. Estimating the dimension of a model. The Annals of Statistics, 6: 461 - 464.
24. Sclove, S. L. 1987. Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52: 333 - 343.
25. Tate, R. L. 2004. Implications of multidimensionality for total score and subscore performance. Applied Measurement in Education, 17: 89 - 112.
26. Templin, J. and Bradshaw, L. 2013. The comparative reliability of diagnostic model examinee estimates. Journal of Classification, 10 (2): 251 - 275.
27. Templin, J. and Bradshaw, L. in press. Hierarchical diagnostic classification models: A family of models for estimating and testing attribute hierarchies. Psychometrika,
28. Templin, J. and Henson, R. 2006. Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11: 287 - 305.
29. Templin, J. and Hoffman, L. 2013. Obtaining diagnostic classification model estimates using Mplus. Educational Measurement: Issues and Practice, 32 (2): 37 - 50.
30. Thelk, A. D., Sundre, D. L., Horst, S. J. and Finney, S. J. 2009. Motivation matters: Using the Student Opinion Scale to make valid inferences about student performance. The Journal of General Education, 58: 129 - 151.