Skills diagnosis using IRT-based latent class models

Journal of Educational Measurement

Volumn 44, Issue 4, 2007, Pages 293-311

  Roussos, Louis A ^a   Templin, Jonathan L ^b,d   Henson, Robert A ^c  

^a Measured Progress   (United States)

^b UNIVERSITY OF KANSAS   (United States)

^c UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

^d UNIVERSITY OF GEORGIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 36348974087     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2007.00040.x     Document Type: Article

References (50)

1. American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders (4th edition, text revision). Washington, DC : American Psychiatric Press, Inc.
2. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of the EM algorithm. Psychometrika, 46, 443 449.
3. Bolt, D., & Li, Y. (2003). A low-dimensional IRT approach to linking calibrations based on the Fusion Model. Unpublished ETS Project Report, Princeton, NJ.
4. de la Torre, J., & Douglas, J. A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333 353.
5. DiBello, L. V., Roussos, L. A., & Stout, W. F. (2007). Review of cognitively diagnostic assessment and a summary of psychometric models. In C. R. Rao & S. Sinharay (Eds Handbook of Statistics, Volume 26, Psychometrics (pp. 979 1030). Amsterdam, The Netherlands : Elsevier.
6. DiBello, L. V., Stout, W. F., & Roussos, L. A. (1995). Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In P. D. Nichols, S. F. Chipman, & R. L. Brennan (Eds Cognitively diagnostic assessment (pp. 361 389). Mahwah, NJ : Erlbaum.
7. Eignor, D., Taylor, C., Kirsch, I., & Jamieson, J. (1998). Development of a scale for assessing the level of computer familiarity of TOEFL examinees. TOEFL Research Report No. 60. Princeton, NJ : Educational Testing Service.
8. Feasel, K., Henson, R. A., & Jones, L. (2004). Analysis of the gambling research instrument (GRI). Unpublished manuscript.
9. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. R. (1995). Bayesian data analysis. London : Chapman & Hall.
10. Gitomer, D. H., & Yamamoto, K. (1991). Performance modeling that integrates latent trait and class theory. Journal of Educational Measurement, 28, 173 189.
11. Haertel, E. H. (1984). An application of latent class models to assessment data. Applied Psychological Measurement, 8, 333 346.
12. Haertel, E. H. (1989). Using restricted latent class models to map skill structure of achievement items. Journal of Educational Measurement, 26, 301 321.
13. Haertel, E. H. (1990). Continuous and discrete latent structure models of item response data. Psychometrika, 55, 477 494.
14. Hartz, S. M. (2002). A Bayesian framework for the Unified Model for assessing cognitive abilities: Blending theory with practicality. Unpublished doctoral dissertation. Champaign, IL : University of Illinois.
15. Hartz, S. M., & Roussos, L. A. (in press). The Fusion Model for skills diagnosis: Blending theory with practice. ETS Research Report. Princeton, NJ : Educational Testing Service.
16. Henson, R. (2004). Test discrimination and test construction for cognitive diagnosis. Unpublished doctoral dissertation. Champaign, IL : University of Illinois.
17. Henson, R. A., & Douglas, J. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29, 262 277.
18. Henson, R. A., Roussos, L. A., Douglas, J. A., & He, X. (in press). Cognitive diagnosis attribute level discrimination indices. Applied Psychological Measurement.
19. Henson, R. A., Roussos, L., & Templin, J. L. (2004). Cognitive diagnostic "fit" indices. Unpublished ETS Project Report, Princeton, NJ.
20. Henson, R. A., Roussos, L., & Templin, J. L. (2005). Fusion model "fit" indices. Unpublished ETS Project Report, Princeton, NJ.
21. Henson, R. A., & Templin, J. L. (2004a). Creating a proficiency scale with models for cognitive diagnosis. Unpublished ETS Project Report, Princeton, NJ.
22. Henson, R. A., & Templin, J. L. (2004b). Modifications of the Arpeggio algorithm to permit analysis of NAEP. Unpublished ETS Project Report, Princeton, NJ.
23. Henson, R. A., Templin, J. L., & Porch, F. (2004). Description of the underlying algorithm of the improved Arpeggio. Unpublished ETS Project report, Princeton, NJ.
24. Jang, E. E. (2005). A validity narrative: Effects of reading skills diagnosis on teaching and learning in the context of NG TOEFL. Unpublished doctoral dissertation. Champaign, IL : University of Illinois.
25. Jang, E. E. (2006). Pedagogical implications of cognitive skills diagnostic assessment for teaching and learning. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, California.
26. Junker, B., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258 272.
27. Lesieur, H. R., & Blume, S. B. (1987). The South Oaks Gambling Screen(SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184 1188.
28. Maris, E. (1999). Estimating multiple classification latent class models. Psychometrika, 64, 187 212.
29. Reckase, M. D., & McKinley, R. L. (1991). The discriminating power of items that measure more than one dimension. Applied Psychological Measurement, 15, 361 373.
30. Roussos, L. A., DiBello, L. V., Henson, R. A., Jang, E. E., & Templin, J. L. (in press). Skills diagnosis for education and psychology with IRT-based parametric latent class models. In S. Embretson & J. Roberts (Eds New directions in psychological measurement with model-based approaches. Washington, DC : American Psychological Association.
31. Roussos, L. A., DiBello, L. V., Stout, W. F., Hartz, S. M., Henson, R. A., & Templin, J. L. (2007). The fusion model skills diagnosis system. In J. P. Leighton & M. J. Gierl (Eds Cognitive diagnostic assessment for education: Theory and applications (pp. 275 318). Cambridge, UK : Cambridge University Press.
32. Roussos, L. A., Hartz, S. M., & Stout, W. F. (2003). Real data applications of the Fusion Model system using an improved stepwise algorithm. Unpublished ETS Project Report, Princeton, NJ.
33. Roussos, L. A., Henson, R. A., & Jang, E. E. (2005). Simulation study evaluation of the Fusion Model system stepwise algorithm. ETS Project Report, Princeton, NJ.
34. Roussos, L. A., & Templin, J. L. (2004). Effect of skill heterogeneity on Fusion Model equating: A comparison of two methods. Unpublished ETS Project Report, Princeton, NJ.
35. Roussos, L. A., & Templin, J. L. (2005). Theoretically grounded linking and equating for mastery/non-mastery skills diagnosis models. Unpublished ETS Project Report, Princeton, NJ.
36. Roussos, L. A., & Xu, X. (2003). Equating with the Fusion Model using item parameter invariance. Unpublished ETS Project Report, Princeton, NJ.
37. Sinharay, S. (2004). Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics, 29, 461 488.
38. Sinharay, S. (2006). Model diagnostics for Bayesian networks. Journal of Educational and Behavioral Statistics, 31, 1 33.
39. Stanovich, K. E. (1980). Toward an interactive-compensatory model of individual differences in the development of reading fluency. Reading Research Quarterly, 16, 32 71.
40. Tatsuoka, C. (2002). Data analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society, Series C, 337 350.
41. Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345 354.
42. Tatsuoka, K. K. (1990). Toward an integration of item-response theory and cognitive error diagnoses. In N. Frederiksen, R. L. Glaser, A. M. Lesgold, & M. G. Shafto (Eds Diagnostic monitoring of skill and knowledge acquisition. Hillsdale, NJ : Erlbaum.
43. Templin, J. L. (2006). Generalized linear mixed proficiency models for cognitive diagnosis. Manuscript under review.
44. Templin, J. L., & Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287 305.
45. Templin, J. L., Henson, R. A., & Douglas, J. (2006). General theory and estimation of cognitive diagnosis models: Using Mplus to derive model estimates. Manuscript under review.
46. Templin, J., Henson, R., Templin, S., & Roussos, L. (in press). Robustness of hierarchical modeling of skill association in cognitive diagnosis models. Applied Psychological Measurement.
47. von Davier, M. (2005). A general diagnostic model applied to language testing data. ETS Research Report: RR-05-16. Princeton, NJ : Educational Testing Service.
48. von Davier, M., DiBello, L., & Yamamoto, K. (in press). A shortlist of models for cognitive diagnosis. In E. Klieme & D. Leutner (Eds Assessment of competencies in educational contexts. Bern, Switzerland : Hogrefe & Huber Publishers.
49. von Davier, M., & Yamamoto, K. (2004). A class of models for cognitive diagnosis. Paper presented at the ETS Spearmann Conference. The Inn at Penn, Philadelphia, PA. Invitational Conference.
50. Zhang, Y., Puhan, G., DiBello, L. V., Henson, R. A., & Templin, J. L. (2006). Estimating reliability of student profile scores for Next-Generation TOEFL. Submitted for publication in the ETS Research Report series. Princeton, NJ : Educational Testing Service.