The fusion model skills diagnosis system

Cognitive Diagnostic Assessment for Education: Theory and Applications

Volumn , Issue , 2007, Pages 275-318

  Roussos, Louis A ^a   DiBello, Louis V ^b   Stout, William ^c   Hartz, Sarah M ^d   Henson, Robert A ^e   Templin, Jonathan L ^f  

^a University of Illinois at Chicago ^*

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^d UNIVERSITY OF IOWA   (United States)

^e UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

^f UNIVERSITY OF KANSAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84927113195     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511611186.010     Document Type: Chapter

References (52)

1. Birenbaum, M., Tatsuoka, C., & Yamada, Y. (2004). Diagnostic assessment in TIMMS-R: Between countries and within country comparisons of eighth graders’ mathematics performance. Studies in Educational Evaluation, 30, 151–173.
2. Carlin, B., Xia, H., Devine, O., Tollbert, P., & Mulholland, J. (1999). Spatiotemporal hierarchical models for analyzing Atlanta pediatric asthma ER visit rates. In C. Gatsonis, R. Kass, B. Carlin, A. Carriquiry, A. Gelman, I. Verdinelli, &M. West (Eds.), Case studies in Bayesian statistics(Vol. IV, pp. 303–320). New York: Springer-Verlag.
3. The Commission on Instructionally Supportive Assessment. (2001, October). Building tests to support instruction and accountability: A guide for policymakers. Retrieved November 29, 2006, from http://www.testaccountability.org/
4. Cowles, M. K., & Carlin, B. P. (1996). Markov chain Monte Carlo convergence diagnostics: A comparative review. Journal of the American Statistical Association, 91, 883–904.
5. Cronbach, L. J. (1975). Beyond the two disciplines of scientific psychology. American Psychologist, 30, 116–127.
6. de la Torre, J., & Douglas, J.A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333–353.
7. DiBello, L. V., Stout, W. F., & Hartz, S. M. (2000, June). Model parameterization and identifiability issues. Paper presented at the international meeting of the Psychometric Society, University of British Columbia, Vancouver.
8. DiBello, L. V., Stout, W. F., & Roussos, L. A. (1995). Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In P. D. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 361–389). Mahwah, NJ: Erlbaum.
9. DiBello, L. V., Stout, W. F., Roussos, L. A., Henson, R. A., Templin, J. L., & Fife, J. (2006). Skill profiles for groups of students at a given NAEP scale level: Development and demonstration. Unpublished project report, Educational Testing Service, Princeton, NJ.
10. Dorans, N. J. (1989). Two new approaches to assessing differential item functioning: Standardization and the Mantel-Haenszel method. Applied Measurement in Education, 2, 217–233.
11. Embretson, S. (1984).Ageneral latent trait model for response processes. Psychometrika, 49, 175–186.
12. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. R. (1995). Bayesian data analysis. London: Chapman & Hall.
13. Gelman, A., & Meng, X.-L. (1996). Model checking and model improvement. In W. R. Gilks, S. Richardson, & D. J. Spiegelhalter (Eds.), Markov chain Monte Carlo in practice. Boca Raton, FL: Chapman & Hall/CRC.
14. Hambleton, R. K., & Swaminathan, H. (1985). Item response theory. New York: Kluwer-Nijhoff.
15. Hartz, S. M. (2002).A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality. Unpublished doctoral dissertation, University of Illinois, Champaign.
16. Hartz, S. M., & Roussos, L. A. (in press). The fusion model for skills diagnosis: Blending theory with practice (ETS Research Report). Princeton, NJ: Educational Testing Service.
17. Henson, R. A., He, X., & Roussos, L. A. (in press). Cognitive diagnosis attribute level discrimination indices. Applied Psychological Measurement.
18. Henson, R. A., Roussos, L. A., & Templin, J. L. (2004). Cognitive diagnostic “fit” indices. Unpublished ETS Project Report, Princeton, NJ.
19. Henson, R. A., Roussos, L. A., & Templin, J. L. (2005). Fusion model “fit” indices. Unpublished ETS Project Report, Princeton, NJ.
20. Henson, R. A., Stout, W. F., & Templin, J. (2005). Using cognitive model-based sumscores to do skills diagnosis. Unpublished ETS External Team Project Report, Educational Testing Service, Princeton, NJ.
21. Henson, R. A., Templin, J. L., & Porch, F. (2004). Description of the underlying algorithm of the improved Arpeggio. Unpublished ETS External Team Project Report, Educational Testing Service, Princeton, NJ.
22. Henson, R. A., & Templin, J. L. (in press). Using model-based subscoring to do skills diagnosis. Journal of Educational Measurement.
23. Jang, E. E. (2005). A validity narrative: Effects of reading skills diagnosis on teaching and learning in the context of NG TOEFL. Unpublished doctoral dissertation, University of Illinois, Champaign.
24. Jang, E. E. (2006, April). Pedagogical implications of cognitive skills diagnostic assessment for teaching and learning. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
25. Jiang, H. (1996). Applications of computational statistics in cognitive diagnosis and IRT modeling. Unpublished doctoral dissertation, University of Illinois, Champaign.
26. Junker, B. W. (1999, November 30). Some statistical models and computational methods that may be useful for cognitively-relevant assessment. Prepared for the Committee on the Foundations of Assessment, National Research Council. Retrieved November 29, 2006, from http://www.stat.cmu.edu/∼brian/nrc/cfa/.
27. Junker, B. (2000). Some topics in nonparametric and parametric IRT, with some thoughts about the future. Unpublished manuscript, Carnegie Mellon University, Pittsburgh.
28. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
29. Maris, E. (1999). Estimating multiple classification latent class models. Psychometrika, 64, 187–212.
30. McKnight, C., Crosswhite, F., Dossey, J., Kifer, E., Swafford, J., Travers, K., & Cooney, T. (1987). The underachieving curriculum: Assessing U.S. school mathematics from an international perspective. Champaign, IL: Stripes.
31. National Council of Teachers of Mathematics. (1989). Assessment standards for school mathematics. Reston, VA: Author.
32. Patz, R. J., & Junker, B. (1999a). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146–178.
33. Patz, R. J., & Junker, B. (1999b). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342–366.
34. Pellegrino, J. W., & Chudowsky, N. (2003). The foundations of assessment. Measurement: Interdisciplinary Research and Perspectives, 1(2), 103–148.
35. Popham, W. J., Keller, T., Moulding, B., Pellegrino, J. W., & Sandifer, P. (2005). Instructionally supportive accountability tests in science: A viable assessment option? Measurement: Interdisciplinary Research and Perspectives, 3(3), 121–179.
36. Rasch, G. (1961). On general laws and the meaning of measurement in psychology. In J. Neyman (Ed.), Proceedings of the fourth Berkeley symposium on mathematical statistics and probability(Vol. 4). Berkeley: University of California Press.
37. DiBello, L. V., Roussos, L. A., & Stout, W. (2007). Review of cognitively diagnostic assessment and a summary of psychometric models. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics: Volume 26, psychometrics(pp. 979–1030). Amsterdam: Elsevier.
38. Roussos, L. A., DiBello, L.V., Henson, R. A., Jang, E. E., & Templin, J. L. (in press). Skills diagnosis for education and psychology with IRT-based parametric latent class models. In S. Embretson & J. Roberts (Eds.), New directions in psychological measurement with model-based approaches. Washington, DC: American Psychological Association.
39. Samejima, F. (1994, April). Cognitive diagnosis using latent trait models. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans.
40. Samejima, F. (1995). A cognitive diagnosis method using latent trait models: Competency space approach and its relationship with DiBello and Stout’s unified cognitive-psychometric diagnosis model. In P. D. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 391–410). Mahwah, NJ: Erlbaum.
41. Shavelson, R. J., Black, P. J., William, D., & Coffey, J. (in press). On linking formative and summative functions in the design of large-scale assessment systems. Educational Evaluation and Policy Analysis.
42. Shepard, L. A. (2000). The role of classroom assessment in teaching and learning(CSE Technical Report 517). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing, University of California, Los Angeles.
43. Sinharay, S. (2004). Experiences with Markov chain Monte Carlo convergence assessment in two psycho-metric examples. Journal of Educational and Behavioral Statistics, 29, 461–488.
44. Sinharay, S. (2005). Assessing of unidimensional IRT models using a Bayesian approach. Journal of Educational Measurement, 42, 375–394.
45. Sinharay, S. (2006). Model diagnostics for Bayesian networks. Journal of Educational and Behavioral Statistics, 31, 1–33.
46. Sinharay, S., & Johnson, M. S. (2003). Simulation studies applying posterior model checking for assessment of the common item response theory models. (ETS Research Report No. RR-03–28). Princeton, NJ: Educational Testing Service.
47. Snow, R. E., & Lohman, D. F. (1989). Implications of cognitive psychology for educational measurement. In R. L. Linn (Ed.), Educational measurement(3rd ed., pp. 263–331). New York: Macmillan.
48. Tatsuoka, K. K. (1990). Toward an integration of item-response theory and cognitive error diagnoses. In N. Frederiksen, R. L. Glaser, A. M. Lesgold, & M. G. Shafto (Eds.), Diagnostic monitoring of skill and knowledge acquisition. (pp 453–488). Hillsdale, NJ: Erlbaum.
49. Tatsuoka, K. K., Corter, J., & Guerrero, A. (2003). Manual of attribute-coding for general mathematics in TIMSS studies. New York: Columbia University, Teachers College.
50. Tatsuoka, K. K., Corter, J., & Tatsuoka, C. (2004). Patterns of diagnosed mathematical content and process skills in TIMMS-R across a sample of 20 countries. American Educational Research Journal, 41, 901–926.
51. Xin, T. (2004). Latent trait and latent class models for multi-rater, multi-attribute agreement (UMI No. 3129052). Dissertation Abstracts International, 65(04), 1337A.
52. Xin, T., Xu, Z., & Tatsuoka, K. K. (2004). Linkage between teacher quality, student achievement, and cognitive skills: A rule-space model. Studies in Educational Evaluation, 30, 205–223.