Construct validity and cognitive diagnostic assessment

Cognitive Diagnostic Assessment for Education: Theory and Applications

Volumn , Issue , 2007, Pages 119-145

  Yang, Xiangdong ^a   Embretson, Susan E ^b  

^a UNIVERSITY OF KANSAS   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84927066143     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511611186.005     Document Type: Chapter

References (49)

1. American Education Research Association (AERA), American Psychological Association, National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: AERA.
2. The American Heritage Dictionary of the English Language(4th ed.). (2000). Boston: Houghton Mifflin.
3. Anderson, J. R. (1990). Analysis of student performance with the LISP tutor. In N. Frederiksen, R. Glaser, A. Lesgold, & M. G. Shafto (Eds.), Diagnostic monitoring of skills and knowledge acquisition(pp. 27–50). Hillsdale, NJ: Erlbaum.
4. Britton, B. K., & Tidwell, P. (1995). Cognitive structure testing: A computer system for diagnosis of expert-novice differences. In P. Nichols., S. F. Chipman., & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 251–278). Hillsdale, NJ: Erlbaum.
5. Brown, J. S., & Burton, R. R. (1978). Diagnostic models for procedural bugs in basic mathematical skills. Cognitive Science, 2, 155–192.
6. Carpenter, P. A., Just, M. A., & Shell, P. (1990). What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychological Review, 97, 404–431.
7. Chi, M. T. H., Glaser, R., & Farr, M. (1988). The nature of expertise. Hillsdale, NJ: Erlbaum.
8. Collins, A. M., & Loftus, E. F. (1975). A spreading-activation theory of semantic processing. Psychological Review, 82, 407–428.
9. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
10. Das, J. P., Naglieri, J. A., & Kirby, J. R. (1994). Assessment of cognitive processes: The PASS theory of intelligence. Needham Heights, MA: Allyn & Bacon.
11. Dayton, C. M., & MaCready, G. B. (1976). A probabilistic model for a validation of behavioral hierarchies. Psychometrika, 41, 189–204.
12. De La Torre, J., & Douglas, J.A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333–353.
13. DiBello, L., Stout, W., & Roussos, L. (1995). Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In P. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 361–389). Hillsdale, NJ: Erlbaum.
14. Doignon, J. P., & Falmagne, J. C. (1999). Knowledge spaces. Berlin: Springer-Verlag.
15. Draney, K. L., Pirolli, P., & Wilson, M. (1995).A measurement model for complex cognitive skill. In P. Nichols, S. F. Chipman,&R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 103–126). Hillsdale, NJ: Erlbaum.
16. Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179–197.
17. Embretson, S. E. (1985). Test design: developments in psychology and psychometrics. Academic Press.
18. Embretson, S. E. (1994). Application of cognitive design systems to test development. In C. R. Reynolds (Eds.), Cognitive assessment: A multidisciplinary perspective(pp. 107–135). New York: Plenum Press.
19. Embretson, S. E. (1995). The role of working memory capacity and general control processes in intelligence. Intelligence, 20, 169–190.
20. Embretson, S. E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3, 300–326.
21. Embretson, S. E., & Waxman, M. (1989). Models for processing and individual differences in spatial folding. Unpublished manuscript.
22. Ericsson, K. A., & Charness, N. (1994). Expert performance, its structure and acquisition. American Psychologist, 49, 725–747.
23. Guttman, L. (1971). Measurement as structural theory. Psychometrika, 36, 329–347.
24. Hartz, S. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: blending theory with practicality. Unpublished doctoral thesis, University of Illinois at Urbana-Champaign.
25. Irvine, S. H., & Kyllonen, P. C. (2002). Item generation for test development. Mahwah, NJ: Erlbaum.
26. Johnson, P. J., Goldsmith, T. E., & Teague, K.W. (1995). Similarity, structure, and knowledge: A representational approach to assessment. In P. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 221–250). Hillsdale, NJ: Erlbaum.
27. Junker, B., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272.
28. Kane, M. T. (1982). A sampling model for validity. Applied Psychological Measurement, 6, 125–160.
29. Leighton, J. P., Gierl, M. J., & Hunka, S. (2004). The attribute hierarchy method for cognitive assessment: A variation on Tatsuoka’s rule-space approach. Journal of Educational Measurement, 41, 205–236.
30. Lohman, D. F., & Ippel, M. J. (1993). Cognitive diagnosis from statistically based assessment toward theory based assessment. In N. Frederiksen, R. J. Mislevy, & I. Bejar (Eds.), Test theory for a new generation of tests(pp. 41–71). Hillsdale, NJ: Erlbaum.
31. Maris, E. (1999). Estimating multiple classification latent class model. Psychometrika, 64, 187–212.
32. Marshall, S. P. (1990). Generating good items for diagnostic tests. In N. Frederiksen, R. Glaser, A. Lesgold, & M. G. Shafto (Eds.), Diagnostic monitoring of skill and knowledge acquisition(pp. 433–452). Hillsdale, NJ: Erlbaum.
33. Messick, S. (1989). Validity. In R. L. Linn (Eds.), Educational measurement(pp. 13–103). New York: Macmillan.
34. Messick, S. (1995).Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. The American Psychologist, 50, 741–749.
35. Mislevy, R. J. (1993). Foundations of a new test theory. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests(pp. 19–39). Hillsdale, NJ: Erlbaum.
36. Mislevy, R. J. (1996). Test theory reconceived. Journal of Educational Measurement, 33, 379–416.
37. Naveh-Benjamin, M., Lin, Y., & McKeachie, W. J. (1995). Inferring student’s cognitive structures and their development using the “fill-in-the-structure” (FITS) technique. In P. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 279–304). Hillsdale, NJ: Erlbaum.
38. Proctor, C. H. (1970). A probabilistic formulation and statistical analysis for Guttman scaling. Psychometrika, 35, 73–78.
39. Raven, J. C. (1965). Advanced progressive matrices, set I and II. London: H. K. Lewis. (Distributed in the United States by The Psychological Corporation, San Antonio, TX).
40. Rumelhart, D. E. (1980). Schemata: The building blocks of cognition. In R. J. Spiro, B. C. Bruce, & W. F. Brewer (Eds.), Theoretical issues in reading comprehension(pp. 33–57). Hillsdale NJ: Erlbaum.
41. Samejima, F. (1995). A cognitive diagnosis method using latent trait models: Competency space approach and its relationship with DiBello and Stout’s unified cognitive-psychometric diagnosis model. In P. Nichols, S. F. Chipman, & R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 391–410). Hillsdale, NJ: Erlbaum.
42. Sheehan, K. M. (1997a). A tree-based approach to proficiency scaling(ETS Research Report No. RR-97–2). Princeton, NJ: Educational Testing Service.
43. Sheehan, K. M. (1997b). A tree-based approach to proficiency scaling and diagnostic assessment(ETS Research Report No. RR-97–9). Princeton, NJ: Educational Testing Service.
44. Shute, V. J., & Psotka, J. (1996). Intelligent tutoring systems: Past, present, and future. In D. H. Jonassen (Ed.), Handbook of educational communications and technology(pp. 570-600). New York: Macmillan.
45. Snow, R. E., & Lohman, D. F. (1993). Cognitive psychology, new test design, and new test theory: An introduction. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests(pp. 1–17). Hillsdale, NJ: Erlbaum.
46. Tatsuoka, K. K. (1995). Architecture of knowledge structures and cognitive diagnosis: A statistical pattern recognition and classification approach. In P. Nichols, S. F. Chipman,&R. L. Brennan (Eds.), Cognitively diagnostic assessment(pp. 327–359). Hillsdale, NJ: Erlbaum.
47. Templin, J. (2004). Generalized linear mixed proficiency models for cognitive diagnosis. Unpublished doctoral dissertation, University of Illinois at Urbana−Champaign.
48. White, B., & Frederikson, J. (1987). Qualitative models and intelligent learning environment. In R. Lawler&M. Yazdani (Eds.), AI and education(pp. 281–305). Norwood, NJ: Ablex.
49. Yang, X. (2003). Inferring diagnostic information from abstract reasoning test items. Unpublished doctoral thesis, University of Kansas, Lawrence.