Computer adaptive-attribute testing a new approach to cognitive diagnostic assessment

Journal of Psychology

Volumn 216, Issue 1, 2008, Pages 29-39

  Gierl, Mark J ^a,b   Zhou, Jiawen ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b Department of Educational Psychology ^*

Author keywords

Cognition and assessment; Cognitive diagnostic assessment; Computer adaptive testing

Indexed keywords

EID: 44349088190     PISSN: 00443409     EISSN: None     Source Type: Journal    
DOI: 10.1027/0044-3409.216.1.29     Document Type: Article

References (29)

1. Anderson, J.R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51, 355-365.
2. Bejar, I.I. (1996). Generative response modeling: Leveraging the computer as a test delivery medium (ETS Research Report 96-13). Princeton, NJ: Educational Testing Service.
3. Bejar, I.I., Lawless, R., Morley, M.E., Wagner, M.E., Bennett, R.E., & Revuelta, J. (2003). A feasibility study of on-the-fly item generation in adaptive testing. Journal of Technology, Learning, and Assessment, (2)3. Retrieved on July 8, 2006, from http://www.jtla.org
4. Case, S.M., & Swanson, D.B. (2002). Constructing written test questions for the basic and clinical sciences (3rd ed., revised). Philadelphia, PA: National Board of Medical Examiners.
5. Dawson, M.R.W. (1998). Understanding cognitive science. Malden, MA: Blackwell.
6. Dawson, M.R.W. (2004). Minds and machines: Connectionism and psychological modeling. Maiden, MA: Blackwell.
7. Fodor, J.A. (1983). The modularity of mind. Cambridge, MA: MIT Press.
8. Gierl, M.J. (2007). Making diagnostic inferences about cognitive attributes using the rule space model and attribute hierarchy method. Journal of Educational Measurement, 44, 325-340.
9. Gierl, M.J., Cui, Y, & Hunka, S. (2007, April). Using connectionist models to evaluate examinees' response patterns on tests. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
10. Gierl, M.J., Leighton, J.P., & Hunka, S. (2007). Using the attribute hierarchy method to make diagnostic inferences about examinees' cognitive skills. In J.P. Leighton, & M.J. Gierl (Eds.), Cognitive diagnostic assessment for education: Theory and applications (pp. 242-274). Cambridge, UK: Cambridge University Press.
11. Gierl, M.J., Leighton, J.P., Wang, C, Zhou, J., Gokiert, R., & Tan, A. (2008). Developing and validating cognitive models of algebra performance on the SAT® (Research report). New York: The College Board.
12. Gierl, M.J., Wang, C, & Zhou, J. (2008a). Using the attribute hierarchy method to make diagnostic inferences about examinees' cognitive skills in algebra on the SAT®. Journal of Technology, Learning, and Assessment, 6(6).
13. Gierl, M.J., Wang, C., & Zhou, J. (2008b). Using the attribute hierarchy method to develop cognitive models and evaluate problem-solving skills in algebra on the SAT® (Research Report). New York: The College Board.
14. Haladyna, T, & Shindoll, R. (1989). Items shells: A method for writing effective multiple-choice test items. Evaluation and the Health Professions, 12, 97-106.
15. LaDuca, A., Staples, W.I., Templeton, B., & Holzman, G.B. (1986). Item modeling procedure for constructing content-equivalent multiple-choice questions. Medical Education, 20, 53-56.
16. Leighton, J.R, & Gierl, M.J. (Eds.) (2007a). Cognitive diagnostic assessment for education: Theory and practices. Cambridge, UK: Cambridge University Press.
17. Leighton, J.R, & Gierl, M.J. (2007b). Defining and evaluating models of cognition used in educational measurement to make inferences about examinees' thinking processes. Educational Measurement: Issues and Practice, 26, 3-16.
18. Leighton, J.P., Gierl, M.J., & Hunka, S. (2004). The attribute hierarchy model: An approach for integrating cognitive theory with assessment practice. Journal of Educational Measurement, 41, 205-236.
19. Luecht, R.M. (2006a, May). Engineering the test: From principled item design to automated test assembly. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, Dallas, TX.
20. Luecht, R.M. (2006b, September). Assessment engineering: An emerging discipline. Paper presented in the Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, Canada.
21. Luecht, R.M., Gierl, M.J., Tan, X., & Huff, K. (2006, April). Scalability and the development of useful diagnostic scales. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
22. McClelland, J.L. (1998). Connectionist models and Bayesian inference. In M. Oaksford, & N. Chater (Eds.), Rational models of cognition (pp. 21-53). Oxford, UK: Oxford University Press.
23. Mislevy, R.J. (2006). Cognitive psychology and educational assessment. In R.L. Brennan (Ed.), Educational measurement (4th ed., pp. 257-306). Washington, DC: American Council on Education.
24. Snow, R.E., & Lohman, D.F. (1989). Implications of cognitive psychology for educational measurement, in R.L. Linn (Ed.), Educational measurement (3rd ed., pp. 263-331). New York: American Council on Education, Macmillian.
25. Tatsuoka, K.K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354.
26. Tatsuoka, K.K. (1995). Architecture of knowledge structures and cognitive diagnosis: A statistical pattern recognition and classification approach. In P.D. Nichols, S.F. Chipman, & R.L. Brennan (Eds.), Cognitively diagnostic assessment (pp. 327-359). Hillsdale, NJ: Erlbaum.
27. Yang, X, & Embretson, S.E. (2007). Construct validity and cognitive diagnostic assessment. In J.P. Leighton, & M.J. Gierl (Eds.), Cognitive diagnostic assessmentfor education: Theory and practices (pp. 119-145). Cambridge, UK: Cambridge University Press.
28. van der Linden, W.J., & Glas, C.A.W. (2000). Computer adaptive testing: Theory and practice. Dordrecht, The Netherlands: Kluwer.
29. Zhou, J., Gierl, M.J., & Cui, Y. (2007, June). Computerized attribute-adaptive testing: A new computerized adaptive testing approach incorporating cognitive psychology. Paper presented at Graduate Management Admission Council (GMAC®) Conference on Computerized Adaptive Testing, Minneapolis, MN.