Cognitive process validation of an online problem solving assessment

Computers in Human Behavior

Volumn 18, Issue 6, 2002, Pages 669-684

  Chung, Gregory K W K ^a   De Vries, Linda F ^a   Cheak, Alicia M ^a   Stevens, Ronald H ^b   Bewley, William L ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Cognitive processes; Computer based assessment; IMMEX; Problem solving

Indexed keywords

DATA REDUCTION; INTERACTIVE COMPUTER SYSTEMS; KNOWLEDGE REPRESENTATION; LEARNING SYSTEMS; MULTIMEDIA SYSTEMS; ONLINE SYSTEMS; PROBLEM SOLVING; TEACHING; USER INTERFACES;

COGNITIVE PROCESSES; COMPUTER-BASED ASSESSMENTS;

COGNITIVE SYSTEMS;

EID: 0036836505     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0747-5632(02)00023-7     Document Type: Article

References (25)

1. American Educational Research Association, American Psychological Association, and National Council for Measurement in Education Standards for educational and psychological testing. 1999;American Educational Research Association, Washington, DC.
2. Baker E.L. Model-based performance assessment. Theory Into Practice. 36:1997;247-254. (Autumn).
3. Baker E.L., Aschbacher P.R., Niemi D., Sato E. CRESST performance assessment models: assessing content area explanations. 1992;University of California, National Center for Research on Evaluation Standards, and Student Testing, Los Angeles.
4. Baker E.L., Mayer R.E. Computer-based assessment of problem solving. Computers in Human Behavior. 15:1999;269-282.
5. Bennett R.E. Using new technology to improve assessment. Educational Measurement: Issues and Practice. 18(3):1999;5-12.
6. Bennett R.E., Bejar I.I. Validity and automated scoring: it's not only the scoring. Educational Measurement: Issues and Practice. 17(4):1998;9-17.
7. Bennett R.E., Morley M., Quardt E., Rock D.A. Graphical modeling: a new response type for measuring the qualitative component of mathematical reasoning. Applied Measurement in Education. 13:2000;303-322.
8. Burstein, J. (2001, April). Automated essay evaluation with natural language processing. Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, WA.
9. Chung, G. K.W.K., & Baker, E.L. (in press). Issues in the reliability and validity of automated scoring of constructed responses. In M. D. Shermis & J. E. Burstein (Eds.), Automated essay grading: a cross-disciplinary approach. Mahwah, NJ: Erlbaum.
10. Clauser B.E. Recurrent issues and recent advances in scoring performance assessments. Applied Psychological Measurement. 24:2000;310-324.
11. Clauser B.E., Margolis M.J., Clyman S.G., Ross L.P. Development of automated scoring algorithms for complex performance assessments: a comparison of two approaches. Journal of Educational Measurement. 34:1997;141-161.
12. Ekstrom R.B., French J.W., Harman H.H., Dermen D. Kit of factor-referenced cognitive tests. 1976;Educational Testing Service, Princeton, NJ.
13. Ericsson K.A., Simon H.A. Protocol analysis: verbal reports as data. 1993;MIT, Cambridge, MA.
14. Herl H.E., O'Neil H.F. Jr., Chung G.K.W.K., Schacter J. Reliability and validity of a computer-based knowledge mapping system to measure content understanding. Computers in Human Behavior. 15:1999;315-334.
15. Huff K.L., Sireci S.G. Validity issues in computer-based scoring. Educational Measurement: Issues and Practice. 20(3):2001;16-25.
16. Kane M., Crooks T., Cohen A. Validating measures of performance. Educational Measurement: Issues and Practice. 18(2):1999;5-17.
17. Klein D.C.D., Yarnall L., Glaubke C. Using technology to assess students' Web expertise (CSE Tech. Rep. No. 544). 2001;University of California, National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Los Angeles.
18. Lawson A.E. Classroom test of scientific reasoning: revised paper-pencil edition. 1987;Arizona State University, Tempe, AZ.
19. National Research Council Knowing what students know: the science and design of educational assessment. Committee on the Foundations of Assessment. Pellegrino J., Chudowsky N., Glaser R. Board on Testing and Assessment, Center for Education, Division of Behavioral and Social Sciences and Education. 2001;National Academy Press, Washington, DC.
20. O'Neil H.F. Jr. Perspectives on computer-based performance assessment of problem solving. Computers in Human Behavior. 15:1999;255-268.
21. O'Neil H.F. Jr., Wang S-L., Chung G.K.W.K., Herl H.E. Assessment of teamwork skills using computer-based teamwork simulations. O'Neil H.F. Jr., Andrews D.H. Aircrew training and assessment. 2000;245-276 Erlbaum, Mahwah, NJ.
22. Palacio-Cayetano J., Allen R.D., Stevens R. Computer-assisted evaluation - the next generation. American Biology Teacher. 61:1999;514-522.
23. Schacter J., Herl H.E., Chung G.K.W.K., Dennis R.A., O'Neil H.F. Jr. Computer-based performance assessments: a solution to the narrow measurement and reporting of problem-solving. Computers in Human Behavior. 15:1999;403-418.
24. Stevens R., Ikeda J., Casillas A., Palacio-Cayetano J., Clyman S. Artificial neural network-based performance assessments. Computers in Human Behavior. 15:1999;295-313.
25. Vendlinski T., Stevens R. The use of artificial neural nets (ANN) to help evaluate student problem solving strategies. Fishman B., O'Connor-Divelbiss S. Fourth international conference of the learning sciences. 2000;108-114 Erlbaum, Mahwah, NJ.