Issues in the computer-based assessment of collaborative problem solving

Assessment in Education: Principles, Policy and Practice

Volumn 10, Issue 3, 2003, Pages 361-373

  O'Neil, Harold F ^a   Chuang, San Hui ^a   Chung, Gregory K W K ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85068291101     PISSN: 0969594X     EISSN: 1465329X     Source Type: Journal    
DOI: 10.1080/0969594032000148190     Document Type: Article

References (43)

1. Bakeman, R., and Gottman, J. M., 1997. Observing Interaction: an introduction to sequential analysis, 2nd edn, New York: Cambridge University Press.
2. Bakeman, R., Adamson, L. B., and Strisik, P., 1995. “ Lags and logs: statistical approaches to interaction (SPSS version) ”. In The Analysis of Change, Edited by: Gottman, J. M., Mahwah: NJ, Erlbaum.
3. Baker, E. L., 1997. Model-based performance assessment. Theory Into Practice, 36 (4): 247–254.
4. Baker, E. L., and Mayer, R. E., 1999. Computer-based assessment of problem solving. Computers in Human Behavior, 15: 269–282.
5. Baker, E. L., and O'Neil, H. F., Jr. 2002. Measuring problem solving in computer environments: current and future states. Computers in Human Behavior, 18 (6): 609–622.
6. Bandura, A., 1997. Self-efficacy: the exercise of control, New York: Freeman.
7. Becker, H.J., (1999) Internet Use by Teachers: conditions of professional use and teacher-directed student use. Teaching, learning, and computing: 1998 National survey: Report #1 [Online] (Irvine, CA, University of California, Irvine, Center for Research on Information Technology and Organizations, and University of Minnesota). Retrieved [22/1/03] from http://www.crito.uci.edu/TLC/FINDINGS/internet-use/startpage.htm
8. Bowers, C. A., Jentsch, F., Salas, E., and Braun, C. C., 1998. Analyzing communication sequences for team training needs assessment. Human Factors, 40 (4): 672–679.
9. Chen, A., Muntz, R. R., Yuen, S., Locher, I., Park, S. I., and Srivastava, M. B., 2002. A support infrastructure for the Smart Kindergarten. Pervasive Computing, 1 (2): 49–57.
10. Chung, G. K. W. K., & Baker, E. L., (2002) Examining the Feasibility of Measuring Problem Solving Processes Using a Click-through Interface (Draft deliverable to the Center for Digital Innovation, UCLA) (Los Angeles, CA, UCLA National Center for Research on Evaluation, Standards, and Student Testing).
11. Chung, G. K. W. K., O'Neil, H. F., Jr and Herl, H. E., 1999. The use of computer-based collaborative knowledge mapping to measure team processes and team outcomes. Computers in Human Behavior, 15 (3/4): 463–494.
12. Chung, G. K. W. K., Delacruz, G. C, de Vries, L. F., Phan, C. H., Srivastava, M. B., & Alarcon, R., (2002a) Fusing wireless sensor data to measure small-group collaborative processes in real-time Presentation at the annual conference of the Center for Research on Evaluation, Standards, and Student Testing (CRESST), University of California, Los Angeles, September.
13. Chung, G. K. W. K., de Vries, L. F., Cheak, A. M., Stevens, R. H., and Bewley, W. L., 2002b. Cognitive process validation of an online problem solving assessment. Computers in Human Behavior, 18 (6): 669–684.
14. Cohen, B. P., & Arechevala-Vargas (1987) Interdependence, Interaction, and Productivity (Working Paper No. 87–3) (Stanford, CA, Stanford University Center for Sociology Research).
15. Gottman, J. M., and Roy, A. K., 1990. Sequential Analyses: a guide for behavioral researchers, New York: Cambridge University Press.
16. Grigorenko, E. L., and Sternberg, R. J., 1998. Dynamic testing. Psychological Bulletin, 124 (1): 75–111.
17. Herl, H. E., O'Neil, H. F., Jr, Chung, G. K. W. K., and Schacter, J., 1999. Reliability and validity of a computer-based knowledge mapping system to measure content understanding. Computers in Human Behavior, 15 (3/4): 315–333.
18. Hirokawa, R. Y., 1980. A comparative analysis of communication patterns within effective and ineffective decision-making groups. Communication Monographs, 47 (4): 312–321.
19. Hsieh, I.-L., and O'Neil, H. F., Jr. 2002. Types of feedback in a computer-based collaborative problem solving group task. Computers in Human Behavior, 18 (6): 699–715.
20. Hurwitz, C. L., & Abegg, G., (1999) A teacher's perspective on technology in the classroom: computer visualization, concept maps and learning logs, Journal of Education, 181 (2), pp. 123–143.
21. ‘Internet exceeds 2 billion pages’ (2000) Retrieved [23/1/03], from http://www.cyveillance.com/us/newsroom/pressr/000710.asp
22. Jensen, F. V., 2001. Bayesian Networks and Decision Graphs, New York: Springer-Verlag.
23. Jonassen, D. H., 1997. Instructional design models for well-structured and ill-structured problem solving learning. Educational Technology Research and Development, 45 (1): 65–94.
24. Lazonder, A. W., 2000. Exploring novice users’ training needs in searching information on the WWW. Journal of Computer Assisted Learning, 16 (4): 326–335.
25. Mayer, R. E., and Wittrock, M. C., 1996. “ Problem solving transfer ”. In Handbook of Educational Psychology, Edited by: Berliner, D. C., and Calfee, R. C., New York: Macmillan Library Reference.
26. Morgan, B. B., Salas, E., and Glickman, A. S., 1993. An analysis of team evolution and maturation. Journal of General Psychology, 120 (3): 277–291.
27. National Center for Education Statistics (2000) Internet Access in US Public Schools and Classrooms: 1994–1999 (NCES # 2000086) (Washington DC, US Department of Education).
28. O'Neil, H. F., Jr. 1999. Perspectives on computer-based performance assessment of problem solving. Computers in Human Behavior, 15 (3/4): 225–268.
29. O'Neil, H. F., Jr and Abedi, J., 1996. Reliability and validity of a state metacognitive inventory: potential for alternative assessment. Journal of Educational Research, 89 (4): 234–245.
30. O'Neil, H. F., Jr, Allred, K., & Baker, E. L., (1997a) Review of workforce readiness theoretical frameworks, in: H. F., O'Neil, Jr Workforce Readiness: competencies and assessment (Mahwah, NJ, Erlbaum).
31. O'Neil, H. F., Jr, Chung, G. K. W. K., & Brown, R., (1997b) Use of networked simulations as a context to measure team competencies, in: H. F., O'Neil, Jr Workforce Readiness: competencies and assessment (Mahwah, NJ, Erlbaum).
32. O'Neil, H. F., Jr & Herl, H. E., (1998) Reliability and validity of a trait measure of self-regulation. Paper presented at the annual meeting of the American Educational Research Association, San Diego, California, April.
33. Ruiz-Primo, M. A., Schultz, S. E., & Shavelson, R. J., (1997) Concept Map-based Assessment in Science: two exploratory studies (CSE Tech. Rep. No. 436) (Los Angeles, CA, UCLA Center for Research on Evaluation, Standards, and Student Testing).
34. Salas, E., Dickinson, T. L., Converse, S. A., and Tannenbaum, S. I., 1992. “ Toward an understanding of team performance and training ”. In Teams: their training and performance, Edited by: Swezey, R. W., and Salas, E., Norwood, NJ: Ablex.
35. Schacter, J., Herl, H. E., Chung, G. K. W. K., Dennis, R. A., and O'Neil, H. F., Jr. 1999. Computer-based performance assessments: a solution to the narrow measurement and reporting of problem solving. Computers in Human Behavior, 15 (3/4): 403–418.
36. Schau, C., Mattern, N., Zeilik, M., Teague, K., and Weber, R., 2001. Select-and-fill-in concept map scores as a measure of students’ connected understanding of science. Educational and Psychological Measurement, 61 (1): 136–158.
37. Sinclair, K. E., (1997) Workforce competencies of college graduates, in: H. F., O'Neil, Jr Workforce Readiness: competencies and assessment (Mahwah, NJ, Erlbaum).
38. Smith, M. S., & Broom, M., (2003) The landscape and future of the use of technology in K-12 education, in: H. F., O'Neil, Jr & R. S., Perez Technology Applications in Education: a learning view (Mahwah, NJ, Erlbaum).
39. Srtvastava, M., Muntz, R., & Potkonjak, M., (2001) Smart Kindergarten: sensor-based wireless networks for smart developmental problem solving environments, Proceedings of the ACM SIGMOBILE 7th Annual International Conference on Mobile Computing and Networking (New York, AMC Press).
40. Underwood, J., and Underwood, G., 1999. “ Task effects on co-operative and collaborative learning with computers ”. In Learning with Computers, Edited by: Littleton, K., and Light, P., New York: Routledge.
41. Webb, N. M., Nemer, K. M., and Chizhik, A. W., 1998. Equity issues in collaborative group assessment: group composition and performance. American Educational Research Journal, 35 (4): 607–651.
42. Weng, A. L.-B., (1999) A Reliability and Validity Study of the Chinese Version of the Teamwork Skills Questionnaire Unpublished doctoral dissertation, University of Southern California, Los Angeles.
43. Zhang, J., 1998. A distributed representation approach to group problem solving. Journal of the American Society for Information Science, 49 (9): 801–809.