Assessment of collaborative learning

Handbook of Human and Social Conditions in Assessment

Volumn , Issue , 2016, Pages 302-318

  Strijbos, Jan Willem ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85060758838     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781315749136-25     Document Type: Chapter

References (121)

1. Barfield, R. L. (2003). Students’ perceptions of and satisfaction with group grades and the group experience in the college classroom. Assessment & Evaluation in Higher Education, 28(4), 355-370.
2. Belfer, K., & Wakkary, R. (2005). Team assessment guidelines: A case study of collaborative learning in design. In P. Comeaux (Ed.), Assessing online learning (pp. 34-54). San Francisco, CA: Jossey-Bass.
3. Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347-364.
4. Boekaerts, M., & Minnaert, A. (2006). Affective and motivational outcomes of working in collaborative groups. Educational Psychology, 26(2), 187-208.
5. Boud, D., Cohen, R., & Sampson, J. (1999). Peer learning and assessment. Assessment & Evaluation in Higher Education, 24(4), 413-426.
6. Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31(4), 399-413.
7. Bushell, G. (2006). Moderation of peer assessment in group projects. Assessment & Evaluation in Higher Education, 31(1), 91-108.
8. Chen, W., Looi, C. K., Xie, W., & Wen, Y. (2013). Empowering argumentation in the science classroom with a complex CSCL environment. In L. H. Wong, C.-C. Lui, T. Hirashima, P. Sumedi, & M. Lukman (Eds.), Proceedings of the 21st International Conference on Computers in Education (pp. 348-357). Bali: Asia-Pacific Society for Computers in Education.
9. Cheng, W., & Warren, M. (2000). Making a difference: Using peers to assess individual students’ contributions to a group project. Teaching in Higher Education, 5(2), 243-255.
10. Chiriac, E. H., & Granström, K. (2012). Teachers’ leadership and students’ experience of group work. Teachers and Teaching: Theory and Practice, 18(3), 345-363.
11. Chiu, M. M. (2008). Flowing toward correct contributions during group problem solving: A statistical discourse analysis. The Journal of the Learning Sciences, 17(3), 415-463.
12. Cohen, E. G. (1994). Restructuring the classroom: Conditions for productive small groups. Review of Educational Research, 64(1), 1-35.
13. Cohen, E. G., Lotan, R. A., Abram, P. L., Scarloss, B. A., & Schultz, S. E. (2002). Can groups learn? Teachers College Record, 104(6), 1045-1068.
14. De Hei, M. S. A., Strijbos, J. W., Sjoer, E., & Admiraal, W. (2015). Collaborative learning in higher education: Lecturers’ practices and beliefs. Research Papers in Education, 30(2), 232-247.
15. De Hei, M., Strijbos, J.-W., Sjoer, E., & Admiraal, W. (2016). Thematic review of approaches to design group learning activities in higher education: The development of a comprehensive framework. Educational Research Review, 18, 33-45. doi: 10.1016/j.edurev.2016.01.001
16. De Wever, B., Van Keer, H., Schellens, T., & Valcke, M. (2011). Assessing collaboration in a wiki: The reliability of university students’ peer assessment. The Internet and Higher Education, 14(4), 201-206.
17. Dingyloudi, F., & Strijbos, J. W. (2015). Examining value creation in a community of learning practice: Methodological reflections on story-telling and story-reading. Seminar.net: International Journal of Media, Technology & Lifelong Leaning, 11(3), 209-222.
18. Fischer, K. W., & Granott, N. (1995). Beyond one-dimensional change: Parallel concurrent, socially distributed processes in learning and development. Human Development, 38(6), 302-314.
19. Fischer, F., & Mandl, H. (2005). Knowledge convergence in computer-supported collaborative learning: The role of external representation tools. The Journal of the Learning Sciences, 14(3), 405-441.
20. Frederiksen, N. (1984). The real test bias: Influences of testing on teaching and learning. American Psychologist, 3, 193-202.
21. Freeman, M., & McKenzie, J. (2002). SPARK, a confidential web-based template for self and peer assessment of team work: Benefits of evaluating across different subjects. British Journal of Educational Technology, 33(5), 551-569.
22. Frykedal, K. F., & Chiriac, E. H. (2011). Assessment of students’ learning when working in groups. Educational Research, 53(3), 331-345.
23. Gillies, R. M. (2007). Cooperative learning: Integrating theory and practice. Los Angeles, CA: Sage.
24. Gillies, R. M., & Ashman, A. F. (2003). An historical overview of the use of groups to promote socialization and learning. In R. M. Gillies & A. F. Ashman (Eds.), Co-operative learning: The social and intellectual outcomes of learning in groups (pp. 1-18). London: Routledge.
25. Gillies, R. M., & Boyle, M. (2010). Teachers’ reflections on cooperative learning: Issues of implementation. Teaching and Teacher Education, 26(4), 933-940.
26. Goldfinch, J. (1994). Further developments in peer assessment of group projects. Assessment & Evaluation in Higher Education, 19(1), 29-35.
27. Gress, C. L. Z., Fior, M., Hadwin, A. F., & Winne, P. H. (2010). Measurement and assessment in computersupported collaborative learning. Computers in Human Behavior, 26(5), 806-814.
28. Gweon, G., Jain, M., McDonough, J., Raj, B., & Rosé, C. P. (2013). Measuring prevalence of other-oriented transactive contributions using an automated measure of speech style accommodation. International Journal of Computer-Supported Collaborative Learning, 8(2), 245-265.
29. Harlen, W., & James, M. (1996 April). Creating a positive impact of assessment on learning. Paper presented at AERA 1996 annual meeting, New York, NY.
30. Hatano, G, & Inagaki, K. (1991). Sharing cognition through collective comprehension activity. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 331-348). Washington, DC: American Psychological Association.
31. Hijzen, D., Boekaerts, M., & Vedder, P. (2007). Exploring the links between students’ engagement in cooperative learning, their goal preferences and appraisals of instruction conditions in the classroom. Learning and Instruction, 17(6), 673-687.
32. Hoffman, J. R., & Rogelberg, S. G. (2001). All together now? College students’ preferred project group grading procedures. Group Dynamics: Theory, Research, and Practice, 5(1), 33-40.
33. Janssen, J., & Bodemer, D. (2013). Coordinated computer-supported collaborative learning: Awareness and awareness tools. Educational Psychologist, 48(1), 40-55.
34. Järvelä, S., & Hadwin, A. (2013). New frontiers: Regulating learning in CSCL. Educational Psychologist, 48(1), 25-39.
35. Järvelä, S., Volet, S., & Järvenoja, H. (2010). Research on motivation in collaborative learning: Moving beyond the cognitive-situative divide and combining individual and social processes. Educational Psychologist, 45(1), 15-27.
36. Jeong, H., & Chi, M. T. H. (2007). Knowledge convergence and collaborative learning. Instructional Science, 35(4), 287-315.
37. Johnson, D. W. (1981). Student-student interaction: The neglected variable in education. Educational Researcher, 10, 5-10.
38. Johnson, D. W., & Johnson, R. T. (1994). Learning together and alone: Cooperative, competitive and individualistic learning (4th ed.). Needham Heights, MA: Allyn & Bacon.
39. Johnson, D. W., & Johnson, R. T. (2003). Student motivation in co-operative groups: social interdependence theory. In R. M. Gillies & A. F. Ashman (Eds.), Co-operative learning: The social and intellectual outcomes of learning in groups (pp. 136-176). London, UK: Routledge.
40. Johnson, D. W., & Johnson, R. T. (2004). Assessing students in groups: Promoting group responsibility and individual accountability. Thousand Oaks, CA: Corwin Press.
41. Johnston, L., & Miles, L. (2004). Assessing contributions to group assignments. Assessment & Evaluation in Higher Education, 29(6), 751-768.
42. Kagan, S. (1995). Group grades miss the mark. Educational Leadership, 52(8), 68-71.
43. Kali, Y., & Ronen, M. (2008). Assessing the assessors: Added value in web-based multi-cycle peer assessment in higher education. Research and Practice in Technology Enhanced Learning, 3(1), 3-32.
44. Kench, P. L., Field, N., Agudera, M., & Gill, M. (2009). Peer assessment of individual contributions to a group project: Student perceptions. Radiography, 15(2), 158-165.
45. Kerr, N. L. (1983). Motivation losses in small groups: A social dilemma analysis. Journal of Personality and Social Psychology, 45(4), 819-828.
46. Kerr, N. L., & Bruun, S. E. (1983). Dispensability of member effort and group motivation losses: Free rider effects. Journal of Personality and Social Psychology, 44(1), 78-94.
47. Kollar, I., & Fischer, F. (2010). Peer assessment as collaborative learning: A cognitive perspective. Learning and Instruction, 20(4), 344-348.
48. Kreijns, K. (2004). Sociable CSCL environments: Social affordances, sociability and social presence. Unpublished doctoral dissertation, Open University of the Netherlands, Heerlen, The Netherlands.
49. Kreijns, K., Kirschner, P. A., & Jochems, W. M. G. (2003). Identifying the pitfalls for social interaction in computer-supported collaborative learning: A review of the research. Computers in Human Behavior, 19(3), 335-353.
50. Kumar, V. S., Gress, C. L. Z., Hadwin, A. F., & Winne, P. H. (2010). Assessing process in CSCL: An ontological approach. Computers in Human Behavior, 26(5), 825-834.
51. Law, N., & Wong, E. (2003). Developmental trajectory in knowledge building: An investigation. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments (pp. 57-66). Dordrecht, the Netherlands: Kluwer/ Springer.
52. Lee, E.Y.C., Chan, C.K.K., & Van Aalst, J. (2006). Students assessing their own collaborative knowledge building. International Journal of Computer-Supported Collaborative Learning, 1(1), 57-87.
53. Lejk, M., & Wyvill, M. (2001a). The effect of inclusion of self-assessment with peer-assessment of contributions to a group project: A quantitative study of secret and agreed assessments. Assessment & Evaluation in Higher Education, 26(6), 551-561.
54. Lejk, M., & Wyvill, M. (2001b). Peer assessment of contributions to a group project: A comparison of holistic and category-based approaches. Assessment & Evaluation in Higher Education, 26(1), 61-72.
55. Lejk, M., Wyvill, M., & Farrow, S. (1996). A survey of methods of deriving individual grades from group assessments. Assessment & Evaluation in Higher Education, 21(3), 267-280.
56. Li, L. (2001). Some refinements on peer assessment of group projects. Assessment & Evaluation in Higher Education, 26(1), 5-18.
57. Lipponen, L., Hakkarainen, K., & Paavola, S. (2004). Practices and orientations of CSCL. In J. W. Strijbos, P. A. Kirschner, & R. L. Martens (Eds.), What we know about CSCL: And implementing it in higher education (pp. 31-50). Boston, MA: Kluwer/ Springer.
58. Macdonald, J. (2003). Assessing online collaborative learning: Process and product. Computers & Education, 40(4), 377-391.
59. Magin, D. J. (2001). A novel technique for comparing the reliability of multiple peer assessments with that of single teacher assessments of group process work. Assessment & Evaluation in Higher Education, 26(2), 139-152.
60. McConnell, D. (2006). E-learning groups and communities. Berkshire, UK: The Society for Research into Higher Education & The Open University Press.
61. Miyake, N. (2007). Computer supported collaborative learning. In R. Andrews & C. Haythornthwaite (Eds.), The Sage handbook of e-learning research (pp. 248-265). London, UK: Sage.
62. Miyake, N. (2008). Conceptual change through collaboration. In S. Vosniadou (Ed.), International handbook of conceptual change (pp. 453-478). New York: Routledge.
63. Mu, J., Stegmann, K., Mayfield, E., Rosé, C., Fischer, F. (2012). The ACODEA framework: Developing segmentation and classification schemes for fully automatic analysis of online discussions. International Journal of Computer-Supported Collaborative Learning, 7(2), 285-305.
64. Nepal, K. P. (2012). An approach to assign individual marks from a team mark: The case of Australian grading system at universities. Assessment & Evaluation in Higher Education, 37(5), 555-562.
65. Neus, J. N. (2011). Peer assessment accounting for student agreement. Assessment & Evaluation in Higher Education, 36(3), 301-314.
66. OECD. (2013). PISA 2015 draft collaborative problem solving framework. Retrieved from http://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Collaborative%20Problem%20Solving%20Frame work%20.pdf
67. Oosterhof, A., Conrad, R. M., & Ely, D. P. (2008). Assessing learners online. Upper Saddle River, NJ: Pearson.
68. Pauli, R., Mohiyeddini, C., Bray, D., Michie, F., & Street, B. (2012). Individual differences in negative group work experiences in collaborative learning. Educational Psychology, 28(1), 47-58.
69. Petropoulou, O., Vassilikopoulou, M., & Retalis, S. (2011). Enriched assessment rubrics: A new medium for enabling teachers to easily assess student’s performance when participating in complex interactive learning scenarios. Operational Research, 11(2), 171-186.
70. Phielix, C., Prins, F. J., & Kirschner, P. A. (2010). Awareness of group performance in a CSCL environment: Effects of peer feedback and reflection. Computers in Human Behavior, 26(2), 151-161.
71. Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., & Koller, D. (2013). Tuned models of peer assessment in MOOCs. In S. K. D’Mello, R. A. Calvo, & A. Olney (Eds.), Proceedings of The 6th International Conference on Educational Data Mining (EDM 2013) (pp. 153-160). Memphis, TN: International Educational Data Mining Society.
72. Prins, F. J., Sluijsmans, D.M.A., Kirschner, P. A., & Strijbos, J. W. (2005). Formative peer assessment in a CSCL environment. Assessment & Evaluation in Higher Education, 30(4), 417-444.
73. Puntambekar, S., Erkens, G., & Hmelo-Silver, C. (Eds.). (2011). Analyzing interactions in CSCL: Methods, approaches and issues. New York: Springer.
74. Reimann, P., Yacef, K., & Kay, J. (2011). Analyzing collaborative interactions with data mining methods for the benefit for learning. In S. Puntambekar, G. Erkens, & C. Hmelo-Silver (Eds.), Analyzing interactions in CSCL: Methods, approaches and issues (pp. 161-185). New York: Springer.
75. Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state-of-the-art. IEEE transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews, 40(6), 601-618.
76. Rosen, Y., & Foltz, P. W. (2014). Assessing collaborative problem solving through automated technologies. Research and Practice in Technology Enhanced Learning, 9(3), 389-410.
77. Ross, J. A., & Rolheiser, C. (2003). Student assessment practices in co-operative learning. In R. M. Gillies & A. F. Ashman (Eds.), Co-operative learning: The social and intellectual outcomes of learning in groups (pp. 119-135). London, UK: Routledge.
78. Ross, J. A., Rolheiser, C., & Hogaboam-Gray, A. (1998). Student evaluation in co-operative learning: Teacher cognitions. Teachers and Teaching: Theory and Practice, 4(2), 299-316.
79. Rummel, N., Deiglmayer, A., Spada, H., Kahrimanis, G., & Avouris, N. (2011). Analyzing collaborative interactions across domains and settings: An adaptable rating scheme. In S. Puntambekar, G. Erkens, & C. Hmelo-Silver (Eds.), Analyzing interactions in CSCL: Methods, approaches and issues (pp. 367-390). New York: Springer.
80. Salomon, G. (2000, June 28). It’s not just the tool, but the educational rationale that counts. Invited keynote address at the 2000 ED-MEDIA Meeting, Montreal, Canada.
81. Salomon, G., & Globerson, T. (1989). When teams do not function the way they ought to. International Journal of Educational Research, 13(1), 89-99.
82. Scriven, M. (1967). The methodology of evaluation. In R. E. Stake (Ed.), Perspectives of curriculum evaluation (Vol. 1, pp. 39-55). Chicago: Rand McNally.
83. Shaffer, D. W., Hatfield, D., Svarovsky, G. N., Nash, P., Nulty, A., Bagley, E., Frank, K., Rupp, A. A., & Mislevy, R. (2009). Epistemic network analysis: A prototype for 21st century assessment of learning. International Journal of Learning and Media, 1(2), 33-53.
84. Sharan, Y., & Sharan, S. (1992). Expanding cooperative learning through group investigation. New York: Teachers College Press.
85. Sharan, S., Sharan, Y, & Tan, I. G.-C. (2013). The group investigation approach to cooperative learning. In C. E. Hmelo-Silver, C. A. Chinn, C.K.K. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 351-369). New York: Routledge.
86. Sharp, S. (2006). Deriving individual student marks from a tutor’s assessment of group work. Assessment & Evaluation in Higher Education, 31(3), 329-343.
87. Sivan, A. (2000). The implementation of peer assessment: An action research approach. Assessment in Education: Principles, Policy & Practice, 7(2), 193-213.
88. Slavin, R. E. (1980). Cooperative learning in teams: State of the art. Educational Psychologist, 15(2), 93-111.
89. Slavin, R. E. (1995). Cooperative learning: Theory, research and practice (2nd ed.). Needham Heights: Allyn & Bacon.
90. Slavin, R. E. (1996). Research on cooperative learning and achievement: What we know, what we need to know. Contemporary Educational Psychology, 21(1), 43-69.
91. Stahl, G., Koschmann, T., & Suthers, D. (2006). Computer-supported collaborative learning: A historical perspective. In R. K. Sawyer (Ed.), Cambridge handbook of the learning sciences (pp. 409-426). Cambridge, UK: Cambridge University Press.
92. Strijbos, J. W. (2011). Assessment of (computer-supported) collaborative learning. IEEE Transactions on Learning Technologies, 4(1), 59-73.
93. Strijbos, J. W., & Fischer, F. (2007). Methodological challenges for collaborative learning research. Learning and Instruction, 17(4), 389-394.
94. Strijbos, J. W., Kirschner, P. A., & Martens, R. L. (Eds.). (2004a). What we know about CSCL: And implementing it in higher education. Boston, MA: Kluwer Academic/ Springer.
95. Strijbos, J. W., Kirschner, P. A., & Martens, R. L. (2004b). What we know about CSCL: And what we do not (but need to know) about CSCL. In J. W. Strijbos, P. A. Kirschner, & R. L. Martens (Eds.), What we know about CSCL: And implementing it in higher education (pp. 245-259). Boston, MA: Kluwer/ Springer.
96. Strijbos, J. W., Martens, R. L., & Jochems, W.M.G. (2004). Designing for interaction: Six steps to designing computer-supported collaborative learning. Computers & Education, 42(4), 403-424.
97. Strijbos, J. W., Martens, R. L., Jochems, W.M.G., & Broers, N. J. (2007). The effect of functional roles on perceived group efficiency during computer-supported collaborative learning: A matter of triangulation. Computers in Human Behavior, 23(1), 353-380.
98. Strijbos, J. W., Ochoa, T. A., Sluijsmans, D.M.A., Segers, M.S.R., & Tillema, H. H. (2009). Fostering interactivity through formative peer assessment in (web-based) collaborative learning environments. In C. Mourlas, N. Tsianos, & P. Germanakos (Eds.), Cognitive and emotional processes in web-based education: Integrating human factors and personalization (pp. 375-395). Hershey, PA: IGI Global.
99. Strijbos, J. W., & Sluijsmans, D.M.A. (2010). Unravelling peer assessment through (quasi) experimental research. Learning and Instruction, 20(4), 265-269.
100. Stuart, M. A. (1994). Effects of group grading on cooperation and achievement in two fourth-grade math classes. The Elementary School Journal, 95(1), 11-21.
101. Sung, Y. T., Chang, K. E., Chiou, S. K., & Hou, H. T. (2005). The design and application of a web-based self- and peer-assessment system. Computers & Education, 45(2), 187-202.
102. Swan, K., Shen, J., & Hiltz, S. R. (2006). Assessment and collaboration in online learning. Journal of Asynchronous Learning Networks, 10(1), 45-61.
103. Tolmie, A. K., Topping, K. J., Christie, D., Donaldson, C., Howe, C., Jessiman, E., Livingston, K., & Thurston, A. (2010). Social effects of collaborative learning in primary schools. Learning and Instruction, 20(3), 177-191.
104. Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249-276.
105. Van Aalst, J. (2013). Assessment in collaborative learning. In C. E. Hmelo-Silver, C. A. Chinn, C.K.K. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 280-296). New York: Routledge.
106. Van Aalst, J., & Chan, C.K.K. (2007). Student-directed assessment of knowledge building using electronic portfolios. The Journal of the Learning Sciences, 16(2), 175-220.
107. Van Gennip, N.A.E., Segers, M.S.R., & Tillema, H. H. (2009). Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features. Educational Research Review, 4(1), 41-54.
108. Van Gennip, N.A.E., Segers, M.S.R., & Tillema, H. H. (2010). Peer assessment as a collaborative learning activity: The role of interpersonal variables and conceptions. Learning and Instruction, 20(4), 280-290.
109. Vanderhoven, E., Raes, A., Montrieux, H., Rotsaert, T, , Schellens, T. (2015). What if pupils can assess their peers anonymously? A quasi-experimental study. Computer & Education, 81, 123-132.
110. Volet, S., Summers, M., & Thurman, J. (2009). High-level co-regulation in collaborative learning: How does it emerge and how is it sustained? Learning and Instruction, 19(2), 128-143.
111. Wang, L., MacCann, C., Zhuang, X., Liu, O. L., & Roberts, R. D. (2009). Assessing teamwork and collaboration in high school students: A multimethod approach. Canadian Journal of School Psychology, 24(2), 108-124.
112. Webb, N. M. (1993). Collaborative group versus individual assessment in mathematics: Processes and outcomes. Educational Assessment, 1(2), 131-152.
113. Webb, N. M. (1997). Assessing students in small collaborative groups. Theory into Practice, 36(4), 205-213.
114. Weinberger, A., Stegmann, K., & Fischer, F. (2007). Knowledge convergence in collaborative learning: Concepts and assessment. Learning and Instruction, 17(4), 416-426.
115. Wenger, E., Trayner, B., & De Laat, M. (2011). Promoting and assessing value creation in communities and networks: A conceptual framework. Heerlen, the Netherlands: Ruud de Moor Centrum.
116. Willey, K., & Gardner, A. (2009). Improving self- and peer assessment processes with technology. Campus-Wide Information Systems, 26(5), 379-399.
117. Williams, K. D., & Karau, S. J. (1991). Social loafing and social compensation: The effects of expectations of co-worker performance. Journal of Personality and Social Psychology, 61(4), 570-581.
118. Wise, A. F., & Chiu, M. M. (2011). Analyzing temporal patterns of knowledge construction in a role-based online discussion. International Journal of Computer-Supported Collaborative Learning, 6(3), 445-470.
119. Wu, C., Chanda, E., & Willison, J. (2014). Implementation and outcomes of online self and peer assessment on group based honours research projects. Assessment & Evaluation of Higher Education, 39(1), 21-37.
120. Zhang, B., Johnston, L., & Kilic, G. B. (2008). Assessing the reliability of self- and peer rating in student group work. Assessment & Evaluation in Higher Education, 33(3), 329-340.
121. Zottmann, J. M., Stegmann, K., Strijbos, J. W., Vogel, F., Wecker, C., & Fischer, F. (2013). Computer-supported collaborative learning with digital video cases in teacher education: The impact of teaching experience on knowledge convergence. Computers in Human Behavior, 29(5), 2100-2108.