Structuring peer assessment: Comparing the impact of the degree of structure on peer feedback content

Computers in Human Behavior

Volumn 52, Issue , 2015, Pages 315-325

  Gielen, Mario ^a   De Wever, Bram ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Computer supported collaborative learning; Content analysis; Peer assessment; Peer feedback content; Scripting; Wiki environment

Indexed keywords

STUDENTS;

COMPUTER SUPPORTED COLLABORATIVE LEARNING; CONTENT ANALYSIS; PEER ASSESSMENT; PEER FEEDBACK; SCRIPTING; WIKI ENVIRONMENT;

FEEDBACK;

EID: 84936747679     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2015.06.019     Document Type: Article

References (74)

1. A. Agresti Categorical data analysis 2nd ed. 2002 Wiley New York
2. F. Anseel, and F. Lievens Certainty as a moderator of feedback reactions? A test of the strength of the self-verification motive Journal of Occupational and Organizational Psychology 79 2006 533 551
3. A. Bandura, and D. Cervone Differential engagement of self-reactive influences in cognitive motivation Organizational Behavior and Human Decision Processes 38 1986 92 113
4. R.L. Bangert-Drowns, C.C. Kulik, J.A. Kulik, and M.T. Morgan The instruction effect of feedback in test-like events Review of Educational Research 6 1991 218 238
5. J. Biggs Enhancing teaching through constructive alignment Higher Education 32 1996 347 364
6. P. Black, and D. William Assessment and classroom learning Assessment in Education: Principles, Policy, and Practice 5 1998 7 74
7. D. Boud Sustainable assessment: Rethinking assessment for the learning society Studies in Continuing Education 22 2000 151 167
8. D. Boud, and E. Molloy Rethinking models of feedback for learning: The challenge of design Assessment & Evaluation in Higher Education 38 2013 698 712
9. R. Butler Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest, and performance Journal of Educational Psychology 79 1987 474 482
10. D. Carless Learning-oriented assessment: Conceptual bases and practical implications Innovations in Education and Teaching International 44 2007 57 66
11. E.S. Chapman Key considerations in the design and implementation of effective peer-assisted learning programs K.J. Topping, S. Ehly, Peer-assisted learning 1998 Erlbaum Mahwah, NJ 67 84
12. K.H. Cheng, J.C. Liang, and C.C. Tsai Examining the role of feedback messages in undergraduate students' writing performance during an online peer assessment activity The Internet and Higher Education 25 2015 78 84
13. W. Cheng, and M. Warren Having second thoughts: Students perceptions before and after a peer assessment exercise Studies in Higher Education 22 1997 233 239
14. K. Cho, and C. MacArthur Student revision with peer and expert reviewing Learning and Instruction 20 2010 328 338
15. C. Coll, M.J. Rochera, and I. De Gispert Supporting online collaborative learning in small groups: Teacher feedback on learning content, academic task and social participation Computers & Education 75 2014 53 64
16. B. De Wever, T. Schellens, M. Valcke, and H. Van Keer Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review Computers & Education 46 2006 6 28
17. B. De Wever, H. Van Keer, T. Schellens, and M. Valcke Roles as structuring tool in online discussion groups: The differential impact of different roles on social knowledge constructions Computers in Human Behavior 26 2010 516 523
18. P. Dillenbourg, and P. Jermann Designing integrative scripts F. Fischer, I. Kollar, H. Mandl, J.M. Haake, Scripting computer-supported collaborative learning: Cognitive, computational, and educational perspectives 2007 Springer New York, NY 275 301
19. P. Dillenbourg, S. Järvelä, and F. Fischer The evolution of research in computer-supported collaborative learning: From design to orchestration N. Balacheff, S. Ludvigsen, T. de Jong, A. Lazonder, S. Barnes, Technology-enhanced learning: Principles and products 2009 Springer 3 19
20. P. Dillenbourg Over-scripting CSCL P.A. Kirschner, Three worlds of CSCL: Can we support CSCL? 2002 Open University of the Netherlands Heerlen 61 91
21. Dysthe, O. (2004). The challenges of assessment in a new learning culture. In The 32nd international NERA/NFPF conference, Reykjavik, Iceland.
22. C. Evans Making sense of assessment feedback in higher education Review of Educational Research 83 2013 70 120
23. N. Falchikov Improving feedback to and from students P. Knight, Assessment for learning in higher education 1995 Kogan Page London 157 166
24. F. Fischer, I. Kollar, K. Stegmann, and C. Wecker Toward a script theory of guidance in computer-supported collaborative learning Educational Psychologist 48 2013 56 66
25. A.S. García, M.T. García-Álvarez, and B. Moreno Analysis of assessment opportunities of learning spaces: On-line versus face-to-face methodologies Computers in Human Behavior 30 2014 372 377
26. M. Gielen, and B. De Wever Peer assessment in a wiki: product improvement, students' learning and perception regarding peer feedback Procedia - Social and Behavioral Sciences 69 2012 585 594
27. M. Gielen, and B. De Wever Structuring the peer assessment process: A multilevel approach for the impact on product improvement and peer feedback quality Journal of Computer Assisted Learning 2015 10.1111/jcal.12096
28. G.H. Gregory, and C. Chapman Differentiated instructional strategies: One size doesn't fit all 2012 SAGE
29. J. Hattie, and M. Gan Instruction based on feedback P. Alexander, R.E. Mayer, Handbook of research on learning and instruction 2011 Routledge New York 249 271
30. J. Hattie, and H. Timperley The power of feedback Review of Educational Research 77 2007 81 112
31. T. Hovardas, O.E. Tsivitanidou, and Z.C. Zacharia Peer versus expert feedback: An investigation of the quality of peer feedback among secondary school students Computers & Education 71 2014 133 152
32. K.J. Kennedy, J.K.S. Chan, P.K. Fok, and W.M. Yu Forms of assessment and their potential for enhancing learning: Conceptual and cultural issues Educational Research for Policy and Practice 7 2008 197 207
33. A.N. Kluger, and A. DeNisi The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory Psychological Bulletin 119 1996 254 284
34. L. Kobbe, A. Weinberger, P. Dillenbourg, A. Harrer, R. Hamalainen, and P. Hakkinen Specifying computer-supported collaboration scripts International Journal of Computer-Supported Collaborative Learning 2 2007 211 224
35. I. Kollar, and F. Fischer Peer assessment as collaborative learning: A cognitive perspective Learning and Instruction 20 2010 344 348
36. I. Kollar, F. Fischer, and F.W. Hesse Collaboration scripts - A conceptual analysis Educational Psychology Review 18 2006 159 185
37. I. Kollar, F. Fischer, and J.D. Slotta Internal and external scripts in computer-supported collaborative inquiry learning Learning and Instruction 17 2007 708 721
38. R.W. Kulhavy, and W.A. Stock Feedback in written instruction: The place of response certitude Educational Psychology Review 1 1989 279 308
39. R.W. Kulhavy, and W. Wager Feedback in programmed instruction: Historical context and implications for practice J.V. Dempsey, G.C. Sales, Interactive instruction and feedback 1993 Educational Technology Englewood Cliffs, NJ 3 20
40. J.R. Landis, and G.G. Koch A one way components of variance model for categorical data Biometrics 33 1977 671 679
41. C. Lockhart, and P. Ng Analyzing talk in ESL peer response groups: Stances, functions, and content Language Learning 45 1995 605 655
42. B.J. Mason, and R. Bruning Providing feedback in computer-based instruction: What the research tells us 2001 Center for Instructional Innovation, University of Nebraska-Lincoln NE
43. J. Mumm, and B. Mutlu Designing motivational agents: The role of praise, social comparison, and embodiment in computer feedback Computers In Human Behavior 27 2011 1643 1650
44. Narciss, S. (2006). Informatives Tutorielles Feedback. In Entwicklungs- und Evaluationsprinzipien auf der Basis instruktionspsychologischer Erkenntnisse (Informative Tutorial Feedback), Münster, Waxmann.
45. S. Narciss, and K. Huth How to design informative tutoring feedback for multi-media learning H.M. Niegemann, D. Leutner, R. Brunken, Instructional design for multimedia learning 2004 Münster Waxmann 181 195
46. S. Narciss Feedback strategies for interactive learning tasks J.M. Spector, M.D. Merrill, J.J.G. Van Merriënboer, M.P. Driscoll, Handbook of research on educational communications and technology 3rd ed. 2008 Erlbaum Mahwah, NJ 125 143
47. M.M. Nelson, and C.D. Schunn The nature of feedback: How different types of peer feedback affect writing performance Instructional Science 37 2008 375 401
48. A.M. O'Donnell, and D.F. Dansereau Scripted cooperation in student dyads: A method for analyzing and enhancing academic learning and performance R. Hertz-Lazarowitz, N. Miller, Interaction in cooperative groups: The theoretical anatomy of group learning 1992 Cambridge University Press Cambridge, MA 120 141
49. A.M. O'Donnell Structuring dyadic interaction through scripted cooperation A.M. O'Donnell, A. King, Cognitive perspectives on peer learning 1999 Erlbaum Mahwah, NJ 179 196
50. J.W. Pellegrino, N. Chudowsky, and R. Glaser Knowing what students know: The science and design of educational assessment 2001 National Academy Press Washington, DC
51. C. Phielix, F.J. Prins, and P.A. Kirschner Awareness of group performance in a CSCL-environment: Effects of peer feedback and reflection Computers in Human Behavior 26 2010 151 161
52. P.M. Podsakoff, and J.L. Farh Effects of feedback sign and credibility on goal setting and task performance Organizational Behavior and Human Decision Processes 44 1989 45 67
53. O. Poverjuc, V. Brooks, and D. Wray Using peer feedback in a Master's programme: A multiple case study Teaching in Higher Education 17 2012 465 477
54. F. Prins, D. Sluijsmans, and P.A. Kirschner Feedback for general practitioners in training: Quality, styles, and preferences Advances in Health Sciences Education 11 2006 289 303
55. C. Rogers Client-centered therapy: Its current practice, implications and theory 1951 Constable London
56. L. Rourke, T. Anderson, D.R. Garrison, and W. Archer Methodological issues in the content analysis of computer conference transcripts International Journal of Artificial Intelligence in Education 12 2001 8 22
57. D.R. Sadler Formative assessment and the design of instructional systems Instructional Science 18 1989 119 144
58. D.R. Sadler Formative assessment: Revisiting the territory Assessment in Education 5 1998 77 84
59. D.R. Sadler Beyond feedback: Developing student capability in complex appraisal Assessment and Evaluation in Higher Education 35 2010 535 550
60. V.J. Shute Focus on formative feedback Review of Educational Research 78 2008 153 189
61. Sluijsmans, D. (2002). Student involvement in assessment: The training of peer assessment skills, Open University of the Netherlands, Heerlen (unpublished doctoral dissertation).
62. Strijbos, J. W., Van Goozen, B., & Prins, F. (2012, August). Developing a coding scheme for analysing peer feedback messages. In Paper presented at the EARLI-SIG 1 assessment and evaluation conference, Brussels, Belgium.
63. J.W. Strijbos, R.L. Martens, F.J. Prins, and W.M.G. Jochems Content analysis: What are they talking about? Computers & Education 46 2006 29 48
64. J.W. Strijbos, S. Narciss, and K. Dünnebier Peer feedback content and sender's competence level in academic writing revision tasks: Are they critical for feedback perceptions and efficiency? Learning and Instruction 20 2010 291 303
65. J.W. Strijbos, and D. Sluijsmans Unravelling peer assessment: Methodological, functional, and conceptual developments Learning and Instruction 20 2010 265 269
66. K.J. Topping Peer assessment between students in colleges and universities Review of Educational Research 68 1998 249 276
67. K.J. Topping Methodological quandaries in studying process and outcomes in peer assessment Learning and Instruction 20 2010 339 343
68. K.J. Topping, E.F. Smith, I. Swanson, and A. Elliot Formative peer assessment of academic writing between postgraduate students Assessment & Evaluation in Higher Education 25 2000 149 169
69. I. Van den Berg, W. Admiraal, and A. Pilot Peer assessment in university teaching: Evaluating seven course designs Assessment and Evaluation in Higher Education 31 2006 9 16
70. M. Van Zundert, D. Sluijsmans, and J. van Merriënboer Effective peer assessment processes: Research findings and future directions Learning and Instruction 20 2010 270 279
71. D. Van-Dijk, and A.N. Kluger Feedback sign effect on motivation: Is it moderated by regulatory focus? Applied Psychology: An International Review 53 2004 113 135
72. M. Vargas-Vera, M. Nagy, and P. Ordóñez de Pablos A framework for detecting and removing knowledge overlaps in a collaborative environment: Case of study a computer configuration problem Journal of Web Engineering 12 2013 422 438
73. Walker, M. (2014). The quality of written peer feedback on undergraduates' draft answers to an assignment, and the use made of the feedback. Assessment & Evaluation in Higher Education. http://dx.doi.org/10.1080/02602938.2014.898737.
74. C. Wecker, and F. Fischer Fading scripts in computer-supported collaborative learning: The role of distributed monitoring C. Chinn, G. Erkens, S. Puntambekar, Proceedings of the CSCL 2007 2007 Erlbaum Mahwah, NJ 763 771