The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis

Assessment and Evaluation in Higher Education

Volumn 44, Issue 6, 2019, Pages 863-880

  Huisman, Bart ^a   Saab, Nadira ^a   van den Broek, Paul ^a   van Driel, Jan ^b  

^a LEIDEN UNIVERSITY   (Netherlands)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

academic writing; higher education; peer assessment; peer feedback

Indexed keywords

EID: 85059464216     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2018.1545896     Document Type: Article

References (72)

1. Admiraal, W., B., Huisman, and O., Pilli. 2015. “Assessment in Massive Open Online Courses.” The Electronic Journal of e-Learning 13 (4):207–16.
2. Ajzen, I. 1991. “The Theory of Planned Behavior.” Organizational Behavior and Human Decision Processes 50 (2):179–211. doi: 10.1016/0749-5978(91)90020-T.
3. Ajzen, I., and M., Fishbein. 2005. "The influence of attitudes on behavior." In The handbook of attitudes., edited by D., Albarracin, B. T., Johnson and M. P., Zanna, 173–221. NJ: Lawrence Erlbaum Associates: Mahwah.
4. Bailey, R., and M., Garner. 2010. “Is the Feedback in Higher Education Assessment Worth the Paper It Is Written on? Teachers' Reflections on Their Practices.” Teaching in Higher Education 15 (2):187–98. doi: 10.1080/13562511003620019.
5. Ballantyne, R., K., Hughes, and A., Mylonas. 2002. “Developing Procedures for Implementing Peer Assessment in Large Classes Using an Action Research Process.” Assessment & Evaluation in Higher Education 27 (5):427–41. doi: 10.1080/0260293022000009302.
6. * Birjandi, P., and N. H., Tamjid. 2012. “The Role of Self-, Peer and Teacher Assessment in Promoting Iranian EFL Learners' Writing Performance.” Assessment & Evaluation in Higher Education 37 (5):513–33. doi: 10.1080/02602938.2010.549204.
7. Borenstein, M., L. V., Hedges, J. P. T., Higgins, and H. R., Rothstein. 2009. Introduction to Meta-analysis, introduction to Meta-Analysis. West Sussex, UK: John Wiley & Sons, Ltd.
8. * Cahyono, B. Y., and R., Amrina. 2016. “Peer Feedback, Self-Correction, and Writing Proficiency of Indonesian EFL Students.” Arab World English Journal 7 (1):178–93. doi: 10.24093/awej/vol7no1.12.
9. * Cheng, K. H., J. C., Liang, and C. C., Tsai. 2015. “Examining the Role of Feedback Messages in Undergraduate Students' Writing Performance during an Online Peer Assessment Activity.” Internet and Higher Education 25:78–84. doi: 10.1016/j.iheduc.2015.02.001.
10. Cho, K., and C., MacArthur. 2010. “Student Revision with Peer and Expert Reviewing.” Learning and Instruction 20 (4):328–38. doi: 10.1016/j.learninstruc.2009.08.006.
11. * Cho, K., and C., MacArthur. 2011. “Learning by Reviewing.” Journal of Educational Psychology 103 (1):73–84. doi: 10.1037/a0021950.
12. * Cho, K., and C. D., Schunn. 2007. “Scaffolded Writing and Rewriting in the Discipline: A Web-Based Reciprocal Peer Review System.” Computers & Education 48 (3):409–26. doi: 10.1016/j.compedu.2005.02.004.
13. Cho, K., C. D., Schunn, and R. W., Wilson. 2006. “Validity and Reliability of Scaffolded Peer Assessment of Writing from Instructor and Student Perspectives.” Journal of Educational Psychology 98 (4):891–901. doi: 10.1037/0022-0663.98.4.891.
14. * Cho, Y. H., and K., Cho. 2011. “Peer Reviewers Learn from Giving Comments.” Instructional Science 39 (5):629–43. doi: 10.1007/s11251-010-9146-1.
15. Ciftci, H., and Z., Kocoglu. 2012. “Effects of Peer e-Feedback on Turkish EFL Students' Writing Performance.” Journal of Educational Computing Research 46 (1):61–84. doi: 10.2190/EC.46.1.c
16. Cohen, J. C. 1988. Statistical power analysis for the behavioural sciences. (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
17. * Crossman, J. M., and S. L., Kite. 2012. “Facilitating Improved Writing among Students through Directed Peer Review.” Active Learning in Higher Education 13 (3):219–29. doi: 10.1177/1469787412452980.
18. * Diab, N. M. 2011. “Assessing the Relationship between Different Types of Student Feedback and the Quality of Revised Writing.” Assessing Writing 16 (4):274–92. doi: 10.1016/j.asw.2011.08.001.
19. Dochy, F., M., Segers, and D., Sluijsmans. 1999. “The Use of Self-, Peer and co-Assessment in Higher Education: A Review.” Studies in Higher Education 24 (3):331–50. doi: 10.1080/03075079912331379935.
20. Evans, C. 2013. “Making Sense of Assessment Feedback in Higher Education.” Review of Educational Research 83 (1):70–120. doi: 10.3102/0034654312474350.
21. Falchikov, N., and D., Boud. 1989. “Student Self-Assessment in Higher Education: A Meta-Analysis.” Review of Educational Research 59 (4):395–430. doi: 10.3102/00346543059004395.
22. Falchikov, N., and J., Goldfinch. 2000. “Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks.” Review of Educational Research 70 (3):287–322. doi: 10.2307/1170785.
23. Flower, L., J. R., Hayes, L., Carey, K., Schriver, and J., Stratman. 1986. “Detection, Diagnosis, and the Strategies of Revision +.” Composition." College Composition and Communication 37 (1):16–55. doi: 10.2307/357381.
24. Gielen, S., F., Dochy, and P., Onghena. 2011. “An Inventory of Peer Assessment Diversity.” Assessment & Evaluation in Higher Education 36 (2):137–55. doi: 10.1080/02602930903221444.
25. Graham, S., and D., Perin. 2007. “A Meta-Analysis of Writing Instruction for Adolescent Students.” Journal of Educational Psychology 99 (3):445–76. doi: 10.1037/0022-0663.99.3.445.
26. * Greenberg, K. P. 2015. “Rubric Use in Formative Assessment: A Detailed Behavioral Rubric Helps Students Improve Their Scientific Writing Skills.” Teaching of Psychology 42 (3):211–7. doi: 10.1177/0098628315587618.
27. Gunersel, A. B., N. J., Simpson, K. J., Aufderheide, and L., Wang. 2008. “Effectiveness of Calibrated Peer Review for Improving Writing and Critical Thinking Skills in Biology Undergraduate Students.” Journal of the Scholarship of Teaching and Learning 8 (2):25–37.
28. * Hartberg, Y., A. B., Gunersel, N. J., Simspon, and V., Balester. 2008. “Development of Student Writing in Biochemistry Using Calibrated Peer Review.” Journal of the Scholarship of Teaching and Learning 8 (1):29–44.
29. Hayes, J. R., and L. S., Flower. 1987. “On the Structure of the Writing Process.” Topics in Language Disorders 7 (4):19–30.
30. * Hu, G., and S. T. E., Lam. 2010. “Issues of Cultural Appropriateness and Pedagogical Efficacy: Exploring Peer Review in a Second Language Writing Class.” Instructional Science 38 (4):371–94. doi: 10.1007/s11251-008-9086-1.
31. Huisman, B. A., N., Saab, J. H., van Driel, and P. W., van den Broek. 2018. “Peer Feedback on Academic Writing: Undergraduate Students' Peer Feedback Role, Peer Feedback Perceptions and Essay Performance.” Assessment & Evaluation in Higher Education 36 (7):955–68. doi: 10.1080/02602938.2018.1424318
32. Landis, J. R., and G. G., Koch. 1977. “Measurement of Observer Agreement for Categorical Data.” Biometrics 33 (1):159–74. doi: 10.2307/2529310.
33. Lazonder, A. W., and R., Harmsen. 2016. “Meta-Analysis of Inquiry-Based Learning: Effects of Guidance.” Review of Educational Research 86 (3):681–718. doi: 10.3102/0034654315627366.
34. * Lee, C.-Y. 2015. “The Effects of Online Peer Assessment and Family Entrepreneurial Experience on Students' Business Planning Performance.” TOJET: The Turkish Online Journal of Educational Technology 14 (1):123–32.
35. Lindblom-Ylänne, S., H., Pihlajamäki, and T., Kotkas. 2006. “Self-, Peer- and Teacher-Assessment of Student Essays.” Active Learning in Higher Education 7 (1):51–62. doi: 10.1177/1469787406061148.
36. Lipsey, M. W., and D. B., Wilson. 1993. “The Efficacy of Psychological, Educational, and Behavioral Treatment: Confirmation from Meta-Analysis.” American Psychologist 48 (12):1181–209. doi: 10.1037/0003-066X.48.12.1181.
37. Lipsey, M. W., and D. B., Wilson. 2001. Practical Meta-analysis, applied social research methods series. Thousand oaks., Calif: SAGE Publications, Inc.
38. Liu, N., and D., Carless. 2006. “Peer Feedback: The Learning Element of Peer Assessment.” Teaching in Higher Education 11 (3):279–90. doi: 10.1080/13562510600680582.
39. Lundstrom, K., and W., Baker. 2009. “To Give Is Better than to Receive: The Benefits of Peer Review to the Reviewer's Own Writing.” Journal of Second Language Writing 18 (1):30–43. doi: 10.1016/j.jslw.2008.06.002.
40. Matsuno, S. 2009. “Self-, Peer-, and Teacher-Assessments in Japanese University EFL Writing Classrooms.” Language Testing 26 (1):75–100. doi: 10.1177/0265532208097337.
41. McConlogue, T. 2015. “Making Judgements: investigating the Process of Composing and Receiving Peer Feedback.” Studies in Higher Education 40 (9):1495–506. doi: 10.1080/03075079.2013.868878.
42. Nicol, D. J., and D., Macfarlane-Dick. 2006. “Formative Assessment and Self-Regulated Learning: A Model and Seven Principles of Good Feedback Practice.” Studies in Higher Education 31 (2):199–218. doi: 10.1080/03075070600572090.
43. Nicol, D. J., A., Thomson, and C., Breslin. 2014. “Rethinking Feedback Practices in Higher Education: A Peer Review Perspective.” Assessment & Evaluation in Higher Education 39 (1):102–22. doi: 10.1080/02602938.2013.795518.
44. * Noroozi, O., H., Biemans, and M., Mulder. 2016. “Relations between Scripted Online Peer Feedback Processes and Quality of Written Argumentative Essay.” Internet and Higher Education 31:20–31. doi: 10.1016/j.iheduc.2016.05.002.
45. * Novakovich, J. 2016. “Fostering Critical Thinking and Reflection through Blog-Mediated Peer Feedback.” Journal of Computer Assisted Learning 32 (1):16–30. doi: 10.1111/jcal.12114
46. OECD. 2016. "Education at a glance 2016: OECD indicators.". In. OECD Publishing, Paris.
47. Patchan, M. M., and C. D., Schunn. 2015. “Understanding the Benefits of Providing Peer Feedback: How Students Respond to Peers’ Texts of Varying Quality.” Instructional Science43(5): 591-614. doi: 10.1007/s11251-015-9353-x.
48. Polanin, J. R., E. A., Hennessy, and E. E., Tanner-Smith. 2016. “A Review of Meta-Analysis Packages in R.” Journal of Educational and Behavioral Statistics 42 (2):206–42. doi: 10.3102/1076998616674315.
49. R Core team 2017. "R: a language and environment for statistical computing.". In. Vienna, Austria: R Foundation for Statistical Computing.
50. Raudenbush, S. W. 2009. "Analyzing effect sizes: Random-effects models." In The handbook of research synthesis and Meta-analysis., 2nd ed., edited by Harris, Cooper, Larry V., Hedges, Jeffrey C., Valentine, Harris, Cooper, Larry V., Hedges and Jeffrey C., Valentine, 295–315. New York, NY, US: Russell Sage Foundation.
51. Sadler, D. R. 1989. “Formative Assessment and the Design of Instructional-Systems.” Instructional Science 18 (2):119–44. doi: 10.1007/Bf00117714.
52. * Sampson, V., and J. P., Walker. 2012. “Argument-Driven Inquiry as a Way to Help Undergraduate Students Write to Learn by Learning to Write in Chemistry.” International Journal of Science Education 34 (10):1443–85. doi: 10.1080/09500693.2012.667581.
53. Schriver, K. 1989. “Evaluating Text Quality: The Continuum from Text-Focused to Reader-Focused Methods.” IEEE Transactions on Professional Communication 32 (4):238–55. doi: 10.1109/47.44536.
54. Shute, V. J. 2008. “Focus on Formative Feedback.” Review of Educational Research 78 (1):153–89. doi: 10.3102/0034654307313795.
55. * Stellmack, M. A., N. K., Keenan, R. R., Sandidge, A. L., Sippl, and Y. L., Konheim-Kalkstein. 2012. “Review, Revise, and Resubmit: The Effects of Self-Critique, Peer Review, and Instructor Feedback on Student Writing.” Teaching of Psychology 39 (4):235–44. doi: 10.1177/0098628312456589.
56. Strijbos, J. W., S., Narciss, and K., Dünnebier. 2010. “Peer Feedback Content and Sender's Competence Level in Academic Writing Revision Tasks: Are They Critical for Feedback Perceptions and Efficiency?” Learning and Instruction 20 (4):291–303. doi: 10.1016/j.learninstruc.2009.08.008.
57. Strijbos, J. W., and D., Sluijsmans. 2010. “Unravelling Peer Assessment: Methodological, Functional, and Conceptual Developments.” Learning and Instruction 20 (4):265–9. doi: 10.1016/j.learninstruc.2009.08.002.
58. Topping, K. J. 1998. “Peer Assessment between Students in Colleges and Universities.” Review of Educational Research 68 (3):249–76. doi: 10.3102/00346543068003249.
59. Topping, K. J. 2009. “Peer Assessment.” Theory into Practice 48 (1):20–7. doi: 10.1080/00405840802577569.
60. Topping, K. J. 2010. “Methodological Quandaries in Studying Process and Outcomes in Peer Assessment.” Learning and Instruction 20 (4):339–43. doi: 10.1016/j.learninstruc.2009.08.003.
61. * Tsai, Y.-C., and M.-T., Chuang. 2013. “Fostering Revision of Argumentative Writing through Structured Peer Assessment.” Perceptual and Motor Skills 116 (1):210. doi: 10.2466/10.23.PMS.116.1.210-221.
62. van Gennip, N. A. E., M. S. R., Segers, and H. H., Tillema. 2009. “Peer Assessment for Learning from a Social Perspective: The Influence of Interpersonal Variables and Structural Features.” Educational Research Review 4 (1):41–54. doi: 10.1016/j.edurev.2008.11.002.
63. van Zundert, M., D., Sluijsmans, and J., van Merriënboer. 2010. “Effective Peer Assessment Processes: Research Findings and Future Directions.” Learning and Instruction 20 (4):270–9. doi: 10.1016/j.learninstruc.2009.08.004.
64. Viechtbauer, W. 2010. "Conducting Meta-Analyses in R with the Metafor Package.” Journal of Statistical Software 2010 36 (3):48. doi: 10.18637/jss.v036.i03.
65. Walker, J. P., and V., Sampson. 2013. “Argument-Driven Inquiry: Using the Laboratory to Improve Undergraduates' Science Writing Skills through Meaningful Science Writing, Peer-Review, and Revision.” Journal of Chemical Education 90 (10):1269–74. doi: 10.1021/ed300656p.
66. Wingate, U. 2010. “The Impact of Formative Feedback on the Development of Academic Writing.” Assessment & Evaluation in Higher Education 35 (5):519–33. doi: 10.1080/02602930903512909.
67. * Wong, H., and P., Storey. 2006. “Knowing and Doing in the ESL Writing Class.” Language Awareness 15 (4):283–300. doi: 10.2167/la365/0.
68. Wright, D. B. 2006. “Comparing Groups in a before–after Design: When t Test and ANCOVA Produce Different Results.” British Journal of Educational Psychology 76 (3):663–75. doi: 10.1348/000709905X52210.
69. * Xiao, Y., and R., Lucking. 2008. “The Impact of Two Types of Peer Assessment on Students' Performance and Satisfaction within a Wiki Environment.” Internet and Higher Education 11 (3-4):186–93. doi: 10.1016/j.iheduc.2008.06.005.
70. * Yang, M., R., Badger, and Z., Yu. 2006. “A Comparative Study of Peer and Teacher Feedback in a Chinese EFL Writing Class.” Journal of Second Language Writing 15 (3):179–200. doi: 10.1016/j.jslw.2006.09.004.
71. * Yang, Y. F., and W. T., Meng. 2013. “The Effects of Online Feedback Training on Students’ Text Revision.” Language Learning & Technology 17 (2):220–38.
72. * Yoshizawa, S., T., Terano, and A., Yoshikawa. 2012. “Assessing the Impact of Student Peer Review in Writing Instruction by Using the Normalized Compression Distance.” IEEE Transactions on Professional Communication 55 (1):85–96. doi: 10.1109/tpc.2011.2172833.