Peer assessment in the digital age: a meta-analysis comparing peer and teacher ratings

Assessment and Evaluation in Higher Education

Volumn 41, Issue 2, 2016, Pages 245-264

  Li, Hongli ^a   Xiong, Yao ^b   Zang, Xiaojiao ^b   Kornhaber, Mindy L ^b   Lyu, Youngsun ^b   Chung, Kyung Sun ^b   Suen, Hoi K ^b  

^a GEORGIA STATE UNIVERSITY   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

meta analysis; peer assessment

Indexed keywords

EID: 84955200360     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2014.999746     Document Type: Article

References (56)

1. J.*Avery, 2014. “Leveraging Crowdsourced Peer-to-peer Assessments to Enhance the Case Method of Learning.” Journal for Advancement of Marketing Education 22 (1): 1–15.
2. D.A.Belsley,, E.Kuh, and R.E.Welsch. 1980. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. New York: John Wiley.10.1002/0471725153
3. E.C.Berg, 1999. “The Effects of Trained Peer Response on ESL Students’ Revision Types and Writing Quality.” Journal of Second Language Writing 8 (3): 215–241.10.1016/S1060-3743(99)80115-5
4. S.Bloxham,, and A.West. 2004. “Understanding the Rules of the Game: Making Peer Assessment as a Medium for Developing Students’ Conceptions of Assessment.” Assessment & Evaluation in Higher Education 29 (6): 721–733.
5. M.Borenstein,, L.V.Hedges, J.Higgins, and H.R.Rothstein. 2009. Introduction to Meta-analysis. Chichester: John Wiley.10.1002/9780470743386
6. D.Boud, 2012. Developing Student Autonomy in Learning. 2nd ed. New York: Nichols Publishing Company.
7. L.*Bouzidi,, and A.Jaillet. 2009. “Can Online Peer Assessment Be Trusted?” Journal of Educational Technology & Society 12 (4): 257–268.
8. W.Burnett,, and G.Cavaye. 1980. “Peer Assessment by Fifth Year Students of Surgery.” Assessment in Higher Education 5 (3): 273–278.10.1080/0260293800050305
9. C.M.Cestone,, R.E.Levine, and D.R.Lane. 2008. “Peer Assessment and Evaluation in Team-based Learning.” New Directions for Teaching and Learning 2008 (116): 69–78.10.1002/tl.v2008:116
10. Y.C.*Chen,, and C.C.Tsai. 2009. “An Educational Research Course Facilitated by Online Peer Assessment.” Innovations in Education & Teaching International 46 (1): 105–117.
11. K.*Cho,, C.Schunn, and R.Wilson. 2006. “Validity and Reliability of Scaffolded Peer Assessment of Writing from Instructor and Student Perspectives.” Journal of Educational Psychology 98 (4): 891–901.10.1037/0022-0663.98.4.891
12. P.Davies, 2006. “Peer Assessment: Judging the Quality of Students’ Work by Comments rather than Marks.” Innovations in Education and Teaching International 43 (1): 69–82.10.1080/14703290500467566
13. P.Davies, 2009. “Review and Reward within the Computerised Peer-assessment of Essays.” Assessment & Evaluation in Higher Education 34 (3): 321–333.
14. N.Falchikov, 1995. “Peer Feedback Marking: Developing Peer Assessment.” Innovations in Education and Training International 32 (2): 175–187.10.1080/1355800950320212
15. N.Falchikov,, and D.Boud. 1989. “Student Self-assessment in Higher Education: A Meta-analysis.” Review of Educational Research 59 (4): 395–430.10.3102/00346543059004395
16. N.Falchikov,, and J.Goldfinch. 2000. “Student Peer Assessment in Higher Education: A Meta-analysis Comparing Peer and Teacher Marks.” Review of Educational Research 70 (3): 287–322.10.3102/00346543070003287
17. M.Fan, 2011. International Students’ Perceptions, Practices and Identities of Peer Assessment in the British University: A Case Study. Paper presented at the Internationalisation of Pedagogy and Curriculum in Higher Education Conference, Coventry. https://www.heacademy.ac.uk/node/3770
18. S.Gielen,, F.Dochy, and P.Onghena. 2011. “An Inventory of Peer Assessment Diversity.” Assessment & Evaluation in Higher Education 36 (2): 137–155.
19. G.V.Glass, 1977. “Integrating Findings: The Meta-analysis of Research.” Review of Research in Education 5: 351–379.
20. G.V.Glass, 2000. Meta-analysis at 25. http://www.gvglass.info/papers/meta25.html
21. J.*Hafner,, and P.Hafner. 2003. “Quantitative Analysis of the Rubric as an Assessment Tool: An Empirical Study of Student Peer-group Rating.” International Journal of Science Education 25 (12): 1509–1528.10.1080/0950069022000038268
22. S.J.Hanrahan,, and G.Isaacs. 2001. “Assessing Self- and Peer-assessment: The Students’ Views.” Higher Education Research & Development 20 (1): 53–70.
23. J.*Harris, 2011. “Peer Assessment in Large Undergraduate Classes: An Evaluation of a Procedure for Marking Laboratory Reports and a Review of Related Practices.” Advances in Physiology Education 35 (2): 178–187.
24. A.N.Joinson, 1999. “Social Desirability, Anonymity, and Internet-based Questionnaires.” Behavior Research Methods, Instruments and Computers 31 (3): 433–438.10.3758/BF03200723
25. J.S.Kane,, and E.E.Lawler. 1978. “Methods of Peer Assessment.” Psychological Bulletin 85 (3): 555–586.10.1037/0033-2909.85.3.555
26. R.A.*Kovach,, D.S.Resch, and S.J.Verhulst. 2009. “Peer Assessment of Professionalism: A Five-year Experience in Medical Clerkship.” Journal of General Internal Medicine 24 (6): 742–746.10.1007/s11606-009-0961-5
27. J.C.*Liang,, and C.C.Tsai. 2010. “Learning Through Science Writing via Online Peer Assessment in a College Biology Course.” The Internet and Higher Education 13 (4): 242–247.10.1016/j.iheduc.2010.04.004
28. S.S.J.*Lin,, E.X.F.Liu, and S.M.Yuan. 2001. “Web-based Peer Assessment: Feedback for Students with Various Thinking-styles.” Journal of Computer Assisted Learning 17 (4): 420–432.10.1046/j.0266-4909.2001.00198.x
29. N.F.Liu,, and D.Carless. 2006. “Peer Feedback: The Learning Element of Peer Assessment.” Teaching in Higher Education 11 (3): 279–290.10.1080/13562510600680582
30. E.Z.F.*Liu,, S.S.J.Lin, and S.-M.Yuan. 2002. “Alternatives to Instructor Assessment: A Case Study of Comparing Self and Peer Assessment with Instructor Assessment under a Networked Innovative Assessment Procedures.” International Journal of Instructional Media 29 (4): 395–404.
31. D.Magin, 2001. “Reciprocity as a Source of Bias in Multiple Peer Assessment of Group Work.” Studies in Higher Education 26 (1): 53–63.10.1080/03075070020030715
32. P.J.Miller, 2003. “The Effect of Scoring Criteria Specificity on Peer and Self-assessment.” Assessment & Evaluation in Higher Education 28 (4): 383–394.
33. D.D.Nulty, 2011. “Peer and Self-assessment in the First Year of University.” Assessment & Evaluation in Higher Education 36 (5): 493–507.
34. P.Orsmond,, S.Merry, and K.Reiling. 1996. “The Importance of Marking Criteria in the Use of Peer Assessment.” Assessment & Evaluation in Higher Education 21 (3): 239–250.
35. T.Panitz, 2003. “Faculty and Student Resistance to Cooperative Learning.” In Small Group Instruction in Higher Education: Lessons from the Past, Visions of the Future, edited by J.L.Cooper, P.Robinson, and D.Ball, 193–200. Stillwater, OK: New Forums Press.
36. K.Pond,, and R.UI-Haq, and W.Wade. 1995. “Peer Review: A Precursor to Peer Assessment.” Innovations in Education & Training International 32 (4): 314–323.
37. S.W.Raudenbush,, and A.S.Bryk. 1985. “Empirical Bayes Meta-analysis.” Journal of Educational Statistics 10 (2): 75–98.
38. S.W.Raudenbush,, and A.S.Bryk. 2002. Hierarchical Linear Models: Applications and Data Analysis Methods. 2nd ed. London: Sage.
39. S.W.Raudenbush,, A.S.Bryk, and R.Congdon. 2004. HLM 6 for Windows [Computer Software]. Lincolnwood, IL: Scientific Software International.
40. R.Rosenthal, 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86 (3): 638–641.10.1037/0033-2909.86.3.638
41. R.M.Sealey, 2013. “Peer Assessing in Higher Education: Perspectives of Studies and Staff.” Education Research and Perspectives 40: 276–298.
42. J.L.Senger,, and R.Kanthan. 2012. “Student Evaluations: Synchronous Tripod of Learning Portfolio Assessment – Self-assessment, Peer-assessment, Instructor-assessment.” Creative Education 3 (1): 155–163.10.4236/ce.2012.31025
43. D.Sharpe, 1997. “Of Apples and Oranges, File Drawers and Garbage: Why Validity Issues in Meta-analysis Will Not Go Away.” Clinical Psychology Review 17 (8): 881–901.10.1016/S0272-7358(97)00056-1
44. G.K.Sims, 1989. “Student Peer Review in the Classroom: A Teaching and Grading Tool.” Journal of Agronomic Education 8 (2): 105–108.
45. D.Sluijsmans,, S.Brand-Gruwel, J.J.van Merriënboer, and T.J.Bastiaens. 2002. “The Training of Peer Assessment Skills to Promote the Development of Reflection Skills in Teacher Education.” Studies in Educational Evaluation 29 (1): 23–42.10.1016/S0191-491X(03)90003-4
46. R.Speyer,, W.Pilz, J.Van Der Kruis, and J.Brunings. 2011. “Reliability and Validity of Student Peer Assessment in Medical Education: A Systematic Review.” Medical Teacher 33 (11): e572–e585.10.3109/0142159X.2011.610835
47. H.K.Suen, 2014. “Peer Assessment for Massive Open Online Courses (MOOCs).” The International Review of Research in Open and Distance Learning 15 (3): 312–327.
48. K.J.Topping, 1998. “Peer Assessment Between Students in Colleges and Universities.” Review of Educational Research 68 (3): 249–276.10.3102/00346543068003249
49. K.J.Topping, 2003. “Self and Peer Assessment in School and University: Reliability, Validity and Utility.” In Optimising New Modes of Assessment: In Search of Qualities and Standards, edited by M.S.R.Segers, F.J.R.C.Dochy, and E.C.Cascallar, 55–87. Dordrecht: Kluwer.10.1007/0-306-48125-1
50. K.J.Topping, 2005. “Trends in Peer Learning.” Educational Psychology 25 (6): 631–645.10.1080/01443410500345172
51. K.J.Topping, 2009. “Peer Assessment.” Theory into Practice 48 (1): 20–27.10.1080/00405840802577569
52. P.V.*Tsai, 2013. “Peering into Peer Assessment: An Investigation of the Reliability of Peer Assessment in MOOCs.” Unpublished Master thesis, Princeton University, Princeton, NJ.
53. I.van den Berg,, W.Admiraal, and A.Pilot. 2006. “Peer Assessment in University Teaching: Evaluating Seven Courses Designs.” Assessment & Evaluation in Higher Education 31 (1): 19–36.
54. N.van Gennip,, M.Segers, and H.Tillema. 2009. “Peer Assessment for Learning from a Social Perspective: The Influence of Interpersonal Variables and Structural Features.” Educational Research Review 4 (1): 41–54.10.1016/j.edurev.2008.11.002
55. M.L.*Wen,, and C.-C.Tsai. 2008. “Online Peer Assessment in an Inservice Science and Mathematics Teacher Education Course.” Teaching in Higher Education 13 (1): 55–67.10.1080/13562510701794050
56. R.F.Winch,, and R.B.W.Anderson. 1967. “Two Problems Involved in the Use of Peer-rating Scales and Some Observations on Kendall's Coefficient of Concordance.” Sociometry 30 (3): 316–322.10.2307/2786451