Self-grading and peer-grading for formative and summative assessments in 3rd through 12th grade classrooms: A meta-analysis

Journal of Educational Psychology

Volumn 109, Issue 8, 2017, Pages 1049-1066

  Sanchez, Carmen E ^a   Atkinson, Kayla M ^a,b   Koenka, Alison C ^a,c   Moshontz, Hannah ^a   Cooper, Harris ^a  

^a DUKE UNIVERSITY   (United States)

^b University of Southern Florida   (United States)

^c OHIO STATE UNIVERSITY   (United States)

Author keywords

Meta analysis; Peer grading; Primary and secondary education; Self grading; Student grading

Indexed keywords

EID: 85014999807     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/edu0000190     Document Type: Article

References (101)

1. Aitchison, R. E. (1995). The effects of self-evaluation techniques on the musical performance, self-evaluation accuracy, motivation, and selfesteem of middle school instrumental music students. Iowa City, Iowa: University of Iowa.
2. *Andrade, H. G., & Boulay, B. A. (2003). Role of rubric-referenced self-assessment in learning to write. The Journal of Educational Research, 97, 21-30. http://dx.doi.org/10.1080/00220670309596625
3. Andrade, H., & Du, Y. (2007). Student responses to criteria-referenced self-assessment. Assessment & Evaluation in Higher Education, 32, 159-181. http://dx.doi.org/10.1080/02602930600801928
4. Andrade, H., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced selfassessment on elementary school students' writing. Educational Measurement: Issues and Practice, 27, 3-13. http://dx.doi.org/10.1111/j .1745-3992.2008.00118.x
5. Andrade, H., & Valtcheva, A. (2009). Promoting learning and achievement through self-assessment. Theory Into Practice, 48, 12-19. http://dx.doi .org/10.1080/00405840802577544
6. APA Publications and Communications Working Group on Quantitative Research Reporting Standards. (2016). Journal article reporting standards for quantitative research in psychology-once again. Manuscript under review.
7. Atkinson, K. M., Sanchez, C. E., Koenka, A. C., Moshontz, H., & Cooper, H. (2016). Who makes the grade? A synthesis of research comparing self, peer and instructor grades in college classrooms. Manuscript submitted for publication.
8. Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213-238. http://dx.doi.org/10.3102/ 00346543061002213
9. Barnett, V., & Lewis, T. (1994). Outliers in statistical data (Vol. 3). New York, NY: Wiley.
10. Beach, R. (1979). The effects of between-draft teacher evaluation versus student self-evaluation on high school student's revising of rough drafts. Research in the Teaching of English, 13, 111-119.
11. Berger, R., Rugen, L., & Woodfin, L. (2014). Leaders of their own learning: Transforming schools through student-engaged assessment. Hoboken, NJ: Wiley.
12. Bickmore, D. K. (1981). The effects of student self-evaluation and pupilteacher conferences on student perceptions, self concepts, and learning. Provo, UT: Department of Secondary Education and Foundations, Brigham Young University.
13. Bonniol, J. J. (1981). Influence de l'explicitation des critères utilisés sur le fonctionnement des mécanimes d'évaluation d'une production scolaire [Influence of the exploitation of the criteria used on the mechanisms of a scholastic evaluation]. Bulletin de Psychologie, 353, 173-186.
14. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2014). Comprehensive meta-analysis (version 3.0 and Version 3.3.070). Englewood, NJ: Biostat.
15. Boud, D. (1991). Implementing student self-assessment. Hammondville, New South Wales: Higher Education Research and Development Society of Australasia.
16. Brookhart, S. M. (1997). A theoretical framework for the role of classroom assessment in motivating student effort and achievement. Applied Measurement in Education, 10, 161-180. http://dx.doi.org/10.1207/ s15324818ame1002_4
17. Brown, G. T., & Harris, L. R. (2013). Student self-assessment. Thousand Oaks, CA: Sage. http://dx.doi.org/10.4135/9781452218649.n21
18. Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65, 245-281. http://dx.doi.org/10.3102/00346543065003245
19. Butler, Y. G., & Lee, J. (2010). The effects of self-assessment among young learners of English. Language Testing, 27, 5-31. http://dx.doi .org/10.1177/0265532209346370
20. Califano, L. Z. (1987). Teacher and peer editing: Their effects on students' writing as measured by t-unit length, holistic scoring, and the attitudes of fifth and sixth grade students. Flagstaff, AZ: Northern Arizona University.
21. **Chang, C.-C., Tseng, K.-H., & Lou, S.-J. (2012). A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a web-based portfolio assessment environment for high school students. Computers & Education, 58, 303-320. http://dx.doi.org/10.1016/j.compedu.2011.08.005
22. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Routledge.
23. Crocker, A., & Cheeseman, R. (1988). The ability of young children to rank themselves for academic ability. Educational Studies, 14, 105-110.
24. Davis, L. M. (1981). The effects of structured singing activities and self-evaluation practice on elementary band students' instrumental music performance, melodic tonal imagery, self-evaluation, and attitude. Columbus, OH: The Ohio State University.
25. Dochy, F., Segers, M., & Sluijsmans, D. (1999). The use of self-, peer and co-assessment in higher education: A review. Studies in Higher Education, 24, 331-350. http://dx.doi.org/10.1080/03075079912331379935
26. Dunning, D., Heath, C., & Suls, J. M. (2004). Flawed self-assessment: implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69-106. http://dx.doi.org/10.1111/j .1529-1006.2004.00018.x
27. Duval, S., & Tweedie, R. (2000a). A nonparametric "trim and fill" method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89-98.
28. Duval, S., & Tweedie, R. (2000b). Trim and fill: A simple funnel-plotbased method of testing and adjusting for publication bias in metaanalysis. Biometrics, 56, 455-463. http://dx.doi.org/10.1111/j.0006- 341X.2000.00455.x
29. Dweck, C. S. (1986). Motivational processes affecting learning. American Psychologist, 41, 1040-1048. http://dx.doi.org/10.1037/0003-066X.41 .10.1040
30. Evans, E. D., & Engelberg, R. A. (1988). Student perceptions of school grading. Journal of Research & Development in Education, 21, 45-54.
31. Falchikov, N., & Boud, D. (1989). Student self-assessment in higher education: A meta-analysis. Review of Educational Research, 59, 395- 430. http://dx.doi.org/10.3102/00346543059004395
32. Falchikov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70, 287-322. http://dx.doi.org/10.3102/ 00346543070003287
33. Farrell, K. J. (1977). A comparison of three instructional approaches for teaching written composition to high school juniors: Teacher lecture, peer evaluation, and group tutoring. Boston, MA: Boston University.
34. Fitzgerald, J., & Markham, L. R. (1987). Teaching children about revision in writing. Cognition and Instruction, 4, 3-24. http://dx.doi.org/10.1207/ s1532690xci0401_1
35. Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive- developmental inquiry. American Psychologist, 34, 906- 911. http://dx.doi.org/10.1037/0003-066X.34.10.906
36. *Fontana, D., & Fernandes, M. (1994). Improvements in mathematics performance as a consequence of self-assessment in Portuguese primary school pupils. British Journal of Educational Psychology, 64, 407-417. http://dx.doi.org/10.1111/j.2044-8279.1994.tb01112.x
37. Goodrich, H. (1996). Student self-assessment: At the intersection of metacognition and authentic assessment. Cambridge, MA: Harvard Graduate School of Education.
38. Graham, S., Harris, K., & Hebert, M. (2011). Informing writing: The benefits of formative assessment. A report from Carnegie Corporation of New York. New York, NY: Carnegie Corporation of New York.
39. Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment and writing. The Elementary School Journal, 115, 523-547. http://dx.doi .org/10.1086/681947
40. Grubbs, F. E. (1950). Sample criteria for testing outlying observations. Annals of Mathematical Statistics, 21, 27-58. http://dx.doi.org/10.1214/ aoms/1177729885
41. *Guastello, E. F. (2001). Parents as partners: Improving children's writing. In W. M. Linek, E. G. Sturtevant, J. A. R. Dugan, & P. E. Linder (Eds.), Celebrating the voices of literacy: Yearbook of the College Reading Association (pp. 279-295). Readyville, TN: College Reading Association.
42. Hedges, L., & Olkin, I. (1985). Statistical models for meta-analysis. New York, NY: Academic Press.
43. Hedges, L. V., & Rhoads, C. H. (2011). Correcting an analysis of variance for clustering. British Journal of Mathematical and Statistical Psychology, 64, 20-37. http://dx.doi.org/10.1111/j.2044-8317.2010.02005.x
44. Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39-65. http://dx.doi.org/10.1002/jrsm.5
45. Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539-1558. http://dx.doi.org/ 10.1002/sim.1186
46. Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ: British Medical Journal, 327, 557-560. http://dx.doi.org/10.1136/bmj.327.7414.557
47. Hodgson, C. (2010). Assessment for learning in science: What works? Primary Science, 115, 14-16.
48. *Horn, G. C. (2009). Rubrics and revision: What are the effects of 3rd graders using rubrics to self-assess or peer-assess drafts of writing? Boise, ID: Boise State University.
49. Hovardas, T., Tsivitanidou, O. E., & Zacharia, Z. C. (2014). Peer versus expert feedback: An investigation of the quality of peer feedback among secondary school students. Computers & Education, 71, 133-152.
50. Ikeguchi, C. B. (1996). Self Assessment and ESL Competence of Japanese Returnees. Tsukuba Women's University, Tsukuba, Japan. Retrieved from http://files.eric.ed.gov/fulltext/ED399798.pdf
51. Irwin, J. L. (1973). An investigation of the effects of student self-evaluation and marking on achievement of cognitive and affective objectives of a basic mechanical drawing course. State College, PA: Pennsylvania State University.
52. *Karegianes, M. L., Pascarella, E. T., & Pflaum, S. W. (1980). The effects of peer editing on the writing proficiency of low-achieving tenth grade students. The Journal of Educational Research, 73, 203-207. http://dx .doi.org/10.1080/00220671.1980.10885236
53. Klenowski, V. (1995). Student self-evaluation processes in student-centred teaching and learning contexts of Australia and England. Assessment in Education: Principles, Policy & Practice, 2, 145-163. http://dx.doi.org/ 10.1080/0969594950020203
54. Koivula, N., Hassmén, P., & Hunt, D. P. (2001). Performance on the Swedish Scholastic Aptitude Test: Effects of self-assessment and gender. Sex Roles, 44, 629 - 645. http://dx.doi.org/10.1023/A:1012 203412708
55. **Kruse, N. B. (2006). The effect of instruction on sixth grade band students' abilities to self-rate etude performance. East Lansing, MI: Michigan State University.
56. Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A metaanalysis and review of the literature. Review of Educational Research, 75, 63-82. http://dx.doi.org/10.3102/00346543075001063
57. Lane, S. (2012). Performance assessment. In J. McMillan (Ed.), Sage handbook of research on classroom assessment (pp. 313-330). Thousand Oaks, CA: Sage.
58. **Lin, S. S., Liu, E. Z., & Yuan, S. (2002). Student attitudes toward networked peer assessment: Case studies of undergraduate students and senior high school students. International Journal of Instructional Media, 29, 241-254.
59. *Maqsud, M., & Pillai, C. M. (1991). Effect of self-scoring on subsequent performances in academic achievement tests. Educational Research, 33, 151-154. http://dx.doi.org/10.1080/0013188910330208
60. *McDonald, B., & Boud, D. (2003). The impact of self-assessment on achievement: The effects of self-assessment training on performance in external examinations. Assessment in Education: Principles, Policy & Practice, 10, 209 -220. http://dx.doi.org/10.1080/0969594032000 121289
61. Nicholls, J. G., Patashnick, M., & Mettetal, G. (1986). Conceptions of ability and intelligence. Child Development, 57, 636-645. http://dx.doi .org/10.2307/1130342
62. *Olina, Z., & Sullivan, H. J. (2004). Student self-evaluation, teacher evaluation, and learner performance. Educational Technology Research and Development, 52, 5-22. http://dx.doi.org/10.1007/BF02504672
63. Paquette, K. R. (2008). Integrating the 6 + 1 writing traits model with cross-age tutoring: An investigation of elementary students' writing development. Literacy Research and Instruction, 48, 28-38. http://dx .doi.org/10.1080/19388070802226261
64. *Pierson, H. (1967). Peer and teacher correction: A comparison of the effects of two methods of teaching composition in grade nine English classes. New York, NY: New York University.
65. *Poplin, B. D. (2009). Effects of student self-corrective measures on learning and standardized test scores. Lynchburg, VA: Liberty University.
66. *Ramdass, D., & Zimmerman, B. J. (2008). Effects of self-correction strategy training on middle school students' self-efficacy, selfevaluation, and mathematics division learning. Journal of Advanced Academics, 20, 18-41.
67. Rosenthal, R. (1987). Judgment studies: Design, analysis, and metaanalysis. New York, NY: Cambridge University Press. http://dx.doi.org/ 10.1017/CBO9780511527807
68. Ross, J. A. (2006). The reliability, validity, and utility of self-assessment. Practical Assessment, Research & Evaluation, 11, 1-13.
69. *Ross, J. A., Hogaboam-Gray, A., & Rolheiser, C. (2001). Self-evaluation in grade 11 mathematics: Effects on achievement and student beliefs about ability. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
70. *Ross, J. A., Hogaboam-Gray, A., & Rolheiser, C. (2002). Student selfevaluation in grade 5- 6 mathematics effects on problem-solving achievement. Educational Assessment, 8, 43-58. http://dx.doi.org/10 .1207/S15326977EA0801_03
71. *Ross, J. A., Rolheiser, C., & Hoaboam-Gray, A. (1998). Impact of self-evaluation training on mathematics achievement in cooperative learning environment. Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, CA.
72. *Ross, J. A., Rolheiser, C., & Hogaboam-Gray, A. (1999). Effects of self-evaluation training on narrative writing. Assessing Writing, 6, 107- 132. http://dx.doi.org/10.1016/S1075-2935(99)00003-3
73. *Ross, J. A., & Starling, M. (2008). Self-assessment in a technologysupported environment: The case of grade 9 geography. Assessment in Education: Principles, Policy & Practice, 15, 183-199. http://dx.doi .org/10.1080/09695940802164218
74. Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68 -78. http://dx.doi.org/10.1037/0003- 066X.55.1.68
75. */**Sadler, P. M., & Good, E. (2006). The impact of self-and peer-grading on student learning. Educational Assessment, 11, 1-31. http://dx.doi.org/ 10.1207/s15326977ea1101_1
76. *Schunk, D. H. (1996). Goal and self-evaluative influences during children's cognitive skill learning. American Educational Research Journal, 33, 359-382. http://dx.doi.org/10.3102/00028312033002359
77. Sebba, J., Crick, R., Yu, G., Lawson, H., Harlen, W., & Durant, K. (2008). Systematic review of research evidence of the impact on students in secondary schools of self and peer assessment. I. Research Evidence in Education Library series. London, UK: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. Retrieved from http://eppi.ioe.ac.uk/cms/Default.aspx
78. Stipek, D. J. (1981). Children's perceptions of their own and their classmates' ability. Journal of Educational Psychology, 73, 404-410. http:// dx.doi.org/10.1037/0022-0663.73.3.404
79. Stipek, D. J., & Tannatt, L. M. (1984). Children's judgments of their own and their peers' academic competence. Journal of Educational Psychology, 76, 75-84. http://dx.doi.org/10.1037/0022-0663.76.1.75
80. **Sung, Y.-T., Chang, K.-E., Chang, T.-H., & Yu, W.-C. (2010). How many heads are better than one? The reliability and validity of teenagers' self- and peer assessments. Journal of Adolescence, 33, 135-145. http:// dx.doi.org/10.1016/j.adolescence.2009.04.004
81. **Sung, Y.-T., Chang, K.-E., Chiou, S.-K., & Hou, H.-T. (2005). The design and application of a web-based self-and peer-assessment system. Computers & Education, 45, 187-202. http://dx.doi.org/10.1016/j .compedu.2004.07.002
82. Tanner-Smith, E. E., & Tipton, E. (2014). Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS. Research Synthesis Methods, 5, 13-30. http://dx.doi.org/10.1002/jrsm.1091
83. Tanner-Smith, E. E., Tipton, E., & Polanin, J. R. (2016). Handling complex meta-analytic data structures using robust variance estimates: A tutorial in R. Journal of Developmental and Life-Course Criminology, 2, 85- 112.
84. R Core Team. (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/
85. Tillema, H., Leenknecht, M., & Segers, M. (2011). Assessing assessment quality: Criteria for quality assurance in design of (peer) assessment for learning-a review of research studies. Studies in Educational Evaluation, 37, 25-34. http://dx.doi.org/10.1016/j.stueduc.2011.03.004
86. Tipton, E. (2015). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods, 20, 375-393. http://dx .doi.org/10.1037/met0000011
87. Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68, 249-276. http://dx.doi .org/10.3102/00346543068003249
88. Topping, K. (2003). Self and peer assessment in school and university: Reliability, validity and utility. In M. Segers, F. J. R. C. Dochy, & E. Cascalla (Eds.), Optimising new modes of assessment: In search of qualities and standards (pp. 55-87). New York, NY: Springer.
89. Topping, K. (2009). Peer assessment. Theory Into Practice, 48, 20-27. http://dx.doi.org/10.1080/00405840802577569
90. Topping, K. (Ed.). (2013). Peers as a source of formative and summative assessment. Thousand Oaks, CA: Sage. http://dx.doi.org/10.4135/ 9781452218649.n22
91. **Tseng, S.-C., & Tsai, C.-C. (2007). On-line peer assessment and the role of the peer feedback: A study of high school computer course. Computers & Education, 49, 1161-1174. http://dx.doi.org/10.1016/j.compedu .2006.01.007
92. van Gennip, N. A., Segers, M. S., & Tillema, H. H. (2009). Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features. Educational Research Review, 4, 41-54. http://dx.doi.org/10.1016/j.edurev.2008.11.002
93. van Kraayenoord, C. E., & Paris, S. G. (1997). Australian students' self-appraisal of their work samples and academic progress. The Elementary School Journal, 97, 523-537. http://dx.doi.org/10.1086/461879
94. van Zundert, M., Sluijsmans, D., & van Merriënboer, J. (2010). Effective peer assessment processes: Research findings and future directions. Learning and Instruction, 20, 270 -279. http://dx.doi.org/10.1016/j .learninstruc.2009.08.004
95. *Wall, S. M. (1982). Effects of systematic self-monitoring and selfreinforcement in children's management of test performances. The Journal of Psychology: Interdisciplinary and Applied, 111, 129-136. http:// dx.doi.org/10.1080/00223980.1982.9923524
96. Wang, M. C., Haertel, G. D., & Walberg, H. J. (1990). What influences learning? A content analysis of review literature. The Journal of Educational Research, 84, 30-43. http://dx.doi.org/10.1080/00220671.1990 .10885988
97. *Warner, Z. B., Chen, F., & Andrade, H. (2012). Student Self-Assessment in Middle School Mathematics: A Pilot Study. Proceedings of the Northeastern Educational Research Association Conference 2012, 5. Retrieved from http://digitalcommons.uconn.edu/nera_2012/5
98. Wilson, D. (2001). Effect size determination program. College Park, MD: University of Maryland.
99. Wise, W. G. (1992). The effects of revision instruction on eighth graders' persuasive writing (Unpublished doctoral dissertation). College Park, MD: University of Maryland.
100. Wright, C. R., & Houck, J. W. (1995). Gender Differences among selfassessments, teacher ratings, grades, and aptitude test scores for a sample of students attending rural secondary schools. Educational and Psychological Measurement, 55, 743-752.
101. Wolter, D. R. (1975). Effect of feedback on performance on a creative writing task (Unpublished doctoral dissertation). Ann Arbor, MI: University of Michigan.