The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research

Frontiers in Psychology

Volumn 10, Issue , 2020, Pages

  Wisniewski, Benedikt ^a   Zierer, Klaus ^a   Hattie, John ^b  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

feedback; meta analysis; student achievement; student learning; teaching

Indexed keywords

EID: 85079073205     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2019.03087     Document Type: Review

References (67)

1. Azevedo R., Bernard R. M., (1995). A meta-analysis of the effects of feedback in computer-based instruction. J. Educ. Comput. Res. 13 111–127. 10.2190/9LMD-3U28-3A0G-FTQT
2. Bangert-Drowns R. L., Kulik C.-L. C., Kulik J. A., Morgan M., (1991). The instructional effect of feedback in test-like events. Rev. Educ. Res. 61 213–238. 10.3102/00346543061002213
3. Biber D., Nekrasova T., Horn B., (2011). The Effectiveness of feedback for L1-English and L2-writing development: a meta-analysis. ETS Res. Rep. Ser. 2011 1–99. 10.1002/j.2333-8504.2011.tb02241.x
4. Borenstein M., Hedges L. V., Higgins J. P. T., Rothstein H. R., (2009). Introduction to Meta-Analysis. Chichester, UK: John Wiley & Sons, Ltd, 10.1002/9780470743386 29218357
5. Borenstein M., Hedges L. V., Higgins J. P. T., Rothstein H. R., (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Res. Synth. Methods 1 97–111. 10.1002/jrsm.12 26061376
6. Brand A., Bradley M. T., (2012). More voodoo correlations: when average-based measures inflate correlations. J. Gen. Psychol. 139 260–272. 10.1080/00221309.2012.703711 24837177
7. Brooks C., Carroll A., Gillies R., (2019). A matrix of feedback. Aust. J. Teach. Educ. 44 14–32. 10.14221/ajte.2018v44n4.2
8. Brown D., (2016). The type and linguistic foci of oral corrective feedback in the L2 classroom: a meta-analysis. Lang. Teach. Res. 20 436–458. 10.1177/1362168814563200
9. Cheung M. W. L., Ho R. C., Lim Y., Mak A., (2012). Conducting a meta-analysis: basics and good practices. Int. J. Rheum. Dis. 15 129–135. 10.1111/j.1756-185X.2012.01712.x 22462415
10. Cohen J., (1988). Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Erlbaum.
11. Deeks J. J., Higgins J. P., Altman D. G., (2008). “Analysing data and undertaking meta-analyses,” in Cochrane Handbook for Systematic Reviews of Interventions, eds Higgins J. P., Green S., (London, UK: John Wiley & Sons Ltd), 243–296. 10.1002/9780470712184
12. Egger M., Davey Smith G., Schneider M., Minder C., (1997). Bias in meta-analysis detected by a simple, graphical test. Br. Med. J. 315 629–634. 10.1136/bmj.315.7109.629 9310563
13. Getsie R. L., Langer P., Glass G. V., (1985). Meta-analysis of the effects of type and combination of feedback on children’s discrimination learning. Rev. Educ. Res. 55 9–22. 10.3102/00346543055001009
14. Gleser L. J., Olkin I., (2009). “Stochastically dependent effect sizes,” in The handbook of Research Synthesis and Meta-Analysis, eds Cooper H., Hedges L. V., Valentine J. C., (New York, NY: Russell Sage Foundation), 357–376.
15. Graham S., Hebert M., Harris K. R., (2015). Formative assessment and writing. Elem. Sch. J. 115 523–547.
16. Hattie J., (2009). Visible Learning: A Synthesis of 800+ Meta-Analyses on Achievement. London: Routledge.
17. Hattie J., Clarke S., (2018). Visible Learning: Feedback. London: Routledge, 10.4324/9780429485480
18. Hattie J., Timperley H., (2007). The power of feedback. Rev. Educ. Res. 77 81–112. 10.3102/003465430298487
19. Hattie J., Zierer K., (2019). Visible Learning Insights. London: Routledge, 10.4324/9781351002226
20. Hedges L. V., Olkin I., (1985). Statistical Methods for Meta-Analysis. San Diego, CA: Academic Press.
21. Hedges L. V., Tipton E., Johnson M. C., (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Res. Synth. Methods 1 39–65. 10.1002/jrsm.5 26056092
22. Hedges L. V., Vevea J. L., (1998). Fixed-and random-effects models in meta-analysis. Psychol. Methods 3 486–504. 10.1037/1082-989x.3.4.486
23. Hunter J. E., Schmidt F. L., (2000). Fixed effects vs. random effects meta-analysis models: implications for cumulative research knowledge. Int. J. Sel. Assess. 8 275–292. 10.1111/1468-2389.00156
24. Kang E., Han Z., (2015). The efficacy of written corrective feedback in improving L2 written accuracy: a meta-analysis. Modern Lang. J. 99 1–18. 10.1111/modl.12189
25. Kluger A. N., DeNisi A., (1996). The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol. Bull. 119 254–284. 10.1037/0033-2909.119.2.254
26. Krippendorff K., (2004). Reliability in content analysis: some common misconceptions and recommendations. Hum. Commun. Res. 30 411–433. 10.1093/hcr/30.3.411
27. Kulik J. A., Kulik C.-L. C., (1988). Timing of feedback and verbal learning. Rev. Educ. Res. 58 79–97. 10.3102/00346543058001079
28. L’Hommedieu R., Menges R. J., Brinko K. T., (1990). Methodological explanations for the modest effects of feedback from student ratings. J. Educ. Psychol. 82 232–241. 10.1037/0022-0663.82.2.232
29. Li S., (2010). The effectiveness of corrective feedback in SLA: a meta-analysis. Lang. Learn. 60 309–365. 10.1111/j.1467-9922.2010.00561.x
30. Light R. J., Pillemer D. B., (1986). Summing Up: The Science of Reviewing Research. Cambridge, MA: Harvard University Press.
31. Lysakowski R. S., Walberg H. J., (1980). Classroom reinforcement. Eval. Educ. 4 115–116. 10.1016/0191-765x(80)90038-5
32. Lysakowski R. S., Walberg H. J., (1981). Classroom reinforcement and learning: a quantitative synthesis. J. Educ. Res. 75 69–77. 10.1080/00220671.1981.10885359
33. Lyster R., Saito K., (2010). Oral feedback in classroom SLA: a meta-analysis. Stud. Sec. Lang. Acquis. 32 265–302. 10.1017/S0272263109990520
34. Madsen C. K., Dorow L. G., Moore R. S., Womble J. U., (1976). Effect of music via television as reinforcement for correct mathematics. J. Res. Music Educ. 24 51–59. 10.2307/3344936
35. Madsen C. K., Moore R. S., Wagner M. J., Yarbrough C., (1975). A comparison of music as reinforcement for correct mathematical responses versus music as reinforcement for attentiveness. J. Music Ther. 12 84–95. 10.1093/jmt/12.2.84
36. Marsh H. W., (1987). Students’ evaluations of university teaching: research findings, methodological issues, and directions for future research. Int. J. Educ. Res. 11 253–388. 10.1016/0883-0355(87)90001-2
37. Menges R. J., Brinko K. T., (1986). “Effects of student evaluation feedback: a meta-analysis of higher education research,” in Paper Presented at 70th Annual Meeting of the American Educational Research Association, San Francisco, CA
38. Miller P. C., (2003). The Effectiveness of Corrective Feedback: A Meta-Analysis. Unpublished doctoral Dissertation, Purdue University, Lafayette, IN.
39. Miller P. C., Pan W., (2012). Recasts in the L2 classroom: a meta-analytic review. Int. J. Educ. Res. 56 48–59. 10.1016/j.ijer.2012.07.002
40. Moher D., Liberati A., Tetzlaff J., Altman D. G., (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann. Int. Med. 151 264–269. 10.1371/journal.pmed1000097
41. Morris S. B., DeShon R. P., (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol. Methods 7 105–125. 10.1037/1082-989x.7.1.105 11928886
42. Neubert M. J., (1998). The value of feedback and goal setting over goal setting alone and potential moderators of this effect: a meta-analysis. Hum. Perform. 11 321–335. 10.1207/s15327043hup1104_2
43. R Core Team (2017). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
44. Raudenbush S. W., Bryk A. S., (1985). Empirical bayes meta-analysis. J. Educ. Stat. 10 75–98. 10.3102/10769986010002075
45. Rummel A., Feinberg R., (1988). Cognitive evaluation theory: a meta-analytic review of the literature. Soc. Behav. Person. 16 147–164. 10.2224/sbp.1988.16.2.147 24138839
46. Russel J. R., Spada N., (2006). 4. The effectiveness of corrective feedback for the acquisition of L2 grammar. Lang. Learn. Lang. Teach. 13 133–164. 10.1075/lllt.13.09val
47. Rustenbach S. J., (2003). “Metaanalyse - Eine anwendungsorientierte Einführung [Metaanalysis - An application-oriented introduction],” in Methoden der Psychologie [Methods of Psychology], Vol. 16 ed. Pawlik K., (Bern: Huber).
48. Ryan R. M., Deci E. L., (2000). Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp. Educ. Psychol. 25 54–67. 10.1006/ceps.1999.1020 10620381
49. Sadler D. R., (1989). Formative assessment and the design of instructional systems. Instr. Sci. 18 119–144. Instr. Sci. 18 119–144. 10.1007/bf00117714
50. Schimmel B. J., (1983). “A meta-analysis of feedback to learners in computerized and programmed instruction,” in Paper Presented at the Annual Meeting of the American Educational Research Association Montreal, Canada.
51. Shadish W. R., Haddock C. K., (1994). “Combining estimates of effect size,” in The Handbook of Research Synthesis, eds Cooper H., Hedges L. V., (New York, NY: Russell Sage Foundation), 261–281.
52. Sidik K., Jonkman J. N., (2006). Robust variance estimation for random effects meta-analysis. Comput. Stat. Data Anal. 50 3681–3701. 10.1016/j.csda.2005.07.019
53. Slavin R. E., (2008). Perspectives on evidence-based research in education—what works? Issues in synthesizing educational program evaluations. Educ. Res. 37 5–14. 10.3102/0013189x08314117
54. Standley J. M., (1996). A meta-analysis on the effects of music as reinforcement for education/therapy objectives. J. Res. Music Educ. 44 105–133. 10.2307/3345665
55. Swanson H. L., Lussier C. M., (2001). A selective synthesis of the experimental literature on dynamic assessment. Rev. Educ. Res. 71 321–363. 10.3102/00346543071002321
56. Tenenbaum G., Goldring E., (1989). A meta-analysis of the effect of enhanced instruction: cues, participation, reinforcement and feedback and correctives on motor skill learning. J. Res. Dev. Educ. 22 53–64.
57. Travlos A. K., Pratt J., (1995). Temporal locus of knowledge of results: a meta-analytic review. Percept. Mot. Skills 80 3–14. 10.2466/pms.1995.80.1.3 7624211
58. Truscott J., (2007). The effect of error correction on learners’ ability to write accurately. J. Sec. Lang. Writ. 16 255–272. 10.1016/j.jslw.2007.06.003
59. Uttl B., White C. A., Gonzalez D. W., (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Stud. Educ. Eval. 54 22–42. 10.1016/j.stueduc.2016.08.007
60. vana der Kleij F. M., Feskens R. C., Eggen T. J., (2015). Effects of feedback in a computer-based learning environment on students’ learning outcomes: a meta-analysis. Rev. Educ. Res. 85 475–511. 10.3102/0034654314564881
61. Viechtbauer W., (2007). Accounting for heterogeneity via random-effects models and moderator analyses in meta-analysis. Zeitschrift für Psychologie/J. Psychol. 215 104–121. 10.1027/0044-3409.215.2.104
62. Walberg H. J., (1982). What makes schooling effective? Contemp. Educ. Rev. 1 1–34.
63. Wecker C., Vogel F., Hetmanek A., (2017). Visionär und imposant–aber auch belastbar?. [Visionary and impressive – but also reliable?]. Zeitschrift für Erziehungswissenschaft 20 21–40. 10.1007/s11618-016-0696-0
64. Wiersma U. J., (1992). The effects of extrinsic rewards in intrinsic motivation: a meta-analysis. J. Occup. Organ. Psychol. 65 101–114. 10.1111/j.2044-8325.1992.tb00488.x
65. Wilkinson S. S., (1981). The relationship of teacher praise and student achievement: a meta-analysis of selected research. Diss. Abstr. Int. 41:3998A.
66. Witt P. L., Wheeless L. R., Allen M., (2004). A meta-analytical review of the relationship between teacher immediacy and student learning. Commun. Monogr. 71 184–207. 10.1080/036452042000228054
67. Yeany R. H., Miller P., (1983). Effects of diagnostic/remedial instruction on science learning: a meta analysis. J. Res. Sci. Teach. 20 19–26. 10.1002/tea.3660200103