Effects of the Attributes of Educational Interventions on Students’ Academic Performance: A Meta-Analysis

Review of Educational Research

Volumn 84, Issue 4, 2014, Pages 509-545

  de Boer, Hester ^a   Donker, Anouk S ^a   van der Werf, Margaretha P C ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

academic performance; attributes of educational interventions and their effect studies; learning strategy instruction; meta analysis; moderator analysis

Indexed keywords

EID: 84908514076     PISSN: 00346543     EISSN: 19351046     Source Type: Journal    
DOI: 10.3102/0034654314540006     Document Type: Article

References (92)

1. Abrami P. C.,Poulsen C.,Chambers B.Teacher motivation to implement an educational innovation: Factors differentiating users and non-users of cooperative learning.Educational Psychology. 2004;24:201-216
2. Aleven A. W.M. M.,Koedinger K. R.An effective metacognitive strategy: Learning by doing and explaining with a computer-based cognitive tutor.Cognitive Science: A Multidisciplinary Journal. 2002;26:147-179
3. *Allen K. D.,Hancock T. E.Reading comprehension improvement with individualized cognitive profiles and metacognition.Literacy Research and Instruction. 2008;47:124-139
4. Bangert-Drowns R. L.,Hurley M. M.,Wilkinson B.The effects of school-based writing-to-learn interventions on academic achievement: A meta-analysis.Review of Educational Research. 2004;74:29-58
5. *Blank L. M.A metacognitive learning cycle: A better warranty for student understanding?.Science Education. 2000;84:486-506
6. Boekaerts M.Self-regulated learning: A new concept embraced by researchers, policy makers, educators, teachers, and students.Learning and Instruction. 1997;7:161-186
7. Boekaerts M.,Pintrich P. R.,Zeidner M.Handbook of self-regulation. San Diego, CA: Academic Press; 2000:
8. Borenstein M.,Hedges L. V.,Higgins J. P. T.,Rothstein H. R.Introduction to meta-analysis. Chichester, England: Wiley; 2009:
9. *Boulware-Gooden R.,Carreker S.,Thornhill A.,Malatesha J. R.Instruction of metacognitive strategies enhances reading comprehension and vocabulary achievement of third-grade students.The Reading Teacher. 2007;61:70-77
10. *Bruce M. E.,Robinson G. L..Paper presented at the Annual European Conference on Reading; 2001Dublin, Ireland; 2001.
11. Brunstein J. C.,Glaser C.Testing a path-analytical mediation model of how self-regulated writing skills improve fourth-graders’ composition skills: A randomized controlled trial.Journal of Educational Psychology. 2011;103:922-938
12. Camahalan F. M. G.Effects of self-regulated learning on mathematics achievement of selected Southeast Asian children.Journal of Instructional Psychology. 2006;33:194-205
13. *Cantrell S. C.,Almasi J. F.,Carter J. C.,Rintamaa M.,Madden A.The impact of a strategy-based intervention on the comprehension and strategy use of struggling adolescent readers.Journal of Educational Psychology. 2010;102:257-280
14. Chiu C. W. T..Paper presented at the annual meeting of the American Educational Research Association; 1998San Diego, CA; 1998.
15. Cohen J.Statistical power analysis for the behavioral sciences. 1988. Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.Hillsdale, NJ: Lawrence Erlbaum; 1988:
16. Creemers B. P. M.The effective classroom. London, England: Cassell; 1994:
17. Creemers B. P. M.,van der Werf M. P. C.Economic viewpoints in educational effectiveness: Cost-effectiveness analysis of an educational improvement project.School Effectiveness and School Improvement. 2000;11:361-384
18. Datnow A.,Castellano M.Teachers’ responses to success for all: How beliefs, experiences and adaptations shape implementation.American Educational Research Journal. 2000;37:775-799
19. Datnow A.,Stringfield S.Working together for reliable school reform.Journal of Education for Students Placed at Risk. 2000;5:183-204
20. De Acedo Lizarraga M. L. S.,de Acedo Baquedano M. T. S.,Oliver M. S.Stimulation of thinking skills in high school students.Educational Studies. 2010;36:329-340
21. *Dejonckheere P.,Van de Keere K.,Tallir I.Are fourth and fifth grade children better scientists through metacognitive learning?.Electronic Journal of Research in Educational Psychology. 2011;9:133-156
22. Dignath C.,Büttner G.Components of fostering self-regulated learning among students: A meta-analysis on intervention studies at primary and secondary school level.Metacognition Learning. 2008;3:231-264
23. Donker A. S.,de Boer H.,Kostons D.,Dignath-van Ewijk C. C.,van der Werf M. P. C.Effectiveness of learning strategy instruction on academic performance: A meta-analysis.Educational Research Review. 2014;11:1-26
24. *Dresel M.,Haugwitz M.A computer-based approach to fostering motivation and self-regulated learning.Journal of Experimental Education. 2008;77:3-18
25. Dynarski M.,Agodini R.,Heaviside S.,Novak T.,Carey N.,Campuzano L.,.. Sussex W.Effectiveness of reading and mathematics software products: Findings from the first student cohort. Washington, DC: U.S. Department of Education, Institute of Education Sciences; 2007:
26. *Erktin E.Teaching thinking for mathematics through the enhancement of metacognitive skills.Research in the Schools. 2004;11:3-13
27. *García-Sánchez J. N.,Fidalgo-Redondo R.Effects of two types of self-regulatory instruction programs on students learning disabilities in writing products, processes, and self-efficacy.Learning Disability Quarterly. 2006;29:181-211
28. *Glaser C.,Brunstein J. C.Improving fourth-grade students’ composition skills: Effects of strategy instruction and self-regulation procedures.Journal of Educational Psychology. 2007;99:297-310
29. *Graham S.,Harris K. R.,Mason L.Improving the writing performance, knowledge, and self-efficacy of struggling young writers: The effects of self-regulated strategy development.Contemporary Educational Psychology. 2005;30:207-241
30. Guskey T. R.Closing achievement gaps: Revisiting Benjamin S. Bloom’s “learning for mastery.”.Journal of Advanced Academics. 2007;19:8-31
31. Guskey T. R.,Pigott T. D.Research on group-based mastery learning programs: A meta-analysis.Journal of Educational Research. 1988;81:197-216
32. *Guterman E.Integrating written metacognitive awareness guidance as a “psychological tool” to improve student performance.Learning and Instruction. 2003;13:633-651
33. *Harris K. R.,Graham S.,Mason L. H.Improving the writing, knowledge, and motivation of struggling young writers: Effects of self-regulated strategy development with and without peer support.American Educational Research Journal. 2006;43:295-340
34. Hattie J.,Biggs J.,Purdie N.Effects of learning skills interventions on student learning: A meta-analysis.Review of Educational Research. 1996;66:99-136
35. *Hauptman H.,Cohen A.The synergetic effect of learning styles on the interaction between virtual environments and the enhancement of spatial thinking.Computers & Education. 2011;57:2106-2117
36. Hedges L. V.,Olkin I.Statistical methods for meta-analysis. San Diego, CA: Academic Press; 1985:
37. *Huff J. D.,Nietfeld J. L.Using strategy instruction and confidence judgments to improve metacognitive monitoring.Metacognition and Learning. 2009;4:161-176
38. *Jacobse A. E.,Harskamp E.Student-controlled metacognitive training for solving word problems in primary school mathematics.Educational Research and Evaluation. 2009;15:447-463
39. *Kaniel S.,Licht P.,Peled B.The influence of metacognitive instruction of reading and writing strategies on positive transfer.Gifted Education International. 2000;51:45-63
40. *Kapa E.A metacognitive support during the process of problem solving in a computerized environment.Educational Studies in Mathematics. 2001;47:317-336
41. *Kapa E.Transfer from structured to open-ended problem solving in a computerized metacognitive environment.Learning and Instruction. 2007;17:688-707
42. *Kim H. J.,Pedersen S.Advancing young adolescents’ hypothesis-development performance in a computer-supported and problem-based learning environment.Computers and Education. 2011;57:1780-1789
43. *Kramarski B.,Dudai V.Group-metacognitive support for online inquiry in mathematics with differential self-questioning.Journal of Educational Computer Research. 2009;40:377-404
44. *Kramarski B.,Gutman M.How can self-regulated learning be supported in mathematical e-learning environments?.Journal of Computer Assisted Learning. 2006;22:24-33
45. *Kramarski B.,Hirsch C.Effects of computer algebra system (CAS) with metacognitive training on mathematical reasoning.Educational Media International. 2003;40:249-257
46. *Kramarski B.,Mevarech Z. R.Enhancing mathematical reasoning in classroom: The effects of cooperative learning and the metacognitive training.American Educational Research Journal. 2003;40:281-310
47. *Kramarski B.,Mevarech Z. R.,Arami M.The effects of metacognitive instruction on solving mathematical authentic tasks.Educational Studies in Mathematics. 2002;49:225-250
48. *Kramarski B.,Mevarech Z. R.,Lieberman A.Effects of multilevel versus unilevel metacognitive training on mathematical reasoning.Journal of Educational Research. 2001;94:292-300
49. *Kramarski B.,Mizrachi N.Online discussion and self-regulated learning: Effects of instructional methods on mathematical literacy.Journal of Educational Research. 2006;99:218-230
50. *Kramarski B.,Ritkof R.The effects of metacognition and email interactions on learning graphing.Journal of Computer Assisted Learning. 2002;18:33-43
51. *Kramarski B.,Zoldan S.Using errors as springboards for enhancing mathematical reasoning with three metacognitive approaches.Journal of Educational Research. 2008;102:137-151
52. Lewis M..Paper presented at the annual meeting of the Southwest Educational Research Association; 2007San Antonio, TX; 2007.
53. Lipsey M. W.,Wilson D. B.Practical meta-analysis. Thousand Oaks, CA: Sage; 2001:
54. *Lubliner S.,Smetana L.The effects of comprehensive vocabulary instruction on Title I students’ metacognitive word-learning skills and reading comprehension.Journal of Literacy Research. 2005;37:163-200
55. *Mason L. H.Explicit self-regulated strategy development versus reciprocal questioning: Effects on expository reading comprehension among struggling readers.Journal of Educational Psychology. 2004;96:238-296
56. Mayer R. E.Learning and instruction. 2008. Learning and instruction (2nd ed.). Upper Saddle River, NJ: Pearson Merrill Prentice Hall.Upper Saddle River, NJ: Pearson Merrill Prentice Hall; 2008:
57. *Mevarech Z. R.,Kramarski B.The effects of metacognitive training versus worked-out examples on students’ mathematical reasoning.British Journal of Educational Psychology. 2004;73:449-471
58. *Meyer E.,Abrami P. C.,Wade C. A.,Aslan O.,Deault L.Improving literacy and metacognition with electronic portfolio’s: Teaching and learning with ePEARL.Computers & Education. 2010;55:84-91
59. *Michalsky T.,Mevarech Z. R.,Haibi L.Elementary school children reading scientific texts: Effects of metacognitive instruction.Journal of Educational Research. 2009;102:363-376
60. *Molenaar I.,Chiu M. M.,Sleegers P.Scaffolding of small-groups’ metacognitive activities with an avatar.International Journal of Computer-Supported Collaborative Learning. 2011;6:601-624
61. *Mourad A. E.The effectiveness of a program based on self-regulated strategy development on the writing skills of writing-disabled secondary school students.Electronic Journal of Research in Educational Psychology. 2009;7:5-24
62. Orwin R. G.A fail-safe N for effect size in meta-analysis.Journal of Educational Statistics. 1983;8:157-159
63. *Pennequin V.,Sorel O.,Nanty I.,Fontaine R.Metacognition and low achievement in mathematics: The effect of training in the use of metacognitive skills to solve mathematical word problems.Thinking and reasoning. 2010;16:198-220
64. *Perels F.,Dignath C.,Schmitz B.Is it possible to improve mathematical achievement by means of self-regulation strategies? Evaluation of an intervention in regular math classes.European Journal of Psychology of Education. 2009;24:17-31
65. *Perels F.,Gurtler T.,Schmitz B.Training of self-regulatory and problem-solving competence.Learning and Instruction. 2005;15:123-139
66. *Peters E. E.,Kitsantas A.Self-regulation of student epistemic thinking in science: The role of metacognitive prompts.Educational Psychology. 2010a;30:27-52
67. *Peters E. E.,Kitsantas A.The effect of nature of science metacognitive prompts on science students’ content and nature of science knowledge, metacognition, and self-regulatory efficacy.School Science and Mathematics. 2010b;110:382-396
68. Peters J. L.,Sutton A. J.,Jones D. R.,Abrams K. R.,Rushton L.Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity.Statistics in Medicine. 2007;26:4544-4562
69. Pressley M.Comprehension instruction: Research-based best practices. Block C. C.Pressley M., ed. New York, NY: Guilford Press; 2002:11-27.
70. Raudenbush S. W.,Bryk A. S.,Congdon R.Skokie, IL: Scientific Software International; 2004:
71. *Reynolds G. A.,Perin D.A comparison of text structure and self-regulated writing strategies for composing from sources by middle school students.Reading Psychology. 2009;30:265-300
72. Rosenshine B.The conduct and reporting of intervention studies.Educational Psychology Review. 1994;6:245-254
73. Rosenthal R.The file drawer problem and tolerance for null results.Psychological Bulletin. 1979;86:638-641
74. Slavin R. E.Synthesis of research on cooperative learning.Educational Leadership. 1991;48 (5): 71-82
75. Slavin R. E.,Lake C..Paper presented at the annual meetings of the Society for Research on Educational Effectiveness; 2009Crystal City, VA; 2009.
76. Slavin R.,Madden N. A.Measures inherent to treatments in program effectiveness reviews.Journal of Research on Educational Effectiveness. 2011;4:370-380
77. *Souvignier E.,Mokhlesgerami J.Using self-regulation as a framework for implementing strategy instruction to foster reading comprehension.Learning and Instruction. 2006;16:57-71
78. *Stoeger H.,Ziegler A.Evaluation of a classroom based training to improve self-regulation in time management tasks during homework activities with fourth graders.Metacognition and Learning. 2008;3:207-230
79. *Stoeger H.,Ziegler A.Do pupils with differing cognitive abilities benefit similarly from a self-regulated learning training program?.Gifted Education International. 2010;26:110-123
80. *Tajika H.,Nakatsu N.,Nozaki H.,Neumann E.,Maruno S.Effects of self-explanation as a metacognitive strategy for solving mathematical word problems.Japanese Psychological Research. 2007;49:222-233
81. *Talebi S. H.An attempt towards learner autonomy in L2 (English) and L3 (Arabic) reading through cognitive and metacognitive reading strategy instruction (CMRSI) in L2.Indian Journal of Applied Linguistics. 2009;35:101-112
82. *Teong S. K.The effect of metacognitive training on mathematical word-problem solving.Journal of Computer Assisted Learning. 2003;19:46-55
83. Thompson B.Stepwise regression and stepwise discriminant analysis need not apply here: A guidelines editorial.Educational and Psychological Measurement. 1995;55:525-534
84. *Torrance M.,Fidalgo R.,García J-N.The teachability and effectiveness of cognitive self-regulation in sixth-grade writers.Learning and Instruction. 2007;17:265-285
85. *Tracy B.,Reid R.,Graham S.Teaching young students strategies for planning and drafting stories: The impact of self-regulated strategy development.Journal of Educational Research. 2009;102:323-331
86. *Van Keer H.,Vanderlinde R.The impact of cross-age peer tutoring on third and sixth graders’ reading strategy awareness, reading strategy use, and reading comprehension.Middle Grades Research Journal. 2010;5:33-45
87. *Vaughn S.,Klingner J. K.,Swanson E. A.Efficacy of collaborative strategic reading with middle school students.American Educational Research Journal. 2011;48:938-964
88. Wehby J. H.,Maggin D. M.,Johnson L.,Symons F. J..Paper presented at the annual meetings of the Society for Research on Educational Effectiveness; 2010Washington, DC; 2010.
89. Weinstein C. E.,Mayer R. E.Handbook of research on teaching. Wittrock M., ed. New York, NY: Macmillan; 1986:315-327.
90. *Wright J.,Jacobs B.Teaching phonological awareness and metacognitive strategies to children with reading difficulties: A comparison of two instructional methods.Educational Psychology. 2003;23:17-47
91. Zimmerman B. J.Becoming a self-regulated learner: an overview.Theory Into Practice. 2002;41:64-70
92. *Zion M.,Michalsky T.,Mevarech Z. R.The effects of metacognitive instruction embedded within an asynchronous learning network on scientific inquiry skills.International Journal of Science Education. 2005;27:957-983