Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Impact Evaluations

Review of Educational Research

Volumn 87, Issue 5, 2017, Pages 863-898

  Conn, Katharine M ^a  

^a Howard Hughes Medical Institute   (United States)

Author keywords

education and developing countries; impact evaluation; meta analysis; randomized experiment; Sub Saharan Africa

Indexed keywords

EID: 85028966448     PISSN: 00346543     EISSN: 19351046     Source Type: Journal    
DOI: 10.3102/0034654317712025     Document Type: Article

References (108)

1. *Abdu-Raheem B. O., (2012). Effects of problem-solving method on secondary school students’ achievement and retention in social studies in Ekiti State, Nigeria. Journal of International Education Research, 8, 19–26.
2. Adedayo O. A., (1999). Differential impacts by gender of instruction on achievement in mathematics at the tertiary level. Educational Studies in Mathematics, 37, 83–91. doi:10.1023/A:1003295525989
3. Adegoke B. A., (2011). Effect of multimedia instruction on senior secondary school students’ achievement in physics. European Journal of Educational Studies, 3, 537–550.
4. Adeleke M. A., (2007). Strategic improvement of mathematical problem solving performance of secondary school students using procedural and conceptual learning strategies. Educational Research and Reviews, 2, 259–263.
5. Agbatogun A. O., (2012). Exploring the efficacy of student response system in a Sub-Saharan African country: A sociocultural perspective. Journal of Information Technology Education: Research, 11, 249–267.
6. Ahn S., Ames A. J., Myers N. D., (2012). A review of meta-analyses in education: Methodological strengths and weaknesses. Review of Educational Research, 82, 436–476. doi:10.3102/0034654312458162
7. *Ajaja O. P., Eravwoke O. U., (2010). Effects of cooperative learning strategy on junior secondary school students achievement in integrated science. Electronic Journal of Science Education, 14, 1–18.
8. Akinsola M. K., Animasahun I. A., (2007). The effect of simulation-games environment on students’ achievement in and attitudes to mathematics in secondary school. Turkish Online Journal of Educational Technology, 6(3), 11.
9. Awolola S. A., (2011). Effect of brain-based learning strategy on students’ achievement in senior secondary school mathematics in Oyo State, Nigeria. Cypriot Journal of Educational Sciences, 6, 91–106.
10. Awoniyi A., Ala F. B. O., (1985). Effects of alternative language media on learning in Nigeria. Journal of Negro Education, 54, 225–231. doi:10.2307/2294935
11. *Baird S., Kremer M., Miguel E., Hicks J. H., (2011). Worms at work: Long-run impacts of child health gains. Unpublished manuscript, George Washington University, Washington, DC.
12. *Baird S., McIntosh C., Ozler B., (2011). Cash or condition? Evidence from a cash transfer experiment. Quarterly Journal of Economics, 126, 1709–1753. doi:10.1093/qje/qjr032
13. *Barr A., Mugisha F., Serneels P., Zeitlin A., (2012). Information and collective action in the community monitoring of schools: Field and lab experimental evidence from Uganda. Unpublished manuscript, University of Nottingham, Nottingham, England.
14. *Baumgartner J., Smuts C. M., Malan L., Kvalsvig J., van Stuijvenberg M. E., Hurrell R. F., Zimmermann M. B., (2012). Effects of iron and n23 fatty acid supplementation, alone and in combination, on cognition in school children: A randomized, double-blind, placebo-controlled intervention in South Africa. American Journal of Clinical Nutrition, 96, 1327–1338. doi:10.3945/ajcn.112.041004.
15. *Bimbola O., Oludipe D. I., (2010). Effect of constructivist-based teaching strategy on academic performance of students in integrated science at the junior secondary school level. Educational Research and Reviews, 5, 347–353.
16. *Björkman M., (2006). Does money matter for student performance? Evidence from a grant program in Uganda (Working Paper No. 326). Milan, Italy: Innocenzo Gasparini Institute for Economic Research, Università Bocconi.
17. *Blimpo M. P., (2010). Team incentives for education in developing countries: A randomized field experiment in Benin. Unpublished manuscript, New York University, New York.
18. *Blimpo M. P., Evans D. K., (2011). School-based management and educational outcomes: Lessons from a randomized field experiment. Unpublished Manuscript, Stanford University, Stanford, CA.
19. *Bold T., Kimenyi M., Mwabu G., Ng’ang’a A., Sandefur J., (2013). Scaling up what works: Experimental evidence on external validity in Kenyan education (Working Paper No. 321). Washington, DC: Center for Global Development.
20. *Bold T., Kimenyi M., Mwabu G., Sandefur J., (2013). The high return to private schooling in a low-income country (Working Paper No. 5). Washington, DC: Brookings Institute.
21. *Bourdon J., Frölich M., Michaelowa K., (2010). Teacher shortages, teacher contracts and their effect on education in Africa. Journal of the Royal Statistical Society: Series A, 173, 93–116. doi:10.1111/j.1467-985X.2009.00601.x
22. *Brooker S., Inyega H., Estambale B., Njagi K., Juma E., Jones C... Jukes M., (2013). Impact of malaria control and enhanced literacy instruction on educational outcomes among Kenyan schoolchildren: A multi-sectoral, prospective, randomized evaluation (3ie Draft Grantee Final Report). Retrieved from http://www.3ieimpact.org/media/filer_public/2013/10/18/malaria_kenya_consolidated_dfr.pdf
23. Case A., Deaton A., (1999). School inputs and educational outcomes in South Africa. Quarterly Journal of Economics, 114, 1047–1084. doi:10.1162/003355399556124
24. *Clarke S. E., Jukes M. C., Njagi J. K., Khasakhala L., Cundill B., Otido J... Brooker S., (2008). Effect of intermittent preventive treatment of malaria on health and education in schoolchildren: A cluster randomized, double-blind, placebo-controlled trial. Lancet, 372, 127–138. doi:10.1016/S0140-6736(08)61034-X
25. Cohen D., Raudenbush S., Ball D. L., (2003). Resources, instruction, and research. Educational Evaluation and Policy Analysis, 25, 119–142. doi:10.3102/01623737025002119
26. Conn K., (2014). Identifying Effective Education Interventions in Sub-Saharan Africa: A meta-analysis of rigorous impact evaluations (Doctoral dissertation). Retrieved from Columbia University Academic Commons. doi:10.7916/D898854G
27. *Das J., Dercon S., Habyarimana J., Krishnan P., Muralidharan K., Sundararaman V., (2013). School inputs, household substitution, and test scores. American Economic Journal: Applied Economics, 5, 29–57. doi:10.1257/app.5.2.29
28. Deaton A., (2010). Instruments, randomization, and learning about development. Journal of Economic Literature, 48, 424–455. doi:10.1257/jel.48.2.424
29. *Duflo E., Dupas P., Kremer M., (2011). Peer effects, teacher incentives, and the impact of tracking: Evidence from a randomized evaluation in Kenya. American Economic Review, 101, 1739–1774. doi:10.1257/aer.101.5.1739
30. *Duflo E., Dupas P., Kremer M., (2012). School governance, teacher incentives, and pupil-teacher ratios: Experimental evidence from Kenyan public schools (Working Paper No. 17939). Washington, DC: National Bureau of Economic Research. doi:10.3386/w17939
31. *Dumitrescu A., Levy D., Orfield C., Sloan M., (2011). Impact evaluation of Niger’s IMAGINE Program (Final report). Retrieved from https://www.mathematica-mpr.com/our-publications-and-findings/publications/impact-evaluation-of-nigers-imagine-program
32. Egger M., Smith G. D., Schneider M., Minder C., (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634. doi:10.1136/bmj.315.7109.629
33. *Evans D., Kremer M., Ngatia M., (2009). The impact of distributing school uniforms on children’s education in Kenya. Unpublished manuscript, Harvard University, Cambridge, MA.
34. Evans D. K., Popova A., (2015). What really works to improve learning in developing countries? An analysis of divergent findings in systematic reviews (Working Paper No. 7203). Washington, DC: World Bank.
35. Fisher D., Frey N., Hattie J., (2016). Visible learning for literacy, Grades K-12: Implementing the practices that work to best accelerate student learning. Thousand Oaks, CA: Corwin.
36. Fisher Z., (2014). robumeta [Package in R]. Retrieved from https://cran.r-project.org/web/packages/robumeta/index.html
37. *Frölich M., Michaelowa K., (2011). Peer effects and textbooks in African primary education. Labour Economics, 18, 474–486. doi:10.1016/j.labeco.2010.11.008
38. Ganimian A., Murnane R., (2016). Improving education in developing countries: Lessons from rigorous impact evaluations. Review of Educational Research, 86, 719–755. doi:10.3102/0034654315627499
39. Garlick R., (2013). Academic peer effects with different group assignment policies: Residential tracking versus random assignment. Unpublished manuscript, University of Michigan, Ann Arbor.
40. *Gee K. A., (2010). The impact of school-based anti-malarial treatment on adolescents’ cognition: Evidence from a cluster-randomized intervention in Kenya (Doctoral dissertation). Retrieved from ProQuest Dissertation and Theses. (UMI Number 3446325)
41. *Githau B. N., Nyabwa R. A., (2008). Effects of advance organiser strategy during instruction on secondary school students’ mathematics achievement in Kenya’s Nakuru district. International Journal of Science and Mathematics Education, 6, 439–457. doi:10.1007/s10763-006-9037-8
42. Glass G. V., McGaw B., Smith M. L., (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
43. Glass G. V., Smith M. L., (1979). Meta-analysis of research on the relationship of class size and achievement. Educational Evaluation and Policy Analysis, 1, 2–16.
44. Glewwe P., Hanushek E. A., Humpage S., Ravina R., (2011). School resources and educational outcomes in developing countries: A review of the literature from 1990 to 2010. Unpublished manuscript, University of Minnesota, Minneapolis, Minnesota.
45. *Glewwe P., Ilias N., Kremer M., (2010). Teacher incentives. American Economic Journal: Applied Economics, 2, 205–227. doi:10.1257/app.2.3.205
46. Glewwe P., Kremer M., (2006). Schools, teachers, and education outcomes in developing countries. In Hanushek E., Welch F., (Eds.), Handbook of the economics of education (Vol. 2, pp. 945–1017). Amsterdam, Netherlands: Elsevier. doi:10.1016/S1574-0692(06)02016-2
47. *Glewwe P., Kremer M., Moulin S., (2009). Many children left behind? Textbooks and test scores in Kenya. American Economic Journal: Applied Economics, 1, 112–135. doi:10.1257/app.1.1.112
48. *Glewwe P., Kremer M., Moulin S., Zitzewitz E., (2004). Retrospective vs. prospective analyses of school inputs: The case of flip charts in Kenya. Journal of Development Economics, 74, 251–268. doi:10.1016/j.jdeveco.2003.12.010
49. *Glewwe P., Maïga E., (2011). The impacts of school management reforms in Madagascar: Do the impacts vary by teacher type? Unpublished manuscript, University of Minnesota, Minneapolis.
50. Glewwe P., Muralidharan K., (2015). Improving school education outcomes in developing countries: Evidence, knowledge gaps, and policy implications (Working Paper 15/001). Oxford, England: Research on Improving Systems of Education.
51. *Grigorenko E., Sternberg R., Jukes M., Alcock K. J., Lambo J., Ngorosho D... Bundy D. A., (2006). Effects of antiparasitic treatment on dynamically and statically tested cognitive skills over time. Journal of Applied Developmental Psychology, 27, 499–526. doi:10.1016/j.appdev.2006.08.005
52. Hattie J., (2009). Visible learning: A synthesis of over 800 meta-analysis relating to achievement. New York, NY: Routledge.
53. Hattie J., (2012). Visible learning for teachers: Maximizing impact on learning. New York, NY: Routledge.
54. Hattie J., Rogers J., Swaminathan H., (2014). The role of meta-analysis in education research. In Reid A., Hart E., Peters M., (Eds.), A companion to research in education (pp. 197–207). Dordrecht, Netherlands: Springer.
55. Hedges L. V., Laine R. D., Greenwald R., (1994). An exchange: Part 1: Does money matter? A meta-analysis of studies of the effects of differential school inputs on student. Educational Researcher, 23, 5–14. doi:10.3102/0013189X023003005
56. Hedges L. V., Tipton E., Johnson M. C., (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65. doi:10.1002/jrsm.5
57. Heyneman S. P., Loxley W. A., (1983). The effect of primary school quality on academic achievement across twenty-nine high and low-income countries. American Journal of Sociology, 88, 1162–1194.
58. Higgins J. P. T., Altman D. G., Gøtzsche P. C., Jüni P., Moher D., Oxman A. D... Sterne J. A. C., (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Medical Journal, 343. doi:10.1136/bmj.d5928
59. Higgins J. P. T., Green S., (Eds.). (2011). Cochrane handbook for systematic reviews of interventions (Version 5.1.0). Retrieved from www.cochrane-handbook.org
60. Hill C. J., Bloom H., Black A. R., Lipsey M., (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2, 172–177. doi:10.1111/j.1750-8606.2008.00061.x
61. Hubbard P., (2007). Putting the power of transparency in context: Information’s role in reducing corruption in Uganda’s education sector (Working Paper No. 136). Washington, DC: Center for Global Development.
62. Jacoby H. G., (2002). Is there an intrahousehold “flypaper effect”? Evidence from a school feeding programme. Economic Journal, 112, 196–221. doi:10.1111/1468-0297.0j679
63. *Jinabhai C., Taylor M., Coutsoudis A., Coovadia H. M., Tompkins A. M., Sullivan K. R., (2001). A randomized controlled trial of the effect of antihelminthic treatment and micronutrient fortification on health status and school performance of rural primary school children. Annals of Tropical Paediatrics, 21, 319–333. doi:10.1080/07430170120093508
64. *Jukes M., Pinder M., Grigorenko E. L., Smith H. B., Walraven G., Bariau E. M...Bundy D. A. P., (2006). Long-term impact of malaria chemoprophylaxis on cognitive abilities and educational attainment: Follow-up of a controlled trial. PLoS Clinical Trials, 1, e19. doi:10.1371/journal.pctr.0010019
65. *Kazianga H., de Walque D., Alderman H., (2012). Educational and child labor impacts of two food for education schemes: Evidence from a randomized trial in rural Burkina Faso. Unpublished manuscript, Oklahoma State University, Stillwater, OK.
66. *Kazianga H., Levy D., Linden L. L., Sloan M., (2013). The effects of “girl-friendly” schools: Evidence from the BRIGHT School Construction Program in Burkina Faso. American Economic Journal, 5, 41–62. doi:10.1257/app.5.3.41
67. *Kiboss J. K., (2012). Effect of special e-learning program on hearing-impaired learners’ achievement and perception of basic geometry in lower primary mathematics. Journal of Educational Computing Research, 46, 31–59.
68. *Korsah G. A., Mostow J., Dias M. B., Sweet T. M., Belousov S. M., Dias M. F., Gong H., (2010). Improving child literacy in Africa: Experiments with an automated reading tutor. Information Technologies & International Development, 6, 1–19.
69. Kremer M., Brannen C., Glennerster R., (2013). The challenge of education and learning in the developing world. Science, 340, 297–299. doi:10.1126/science.1235350
70. Kremer M., Holla A., (2009). Improving education in the developing world: What have we learned from randomized evaluations? Annual Review of Economics, 1, 513–542. doi:10.1146/annurev.economics.050708.143323
71. *Kremer M., Miguel E., Thornton R., (2009). Incentives to learn. Review of Economics and Statistics, 91, 437–456. doi:10.1162/rest.91.3.437
72. Krishnaratne S., White H., Carpenter E., (2013). Quality education for all children? What works in education in developing countries (Working Paper No. 20). New Delhi, India: International Initiative for Impact Evaluation.
73. Kurumeh M. S. C., Achor E. E., (2008). Effect of Cuisenaire Rods’ approach on some Nigeria primary pupils’ achievement in decimal fractions. Educational Research and Reviews, 3, 339–343.
74. *Lassibille G., Tan J.-P., Jesse C., Van Nguyen T., (2010). Managing for results in primary education in Madagascar: Evaluating the impact of selected workflow interventions. World Bank Economic Review, 24, 303–329. doi:10.1093/wber/lhq009
75. Lipsey M. W., Wilson D. B., (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
76. *Louw J., Muller J., Tredoux C., (2008). Time-on-task, technology and mathematics achievement. Evaluation and Program Planning, 31, 41–50. doi:10.1016/j.evalprogplan.2007.11.001
77. *Lucas A. M., Mbiti I. M., (2012). Access, sorting, and achievement: The short-run effects of free primary education in Kenya. American Economic Journal: Applied Economics, 4, 226–225. doi:10.1257/app.4.4.226
78. *Lucas A. M., McEwan P. J., Ngware M., Oketch M., (2013). Improving early-grade literacy in East Africa: Experimental evidence from Kenya and Uganda. Unpublished manuscript, University of Delaware, Newark, DE.
79. Ludwig J., Kling J. R., Mullainathan S., (2011). Mechanism experiments and policy evaluation. Journal of Economic Perspectives, 25, 17–38. doi:10.3386/w17062
80. *Martinez S., Naudeau S., Pereira V., (2012). The promise of preschool in Africa: A randomized impact evaluation of early childhood development in rural Mozambique (3ie Impact Evaluation). Retrieved http://www.3ieimpact.org/evidence/impact-evaluations/details/106/
81. McEwan P. J., (2015). Improving learning in primary schools of developing countries: A meta-analysis of randomized experiments. Review of Educational Research, 20, 1–42. doi:10.3102/0034654314553127
82. *Miguel E., Kremer M., (2004). Worms: Identifying impacts on education and health in the presence of treatment externalities. Econometrica, 72, 159–217.
83. *Nguyen T., (2008). Information, role models and perceived returns to education: Experimental evidence from Madagascar. Unpublished manuscript, MIT, Cambridge.
84. *Nwagbo C., (2006). Effects of two teaching methods on the achievement in and attitude to biology of students of different levels of scientific literacy. International Journal of Educational Research, 45, 216–229. doi:10.1016/j.ijer.2006.11.004
85. Okoye N., Okechukwa R., (2010). The effect of concept mapping and problem solving techniques strategies on achievement in biology among Nigerian secondary school students. Education, 131, 288–294.
86. Olowa O. W., (2009). Effects of the problem solving and subject matter approaches on the problem solving ability of secondary school agricultural education. Journal of Industrial Teacher Education, 46, 33–47.
87. Onabanjo I. O., Okpala P. N., (2006). Peer tutoring: Assisted instruction, parent supportiveness and student locus of control as determinants of academic achievement in senior secondary school mathematics. Unpublished manuscript, Olabisi Onabanjo University, Ago-Iwoye, Ogun State, Nigeria.
88. Onu V. C., Eskay M., Igbo J. N., Obiyo N., Agbo O., (2012). Effect of training in math metacognitive strategy on fractional achievement of Nigerian schoolchildren. US-China Education Review, B3, 316–325.
89. *Orkin K., (2013). Lengthening the school day and children’s achievement in Ethiopia. Unpublished manuscript, University of Oxford, Oxford, England.
90. Orwin R., (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational and Behavioral Statistics, 8, 157–159.
91. *Piper B., (2009). Integrated education program: Impact study of SMRS using early grade reading assessment in three provinces in South Africa. Research Triangle Park, NC: RTI International.
92. *Piper B., Korda M., (2011). EGRA Plus: Liberia: Program evaluation report. Research Triangle Park, NC: RTI International.
93. Plomp T., Pilon J., Reinen I. J., (1991). The effectiveness of remedial computer use for mathematics in a university setting (Botswana). Computers & Education, 16, 337–347. doi:10.1016/0360-1315(91)90007-E
94. *Reinikka R., Svensson J., (2011). The power of information in public services: Evidence from education in Uganda. Journal of Public Economics, 95, 956–966. doi:10.1016/j.jpubeco.2011.02.006
95. *Sailors M., Hoffman J. V., Pearson P. D., Beretvas S. N., Matthee B., (2010). The effects of first- and second-language instruction in rural South African schools. Bilingual Research Journal, 33, 21–41. doi:10.1080/15235881003733241
96. Sandefur J., (2016). Internationally Comparable Mathematics Scores for Fourteen African Countries (Working Paper No. 444). Washington, DC: Center for Global Development.
97. Sarfo F. K., Elen J., (2007). Developing technical expertise in secondary technical schools: The effect of 4C/ID learning environments. Learning Environments Research, 10, 207–221. doi:10.1007/s10984-007-9031-2
98. Snilstveit B., Stevenson J., Phillips D., NatCen M. V., Gallagher E., Schmidt T... Eyers J., (2015). Interventions for improving learning outcomes and access to education in low- and middle-income countries: A systematic review (Final review). Retrieved from the http://www.3ieimpact.org/media/filer_public/2015/12/31/education-review-finalreport.pdf
99. *Spratt J., King S., Bulat J., (2013). Independent evaluation of the effectiveness of Institut pour l’Education Populaire’s “Read-Learn-Lead” (RLL) program in Mali. Research Triangle Park, NC: RTI International.
100. Talabi J. K., (1989). The comparative effects of televised and programmed instruction. Journal of Educational Television, 15, 17–24. doi:10.1080/0260741890150103
101. Tipton E., (2015). Small sample adjustments for robust variance estimation with meta-regression. Psychological Methods, 20, 375–393. doi:10.1037/met0000011
102. *Tooley J., Yong B., Dixon P., Merrifield J., (2011). School choice and academic performance: Some evidence from developing countries. Journal of School Choice, 5, 1–39. doi:10.1080/15582159.2011.548234
103. U.S. Department of Education, Office of Planning, Evaluation, and Policy Development. (2010). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Retrieved from www.ed.gov/about/offices/list/opepd/ppss/reports.html
104. *Van Staden A., (2011). Put reading first: Positive effects of direct instruction and scaffolding for ESL learners struggling with reading. Perspectives in Education, 29, 10–21.
105. *Van Stuijvenberg M. E., Kvalsig J. D., Faber M., Kruger M., Kenoyer D. G., Spinnler Benadé A. J., (1999). Effect of iron-, iodine-, and β-carotene-fortified biscuits on the micronutrient status of primary school children: A randomized controlled trial. American Journal of Clinical Nutrition, 69, 497–503.
106. *Vermeersch C., Kremer M., (2004). School meals, educational achievement, and school competition: Evidence from a randomized evaluation (Policy Research Working Paper No. 3523). Washington, DC: World Bank.
107. *Wachanga S. W., Mwangi J. G., (2004). Effects of the cooperative class experiment teaching method on secondary school students’ chemistry achievement in Kenya’s Nakuru district. International Education Journal, 5, 26–36.
108. *Whaley S. E., Sigman M., Neumann C., Bwibo N., Guthrie D., Weiss R. E... Murphy S. P., (2003). The impact of dietary intervention on the cognitive development of Kenyan schoolchildren. Journal of Nutrition, 133(11 Suppl. 2), 3965S-3971S.