What have we learned from the application of systematic review methodology in international development? - a thematic overview

Journal of Development Effectiveness

Volumn 6, Issue 3, 2014, Pages 236-248

  Langer, Laurenz ^a   Stewart, Ruth ^a,b  

^a UNIVERSITY OF JOHANNESBURG   (South Africa)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

development effectiveness; evidence map; evidence informed policy; international development; systematic review

Indexed keywords

DEVELOPMENT ECONOMICS; ECONOMIC ANALYSIS; METHODOLOGY; POLICY APPROACH; DESIGN; DEVELOPMENT LEVEL; POLICY IMPLEMENTATION;

EID: 84907595184     PISSN: 19439342     EISSN: 19439407     Source Type: Journal    
DOI: 10.1080/19439342.2014.919013     Document Type: Article

References (44)

1. 3ie (International Initiative for Impact Evaluation). 2012. DFID and 3ie Share Experiences with Systematic Reviews. Accessed May 13, 2014. http://www.3ieimpact.org/en/blog/2012/12/18/dfid-and-3ie-share-experiences-systematic-reviews/
2. Breckon, J., and D. Gough. 2013. 7 Myths about Systematic Review and Why we Need to Move on. Accessed May 13, 2014. http://www.alliance4usefulevidence.org/7-myths/
3. Center for Global Development. 2006. When will we ever Learn? Changing Lives through Impact Evaluation. Evaluation Gap Working Group. Washington DC: CGD.
4. Chalmers, I. 2005. "If Evidence-Informed Policy Works in Practice, Does it Matter if it Doesn't Work in Theory?" Evidence & Policy: A Journal of Research, Debate and Practice 1 (2): 227-242. doi:10.1332/1744264053730806.
5. DFID (UK Department for International Development). 2010. Systematic Reviews and Evidence-Informed Policy: Overview. London: DFID.
6. DFID (UK Department for International Development). 2011a. UK Aid: Changing Lives Delivering Results. London: DFID.
7. DFID (UK Department for International Development). 2011b. Systematic Reviews in International Development: An Initiative to Strengthen Evidence-Informed Policy Making. London: DFID.
8. Duvendack, M., J. G. Hombrados, R. Palmer-Jones, and H. Waddington. 2012. "Assessing 'What Works' in International Development: Meta-Analysis for Sophisticated Dummies." Journal of Development Effectiveness 4 (3): 456-471. doi:10.1080/19439342.2012.710642.
9. EPPI-Centre. 2013. History of Systematic Reviews. Accessed May 13, 2014. http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=68
10. Gough, D., S. Olivier, and J. Thomas. 2012. An Introduction to Systematic Reviews. London: Sage.
11. Gough, D., S. Oliver, and J. Thomas. 2013. Learning from Research: Systematic Reviews for Informing Policy Decisions: A Quick Guide. A Paper for the Alliance for Useful Evidence. London: Nesta.
12. Hagen-Zanker, J., and R. Mallett. 2013. How to Do a Rigorous, Evidence-Focused Literature Review in International Development. A Guidance Note. London: ODI.
13. Hagen-Zanker, J., R. Mallett, M. Duvendack, and R. Slater. 2012. Making Systematic Reviews Work for International Development Research. SLRC-ODI. London: ODI.
14. Hansen, H. F., and O. Rieper. 2009. "The Evidence Movement: The Development and Consequences of Methodologies in Review Practices." Evaluation 15 (2): 141-163. doi:10.1177/1356389008101968.
15. Hansen, H., and N. Trifkovic. 2013. Systematic Reviews - Questions, Methods and Usage. Evaluation Study. Ministry of Foreign Affairs of Denmark Evaluation Department. Copenhagen: DANIDA.
16. Higgins, J. P. T., and S. Green, eds. 2011. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 (updated March 2011). The Cochrane Collaboration Accessed February 11, 2014. http://handbook.cochrane.org
17. IDCG (International Development Coordinating Group). 2012. Guidance for Establishing and Managing Review Advisory Groups. http://www.campbellcollaboration.org/ID_Resources/Guidelines_for_Reviewers.php
18. Kayabu, B., and M. Clarke. 2013. "The Use of Systematic Reviews and Other Research Evidence in Disasters and Related Areas: Preliminary Report of a Needs Assessment Survey." PLoS Currents Disasters. doi:10.1371/currents.dis.ed42382881b3bf79478ad503be4693ea.
19. Lipsey, M. W., and E. Noonan. 2009. Better Evidence for a Better World. International Initiative for Impact Evaluation, Working Paper 2. New Delhi: 3ie.
20. Mallett, R. 2012. 'What Works'? Systematic Reviews in International Development Research and Policy. Accessed February 11, 2014. http://www.odi.org.uk/opinion/6283-systematic-reviews-international-development-slrc
21. Masset, E., H. Lawrence, C. Alex, and I.-C. Jairo. 2011. A Systematic Review of Agricultural Interventions that Aim to Improve Nutritional Status of Children. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.
22. Newman, K. 2013. Evidence Synthesis - What has it Ever Done for Us? Accessed May 13, 2014. http://kirstyevidence.wordpress.com/2013/04/29/evidence-synthesis-1/
23. Oliver, S. 2014. "Advantages of Concurrent Preparation and Reporting of Systematic Reviews of Quantitative and Qualitative Evidence." JLL Bulletin: Commentaries on the History of Treatment Evaluation. Accessed May 13, 2014. www.jameslindlibrary.org
24. Petrosino, A., R. F. Boruch, H. Soydan, L. Duggan, and J. Sanchez-Meca. 2001. "Meeting the Challenges of Evidence-Based Policy: The Campbell Collaboration." The ANNALS of the American Academy of Political and Social Science 578 (1): 14-34. doi:10.1177/0002716201578001002.
25. Posthumus, H., A. Martin, and T. Chancellor. 2012. A Systematic Review on the Impacts of Capacity Strengthening of Agricultural Research Systems for Development and the Conditions of Success. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.
26. Pullin, A. S., and T. M. Knight. 2009. "Doing More Good than Harm - Building an Evidence-Base for Conservation and Environmental Management." Biological Conservation 142: 931-934. doi:10.1016/j.biocon.2009.01.010.
27. Snilstveit, B. 2012. "Systematic Reviews: From 'Bare Bones' Reviews to Policy Relevance." Journal of Development Effectiveness 4 (3): 388-408. doi:10.1080/19439342.2012.709875.
28. Snilstveit, B., S. Oliver, and M. Vojtkova. 2012. "Narrative Approaches to Systematic Review and Synthesis of Evidence for International Development Policy and Practice." Journal of Development Effectiveness 4 (3): 409-429. doi:10.1080/19439342.2012.710641.
29. Snilstveit, B., M. Vojtkova, A. Bhavsar, and M. Gaarder. 2013. Evidence Gap Maps - A Tool for Promoting Evidence-Informed Policy and Prioritizing Future Research. Policy Research Working Paper, 6725. Washington, DC: World Bank. doi:10.1596/1813-9450-6725.
30. Snilstveit, B., and H. Waddington. 2012. Systematic Reviews: Let's Work out the Kinks. 3ie. Accessed May 13, 2014. http://www.3ieimpact.org/en/search/?q=lets+work+out+the+kinks
31. Stewart, R. 2014. "Changing the World One Systematic Review at a Time: A New Methodology for Making a Difference." Development Southern Africa 31 (4).
32. Stewart, R., Y. Erasmus, H. Zaranyika, N. R. Da Silva, M. Korth, L. Langer, N. Randall, N. Madinga, and T. de Wet. 2014. "The Size and Nature of the Evidence-Base for Smallholder Farming in Africa: A Systematic Map." Journal of Development Effectiveness 6 (1) 58-68. doi:10.1080/19439342.2013.877060.
33. Stewart, R., C. van Rooyen, and T. de Wet. 2012. "Purity or Pragmatism? Reflecting on the Use of Systematic Review Methodology in Development." Journal of Development Effectiveness 6 (1): 58-68. doi:10.1080/19439342.2012.711341.
34. Stewart, R., C. van Rooyen, M. Dickson, M. Majoro, and T. de Wet. 2010. What is the Impact of Microfinance on Poor People? A Systematic Review of Evidence from Sub-Saharan Africa. Technical Report. London: EPPI-Centre, Social Science Research Unit, University of London.
35. The Campbell Collaboration. 2013. What is a Systematic Review. Accessed May 13, 2014. http://www.campbellcollaboration.org/what_is_a_systematic_review/index.php
36. van Rooyen, C., R. Stewart, and T. de Wet. 2012. "The Impact of Microfinance in Sub-Saharan Africa: A Systematic Review of the Evidence." World Development 40 (11): 2249-2262. doi:10.1016/j.worlddev.2012.03.012.
37. Waddington, H., B. Snilstveit, H. White, and L. Fewtrell. 2009. Water, Sanitation and Hygiene Interventions to Combat Childhood Diarrhoea in Developing Countries. International Initiative for Impact Evaluation, Synthetic Review 001. New Delhi: 3ie.
38. Waddington, H., H. White, B. Snilstveit, J. G. Hombrados, M. Vojtkova, P. Davies, A. Bhavsar, et al. 2012. "How to do a Good Systematic Review of Effects in International Development: A Toolkit." Journal of Development Effectiveness 4 (3): 359-387. doi:10.1080/19439342.2012.711765.
39. Walker, D., G. Bergh, E. Page, and M. Duvendack. 2013. Adapting a Systematic Review for Social Research in International Development: A Case Study from the Child Protection Sector. London: ODI.
40. Walshe, K. 2007. "Understanding What Works - and Why - in Quality Improvement: The Need for Theory-Driven Evaluation." International Journal for Quality in Health Care 19: 57-59. doi:10.1093/intqhc/mzm004.
41. White, H. 2005. Challenges in Evaluating Developing Effectiveness. IDS Working Paper 242. Sussex: Institute of Development Studies.
42. White, H. 2009. Theory-Based Impact Evaluation: Principles and Practice. International Initiative for Impact Evaluation, Working Paper 3. New Delhi: 3ie.
43. White, H., and H. Waddington. 2012. "Why do We Care about Evidence Synthesis? An Introduction to the Special Issue on Systematic Reviews." Journal of Development Effectiveness 4 (3): 351-358. doi:10.1080/19439342.2012.711343.
44. Whitty, B., C. Shutt, C. Roche, I. Guijt, and R. Eyben. 2013. Murky Fields of Imposition. The Case of a Systematic Review. Accessed May 13, 2014. http://bigpushforward.net/archives/1969