Using case studies to explore the external validity of 'complex' development interventions

Evaluation

Volumn 19, Issue 3, 2013, Pages 229-248

  Woolcock, Michael ^a  

^a WORLD BANK   (United States)

Author keywords

case studies; complexity; development; evaluation; external validity

Indexed keywords

EID: 84880091610     PISSN: 13563890     EISSN: 14617153     Source Type: Journal    
DOI: 10.1177/1356389013495210     Document Type: Article

References (64)

1. Allcott H,Mullainathan SExternal validity and partner selection bias. Cambridge, MA: National Bureau of Economic Research Working Paper No. 18373; 2012:.
2. Andrews M,Pritchett L,Woolcock M.Escaping capability traps through problem-driven iterative adaption (PDIA).World Development. forthcoming;:.
3. Angrist J,Fernandez-Val IExtrapolate-ing: external validity and overidentification in the LATE framework. Cambridge, MA: National Bureau of Economic Research; 2010:.
4. Baird S,Ferreira F,Özler B,Woolcock MRelative effectiveness of conditional and unconditional cash transfers for schooling outcomes in developing countries: a systematic review. London: 3ie; 2013:.
5. Bamberger M,Rao V,Woolcock MHandbook of Mixed Methods in Social and Behavioral Research. 2010) Using mixed methods in monitoring and evaluation: experiences from international development. In: TashakkoriATeddlieC (eds), Handbook of Mixed Methods in Social and Behavioral Research, 2nd revised edition. Thousand Oaks, CA: SAGE, 613-41.Tashakkori ATeddlie C, ed. Thousand Oaks, CA: SAGE; 2010:613-41.
6. Banerjee AV,Cole S,Duflo E,Linden L.Remedying education: evidence from two randomized experiments in India.Quarterly Journal of Economics. 2007;122 (3): 1235-64.
7. Barron P,Diprose R,Woolcock MContesting Development: Participatory Projects and Local Conflict Dynamics in Indonesia. New Haven, CT: Yale University Press; 2011:.
8. Bates R,Greif A,Levi M,Rosenthal J-L,Weingast BRAnalytic Narratives. Princeton, NJ: Princeton University Press; 1998:.
9. BoldTKimenyiMMwabuGNg'ang'aASandefurJ (2013) Scaling-up what works: experimental evidence on external validity in Kenyan education. Washington: Center for Global Development, Working Paper No. 321.
10. Booth DAid effectiveness: bring country ownership (and politics) back in. London: ODI; 2011:.
11. BruhnMMcKenzieD (2013) Using administrative data to evaluate municipal reforms: an evaluation of the impact of Minas Fácil Expresso. Washington: World Bank Policy Research Working Paper No. 6368.
12. Byrne D.Evaluating complex social interventions in a complex world.Evaluation. 2013;19 (3):.
13. Byrne D,Callaghan GComplexity Theory and the Social Sciences: The State of the Art. London: Routledge; 2013:.
14. Cartwright N.Are RCTs the gold standard?.Biosocieties. 2007;2 (2): 11-20.
15. Casey K,Glennerster R,Miguel E.Reshaping institutions: evidence on aid impacts using a pre-analysis plan.Quarterly Journal of Economics. 2012;127 (4): 1755-812.
16. Cartwright N,Hardie JEvidence-Based Policy: A Practical Guide to Doing it Better. New York: Oxford University Press; 2012:.
17. Chong A,La Porta R,Lopez-de-Silanes F,Shleifer ALetter grading government efficiency. Cambridge, MA: NBER; 2012:.
18. Churchman CW.Wicked problems.Management Science. 1967;14 (4): 141-2.
19. Cook TDInternational Encyclopedia of the Social and Behavioral Sciences. Smelser NJWright JBaltes PB, ed. Amsterdam: Elsevier; 2001:6037-43.
20. Cook TD,Campbell DTQuasi-Experimentation: Design and Analysis Issues for Field Settings. Boston, MA: Houghton Mifflin Company; 1979:.
21. Deaton A.Instruments, randomization, and learning about development.Journal of Economic Perspectives. 2010;48:424-5.
22. Denizer C,Kaufmann D,Kraay AGood projects or good countries? Macro and micro correlates of World Bank project performance. Washington: World Bank Policy Research; 2012:.
23. DufloEDupasPKremerM (2012) School governance, teacher incentives, and pupil-teacher ratios: experimental evidence from Kenyan primary schools. NBER Working Paper No. 17939.
24. EngberD (2011) The mouse trap (part I): the dangers of using one lab animal to study every disease. Slate, November15. URL: http://www.slate.com/articles/health_and_science/the_mouse_trap/2011/11/the_mouse_trap.html.
25. Eppstein MJ,Horbar JD,Buzas JS,Kauffman S.Searching the clinical fitness landscape.PLoS One. 2012;7 (11): e49901.
26. Fiszbein A,Schady NConditional Cash Transfers: Reducing Present and Future Poverty. Washington: World Bank; 2009:.
27. Freedman DAThe Oxford Handbook of Political Methodology. Box-Steffensmeier JBrady HECollier D, ed. New York: Oxford University Press; 2008:300-18.
28. George A,Bennett ACase Studies and Theory Development in the Social Sciences. Cambridge, MA: MIT Press; 2005:.
29. Gerring JCase Study Research: Principles and Practices. New York: Cambridge University Press; 2007:.
30. Goertz G,Mahoney JA Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences. Princeton, NJ: Princeton University Press; 2012:.
31. Gupta ARed Tape: Bureaucracy, Structural Violence and Poverty in India. Durham, MD and London: Duke University Press; 2012:.
32. Henrich J,Heine SJ,Norenzayan A.The weirdest people in the world?.Behavioral and Brain Sciences. 2010a;33 (2-3): 61-83.
33. Henrich J,Heine SJ,Norenzayan A.Beyond WEIRD: towards a broad-based behavioral science.Behavioral and Brain Sciences. 2010b;33 (2-3): 111-35.
34. HonoréA (2010) Causation in the law. Stanford Encyclopedia of Philosophy. URL (consulted 20March2013): http://stanford.library.usyd.edu.au/entries/causation-law/.
35. Kolata G.Mice fall short as test subjects for humans' deadly ills.New York Times. 2013;:A19.
36. Lamont M.Toward a comparative sociology of valuation and evaluation.Annual Review of Sociology. 2012;38:201-21.
37. Ludwig J,Kling JR,Mullainathan S.Mechanism experiments and policy evaluations.Journal of Economic Perspectives. 2011;25 (3): 17-38.
38. Mahoney J.Strategies of causal inference in small-N analysis.Sociological Methods & Research. 2000;28 (4): 387-424.
39. Mahoney J.Qualitative methodology and comparative politics.Comparative Political Studies. 2007;40 (2): 122-44.
40. Mansuri G,Rao VLocalizing Development: Does Participation Work?. Washington, DC: World Bank; 2012:.
41. Manzi JUncontrolled: The Surprising Payoff of Trial and Error for Business, Politics, and Society. New York: Basic Books; 2012:.
42. MuralidharanKSundararamanV (2010) Contract teachers: experimental evidence from India. University of California, San Diego: Mimeo. URL: http://www.fas.nus.edu.sg/ecs/events/seminar/seminar-papers/31Aug10.pdf.
43. Pawson REvidence-based Policy: A Realist Perspective. London: SAGE; 2006:.
44. Pawson R,Tilly NRealist Evaluation. London: SAGE; 1997:.
45. Picciotto R.Experimentalism and development evaluation: Will the bubble burst?.Evaluation. 2012;18 (2): 213-29.
46. Pritchett LThe folk and the formula: fact and fiction in development. Helsinki: WIDER Annual Lecture; 2013:16.
47. Pritchett L,Woolcock M.Solutions when the solution is the problem: arraying the disarray in development.World Development. 2004;32 (2): 191-212.
48. Pritchett L,Samji S,Hammer JIt's all about MeE: using structured experiential learning ('e') to crawl the design space. Helsinki: UNU WIDER; 2012:.
49. Pritchett L,Woolcock M,Andrews M.Looking like a state: techniques of persistent failure in state capability for implementation.Journal of Development Studies. 2013;49 (1): 1-18.
50. Ragin CCThe Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. Berkeley and Los Angeles: University of California Press; 1987:.
51. What is a Case? Exploring the Foundations of Social Inquiry. Ragin CCBecker H, ed. New York: Cambridge University Press; 1992:.
52. Ramalingam B,Jones HExploring the science of complexity: ideas and implications for development and humanitarian efforts. London: ODI; 2009:.
53. Rao A,Woolcock MBut how generalizable is that? A framework for assessing the external validity of complex development interventions. mimeo: World Bank; forthcoming:.
54. Ravallion M.Growth, inequality and poverty: looking beyond averages.World Development. 2001;29 (11): 1803-15.
55. Ravallion M.Should the randomistas rule?.Economists' Voice. 2009;6 (2): 1-5.
56. Rothwell PM.External validity of randomized controlled trials: 'To whom do the results of this trial apply?'.The Lancet. 2005;365:82-93.
57. Sampson R.The place of context: a theory and strategy for criminology's hard problems.Criminology. 2013;51 (1): 1-31.
58. Seok J,Warren HS,Cuenca AG, et al.Genomic responses in mouse models poorly mimic human inflammatory diseases.Proceedings of the National Academy of Sciences. 2013;110 (9): 3507-12.
59. Shaffer P.Against excessive rhetoric in impact assessment: overstating the case for randomised controlled experiments.Journal of Development Studies. 2011;47 (11): 1619-35.
60. Shanahan M.Dynamical complexity in small-world networks of spiking neurons.Physical Review E. 2008;78 (4): 041924.
61. Stern E,Stame N,Mayne J,Forss K,Davies R,Befani BBroadening the range of designs and methods for impact evaluation. London: DFID; 2012:.
62. Woolcock M.Toward a plurality of methods in project evaluation: a contextualized approach to understanding impact trajectories and efficacy.Journal of Development Effectiveness. 2009;1 (1): 1-14.
63. Woolcock M,Szreter S,Rao V.How and why does history matter for development policy?.Journal of Development Studies. 2011;47 (1): 70-96.
64. Yin RKCase Study Research: Design and Methods. 2009) Case Study Research: Design and Methods, 4th edn.Thousand Oaks, CA: SAGE.Thousand Oaks, CA: SAGE; 2009:.