The need for reflexive evaluation approaches in development cooperation

Evaluation

Volumn 21, Issue 1, 2015, Pages 99-115

  Arkesteijn, Marlèn ^a   van Mierlo, Barbara ^a   Leeuwis, Cees ^a  

^a WAGENINGEN UNIVERSITY   (Netherlands)

Author keywords

complexity; development; evaluation; reflexive methodologies; system learning

Indexed keywords

EID: 84920973081     PISSN: 13563890     EISSN: 14617153     Source Type: Journal    
DOI: 10.1177/1356389014564719     Document Type: Article

References (85)

1. Acemoglu D,Johnson S,Robinson JAHandbook of Economic Growth Vol. 1A. Aghion PDurlauf SN, ed. Amsterdam: North-Holland; 2005:385-472.
2. Acemoglu D,Johnson S,Robinson JAUnderstanding Poverty. Banerjee AVBénabou RMookherjee D, ed. New York: Oxford University Press USA; 2006:19-36.
3. Acemoglu D,Robinson JAWhy Nations Fail. The Origins of Power, Prosperity and Poverty. New York: Crown Publishing; 2012:
4. Argyris C,Schön DOrganizational Learning: A Theory of Action Perspective. Reading, MA: Addison-Wesley; 1978:
5. Arthur B.Competing technologies, increasing returns, and lock-in by historical events.The Economic Journal. 1989;99:116-31
6. Arthur WBIncreasing Returns and Path Dependence in the Economy. Ann Arbor, MI: University of Michigan Press; 1994:
7. Banerjee AV,Duflo EPoor Economics. Barefoot Hedge-Fund Managers, DIY Doctors and the Surprising Truth about Life on Less Than $1 a Day. London: Penguin Books; 2011:
8. Beck U,Giddens A,Lash SReflexive Modernization: Politics, Tradition and Aesthetics in the Modern Social Order. Cambridge: Polity Press; 1994:
9. Logical Framework Analysis. Guidance Notes No. 4. London: BOND Networking for International Development; 2003:
10. Boyd A,Geerling T,Gregory WJ,Kagan C,Midgley G,Murray P,Walsh MP.Systemic evaluation: A participative, multi-method approach.Journal of the Operational Research Society. 2007;58:1306-20
11. Checkland PSystems Thinking, Systems Practice: Includes a 30-Year Retrospective. New York: John Wiley and Sons; 1993:
12. Cleaver F.The inequality of social capital and the reproduction of chronic poverty.World Development. 2005;33 (6): 893-906
13. Collier PThe Bottom Billion: Why the Poorest Countries Are Failing and What Can Be Done about It. Oxford: Oxford University Press; 2007:
14. Crehan K,Von Oppen A.Understandings of development: an arena of struggle. The story of a development project in Zambia.Sociologia Ruralis. 1988;28:113-45
15. David PA.Why are institutions the ‘carriers of history’? Path dependence and the evolution of conventions, organisations and institutions.Structural Change and Economic Dynamics. 1994;5 (2): 205-20
16. Dart J,Davies R.A dialogical, story-based evaluation tool: the most significant change technique.American Journal of Evaluation. 2003;24 (2): 137-55
17. De Soto HThe Mystery of Capital: Why Capitalism Triumphs in the West and Fails Everywhere Else. New York: Basic Books; 2000:
18. Diamond JGuns, Germs and Steel: The Fates of Human Societies. New York: W. Norton & Co; 1997:
19. DickB (1997) Option one-and-a-half. URL (consulted 2 July 2013): http://www.aral.com.au/resources/options.html.
20. Easterly WThe White Man’s Burden: Why the West’s Efforts to Aid the Rest Have Done So Much Ill and So Little Good. London: Penguin Books; 2006a:
21. Easterly W.The big push déjà-vu: a review of Jeffrey Sachs’s ‘End of poverty: Economic possibilities for our time’.Journal of Economic Literature. 2006b;44 (1): 96-105
22. Essers DAntwerp, Belgium: University of Antwerp; 2011:
23. Learning From Change: Issues and Experiences in Participatory Monitoring and Evaluation. Estrella MBlauert JCampilan DGaventa JGonsalves JGuijt IJohnson DARicafort R, ed. London: Intermediate Technology Publications; 2000:
24. Geels FW.From sectoral systems of innovation to socio-technical systems: insights about dynamics and change from sociology and institutional theory.Research Policy. 2004;33 (6/7): 897-920
25. Geels FW,Schot J.Typology of sociotechnical transition pathways.Research Policy. 2007;36:399-417
26. Giddens JThe Constitution of Society: Outline of the Theory of Structuration. Cambridge: Polity Press; 1984:
27. GIZ (2011) Conference on Systemic Approaches in Evaluation. URL (consulted December 2010): http://www.evaluation-conference.de/en/index.html.
28. Grin J,Van Staveren AWerken aan systeeminnovaties. Lessen uit de praktijk van InnovatieNetwerk. Assen, the Netherlands: Van Gorcum; 2007:
29. Guba EG,Lincoln YSFourth Generation Evaluation. Newbury Park, CA: SAGE; 1989:
30. Guijt IParticipatory Monitoring and Evaluation for Natural Resource Management and Research. Best Practice Guidelines, Socio-Economic Methodologies. Chatham and London: Natural Resource Institute / DFID; 1999:
31. Hisschemöller M,Hoppe R.Coping with intractable controversies: the case for problem structuring in policy design and analysis.Knowledge and Policy: The International Journal of Knowledge Transfer and Utilization. 1996;8 (4): 40-60
32. Hoff K.Paths of institutional development: a view from economic history.World Bank Research Observer. 2003;18 (2): 205-26
33. Hounkonnou D,Kossou D,Kuyper TW,Leeuwis C,Nederlof S,Röling N,Sakyi-Dawson O,Traoré M,Van Huis A.An innovation systems approach to institutional change: smallholder development in West Africa.Agricultural Systems. 2012;108:74-83
34. Hummelbrunner R.Systems thinking and evaluation.Evaluation. 2011;17 (4): 395-04
35. Huntington SPolitical Order in Changing Societies. New Haven, CT: Yale University Press; 1968:
36. Jones HLondon: ODI; 2011:
37. Khor MThe Impact of Trade Liberalization on Agriculture in Developing Countries: The Case of Ghana. Penang: Third World Network; 2008:
38. Klein Woolthuis RJA,Gilsing V,Lankhuizen M.A system failure framework for innovation policy design.Technovation. 2005;25 (6): 609-19
39. KleinerARothG (1997) Learning histories: a new tool for turning organizational experience into action. URL (consulted 11 July 2007): http://ccs.mit.edu/lh/21CWP002.html and http://ccs.mit.edu/lh/.
40. Kouévi AT,Van Mierlo B,Leeuwis C.Repetitive discrepancy between espoused and in-use action theories for fishery intervention in Grand-Popo, Benin.International Journal of Learning and Change. 2011;5 (2): 114-38
41. Kouévi AT,Van Mierlo B,Leeuwis C,Vodouhè S.The design of a contextualized responsive evaluation framework for fishery management in Benin.Evaluation and Program Planning. 2013;36 (1): 15-28
42. Landes DSThe Wealth and Poverty of Nations. Why Some Are So Rich and Some So Poor. New York/London: W.W. Norton & Co; 1998:
43. Leeuwis C.Re-conceptualizing participation for sustainable rural development: towards a negotiation approach.Development and Change. 2000;31:931-59
44. Loeber A,Van Mierlo B,Grin J,Leeuwis CSocial Learning Towards a More Sustainable World. Wals A, ed. Wageningen, the Netherlands: Wageningen Academic Publishers; 2007:83-98.
45. Long N,Van der Ploeg JD.Demythologizing planned intervention: an actor perspective.Sociologia Ruralis. 1989;29 (3–4): 226-49
46. Mayne J,Stern ECanberra: Australian Centre for International Agricultural Research; 2013:
47. Midgley G.Pluralism and the legitimation of systems science.Systems Practice. 1992;5:147-72
48. Midgley GSystems Concepts in Evaluation: An Expert Anthology. Williams BImam I, ed. Point Reyes, CA: EdgePress; 2007:11-34.
49. Mowles C.Complex, but not quite complex enough: the turn to the complexity sciences in evaluation scholarship.Evaluation. 2014;20 (2): 160-75
50. Moyo DDead Aid. Why Aid Is Not Working and How There Is Another Way for Africa. London: Penguin Books; 2010:
51. Beyond Log Frame: Using Systems Concepts in Evaluation. Nobuko F, ed. Tokyo: FASID; 2010:
52. The Logical Framework Approach (LFA). Handbook for Objectives-Oriented Planning. 1999) The Logical Framework Approach (LFA). Handbook for Objectives-Oriented Planning, 4th edn.Norwegian Agency for Development Cooperation.Norwegian Agency for Development Cooperation; 1999:
53. Örtengren KThe Logical Framework Approach. A Summary of the Theory Behind the LFA Method. Stockholm: SIDA; 2004:
54. Page SE.Path dependence.Quarterly Journal of Political Science. 2006;1:87-115
55. PANOS (2009) How can complexity theory contribute to more effective development and aid evaluation? Workshop Report. London: Panos. URL (consulted 19 May 2010): http://www.panos.org.uk.
56. Patton MQDevelopmental Evaluation. Applying Complexity Concepts to Enhance Innovation and Use. New York/London: The Guilford Press; 2011:
57. Pawson R,Tilley NRealistic Evaluation. London: SAGE; 1997:
58. Pierson P.Increasing returns, path dependence and the study of politics.American Political Science Review. 2000;94 (2): 252-67
59. Ramalingam BAid on the Edge of Chaos. Rethinking International Cooperation in a Complex World. Oxford: Oxford University Press; 2013:
60. Regeer BJ,Hoes AC,Van Amstel M,Caron-Flinterman JF,Bunders JFG.Six guiding principles for evaluating mode-2 strategies for sustainable development.American Journal of Evaluation. 2009;30 (4): 515-37
61. Reynolds MSystems Concepts in Evaluation: An Expert Anthology. Williams BImam I, ed. Point Reyes, CA: EdgePress; 2007:101-22.
62. Ringsing B,Leeuwis C.Learning about advocacy: a case-study of challenges, everyday practices.Evaluation: The International Journal of Theory, Research and Practice. 2008;14 (4): 407-30
63. Rip A,Kemp RHuman Choice and Climate Change. An International Assessment. Rayner SMalcolm EL, ed. Washington, DC: Batell Press; 1998:327-99.
64. Rittel H,Webber M.Dilemmas in a general theory of planning.Policy Sciences. 1973;4:155-69
65. Rogers PJ.Using programme theory to evaluate complicated and complex aspects of interventions.Evaluation. 2008;14 (1): 29-48
66. Sachs JThe End of Poverty: Economic Possibilities for Our Time. New York: Penguin Press; 2005:
67. Senge PThe Fifth Discipline: The Art and Practice of the Learning Organization. New York: Doubleday Currency; 1990:
68. Shields D.What is the logical framework?.Rural Extension Bulletin I. 1993;4:15-20
69. Snowden D,Boone ME.A leader’s framework for decision making.Harvard Business Review. 2007;:69-76
70. Stacey RDManaging the Unknowable: Strategic Boundaries between Order and Chaos in Organizations. San Francisco, CA: Jossey Bass; 1992:
71. Stake REEvaluation Models: Viewpoints on Educational and Human Services Evaluation. Madaus GScriven MStufflebeam D, ed. Norwell, MA: Kluwer Nijhoff Publishing; 1983:287-310.
72. Totin E,Van Mierlo B,Saïdou A,Mongbo R,Agbossou E,Stroosnijder L,Leeuwis C.Barriers and opportunities for innovation in rice production in the inland valleys.NJAS-Wageningen Journal of Life Sciences. 2012;60–63:57-66
73. Tukker A,Charter M,Vezzoli C,Sto E,Munch Andersen MSystem Innovation for Sustainability. Perspectives on Radical Changes to Sustainable Consumption and Production. Sheffield: Greenleaf Publishing; 2008:
74. Ulrich HP.Enhancing the effectiveness of international development: a systems approach.Development in Practice. 2010;20 (2): 251-64
75. Ulrich W,Reynolds MSystems Approaches to Managing Change: A Practical Guide. Reynolds MHolwell S, ed. London: Springer, The Open University; 2010:
76. The Millennium Development Goals Report 2013. New York: United Nations; 2013:
77. Van Mierlo B,Arkesteijn M,Leeuwis C.Enhancing the reflexivity of system innovation projects with system analyses.American Journal of Evaluation. 2010a;31 (2): 143-61
78. Van Mierlo BC,Regeer B,Van Amstel M, et alReflexive Monitoring in Action. A Guide for Monitoring System Innovation Projects. Boxtel, the Netherlands: Boxpress; 2010b:
79. Van Mierlo BC,Janssen APHM,Leenstra FR,Van Weeghel HJE.Encouraging system learning in two poultry subsectors.Agricultural Systems. 2013;115:29-40
80. Van Ongevalle J,Huysen H,Van Petegem P.Dealing with complexity through actor-focussed planning, monitoring and evaluation.Evaluation. 2014;20:447-66
81. Voß JP,Bauknecht D,Kemp RReflexive Governance for Sustainable Development. Cheltenham: Edward Elgar; 2006:
82. Wade RH.Failing states and cumulative causation in the world system.International Political Science Review. 2005;26 (1): 17-36
83. White HNew Delhi: International Initiative for Impact Evaluation; 2011:
84. Williams B,Hummelbrunner RSystems Concepts in Action. A Practitioner’s Toolkit. Stanford, CA: Stanford Business Books; 2011:
85. Zimmerman B,Glouberman SHealth Care Services and the Process of Change. Forest P-GMcIntosh TMarchildon G, ed. Toronto, Canada: University of Toronto Press; 2004:21-53.