Capacity Development Evaluation: The Challenge of the Results Agenda and Measuring Return on Investment in the Global South

World Development

Volumn 79, Issue , 2016, Pages 1-13

  Vallejo, Bertha ^a,b   Wehn, Uta ^c  

^a TILBURG UNIVERSITY   (Netherlands)

^b UNU MERIT   (Netherlands)

^c UNESCO IHE INSTITUTE FOR WATER EDUCATION   (Netherlands)

Author keywords

Capacity development; Evaluation; Learning; Results agenda; Sustainable Development Goals; Value for money

Indexed keywords

DECISION MAKING; INVESTMENT; LEARNING; SUSTAINABLE DEVELOPMENT;

EID: 84947772245     PISSN: 0305750X     EISSN: 18735991     Source Type: Journal    
DOI: 10.1016/j.worlddev.2015.10.044     Document Type: Article

References (105)

1. Abhijit B., Duflo E., Glennerster R., Kinnan C. The miracle of microfinance? Evidence from a randomized evaluation. American Economic Journal: Applied Economics 2015, 7(1):22-53. 10.1257/app.20130533.
2. Aguinis H., Kraiger K. Benefits of training and development for individuals and teams, organizations and society. Annual Review of Psychology 2009, 60:451-474. 10.1146/annurev.psych.60.110707.163505.
3. Alaerts G., Kasperma J. Progress and challenges in knowledge and capacity development. Capacity development for improved water management 2009, Taylor and Francis, London, UK. M. Blokland, G. Alaerts, J. Kasperma (Eds.).
4. Alley K., Negretto G. Literature review: Definitions of capacity building and implications for monitoring and evaluation 1999, UNICEF, Division of Evaluation, Policy and Planning, New York.
5. Argyris C., Schön D. Organizational learning: A theory of action perspective 1978, Addison-Wesley, MA.
6. Banks N., Hulme D., Edwards M. NGOs, states, and donors revisited: Still too close for comfort?. World Development 2015, 66:707-718. 10.1016/j.worlddev.2014.09.028.
7. Baser H., Morgan P. Capacity, change and performance. Discussion paper (59B) 2008, European Center for Development Policy Management (ECDPM), Maastricht, NL. ECDPM (Ed.).
8. Berg E.J. Rethinking technical cooperation reforms for capacity building in Africa 1993, UNDP, New York.
9. Blume B.D., Ford J.K., Baldwin T.T., Huang J.L. Transfer of training: A meta-analytic review. Journal of Management 2010, 36(4):1040-1064. 10.1177/0149206309352880.
10. Britton B. Self-reflection. Monitoring and evaluation for personal learning. Capacity development in practice 2010, 264-276. Earthscan, London. J. Ubels, N.A. Acquaye-Baddoo, A. Fowler (Eds.).
11. Brown L., LaFond A., Macintyre K. Measuring capacity building 2001, MEASURE Evaluation Project, Chapter Hill.
12. Burns J. Leadership 1978, Harper & Row Publishers, New York.
13. Carman J.G., Fredericks K.A. Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full?. American Journal of Evaluation 2010, 31(1):84-104. 10.1177/1098214009352361.
14. Clark N., Hall A., Sulaiman R., Naik G. Research as capacity building: The case of an NGO facilitated post-harvesting innovation system for the Himalayan Hills. World Development 2003, 31(11):1845-1863. 10.1016/j.worlddev.2003.04.001.
15. Cohen J.M. Capacity building, methodology and the language of discourse in development studies 1994, Harvard Institute for International Development, Cambridge, Mass.
16. Darghouth S. Emerging public-private partnerships in irrigation development and management 2007, World Bank, Washington, DC.
17. Dart J., Davies R. A dialogical, story-based evaluation tool: The most significant change technique. American Journal of Evaluation 2003, 24(2):137-155. 10.1177/109821400302400202.
18. Datta A., Shaxson L., Pellini A. Capacity, complexity and consulting lessons from managing capacity development projects 2012, Overseas Development Institute, London.
19. Denker C., Lutz T. Handbook operationalization of capacity development in the Uganda water and environment sector 2014, Ministry of Water and Environment, Kampala, Uganda.
20. DFID Promoting institutional and organisational development, department for international development issues 2003, DFID, London.
21. Dia M. Africa's management in the 1990s and beyond 1996, The World Bank, Washington, DC.
22. Earl S., Carden F., Patton M.Q., Smutylo T. Outcome mapping: Building, learning and reflection into development programs 2001, International Development Research Center (IDRC), Ottawa.
23. Systems of innovation approaches: Technologies, institutions and organizations 1997, Pinter, Casell Academic, London. C. Edquist (Ed.).
24. Eichinger R., Lombardo M. The career architect development planner 1996, Lominger Limited, Minneapolis.
25. Enemark, S., & Ahene, R. (2002). Capacity building in land management - Implementing land policy reforms in Malawi. Paper presented at the FIG XXII International Congress. Washington, DC.
26. Engel P., Keijzer N., Land T. A balanced approach to monitoring and evaluating capacity and performance. A proposal for a framework 2007, Discussion paper, ECDPM, Maastricht.
27. European Commission, JRC-IPTS, Joanneum Research RTD evaluation toolbox - Assessing the socio-economic impact of RTD-policies. IPTS technical report series 2002, European Commission Joint Research Centre and Institute for Prospective Technological Studies, Sevilla, Spain. G. Fahrenkrog, W. Polt, J. Rojo, A. Tubke, K. Zinocker (Eds.).
28. Eyben, R. (2011). 'Stuff happens': The risks of a results agenda. Retrieved from . http://oxfamblogs.org/fp2p/stuff-happens-the-risks-of-a-results-agenda-guest-post-from-rosalind-eyben/.
29. Forum Pty Ltd. (2015). The 70:20:10 framework. What is it? Retrieved January 18, 2015, from . https://www.702010forum.com/about-702010-framework.
30. Fowler A. Striking a balance: A guide to enhancing the effectiveness of non-governmental organizations in international development 1997, Earthscan, London.
31. Georgenson D.L. The problem of transfer calls for partnership. Training and Development Journal 1982, 36(10):75-78.
32. Godfrey M., Sophal C., Kato T., Piseth L.V., Dorina P., Saravy T.S., et al. Technical assistance and capacity development in an aid-dependent economy: The experience of Cambodia. World Development 2002, 30(3):355-373.
33. Gonzales F.J., Salman S.M.A. Institutional reform for irrigation and drainage: Proceedings of a World Bank workshop. World Bank technical paper (524) 2002, World Bank, Washington, DC.
34. Green, D. (2010). Is the aid industry's audit culture becoming a threat to accountability? Retrieved from http://oxfamblogs.org/fp2p/is-the-aid-industrys-audit-culture-becoming-a-threat-to-accountability/.
35. Green, D. (2015). What do we know about the politics of reducing inequality? Not much - It's time to find out. Blog. Retrieved from http://oxfamblogs.org/fp2p/what-do-we-know-about-the-politics-of-reducing-inequality-not-much-its-time-to-find-out/.
36. Grossman R., Salas E. The transfer of training: What really matters?. International Journal of Training and Development 2011, 15(2):103-120.
37. Guicquero, Y. (2015). Financing sustainable development: The resources are already in the south. Global Views. #Fin4Dev. Retrieved July 2, 2015, from https://www.devex.com/news/financing-sustainable-development-the-resources-are-already-in-the-south-86410.
38. Gunzburg, T. (2015). Time for the EU to lay its cards on the table. Global Views. #FIN4DEV. Retrieved June 30, 2015, from https://www.devex.com/news/time-for-the-eu-to-lay-its-cards-on-the-table-86404.
39. Hedberg B. How organizations learn and unlearn. Handbook of organizational design 1981, Oxford University Press, New York. P. Nystrom, W.H. Starbuck (Eds.).
40. Hencke, D. (2015). IDC chair candidates promise tougher DfID scrutiny, value for money. Inside Development. The Future of DFID. Retrieved June 5, 2015, from https://www.devex.com/news/idc-chair-candidates-promise-tougher-dfid-scrutiny-value-for-money-86360.
41. HLF3. (2008). Accra agenda for action. Paper presented at the Third High Level Forum on Aid Effectiveness, Accra, Ghana.
42. Jennings C., Wargnier J. Effective learning with 70:20:10. The new frontier for the extended enterprise 2015, CrossKnowledge.
43. Jones H., Hearn S. Outcome mapping: A realistic alternative for planning, monitoring and evaluation 2009, ODI, London.
44. Joshi D.K., Hughes B.B., Sisk T.D. Improving governance for the post-2015 sustainable development goals: Scenario forecasting the next 50years. World Development 2015, 70:286-302. 10.1016/j.worlddev.2015.01.013.
45. Jozwiak, G. (2015). The future of DfID - And UK development cooperation. Inside Development. UK Aid. Retrieved from Devex. The Development Newswire website: https://www.devex.com/news/the-future-of-dfid-and-uk-development-cooperation-85455.
46. Kaplan A. Capacity building: Shifting the paradigms of practice. Development in Practice 2000, 10(3 & 4):517-526.
47. Keijzer N., Spierings E., Phlix G., Fowler A. Bringing the invisible into perspective 2011, Reference paper for using the 5Cs framework to plan, monitor and evaluate capacity and results of capacity development processes, ECDPM, Maastricht.
48. Kirkpatrick D.L., Kirkpatrick J.D. Evaluating training programs: The four levels 2006, Berrett-Koehler, San Francisco, CA. 3rd ed.
49. Kolb D. Experiential learning: Experience as the source of learning and development 1984, Prentice-Hall, Englewood Cliffs, NJ.
50. Kuhl S. Capacity development as the model for development aid organizations. Development and Change 2009, 40(3):551-577.
51. Levinger, B. (2015). Capacity building. More than just training. In K. Warren (Ed.), Inside development. Devex.com. https://www.devex.com/news/capacity-building-more-than-just-training-85376.
52. Lifvergen S., Docherty P., Shain A.B.R. Toward a sustainable healthcare system: Transformation through participation. Organizing for sustainable effectiveness 2011, Emerald Books, London. S.A. Mohrman, A.B.R. Shani, C. Worley (Eds.).
53. Lincklaen Arriens W.T., Wehn de Montalvo U. Exploring water leadership. Water Policy 2013, 15:15-41. 10.2166/wp.2013.010.
54. Lusthaus C., Adrien M.-H., Perstinger M. Capacity development: Definitions, issues and implications for planning, monitoring and evaluation 1999, Universalia occasional papers, Universalia, Montreal.
55. Knowledge societies - information technology for sustainable development 1998, Oxford University Press, Oxford. R. Mansell, U. Wehn (Eds.).
56. Mertens D., Hesse-Biber S. Mixed methods and credibility of evidence in evaluation. New Directions for Evaluation 2013, 138:5-13. 10.1002/ev.20053.
57. Morgan G. Creative organizational theory: A resource book 1989, SAGE Publications, Newbury Park, CA.
58. Morgan P. Capacity and capacity development - some strategies 1998, Note prepared for the Political and Social Policies Division, CIDA, Ottawa.
59. Morgan P. An update on the performance monitoring of capacity development programs: What are we learning? 1999, CIDA, Ottawa.
60. Morgan P. The concept of capacity 2006, European Centre for Development Policy Management (ECDPM), Maastricht.
61. Morgan P., Baser H. Making technical cooperation more effective. New approaches in international development 1993, CIDA, Technical Cooperation Division, Hull.
62. Morgan P., Land T., Baser H. Study on capacity, change and performance 2005, Discussion paper, European Centre for Development Policy Management (ECDPM), Maastricht, NL.
63. Mvulirwenande, S., Wehn, U., & Alaerts, G. (2014). Evaluating capacity development in the water sector: Challenges and progress. Paper presented at the 37th WEDC international conference "Knowledge management in water utilities: From challenges to priorities." Hanoi, Vietnam.
64. Mvulirwenande, S., Wehn, U., & Alaerts, G. (2015). Closing the learning cycle in capacity development. A two-step approach to impact evaluation. Paper presented at the 38th WEDC international conference. Water, sanitation and hygiene services beyond 2015: Improving access and sustainability. Loughborough University.
65. Nelson R., Winter S. An evolutionary theory of economic change 1982, Harvard University Press.
66. Nonaka I., Takeuchi H. The knowledge creating company. How Japanese companies create the dynamics of innovation 1995, Oxford University Press, New York.
67. Shaping the 21st century: The context of development co-operation 1996, OECD, OECD, Paris.
68. The challenge of capacity development. Working towards good practice. DAC guidelines and reference series 2006, OECD, OECD, Paris.
69. OECD. (2007-2012). Country programmable aid (CPA) (Aid Architecture). Available from OECD.org Interactive CPA Charts. Retrieved October 17, 2014 http://www.oecd.org/development/aid-architecture/cpa.htm.
70. OECD. (2011). Busan partnership for effective development co-operation. Paper presented at the Fourth High Level Forum on aid effectiveness. Busan, Korea.
71. Ohlbaum, D. (2015a). The illusion of control. Foreign aid effectiveness: A radical rethink. Retrieved February 19, 2015, from https://www.devex.com/news/the-illusion-of-control-85523.
72. Ohlbaum, D. (2015b). The siren song of technical assistance. Global Views. Funding trends. Foreign aid effectiveness. A radical rethink (3/7). Retrieved February 25, 2015, from https://www.devex.com/news/the-siren-song-of-technical-assistance-85539.
73. Ortiz Aragon A., Giles Macedo J.C. A 'systemic theories of change' approach for purposeful capacity development. IDS Bulletin 2010, 41(3):87-99.
74. Ortiz A., Taylor P. Learning purposefully in capacity development: Why, what and when to measure?. Rethinking capacity development 2009, UNESCO-IIEP, Paris. International Institute for Education and Planning (IIEP) (Ed.).
75. Pascual Sanz M., Veenstra S., Wehn de Montalvo U., van Tulder R., Alaerts G. What counts as "results" in capacity development partnerships between water operators? A multi-path approach toward accountability, adaptation and learning. Water Policy 2013, 15:242-266. 10.2166/wp.2013.022.
76. Pearson, J. (2011). Training and beyond: Seeking better practices for capacity development. OECD development cooperation working papers, 1.
77. Polt W., Rojo J. Evaluation methodologies. RTD-evaluation toolbox assessing the socio-economic impact of RTD-policies 2002, European Commission, JRC-IPTS and Joanneum Research, Sevilla, SP. G. Fahrenkrog, W. Polt, J. Rojo, A. Tubke, K. Zinocker (Eds.).
78. Preskill H., Boyle S. A multidisciplinary model of evaluation capacity building. American Journal of Evaluation 2008, 29(4):443-459. 10.1177/1098214008324182.
79. Raynard P. Mapping accountability in humanitarian assistance 2000, Report to Biannual Meeting, Active Learning Network for Accountability and Performance in Humanitarian Assistance (ALNAP), UK.
80. Roberts D. Managing knowledge results: An exploration of the systems and practices of development agencies. Capacity development and results 2013, World Bank Institute.
81. Santos, L. A. (2015). What makes knowledge partnerships for development work. Devex Impact. Inside Development. Knowledge Partnerships. Retrieved June 5, 2015, from https://www.devex.com/news/what-makes-knowledge-partnerships-for-development-work-86206.
82. Sastre Merino S., de los Rios Carmenado I. Capacity building in developing countries. Procedia - Social and Behavioral Sciences 2012, 46:960-967. 10.1016/j.sbspro.2012.05.231.
83. Senge P.M. The fifth discipline. The art and practice of the learning organization 1990, Bantam Doubleday Dell Publishing Group, Inc.
84. Simon H. Bounded rationality and organizational learning. Organizational learning 1996, Sage Publications, London. W.M. Cohen, L.S. Sproull (Eds.).
85. Smillie I. The alms bazaar: Altruism under fire - Non-profit organizations and international development 1995, Intermediate Technology Publications, UK.
86. Stachowiak S. Pathways for change. 6 theories about how policy change happens 2009, Organizational Research Services (ORS).
87. Themistocleous G., Wearne S.H. Project management topic coverage in journals. International Journal of Project Management 2000, 18(1):7-11.
88. Tough A.M. Learning without a teacher. A study of tasks and assistance during adult self-teaching projects 1967, The Ontario Institute for Studies on Education (OISE), Toronto.
89. Tough A.M. Why adults learn 1968, The Ontario Institute for Studies on Education (OISE), Toronto.
90. Tough A.M. The adult's learning projects. A fresh approach to theory and practice in adult learning 1971, Learning Concepts, Austin, TX. 2nd ed.
91. Travisan M.S. Evaluation capacity in K-12 counseling programs. American Journal of Evaluation 2002, 23(3):275-290. 10.1177/109821400202300304.
92. Capacity development in practice 2010, Earthscan, Washington, DC. J. Ubels, N.-A. Acquaye-Baddoo, A. Fowler (Eds.).
93. UNDP Capacity development resources book 1997, UNDP, New York.
94. UNDP Overview of UNDP's approach to supporting capacity development 2009, Capacity Development Group, Bureau for Development Policy. United Nations Development Programme.
95. UNDP Measuring capacity 2010, United Nations Development Programme, New York.
96. UNDP Innovations in monitoring & evaluating results 2013, Discussion paper. Knowledge, innovation and capacity, United Nations Development Program.
97. UNESCO Capacity building guidebook for planning education in emergencies and reconstruction 2006, International Institute for Educational Planning, Paris.
98. Valters, C. (2015). 3 big problems with how we think about results and development. Global Views. The future of DFID. Retrieved July 4, 2015, from https://www.devex.com/news/3-big-problems-with-how-we-think-about-results-and-development-86419.
99. van Kemenade, E. (2014). The myth of the PDCA-cycle in times of emergent change. Paper presented at the European Organization for Quality Congress, Goteborg, Germany.
100. Vogel I. Review of the use of 'theory of change' in international development 2012, DFID, London.
101. Watson D. Measuring capacity development. Combining the "best of two worlds" in monitoring and evaluation of capacity development. Capacity development in practice 2010, 251-263. Earthscan, London. J. Ubels, N.-A. Acquaye-Baddoo, A. Fowler (Eds.).
102. Wehn, U. (2014a). Effective knowledge and capacity development for enhancing the post-2015 development goals. Paper presented at the International Development Studies Lecture Series 2014-2015. University of Amsterdam.
103. Wehn U. Way forward. How can we strengthen institutional capacity? 2014, UNESCO-IHE, Delft, NL.
104. Wehn de Montalvo U., Alaerts G. Leadership in knowledge and capacity development in the water sector: A status review. Water Policy 2013, 15(Suppl. 2):1-14. 10.2166/wp.2013.109.
105. WRI Roots of resilience. Growing the wealth of the poor 2008, World Resources Institute (WRI), in collaboration with United Nations Development Programme, United Nations Environment Programme, and the World Bank, Washington, DC.