Exploring ways to reconcile accountability and learning in the evaluation of niche experiments

Evaluation

Volumn 22, Issue 1, 2016, Pages 6-28

  Regeer, Barbara J ^a   de Wildt Liesveld, Renée ^a   van Mierlo, Barbara ^b   Bunders, Joske F G ^a  

^a ATHENA INSTITUTE   (Netherlands)

^b WAGENINGEN UNIVERSITY   (Netherlands)

Author keywords

accountability; alignment; evaluation; learning; niche experiments

Indexed keywords

EID: 84953377043     PISSN: 13563890     EISSN: 14617153     Source Type: Journal    
DOI: 10.1177/1356389015623659     Document Type: Article

References (74)

1. T.A.AbmaR.E.Stake (2001) Stake’s responsive evaluation: Core ideas and evolution. New Directions for Evaluation2001(92): 7–22.
2. M.AndreausE.Costa (2014) Toward an integrated accountability model for nonprofit organizations. In: (eds) Accountability and Social Accounting for Social and Non-profit Organizations (Advances in Public Interest Accounting). Bradford: Emerald Group Publishing Limited, pp. 153–176.
3. M.ArkesteijnB.van MierloC.Leeuwis (2015) The need for reflexive evaluation approaches in development cooperation. Evaluation21(1): 99–115.
4. D.Baccarini (1999) The logical framework method for defining project success. Project Management Journal30(4): 25–32.
5. L.M.Benjamin (2008) Evaluator’s role in accountability relationships: Measurement technician, capacity builder or risk manager?Evaluation14(3): 323–343.
6. L.M.BenjaminJ.C.Greene (2009) From program to network: The evaluator’s role in today’s public problem-solving environment. American Journal of Evaluation30(3): 296–309.
7. D.CabreraL.ColosiC.Lobdell (2008) Systems thinking. Evaluation and Program Planning31(3): 299–310.
8. C.K.CasselE.McParland (2002) Accountability: Regulating health care as a public good. In: (eds) Ethical Dimensions of Health Policy. New York: Oxford University Press, pp. 249–262.
9. H.Chen (1990) Issues in constructing program theory. New Directions for Program Evaluation47: 7–18.
10. J.A.Chouinard (2013) The case for participatory evaluation in an era of accountability. American Journal of Evaluation34(2): 237–253.
11. J.P.ConnellA.C.KubischL.B.Schorr. (1995) New Approaches to Evaluating Community Initiatives. Volume 1: Concepts, Methods and Contexts. Washington, DC: Aspen Institute.
12. J.B.CousinsL.M.Earl (1992) The case for participatory evaluation. Educational Evaluation and Policy Analysis14(4): 397–418.
13. T.D’Aunno (1992) The effectiveness of human service organizations: A comparison of models. In: (ed.) Human Services as Complex Organisations. Newbury Park: Sage Publications, pp. 341–361.
14. P.De Lancer Julnes (2006) Performance measurement. An effective tool for government accountability? The debate goes on. Evaluation12(2): 219–235.
15. R.de Wildt-LiesveldB.J.RegeerJ.Bunders (2015) Governance strategies to enhance the adaptive capacity of niche experiments. Environmental Innovation and Societal Transitions16: 154–172.
16. R.de Wildt-LiesveldB.RegeerM.van Amstel-van Saane. (2013) Triple P value propositions – From a value trade-off to synergy. Interdisciplinary Environmental Review14(3): 194–210.
17. A.Ebrahim (2005) Accountability myopia: Losing sight of organizational learning. Nonprofit and Voluntary Sector Quarterly34(1): 56–87.
18. R.EdelenboschF.KupperL.Krabbendam. (2015) Brain-based learning and educational neuroscience: Boundary work. Mind, Brain, and Education9(1): 40–49.
19. M.EdwardsD.Hulme (1996) Too close for comfort? The impact of official aid on nongovernmental organizations. World Development24(6): 961–973.
20. K.EisenhardtJ.Martin (2000) Dynamic capabilities: What are they?Stragic Management Journal21: 1005–1121.
21. O.N.Feinstein (2012) Evaluation as a learning tool. In: (eds) Evaluation Voices from Latin America. New Directions for Evaluation. Wiley Periodicals, Inc., and the American Evaluation Association. Published online in Wiley Online Library, pp. 103–112.
22. F.FischerG.J.MillerM.S.Sidney (2006) Handbook of Public Policy Analysis: Theory, Politics and Methods. New York: CRC Press, Taylor and Francis.
23. V.J.Friedman (2001) Designed blindness: An action science perspective on programme theory evaluation. American Journal of Evaluation22(2): 161–181.
24. R.E.Fry (1995) Accountability in organizational life: Problem or opportunity for nonprofits. Nonprofit Management and Leadership6(2): 181–195.
25. K.Fulbright-AndersonA.KubischJ.Connell (1998) New Approaches to Evaluating Community Initiatives. Volume 2: Theory, Measurement and Analysis. Washington, DC: Aspen Institute.
26. F.W.GeelsJ.Schot (2007) Typology of sociotechnical transition pathways. Research Policy36(3): 399–417.
27. J.Grin (2010) The governance of transitions. An agency perspective. In: (eds) Transitions to Sustainable Development New Directions in the Study of Long Term Transformative Change. New York: Routledge.
28. A.G.GubaY.Lincoln (1989) Fourth Generation Evaluation. London, New Delhi: Sage Publications.
29. I.Guijt (2010) Accountability and learning: Exploding the myth of incompatibility between accountability and learning. In: (eds) Capacity Development in Practice. London: Earthscan, pp. 277–291.
30. M.Hajer (2003) Policy without polity? Policy analysis and the institutional void. Policy Sciences36: 175–195.
31. M.M.Harmon (1995) Responsibility as Paradox: A Critique of Rational Discourse on Government. Thousand Oaks, CA: Sage Publications.
32. C.M.HendriksJ.Grin (2007) Contextualizing reflexive governance: The politics of Dutch transitions to sustainability. Journal of Environmental Policy & Planning9(3–4): 333–350.
33. A.C.HoesB.J.RegeerM.B.M.Zweekhorst (2012) Innovation projects and visions on the future: Ambition and commitment in the Agropark case. Journal on Chain and Network Science12(2): 111–124.
34. A.-C.HoesB.Regeer (2015) Adoption of novelties in a pluralist society: Exploring an Agropark case study. Journal of Environmental Policy & Planning17(1): 1–22.
35. P.HoutzagerA.Joshi (2008) Introduction: Contours of a research project and early findings. IDS Bulletin38(6): 1–9.
36. W.JannK.Wegrich (2007) Theories of the policy cycle. In: (eds) Handbook of Public Policy: Theory, Politics and Methods. Boca Raton, FL: CRC Press – Taylor & Francis Groups, pp. 43–62.
37. A.JoshiP.P.Houtzager (2012) Widgets or watchdogs? Conceptual explorations in social accountability. Public Management Review14(2): 145–162.
38. Y.KeshetE.Ben-AryeE.Schiff (2013) The use of boundary objects to enhance interprofessional collaboration: Integrating complementary medicine in a hospital setting. Sociology of Health & Illness35: 666–681.
39. K.E.Kirkhart (2000) Reconceptualizing Evaluation Use: An Integrated Theory of Influence. In: (eds) New Directions for Evaluation. San Francisco: Jossey-Bass, pp. 5–23.
40. C.KurtzD.Snowden (2003) The new dynamics of strategy: Sense-making in a complex and complicated world. IBM Systems Journal42(3): 462–483.
41. M.Lehtonen (2005) OECD Environmental performance review programme: Accountability (f)or learning?Evaluation11(2): 169–188.
42. M.Lehtonen (2014) Evaluating megaprojects: From the “iron triangle” to network mapping. Evaluation20(3): 278–295.
43. D.Loorbach (2010) Transition management for sustainable development: A prescriptive, complexity-based governance framework. Governance23(1): 161–183.
44. J.G.MarchJ.P.Olsen (1985) Democratic Governance. New York: Free Press.
45. A.Najam (1996) NGO accountability: A conceptual framework. Development Policy Review14(4): 339–354.
46. K.NewcomerK.Olejniczak (2013) Accountability for Learning: Promising Practices from Ten Countries. In: 1st International Conference on Public Policy. Grenoble, 26–28 June.
47. B.O’DwyerJ.Unerman (2007) From functional to social accountability: Transforming the accountability relationship between funders and non-governmental development organisations. Accounting, Auditing & Accountability Journal20(3): 446–471.
48. P.OvensF.WellsP.Wallis. (2012) Developing Inquiry for Learning: Reflecting Collaborative Ways to Learn How to Learn in Higher Education (Google eBook). Abingdon (UK) and New York: CRC Press.
49. M.Q.Patton (2008) Utilization-Focused Evaluation. Saint Paul, MN: Sage Publications, Inc.
50. B.Perrin (2002) Towards a new view of accountability. In: Symposium on Promoting Organisation Learning via Evaluation: the New Accountability?Seville, Spain, 10–12 October.
51. R.RavenS.van den BoschR.Weterings (2007) Strategic niche management and transition experiments. From analytical tool to a competence kit for practitioners. In: 4th Dubrovnik Conference on Sustainable Development of Energy Water and Environment Systems. Dubrovnik, Croatia, 4–7 June.
52. B.J.RegeerA.-C.HoesM.van Amstel-van Saane. (2009) Six guiding principles for evaluating mode-2 strategies for sustainable development. American Journal of Evaluation30(4): 515–537.
53. B.J.RichmondL.MookJ.Quarter (2003) Social accounting for nonprofits: Two models. Nonprofit Management and Leadership13(4): 308–324.
54. P.J.Rogers (2008) Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation14(1): 29–48.
55. J.Sanderson (2012) Risk, uncertainty and governance in megaprojects: A critical discussion of alternative explanations. International Journal of Project Management30(4): 432–443.
56. J.SchotF.W.Geels (2008) Strategic niche management and sustainable innovation journeys: Theory, findings, research agenda, and policy. Technology Analysis & Strategic Management20(5): 537–554.
57. N.SiddiqueeG.Faroqi (2009) Holding the giants to account? Contraints on NGO accountability in Bangladesh. Asian Journal of Political Science17(3): 243–264.
58. A.SmithR.Raven (2012) What is protective space? Reconsidering niches in transitions to sustainability. Research Policy41(6): 1025–1036.
59. R.E.StakeT.A.Abma (2005) Responsive evaluation. In: (ed) Encyclopaedia of Evaluation. Thousand Oaks, CA: Sage.
60. S.L.Star (2010) This is not a boundary object: Reflections on the origin of a concept. Science, Technology & Human Values35(5): 601–617.
61. S.L.StarJ.R.Griesemer (1989) Institutional ecology, “translations” and boundary objects: Amateurs and professionals in Berkeley’s Museum of Vertebrate Zoology. Social Studies of Science19(3): 387–420.
62. M.Taanman (2014) Looking for Transitions: Monitoring Approach for Sustainable Transition Programmes. Rotterdam: Erasmus University Rotterdam.
63. D.TeeceG.PisanoA.Shuen (1997) Dynamic capabilities and strategic management. Strategic Management Journal18(7): 509–533.
64. P.Van Der Knaap (2001) Policy evaluation and outcome-oriented management: Instruments for policy-oriented learning. Recent developments in the Netherlands and the evaluation practice of the European Structural Funds. Informationen Zur RaumentwicklungIssue 6/7: 359–371.
65. F.-B.Van Der MeerJ.Edelenbos (2006) Evaluation in multi-actor policy processes: Accountability, learning and co-operation. Evaluation12(2): 201–218.
66. A.Van MarrewijkS.R.CleggT.S.Pitsis. (2008) Managing public-private megaprojects: Paradoxes, complexity, and project design. International Journal of Project Management26(6): 591–600.
67. B.Van MierloB.J.RegeerM.van Amstel. (2010a) Reflexive Monitoring in Action: A Guide for Monitoring System Innovation Projects. Wageningen, Amsterdam. Oisterwijk: Boxpress.
68. B.Van MierloM.van AmstelM.Arkesteijn. (2010b) Keeping the ambition high. The value of reflexive monitoring in action for system innovation projects. In: SISA Workshop; International Workshop on System Innovations, Knowledge Regimes, and Design Practices towards Sustainable Agriculture. Lelystad, 16–18 June.
69. E.Vedung (1997) Public Policy and Program Evaluation. New Brunswick, NJ: Transaction Publishers.
70. E.Wenger (1998) Communities of practice: Learning as a social system. Systems Thinker9(5): 2–3.
71. R.D.Whitley (1984) The Intellectual and Social Organization of the Sciences. Oxford: Oxford University Press.
72. B.WilliamsI.Imam (2007) Systems Concepts in Evaluation. An Expert Anthology. Point Reyes, CA: Edge Press / American Evaluation Association.
73. S.A.ZahraH.J.SapienzaP.Davidsson (2006) Entrepreneurship and dynamic capabilities: A review, model and research agenda. Journal of Management Studies43: 917–955.
74. E.Zapico-Goñi (2007) Matching public management, accountability and evaluation in uncertain contexts: A practical suggestion. Evaluation13(4): 421–438.