The evaluation of climate policy: Theory and emerging practice in Europe

Policy Sciences

Volumn 44, Issue 2, 2011, Pages 179-198

  Huitema, Dave ^a   Jordan, Andrew ^b   Massey, Eric ^a   Rayner, Tim ^b   van Asselt, Harro ^a   Haug, Constanze ^a   Hildingsson, Roger ^c   Monni, Suvi ^d   Stripple, Johannes ^c  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^c LUND UNIVERSITY   (Sweden)

^d JOINT RESEARCH CENTRE   (Italy)

Author keywords

Climate policy; European Union; Evaluation theory; Meta analysis; Policy evaluation

Indexed keywords

ENVIRONMENTAL POLICY; EUROPEAN UNION; META-ANALYSIS; POLICY MAKING;

EUROPE;

EID: 79956146850     PISSN: 00322687     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11077-011-9125-7     Document Type: Article

References (57)

1. Abma, T., & In t Veld, R. (Eds.) (2001). Handboek beleidswetenschap. Amsterdam, The Netherlands: Boom Uitgevers.
2. Bailey, I., & Marsh, S. (2009). Facing up to the greenhouse challenge? Australian climate politics. In H. Compston & I. Bailey (Eds.) Turning down the heat (pp. 202-222). Basingstoke, UK: Palgrave Macmillan.
3. Berkes, F., & Folke, C. (Eds.) (1998). Linking social and ecological systems: Management practices and social mechanisms for building resilience. Cambridge, UK: Cambridge University Press.
4. Christie, C. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation, 97, 7-35.
5. Coenen, F. H. J. M., Huitema, D., & O'Toole, L. J., Jr. (Eds.) (1998). Participation and the quality of environmental decision making. Dordrecht: Kluwer Academic.
6. Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 80, 87-105.
7. Crabbé, A., & Leroy, P. (2008). The handbook of environmental policy evaluation. London, UK: Earthscan.
8. Derlien, H.-U., & Rist, R. C. (2002). Policy evaluation in international comparison. In J. E. Furubo, R. C. Rist, & R. Sandahl (Eds.) International atlas of evaluation (pp. 439-455). New Brunswick, NJ: Transaction Publishers.
9. Dryzek, J. S. (1987). Rational ecology: Environment and political economy. New York, USA: Basil Blackwell.
10. Dunn, W. (2004). Public policy analysis (3rd ed.) Englewood Cliffs, NJ: Prentice Hall.
11. Fischer, F. (1995). Evaluating public policy. Chicago, USA: Nelson-Hall Publishers.
12. Furubo, J. E., Rist, R. C., & Sandahl, R. (Eds.) (2002). International atlas of evaluation. New Brunswick, NJ: Transaction Publishers.
13. Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, USA: Sage Publications.
14. Guba, E., & Lincoln, Y. (1981). Effective evaluation. San Francisco, CA: Jossey-Bass.
15. Guba, E., & Lincoln, Y. (1989). Fourth generation evaluation. London, UK: Sage.
16. Gupta, J., & Grubb, M. (Eds.) (2000). Climate change and european leadership: A sustainable role for Europe?. Cheltenham, UK: Edward Elgar.
17. Harris, P. G. (Ed.) (2007). Europe and global climate change: Politics, foreign policy and regional cooperation. Cheltenham, UK: Edward Elgar.
18. Haug, C., & Huitema, D. (2009). Leren van een beleidsexercitie. De casus van het Europese milieubeleid. Bestuurskunde, 18(3), 36-46.
19. Haug, C., Huitema, D., & Wenzler, I. (forthcoming). Learning through games? Evaluating the learning effect of a policy exercise on European climate policy. Technological Forecasting & Social Change, 78. doi: 10. 1016/j. techfore. 2010. 12. 001.
20. Haug, C., Rayner, T., Huitema, D., Massey. E., Monni, S., van Asselt, H., et al. (2008). What makes climate policies effective? Findings from a 'meta analysis' of recent policy evaluations. Institute for Environmental Studies (IVM). Available at http://adamproject. info/index. php/Downloads/.
21. Haug, C., Rayner, T., Jordan, A., Hildingsson, R., Stripple, J., Monni, S., et al. (2010). Navigating the dilemmas of climate policy in Europe: evidence from policy evaluation studies. Climatic Change, 101(3-4), 427-445.
22. Herrick, C., & Sarewitz, D. (2000). Ex post evaluation. A more effective role for scientific assessments in environmental policy. Science, Technology and Human Values, 25(3), 309-331.
23. Hisschemöller, M., & Hoppe, R. (2001). Coping with intractable controversies: The case for problem structuring in policy design and analysis. In M. Hisschemöller, W. Dunn, R. Hoppe, & J. Ravetz (Eds.) Knowledge, power and participation in environmental policy analysis. Policy Studies Review Annual, 12, 47-72.
24. Huitema, D., Jeliazkova, M., & Westerheijden, D. F. (2002). Phases, levels and circles in policy development: The cases of higher education and environmental quality assurance. Higher Education Policy, 15(2), 197-215.
25. Huitema, D., & Meijerink, S. (Eds.) (2009). Water policy entrepreneurs. A research companion to water transitions around the globe. Cheltenham, UK: Edward Elgar.
26. Huitema, D., Mostert, E., Egas, W., Moellenkamp, S., Pahl-Wostl, C., & Yalcin, R. (2009). Adaptive water governance. Assessing adaptive management from a governance perspective. Ecology and Society, 4(1), 26 [online]. http://www. ecologyandsociety. org/vol14/iss1/art26/.
27. Huitema, D., Rayner, T., Massey, E., Haug, C., Hildingsson, R. Monni, S., et al. (2008). Climate policy evaluation across Europe. Institute for Environmental Studies (IVM). Available at http://adamproject. info/index. php/Downloads/.
28. Jordan, A. J., Huitema, D., van Asselt, H., Rayner, T., & Berkhout, F. (Eds.) (2010). Climate change policy in the European Union. Confronting the dilemmas of mitigation and adaptation? Cambridge, UK: Cambridge University Press.
29. Jordan, A. J., & Lenschow, A. (Eds.) (2008). Innovation in environmental policy. Cheltenham, UK: Edward Elgar.
30. Jordan, A. J., & Liefferink, D. (Eds.) (2004). Environmental policy in the European Union. London, UK: Routledge.
31. Jordan, A. J., van Asselt, H., Berkhout, F., Huitema, D., & Rayner, T. (forthcoming). Climate change policy in the European Union: Understanding the paradoxes of multi-level governing. Global Environmental Politics, 11.
32. King, J. A. (2003). The challenge of studying evaluation theory. New Directions for Evaluation, 97, 57-67.
33. Knaap, G. J., & Kim, T. J. (1998). Introduction: Environmental program evaluation. Framing the subject, identifying issues. In G. J. Knaap & T. J. Kim (Eds.) Environmental program evaluation. A primer (pp. 1-20). Urbana, USA: University of Illinois Press.
34. Kraft, M. E., & Furlong, S. R. (2010). Public policy. Politics, analysis, and alternatives. Washington, DC: CQ Press.
35. Lehtonen, M. (2005). OECD environmental performance review programme. Accountability (f)or learning? Evaluation, 11, 169-188.
36. Lehtonen, M. (2006). Deliberative democracy, participation, and OECD peer reviews of environmental policies. American Journal of Evaluation, 27, 185-201.
37. Lenton, T. M., Held, H., Kriegler, E., Hall, J. W., Lucht, W., Rahmstorf, S., et al. (2008). Tipping elements in the Earth's climate system. Proceedings of the National Academy of Sciences, 105(6), 1786-1793.
38. Martinuzzi, A. (2004). Sustainable development evaluations in Europe-market analysis, meta evaluation and future challenges. Journal of Environmental Assessment, Policy and Management, 6(4), 411-442.
39. Mickwitz, P. (2003). A framework for evaluating environmental policy instruments, context and key concepts. Evaluation, 9, 415-436.
40. Mickwitz, P., & Birnbaum, M. (2009). Key insights for the design of environmental evaluations. In M. Binbaum & P. Mickwitz (Eds.) Environmental program and policy evaluation. New Directions for Evaluation, 122, 105-112.
41. Moberg, F., & Galaz, V. (2005). Resilience: going from conventional to adaptive freshwater management for human and ecosystem compatibility. Stockholm: SIWA (Swedish Water House Policy Brief, No. 3).
42. Nilsson, M., Jordan, A., Turnpenny, J., Hertin, J., Nykvist, B., & Russel, D. (2008). The use and non-use of policy appraisal tools in public policy making: An analysis of three European countries and the European Union. Policy Sciences, 41, 335-355.
43. Owens, S., Rayner, T., & Bina, O. (2004). New agendas for appraisal: Reflections on theory, practice and research. Environment and Planning A, 36(11), 1943-1959.
44. Pahl-Wostl, C. (2009). A conceptual framework for analysing adaptive capacity and multi-level learning processes in resource governance regimes. Global Environmental Change, 18, 354-365.
45. Paterson, M. (2009). Post-hegemonic climate politics? British Journal of Politics & International Relations, 11(1), 140-158.
46. Pawson, R. (2006). Evidence based policy: A realist perspective. London, UK: Sage.
47. Pielke, R. A. (2004). What future for the policy sciences? Policy Sciences, 37, 209-225.
48. Pielke, R. A. (2007). The honest broker. Making sense of science in policy and politics. Cambridge, UK: Cambridge University Press.
49. Ridder, D., Mostert, E., & Wolters, H. A. (Eds.) (2005). Learning together to manage together. Improving participation in water management. Osnabrueck, Germany: University of Osnabrueck, USF.
50. Russel, D., Haxeltine, A., Huitema, D., & Nilsson, M. (2010). Climate change appraisal in the EU: Current trends and future challenges. In M. Hulme & H. Neufeldt (Eds.) Making climate change work for us (pp. 31-53). Cambridge, UK: Cambridge University Press.
51. Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration, 80(1), 1-22.
52. Schreurs, M., & Tiberghien, Y. (2007). Multi-level reinforcement: Explaining EU leadership in climate change mitigation. Global Environmental Politics, 7(4), 19-46.
53. Stufflebeam, D. (2001). The meta evaluation imperative. American Journal of Evaluation, 22, 183-209.
54. van de Graaf, H., & Hoppe, R. (1996). Beleid en politiek. Een inleiding tot de beleidswetenschap en de beleidskunde. Bussum, The Netherlands: Coutinho.
55. Vedung, E. (2005). Public policy and program evaluation (3rd ed.) New Brunswick, USA: Transaction Publishers.
56. Weiss, C. (1977). Research for policy's sake: The enlightenment function of social research. Policy Analysis, 3(4), 531-545.
57. Wollmann, H. (2007). Policy evaluation and evaluation research. In F. Fischer, G. J. Miller, & M. S. Sidnet (Eds.) Handbook of public policy analysis (pp. 393-402). Boca Raton, FL: CRC Press.