Can indicators bridge the gap between science and policy?: An exploration into the (non)use and (non)infl uence of indicators in EU and UK policy making

Nature and Culture

Volumn 9, Issue 3, 2014, Pages 316-343

  Sébastien, Léa ^a   Bauler, Tom ^b   Lehtonen, Markku ^c,d  

^a University Toulouse Jean Jaurès   (France)

^b UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^c UNIVERSITY OF SUSSEX   (United Kingdom)

^d ÉCOLE DES HAUTES ÉTUDES EN SCIENCES SOCIALES   (France)

Author keywords

Boundary objects; Energy; Evidence; Policy; Role of knowledge; Sustainability

Indexed keywords

CONCEPTUAL FRAMEWORK; ENERGY EFFICIENCY; EUROPEAN UNION; KNOWLEDGE; POLICY MAKING; SUSTAINABILITY; SUSTAINABLE DEVELOPMENT;

UNITED KINGDOM;

EID: 84908370102     PISSN: 15586073     EISSN: 15585468     Source Type: Journal    
DOI: 10.3167/nc.2014.090305     Document Type: Article

References (57)

1. Adelle, Camilla, Andrew Jordan, and John Turnpenny. 2012. "Proceeding in Parallel or Drifting Apart? A Systematic Review of Policy Appraisal Research and Practices." Environment and Planning C: Government and Policy 30 (3): 401-415.
2. Amara, Nabil, Mathieu Ouimet, and Réjean Landry. 2004. "New Evidence on Instrumental, Conceptual, and Symbolic Utilization of University Research in Government Agencies." Science Communication 26 (1): 75-106.
3. Bauler, Tom. 2012. "An Analytical Framework to Discuss the Usability of (Environmental) Indicators for Policy." Ecological Indicators 17: 38-45.
4. Beck, Ulrich. 2006. "Refl exive Governance: Politics in the Global Risk Society." In Refl exive Governance for Sustainable Development, ed. Jan-Peter Voß, Dierk Bauknecht, and René Kemp, pp. 31-56. Cheltenham, UK: Edward Elgar.
5. Beyer, Janice M., and Harrison M. Trice. 1982. "The Utilization Process: A Conceptual Framework and Synthesis of empirical Findings." Administrative Science Quarterly 27 (4): 591-622.
6. Bickerstaff, Karen, Irene Lorenzoni, Nick F. Pidgeon, Wouter Poortinga, and Peter Simmons. 2008. "Reframing Nuclear Power in the UK Energy Debate: Nuclear Power, Climate Change Mitigation and Radioactive Waste." Public Understanding of Science 17 (2): 145-169.
7. Boulanger, Paul-Marie. 2007. "Political Uses of Social Indicators: Overview and Application to Sustainable Development Indicators." International Journal of Sustainable Development 10 (1-2): 14-32.
8. Chateauraynaud, Francis. 2011. Argumenter dans un Champ de Forces: Essai de Balistique Sociologique. Paris: Pétra.
9. DTI. 2003. Our Energy Future: Creating a Low Carbon Economy. London: Department of Trade and Industry.
10. DTI. 2004. UK Energy Sector Indicators: A Supplement to the First Annual Report on the Energy White Paper "Our Energy Future: Creating a Low Carbon Economy." London: Department of Trade and Industry.
11. Forss, Kim, Claus C. Reubien, and Jerker Carlsson. 2002. "Process Use of Evaluations: Types of Use that Precede Lessons Learned and Feedback." Evaluation 8 (1): 29-45.
12. Gallopin, Gilberto C. 1996. "Environmental and Sustainability Indicators and the Concept of Situational Indicators: A Systems Approach." Environmental Modelling and Assessment 1 (3): 101-117.
13. Gambetta, Diego. 1998. "'Claro!' An Essay on Discursive Machismo." In Deliberative Democracy, ed. John Elster, pp. 19-43. Cambridge: Cambridge University Press.
14. Greenaway, John Robert, Steve Smith, and John Street. 1992. Deciding factors in British politics: A case studies-approach. London: Routledge. Grupp, Hariolf, and Torben Schubert. 2010. "Review and New Evidence on Composite Innovation Indicators for Evaluating National Performance." Research Policy 39 (1): 67-78.
15. Gudmundsson, Henrik. 2003. "The Policy Use of Environmental Indicators: Learning from Evaluation Research." Journal of Transdisciplinary Environmental Studies 2 (2): 1-12.
16. Hardi, Peter, and Terrence Zdan. 1997. Assessing Sustainable Development: Principles in Practice. Winnipeg: International Institute for Sustainable Development.
17. Henry, Gary T., and Melvin M. Mark. 2003. "Beyond Use: Understanding Evaluation's Infl uence on Attitudes and Actions." American Journal of Evaluation 24 (3): 293-314.
18. Hezri, Adnan A., and Stephen R. Dovers. 2006. "Sustainability Indicators, Policy, Governance: Issues for Ecological Economics." Ecological Economics 60 (1): 86-99.
19. Hood, Christopher. 2007. "Public Service Management by Numbers: Why Does it Vary? Where Has it Come From? What Are the Gaps and the Puzzles." Public Money & Management 27 (2): 95-102.
20. Jasanoff, Sheila. 1987. "Contested Boundaries in Policy-Relevant Science." Social Studies of Science 17 (2): 195-230.
21. Knott, Jack, and Aron Wildavsky. 1980. "If Dissemination Is the Solution, What Is the Problem?" Science Communication 1 (4): 537-578.
22. Lehtonen, Markku. 2005. "OECD Environmental Performance Review Programme: Accountability (f)or Learning?" Evaluation 11 (2): 169-188.
23. MacKerron, Gordon. 2009. "Lessons from the UK on Urgency and Legitimacy in Energy Policymaking." In Energy for the Future: A New Agenda, ed. Ivan Scrase and Gordon MacKerron, pp. 76-88. London and New York: Palgrave Macmillan.
24. McCool, Stephen F., and George H. Stankey. 2004. "Indicators of Sustainability: Challenges and Opportunities at the Interface of Science and Policy." Environmental Management 33 (3): 294-305.
25. Meul, Marijke, Frank Nevens, and Dirk Reheul. 2009. "Validating Sustainability Indicators: Focus on Ecological Aspects of Flemish Dairy Farms." Ecological Indicators 9 (2): 284-295.
26. Mickwitz, Per, and Matti Melanen. 2009. "The Role of Co-Operation between Academia and Policymakers for the Development and Use of Sustainability Indicators: A Case from the Finnish Kymenlaakso Region." Journal of Cleaner Production 17 (12): 1086-1100.
27. Newig, Jens, Jan-Peter Voß, and Jochen Monstadt, eds. 2008. Governance for Sustainable Development: Coping with Ambivalence, Uncertainty and Distributed Power. Oxon, UK: Routledge.
28. Ortega-Cerdà, Miquel. 2005. "Sustainability Indicators as Discursive Elements.& Paper presented at the 6th International Conference of the European Society for Ecological Economics, Lisbon, 14-17 June 2005. http://www.google.fr/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CDIQFjAA&url=http%3A%2F%2Fent-consulting.com%2Fimages%2Fstories%2FENT%2Fpdf%2Farticles%2Findicators.pdf&ei=TVEpUc6sLZO6hAfcxIGYBA&usg=AFQjCNGQRLkahZdn1UwFypGSYXYpZ6woog&bvm=bv.42768644,d.ZG4&cad=rja(accessed 24 February 2013).
29. Owens, Susan, Tim Rayner, and Olivia Bina. 2004. "New Agendas for Appraisal: Refl ections on Theory, Practice, and Research." Environment and Planning A 36 (11): 1943-1959.
30. Parris, Thomas M., and Robert W. Kates. 2003. "Characterizing and Measuring Sustainable Development." Annual Review of Environmental Resources 28 (13): 1-28.
31. Patton, Michael Q. 1998. "Discovering Process Use." Evaluation 4 (2): 225-233.
32. Pawson, Ray. 2006. Evidence-Based Policy: A Realist Perspective. London: Sage.
33. Pintér, Lazlo., Peter Hardi, and Peter Bartelmus. 2005. Indicators of Sustainable Development: Proposals for a Way Forward. Discussion Paper Prepared under a Consulting Agreement on behalf of the UN Division for Sustainable Development, UNDSD/EGM/ISD/2005/CRP.2, PLACE: IISD - International Institute for Sustainable Development.
34. Pregernig, Michael. 2000. "Putting Science into Practice: The Diffusion of Scientifi c Knowledge Exemplifi ed by the Austrian 'Research Initiative Against Forest Decline.'" Forest Policy and Economics 1 (2): 165-176.
35. Rametsteiner, Ewald, Helga Pülzl, Johanna Alkan-Olsson, and Pia Frederiksen. 2011. "Sustainability Indicator Development: Science or Political Negotiation?" Ecological Indicators 11 (1): 61-70.
36. Rich, Robert F., and Cheol H. Oh. 2000. "Rationality and Use of Information in Policy Decisions: A Search for Alternatives." Science Communication 22 (2): 173-211.
37. Ritz, Karl, Helaina I. J. Black, Colin D. Campbell, Jim A. Harris, and Claire Wood. 2009. "Selecting Biological Indicators for Monitoring Soils: A Framework for Balancing Scientifi c and Technical Opinion to Assist Policy Development." Ecological Indicators 9 (6): 1212-1221.
38. Rosenström, Ulla. 2002. "The Potential for the Use of Sustainable Development Indicators in Policy Making in Finland." Futura 21 (2): 19-25.
39. Rutledge, Ian, and Philip Wright. 2011. UK Energy Policy and the End of Market Fundamentalism. Oxford: Oxford University Press.
40. Sabatier, Paul A. 1987. "Knowledge, Policy-Oriented Learning and Policy Change: An Advocacy Coalition Framework." Knowledge: Creation, Diffusion, Utilization 8 (4): 649-692.
41. Saltelli, Andrea, Jochen Jesinghaus, Anna Manca, Massimiliano Mascherini, Michela Nardo, and Michaela Saisana. 2010. "Indicators for Lisbon Post-2010: Business as Usual?" JRC Scientifi c and Technical Reports, JRC 57104, EUR 24280. Luxembourg: Offi ce for Offi cial Publications of the European Union.
42. Sébastien, Léa, and Tom Bauler. 2010. "Is There a Real Demand for Composite Indicators for Sustainability?" Presentation at the International Conference of Ecological Economics, Oldenburg, Germany, 22-25 August 2010.
43. Sébastien, Léa, and Tom Bauler. 2013. "Use and Infl uence of Composite Indicators for Sustainable Development at the EU-Level." Ecological Indicators 35: 3-12, 10.1016/j.ecolind.2013.04.014.
44. Sonntag, Viki. 2010. "Designing Sustainability Indicator Frameworks for Information Flow: A Case Study of B-Sustainable." Applied Research in Quality of Life 5 (4): 325-339.
45. Star, Susan L. 2010. "This Is Not a Boundary Object: Refl ections on the Origin of a Concept." Science, Technology & Human Values 35 (5): 601-617.
46. Stiglitz, Joseph E., Amartya Sen, and Jean-Paul Fitoussi. 2010. Mismeasuring Our Lives: Why GDP Doesn't Add Up. The Report by the Commission on the Measurement of Economic Performance and Social Progress. New York: New Press. Also available at http://www.stiglitz-sen-fitoussi.fr/documents/rapport_anglais.pdf (accessed 8 August 2014).
47. Stirling, Andrew. 2006. "Analysis, Participation and Power: Justifi cation and Closure in Participatory Multi-Criteria Analysis." Land Use Policy 23 (1): 95-107.
48. Turnhout, Esther. 2009. "The Effectiveness of Boundary Objects: The Case of Ecological Indicators." Science and Public Policy 36 (5): 403-412.
49. Turnpenny, John, Claudio M. Radaelli, Andrew Jordan, and Klaus Jacob. 2009. "The Policy and Politics of Policy Appraisal: Emerging Trends and New Directions." Journal of European Public Policy 16 (4): 640-653.
50. UKSA. 2009. UK Energy Sector Indicators. Produced by the Department of Energy and Climate Change. Assessment of compliance with the Code of Practice for Offi cial Statistics. UK Statistics Authority, assessment report, 5 July.
51. Valovirta, Ville. 2002. "Evaluation Utilization as Argumentation." Evaluation 8 (1): 60-80.
52. van der Meer, Frans-Bauke. 1999. "Evaluation and the Social Construction of Impacts." Evaluation 5 (4): 387-406.
53. Vedung, Evert. 1997. Public Policy and Program Evaluation. New Brunswick, NJ: Transaction Publishers.
54. Voß, Jan-Peter, and René Kemp. 2006. "Sustainability and Refl exive Governance: Introduction." In Refl exive Governance for Sustainable Development, ed. Jan- Peter Voß, Dierk Bauknecht, and René Kemp, pp. 3-28. Cheltenham, UK: Edward Elgar.
55. Weiss, Carol H. 1977. "Research for Policy's Sake: The Enlightenment Function of Social Research." Policy Analysis 3 (4): 531-545.
56. Weiss, Carol H. 1999. "The Interface Between Evaluation and Public Policy." Evaluation 5 (4): 468-486.
57. YaleNews. 2002. "Finland Ranks Highest in Environmental Index; U.S. Lags New Environmental Performance Study Complements Annual Sustainability Ranking." 1 February. http://news.yale.edu/2002/02/01/finland-ranks-highest-environmental-index-us-lags-new-environmental-performance-study-com (accessed 23 February 2013).