What is wrong with evidence based policy, and how can it be improved?

Futures

Volumn 91, Issue , 2017, Pages 62-71

  Saltelli, Andrea ^a,b,c   Giampietro, Mario ^a,c,d  

^a European Centre for Governance in Complexity   (Spain)

^b UNIVERSITY OF BERGEN   (Norway)

^c INSTITUT DE CIÈNCIA I TECNOLOGIA AMBIENTALS   (Spain)

^d INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Evidence based policy; PNS; Post normal science; Quantitative story telling; Science and technology studies; Science for governance; STS

Indexed keywords

GOVERNANCE APPROACH; POLICY DEVELOPMENT; PUBLIC ADMINISTRATION; SCIENCE AND TECHNOLOGY;

EID: 85013031144     PISSN: 00163287     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.futures.2016.11.012     Document Type: Article

References (84)

1. Begley, C.G., Ioannidis, J.P., Reproducibility in science. Improving the standard for basic and preclinical research. Circulation Research 116 (2015), 116–126, 10.1161/CIRCRESAHA.114.303819.
2. Begley, C.G., Lee, M.E., Drug development: Raise standards for preclinical cancer research. Nature 483 (2012), 531–533.
3. Begley, C.G., Reproducibility: Six red flags for suspect work. Nature 497 (2013), 433–434.
4. Benessia, A., Funtowicz, S., Giampietro, M., Guimarães Pereira, A., Ravetz, J., Saltelli, A., et al. The rightful place of science: Science on the verge. The consortium for science, policy and outcomes at Arizona State University, 2016.
5. Boden, R., Epstein, D., Managing the research imagination? Globalisation and research in higher education. Globalisation, Societies and Education, 2006, 223–236.
6. Brody, S., Bioenergetics and growth; with special reference to the efficiency complex in domestic animals. 1945, Reinhold.
7. Bush, V., Science, the endless frontier. 1945, United States Office of Scientific Research and Development, U.S. Govt. Print Office.
8. Carrozza, C., Democratizing expertise and environmental governance: Different approaches to the politics of science and their relevance for policy analysis. Journal of Environmental Policy & Planning, 2014, 10.1080/1523908x.2014.914894.
9. Cassidy, J., The reinhart and rogoff controversy: A summing up. 2013, The New Yorker [April 26, 2013 issue].
10. Collingridge, D., Reeve, C., Science speaks to power: The role of experts in policy making. 1986, Frances Pinter, London.
11. de Solla Price, D.J., Little science big science. 1963, Columbia University Press.
12. Della Briotta Parolo, P., Kumar Pan, R., Ghosh, R., Huberman, B.A., Kaski, K., Fortunato, S., Attention decay in science. Journal of Informetrics 9 (2015), 734–745.
13. European Commission, Workshop 'significant digits responsible use of quantitative information’. 2015 https://ec.europa.eu/jrc/en/event/conference/use-quantitative-information.
14. Fargione, J., Hill, J., Tilman, D., Polasky, S., Hawthorne, P., Land clearing and the biofuel carbon debt. Science 319:5867 (2008), 1235–1238.
15. Funtowicz, S., Ravetz, J., Uncertainty and quality in science for policy. 1990, Kluwer Academic Publishers, Dordrecht.
16. Funtowicz, S.O., Ravetz, J.R., A new scientific methodology for global environmental issues. Costanza, R., (eds.) Ecological economics: The science and management of sustainability, 1991, Columbia University Press, New York, 137–152.
17. Funtowicz, S.O., Ravetz, J.R., Three types of risk assessment and the emergence of postnormal science. Krimsky, S., Golding, D., (eds.) Social theories of risk, 1992, Greenwood, Westport, CT, 251–273.
18. Funtowicz, S.O., Ravetz, J.R., Science for the post-normal age. Futures 25:7 (1993), 739–755.
19. Funtowicz, S.O., Ravetz, J.R., The worth of a songbird: Ecological economics as a post-normal science. Ecological Economics 10:3 (1994), 197–207.
20. Funtowicz, S., What is knowledge assessment?. Guimarães Pereira, Â., Guedes Vaz, S., Tognetti, S., (eds.) Interfaces between science and society, 2006, Greenleaf Publishers, Sheffield.
21. Giampietro, M., Mayumi, K., Multiple-scale integrated assessment of societal metabolism: Introducing the approach. Population and the Environment 22:2 (2000), 109–153.
22. Giampietro, M., Mayumi, K., Multiple-scale integrated assessments of societal metabolism: Integrating biophysical and economic representations across scales. Population and the Environment 22:2 (2000), 155–210.
23. Giampietro, M., Mayumi, K., The biofuel delusion: The fallacy behind large-scale agro-biofuel production. 2009, Earthscan Research Edition, London.
24. Giampietro, M., Allen, T.F.H., Mayumi, K., The epistemological predicament associated with purposive quantitative analysis. Ecological Complexity 3:4 (2006), 307–327.
25. Giampietro, M., Mayumi, K., Sorman, A.H., The metabolic pattern of societies: Where economists fall short. 2012, Routledge.
26. Giampietro, M., Mayumi, K., Sorman, A.H., Energy analysis for a sustainable future: Multi-scale integrated analysis of societal and ecosystem metabolism. 2013, Routledge, Abingdon, UK.
27. Giampietro, M., Aspinall, R.J., Ramos-Martin, J., Bukkens, S.G.F., (eds.) Resource accounting for sustainability assessment: The nexus between energy, food, water and land use, 2014, Routledge [250 pp].
28. Grundmann, R., The role of expertise in governance processes. Forest Policy and Economics 11 (2009), 398–403.
29. Guimarães Pereira, Â., Funtowicz, S., Eds., (2015), The end of the Cartesian dream, Routledge's series: Explorations in Sustainability and Governance.
30. Hammersley, M., Is the evidence-based practice movement doing more good than harm? Reflections on Iain Chalmers’ case for research-based policy making and practice. Evidence and Policy 1:1 (2005), 85–100.
31. Horton, R., Comment, offline: What is medicine's 5 sigma?. The Lancet, 385, 2015, 1380.
32. Ioannidis, J.P.A., Why most published research findings are false. PLoS Medicine 2:8 (2005), 696–701.
33. Ioannidis, J.P., How to make more published research true. PLoS Medicine, 11(10), 2014, e1001747.
34. Kahan, D.M., Climate science communication and the measurement problem. Advances in Political Psychology 36 (2015), 1–43.
35. Knight, F.H., Risk, uncertainty, and profit. 1921, Hart, Schaffner & Marx, New York.
36. Krugman, P., Thinking about the liquidity trap. Journal of the Japanese and International Economies 14:4 (2000), 221–237.
37. Krugman, P., The return of depression economics. 2009, W. W Norton & Company.
38. Lakoff, G., Don't think of an elephant: Know your values and frame the debate. 2004-2014, Chelsea Green Publishing.
39. Lakoff, G., Why it matters how we frame the environment. Environmental Communication: A Journal of Nature and Culture 4:1 (2010), 70–81.
40. Latour, B., Nous n'avons jamais été modernes, Editions La découverte, 1993; We Have Never Been Modern. 1991, Harvard UP, Cambridge.
41. Leslie, I., The sugar conspiracy. 2016, The Guardian [April 7].
42. Lyotard, J.-F., La Condition postmoderne. Rapport sur le savoir. 1979, Minuit, Paris.
43. Macilwain, C., The elephant in the room we can't ignore. Nature, 531, 2016, 277.
44. Marris, C., Wynne, B., Simmons, P., Weldon, S., Final report of the PABE. research project funded by the commission of european communities, contract. number: FAIR CT98-3844 (DG12-SSMI)., 2001, University of Lancaster, Lancaster [Dec].
45. Mepham, B., Ethical analysis of food biotechnologies: An evaluative framework. Mepham, B., (eds.) Food ethics, 1996, Routledge, London, 101–119.
46. Mirowski, P., More heat than light. Economics as social physics, physics as nature's economics. 1991, Cambridge University Press, Cambridge.
47. Mirowski, P., Science-mart: Privatizing american science. 2011, Harvard University Press.
48. Mirowski, P., Never let a serious crisis go to waste: How neoliberalism survived the financial meltdown. 2013, Verso Books, Brooklyn.
49. Munda, G., Social multi-criteria evaluation for a sustainable economy. 2008, Springer, Berlin.
50. Pattee, H.H., Evolving self-reference: Matter symbols and semantic closure. Communication and Cognition -Artificial Intelligence 12:1–2 (1995), 9–28.
51. Pearce, W., Wesselink, A., Colebatch, H., Evidence and meaning in policy making. Evidence and Policy 10:2 (2014), 161–165.
52. Phillips, M., Science is turning back to the dark ages. 2016, Times [March 4].
53. Pierce, A., The Queen asks why no one saw the credit crunch coming. 2008, The Telegraph [5 November].
54. Pigou, A.C., (eds.) Memorials of alfred marshall, 1925, Macmillan, London.
55. Porter, T.M., Trust in numbers, the pursuit of objectivity in science and public life. 1995, Princeton.
56. Proctor, R.N., Schiebinger, L., (eds.) Agnotology, the making and unmaking of ignorance, 2008, Stanford University Press.
57. Ravetz, J., Scientific knowledge and its social problems. 1971, Oxford University Press.
58. Ravetz, J.R., Usable knowledge, usable ignorance: Incomplete science with policy implications. Clark, W.C., Munn, R., (eds.) Sustainable development of the biosphere (pp. 415–432), 1986, IIASA/Cambridge University Press, New York.
59. Ravetz, J.R. (2015), Descartes and the rediscovery of ignorance, in Guimarães Pereira, and Funtowicz, 2015, p. xv–xviii.
60. Rayner, S., Uncomfortable knowledge: The social construction of ignorance in science and environmental policy discourses. Economy and Society 41:1 (2012), 107–125.
61. Reinert, E.S., Full circle: Economics from scholasticism through innovation and back into mathematical scholasticism Reflections on a 1769 Price essay:“Why is it that economics so far has gained so few advantages from physics and mathematics?’’. Journal of Economic Studies 27:4/5 (2000), 364–376.
62. Rhodium Group, American climate prospectus. Economic risks in the United States. Prepared as input to the risky business project, 2014.
63. Rittel, H., Webber, M., Dilemmas in a general theory of planning. Policy sciences, Vol. 4, 1973, Elsevier Scientific Publishing Company, Inc., Amsterdam, 155–169 [[Reprinted in N. Cross (ed.), Developments in Design Methodology, J. Wiley & Sons Chichester, 1984, pp. 135–144.].
64. Saltelli, A., Funtowicz, S., When all models are wrong: More stringent quality criteria are needed for models used at the science-policy interface. Issues in Science and Technology vol. winter (2014), 79–85.
65. Saltelli, A., Guimarães Pereira, A., van der Sluijs, J.P., Funtowicz, S., What do I make of your Latinorum? Sensitivity auditing of mathematical modelling. International Journal of Foresight and Innovation Policy 9:2–4 (2013), 213–234.
66. Saltelli, A., Stark, P.B., Becker, W., Stano, P., Climate models As economic guides scientific challenge or quixotic quest?. Spring Issue of Science and Technology (IST) XXXI:3 (2015), 79–84.
67. Saltelli, A., Funtowicz, S., Giampietro, M., Sarewitz, D., Stark, P.B., van der Sluijs, J.P., Costing climate is not a science. Nature, 532, 2016, 177.
68. Sarewitz, D., Frodemen, R., (eds.) Science and environmental policy: An excess of objectivity, earth matters: The earth sciences, philosophy, and the claims of community, 2000, Prentice Hall, 79–98.
69. Schumacher, E.F., Small is beautiful economics as if people mattered. 1973, Penguin Perennial.
70. Searchinger, T., Edwards, R., Mulligan, D., Heimlich, R., Plevin, R., Do biofuel policies seek to cut emissions by cutting food?. Science 347:6229 (2015), 1420–1422.
71. Shapin, S., Schaffer, S., Leviathan and the air-pump: Hobbes, Boyle, and the experimental life. 2011, Princeton university press, Princeton.
72. Siebert, S., Machesky, L.M., Insall, R.H., Overflow in science and its implications for trust. eLife, 4, 2015, e10825, 10.7554/elife.10825.
73. Stern, N., Economics: Current climate models are grossly misleading. Nature 530 (2016), 407–409.
74. Stiglitz, J., Rethinking macroeconomics: What failed, and how to repair it. Journal of the European Economic Association, 2011, 591–645.
75. Strassheim, H., Kettunen, P., When does evidence-based policy turn into policy-based evidence? Configurations, contexts and mechanisms. Evidence and Policy 10:2 (2014), 259–277.
76. Taleb, N.N., Antifragile: Things that gain from disorder. 2012, Random House.
77. Teicholz, N., The big fat surprise: Why butter, meat and cheese belong in a healthy. 2015, Simon & Schuster.
78. Toulmin, S., 1990, University of Chicago Press, Chicago.
79. van der Sluijs, J.P., Petersen, A.C., Janssen, P.H.M., Risbey, J.S., Ravetz, J.R., Exploring the quality of evidence for complex and contested policy decisions. Environmental Research Letters, 3, 2008, 024008 [9 pp.].
80. van der Sluijs, J., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J., Risbey, J., Combining quantitative and qualitative measures of uncertainty in model based environmental assessment: The NUSAP system. Risk Analysis 25:2 (2005), 481–492.
81. Weinberg, A.M., Science and trans-science. Minerva 10 (1972), 209–222.
82. Wilsdon, J. (2014). Evidence-based Union? A new alliance for science advice in Europe. In The Guardian. Available at: http://www.theguardian.com/science/political-science/2014/jun/23/evidence-based-union-a-new-alliance-for-science-advice-in-Europe.
83. Winner, L., The whale and the reactor: A search for limits in an age of high technology. 1986, The University of Chicago Press [1989 edition].
84. Wynne, B., Uncertainty and environmental learning: Reconceiving science and policy in the preventive paradigm. Global Environmental Change 2:2 (1992), 111–127.