Exploring the quality of evidence for complex and contested policy decisions

Environmental Research Letters

Volumn 3, Issue 2, 2008, Pages

  Van Der Sluijs, Jeroen P ^a,b   Petersen, Arthur C ^c   Janssen, Peter H M ^c   Risbey, James S ^d   Ravetz, Jerome R ^e  

^a UTRECHT UNIVERSITY   (Netherlands)

^b LABORATOIRE DES SCIENCES DU CLIMAT ET DE L ENVIRONNEMENT   (France)

^c PBL NETHERLANDS ENVIRONMENTAL ASSESSMENT AGENCY   (Netherlands)

^d Bureau of Meteorology Centre for Australian Weather and Climate Research   (Australia)

^e UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Controversy; Evidence; Health risks; Knowledge quality assessment; Particulate matter; Policy advice; Risk assessment; Science policy; Uncertainty

Indexed keywords

COMMUNICATION; ENVIRONMENTAL IMPACT; ENVIRONMENTAL IMPACT ASSESSMENTS; HEALTH RISKS; PUBLIC POLICY; RISK ASSESSMENT;

CONTROVERSY; EVIDENCE; PARTICULATE MATTER; QUALITY ASSESSMENT; SCIENCE POLICIES; UNCERTAINTY;

DECISION MAKING;

EID: 46749106445     PISSN: None     EISSN: 17489326     Source Type: Journal    
DOI: 10.1088/1748-9326/3/2/024008     Document Type: Review

References (54)

1. Beck L and Wilson D 1997 EPA's data attribute rating system Proc. Specialty Conf. on Emission Inventory: Planning for the Future pp 176-89 http://www.epa.gov/appcdwww/apb/glotech/DARS97.pdf
2. Beck M B 2007 How best to look forward? Science 316 202-3
3. Bell M L, Hobbs B F and Ellis H 2005 Metrics matter: conflicting air quality rankings from different indices of air pollution J. Air Waste Manage. Assoc. 55 97-106
4. Dempster A P 1967 Upper and lower probabilities induced by a multivalued mapping Ann. Stat. 28 325-39
5. EC (European Commission) 2005 Thematic Strategy on Air Pollution: Impact Assessment SEC (2005) 1133 Accessed at: http://ec.europa.eu/governance/impact/ docs/ia_2005/sec_2005_1133_en.pdf
6. EPA (Environmental Protection Agency) 1997 Guiding Principles for Monte Carlo Analysis (EPA/630/R-97/001 http://www.epa.gov/ncea/raf/montecar.pdf)
7. EPA (Environmental Protection Agency) 2003 Draft Guidance on the Development, Evaluation, and Application of Regulatory Environmental Models (Washington, DC: US EPA Council for Regulatory Environmental Modeling) Accessed at: http://www.epa.gov/ord/crem/library/CREM Guidance Draft 12_03.pdf
8. Eschenroeder A and Norris G 2003 Should socioeconomic health effects be included in risk assessments? Environ. Sci. 1 27-58
9. Frey H C and Bharvirkar R 2002 Quantification of variability and uncertainty: a case study of power plant hazardous air pollutant emissions Human and Ecological Risk Analysis ed D Paustenbach (New York: Wiley) pp 587-617
10. Funtowicz S O 2006 Why knowledge assessment? Interfaces between Science and Society ed  Guimarães Pereira, S Guedes Vaz and S Tognetti (Sheffield: Greenleaf) pp 138-45
11. Funtowicz S O and Ravetz J R 1990 Uncertainty and Quality in Science for Policy (Dordrecht: Kluwer)
12. Ha-Duong M, Swart R, Bernstein L and Petersen A C 2007 Uncertainty management in the IPCC: agreeing to disagree Global Environ. Change 17 8-11
13. Hansen J E 2007 Scientific reticence and sea level rise Environ. Res. Lett. 2 024002
14. 2 concentrations under the United Nations Framework Convention on Climate Change as a function of the climate sensitivity probability distribution function Environ. Res. Lett. 2 014001
15. IPCC (Intergovernmental Panel on Climate Change) 2005 Guidance Notes for Lead Authors of the IPCC Fourth Assessment Report on Addressing Uncertainties Accessed at: http://www.ipcc.ch/activity/uncertaintyguidancenote.pdf
16. Janssen P H M, Petersen A C, van der Sluijs J P, Risbey J S and Ravetz J R 2005 A guidance for assessing and communicating uncertainties Water Sci. Technol. 52 125-131
17. Kempen E E M M, van Kruize H, Boshuizen H C, Ameling C B, Staatsen B A and de Hollander A E M 2002 The association between noise exposure and blood pressure and ischemic heart disease: a meta-analysis Environ. Health Perspect. 110 307-17
18. Kinzig A et al 2003 Coping with uncertainty: a call for a new science-policy forum Ambio 32 330-5
19. Kloprogge P and van der Sluijs J P 2006 Verslag expert meeting onzekerheidscommunicatie rond fijn stof en gezondheid [in Dutch] Department of Science, Technology and Society Report NWS-E-2006-55 (Utrecht: Copernicus Institute, Utrecht University) http://www.chem.uu.nl/nws/www/publica/ publicaties2006/E2006-55.pdf
20. Kloprogge P, van der Sluijs J P and Petersen A C 2005 A method for the analysis of assumptions in assessments: exploration of the value-ladenness of two indicators in the fifth Dutch environmental outlook MNP Report 550002010 (Bilthoven: MNP) (Utrecht: Utrecht University) http://www.rivm.nl/bibliotheek/ rapporten/550002010.pdf
21. Maas R 2007 Fine particles: from scientific uncertainty to policy strategy J. Toxicol. Environ. Health A 70 365-8
22. MNP (Netherlands Environmental Assessment Agency) 2005 Particulate matter: a closer look, the state of affairs in the particulate matter Dossier from a Dutch perspective MNP Report 5000370011 (Bilthoven: MNP) http://www.rivm.nl/bibliotheek/rapporten/500037011.pdf
23. MNP/UU 2003 RIVM/MNP Guidance for Uncertainty Assessment and Communication (Bilthoven: MNP) (Utrecht: Utrecht University) Accessed at: http://www.mnp.nl/guidance & http://www.nusap.net/sections.php?op = viewarticle&artid = 17
24. Moolgavkar S H 2005 A review and critique of the EPA's rationale for a fine particle standard Regul. Toxicol. Pharmacol. 42 123-44
25. NRC (National Research Council) 1996 Understanding Risk: Informing Decisions in a Democratic Society (Washington, DC: National Academies Press)
26. NRC (National Research Council) 2007 Models in Environmental Regulatory Decision Making (Washington, DC: National Academies Press)
27. Oreskes N, Shrader-Frechette K and Belitz K 1994 Verification, validation, and conformation of numerical models in the Earth sciences Science 263 641-6
28. Petersen A C 2000 Philosophy of climate science Bull. Am. Meteorol. Soc. 81 265-71
29. Petersen A C 2006 Simulating Nature: A Philosophical Study of Computer-Simulation Uncertainties and Their Role in Climate Science and Policy Advice (Apeldoorn & Antwerp: Spinhuis Publishers) Accessed at: http://hdl.handle.net/1871/11385
30. Pilkey O H and Pilkey-Jarvis L 2007 Useless Arithmetic: Why Environmental Scientists Can't Predict the Future (New York: Columbia University Press)
31. Pope C A III and Dockery D W 2006 Health effects of fine particulate air pollution: lines that connect J. Air Waste Manage. Assoc. 56 709-742
32. Ravetz J R 1971 Scientific Knowledge and its Social Problems (Oxford: Oxford University Press)
33. Refsgaard J C, van der Sluijs J P, Brown J and van der Keur P 2006 A framework for dealing with uncertainty due to model structure error Adv. Water Resour. 29 1586-97
34. Refsgaard J C, van der Sluijs J P, Lajer Højberg A and Vanrolleghem P A 2007 Uncertainty in the environmental modelling process: a review Environ. Model. Softw. 22 1543-56
35. Risbey J S, van der Sluijs J P, Kloprogge P, Ravetz J R, Funtowicz S and Corral Quintana S 2005 Application of a checklist for quality assistance in environmental modelling to an energy model Environ. Model. Assess. 10 63-79
36. RIVM (Netherlands National Institute for Public Health and the Environment) 2002 On health risks of ambient PM in the Netherlands: executive summary RIVM Report 650010033 (Bilthoven: RIVM) http://www.mnp.nl/bibliotheek/ rapporten/650010033.pdf
37. Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M and Tarantola S 2008 Global Sensitivity Analysis: The Primer (Chichester: Wiley)
38. Sarewitz D 2004 How science makes environmental controversies worse Environ. Sci. Policy 7 385-403
39. Schwartz J 1994 Air pollution and daily mortality: a review and meta analysis Environ. Res. 64 36-52
40. SETAC 1994 Life-Cycle Assessment Data Quality: A Conceptual Framework (Pensacola, FL: Society of Environmental Toxicology and Chemistry and SETAC Foundation for Environmenal Education)
41. Shafer 1976 A Mathematical Theory of Evidence (Princeton, NJ: Princeton University Press)
42. UK Strategy Unit 2002 Risk: Improving Government's Capability to Handle Risk and Uncertainty (London: United Kingdom Strategy Unit, Cabinet Office) Accessed at: http://www.cabinetoffice.gov.uk/strategy/downloads/su/risk/report/ downloads/su-risk.pdf
43. van Asselt M B A 2000 Perspectives on Uncertainty and Risk: The PRIMA Approach to Decision Support (Dordrecht: Kluwer-Academic)
44. van der Sluijs J P 2005 Uncertainty as a monster in the science policy interface: four coping strategies Water Sci. Technol. 52 87-92
45. van der Sluijs J P 2006 Uncertainty, assumptions, and value commitments in the knowledge-base of complex environmental problems Interfaces between Science and Society ed  Guimarães Pereira, S Guedes Vaz and S Tognetti (Sheffield: Greenleaf) pp 64-81
46. van der Sluijs J P 2007 Uncertainty and precaution in environmental management: insights from the UPEM conference Environ. Model. Softw. 22 590-98
47. van der Sluijs J P, Craye M, Funtowicz S O, Kloprogge P, Ravetz J R and Risbey J S 2005a Combining quantitative and qualitative measures of uncertainty in model based environmental assessment: the NUSAP system Risk Anal. 25 481-92
48. van der Sluijs J P, Craye M, Funtowicz S O, Kloprogge P, Ravetz J R and Risbey J S 2005b Experiences with the NUSAP system for multidimensional uncertainty assessment in model based foresight studies Water Sci. Technol. 52 133-44
49. van der Sluijs J P, Janssen P H M, Petersen A C, Kloprogge P, Risbey J S, Tuinstra W, van Asselt M B A and Ravetz J R 2004 RIVM/MNP Guidance for Uncertainty Assessment and Communication: Tool Catalogue for Uncertainty Assessment Department of Science, Technology and Society Report NWS-E-2004-37 (Utrecht: Copernicus Institute, Utrecht University) http://www.nusap.net/ downloads/toolcatalogue.pdf
50. 3 emissions in the Netherlands Report NWS-E-2003-21 (Utrecht: TNO and Copernicus Institute) http://www.chem.uu.nl/nws/www/publica/Publicaties2004/e2004-12.pdf
51. Walker W E et al 2003 Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support Integr. Assess. 4 5-17
52. Wardekker J A, van der Sluijs J P, Janssen P H M, Kloprogge P and Petersen A C 2008 Uncertainty communication in environmental assessments: views from the Dutch science-policy interface Environ. Sci. Policy at pressdoi:10.1016/j.envsci.2008.05.005
53. Weiss C 2006 Can there be science-based precaution? Environ. Res. Lett. 1 014003
54. WHO (World Health Organization) 2006 Health Risks of Particulate Matter from Long-Range Transboundary Air Pollution Joint WHO/Convention Task Force on the Health Aspects of Air Pollution (Bonn: European Centre for Environment and Health, WHO Regional Office for Europe)