A review of contemporary methods for the presentation of scientific uncertainty

Health Physics

Volumn 103, Issue 6, 2012, Pages 714-731

  Makinson, K A ^a   Hamby, D M ^a   Edwards, J A ^a  

^a OREGON STATE UNIVERSITY   (United States)

Author keywords

reviews; risk analysis; risk communication; statistics

Indexed keywords

COMPUTER GRAPHICS; METHODOLOGY; PROBABILITY; REVIEW; SCIENCE; STATISTICS; THEORETICAL MODEL; UNCERTAINTY;

COMPUTER GRAPHICS; MODELS, THEORETICAL; PROBABILITY; SCIENCE; STATISTICS AS TOPIC; UNCERTAINTY;

EID: 84869414777     PISSN: 00179078     EISSN: None     Source Type: Journal    
DOI: 10.1097/HP.0b013e31824e6f6f     Document Type: Review

References (82)

1. An YJ, Yoon CG, Jung KW, Ham JH. Estimating the microbial risk of E. coli in reclaimed wastewater irrigation on paddy field. Environmental Monitoring Assessment 129: 53-60; 2007.
2. Bauer LR, Hamby DM. Relative sensitivities of existing and novel model parameters in atmospheric tritium dose estimates. Radiat Protect Dosim 37:253-260; 1991.
3. Benbasat I, Dexter AS. An experimental evaluation of graphical and color-enhanced information systems under varying time constraints. Manage Information Systems Q 10:59-81; 1986.
4. Benbasat I, Dexter AS, Todd P. The influence of color and graphical information presentation in a managerial decision simulation. Human-Computer Interaction 2:65-92; 1986.
5. Ben-Haim Y. Information-gap decision theory: decision under severe uncertainty. San Diego, CA: Academic Press; 2001.
6. Ben-Haim Y. Uncertainty, probability, and information-gaps. Reliability Engineering System Safety 85:249-266; 2004.
7. Bourennane H, King D, Couturier A, Nicoullaud B, Mary B, Richard G. Uncertainty assessment of soil water content spatial patterns using geostatistical simulations: an empirical comparison of a simulation accounting for single attribute and a simulation accounting for secondary information. Ecological Modeling 205:323-335; 2007.
8. Bourennane H, Douay F, Sterckeman T, Villanneau E, Ciesielski H, King D, Baize D. Mapping of anthropogenic trace elements inputs in agricultural topsoil from Northern France using enrichment factors. Geoderma 150:165-174; 2010.
9. Braudaway D. Uncertainty specification for data acquisition devices (DAQ). In: Proceedings of the Annual Instrumentation and Measurement Technology Conference (IMTC). Vail, CO: IMTC; 2003; 946-950.
10. Chao JH, Niu H, Chiu CY, Lin C. A potential dating technique using 228Th/228Ra ratio for tracing the chronosequence of elemental concentrations in plants. Applied Radiat Isotopes 65:641-648; 2007.
11. Chen CF, Ma H, Reckhow KH. Assessment of water quality management with a systematic qualitative uncertainty analysis. Sci Tot Environ 374:13-25; 2007.
12. Clough R, Belt ST, Fairman B, Catterick R, Evans EH. Uncertainty contributions to single and double isotope dilution mass spectrometry with HPLC-CV-MC-ICP-MS for the determination of methylmercury in fish tissue. J Analytical Atomic Spectrometry 20:1072-1075; 2005.
13. Counil E, Verger P, Volatier J-L. Handling of contamination variability in exposure assessment: a case study with ochratoxin A. Food Chem Toxicol 43:1541-1555; 2005.
14. Dawes RM. Behavioral decision making and judgment. In: Gilbert DT, Fiske ST, Lindzey G, eds. The handbook of social psychology. Boston: McGraw-Hill; 1998.
15. Doull J, Borzelleca JF, Becker R, Datson G, DeSesso J, Fan A, Fenner-Crisp P, Holsapple M, Holson J, Llewellyn GC, MacGregor J, Seed J,Walls I,Woo Y-T, Olin S. Framework for use of toxicity screening tools in context-based decisionmaking. Food Chemical Toxicol 45:759-796; 2007.
16. Escuder-Gilabert L, Bonet-Domingo E, Medina-Hernandez MJ, Sagrado S. A diagnostic tool for determining the quality of accuracy validation: assessing the method for determination of nitrate in drinking water. Annals Bioanalytical Chem 387:619-625; 2007.
17. Funtowicz SO, Ravetz JR. Uncertainty and quality in science for policy. Dordrecht, The Netherlands: Kluwer Academic Publishers; 1990.
18. Gallagher M, Doherty J. Parameter estimation and uncertainty analysis for a watershed model. Environmental modeling and software. 2007.
19. Gigerenzer G, Hoffrage U. How to improve Bayesian reasoning without instruction: frequency formats. Psychological Rev 102:684-704; 1995.
20. Gottschalk P, Wattenbach M, Neftel A, Fuhrer J, Jones M, Lanigan G, Davis P, Campbell C, Soussana JF, Smith P. The role of measurement uncertainties for the simulation of grassland net ecosystem exchange (NEE) in Europe. Agriculture, Ecosystems Environment 121:175-185; 2007.
21. Halpern BS, Regan HM, Possingham HP, McCarthy MA. Accounting for uncertainty in marine reserve design. Ecology Lett 9:2-11; 2006.
22. Hamby DM. A probabilistic estimation of atmospheric tritium dose. Health Phys 65:33-40; 1993.
23. Hamby DM. A review of techniques for parameter sensitivity analysis of environmental models. Environmental Monitoring Assessment 32:135-154; 1994.
24. Hamby DM, Benke RR. Uncertainty of the iodine-133 ingestion dose conversion factor. Radiat Protect Dosim 82:245-256; 1999.
25. Hamby DM, Tarantola S. Exploring sensitivity analysis techniques for the assessment of an environmental transport model. Proceedings of ESREL'99VThe Tenth European Conference on Safety and Reliability. Munich-Garching, Germany. Bristol, PA: Taylor & Francis US; 1999.
26. Hamby DM. The Gaussian atmospheric transport model and its sensitivity to the joint frequency distribution and parametric variability. Health Phys 82:64-73; 2002.
27. Harvey RP, Hamby DM. Uncertainty in particulate deposition for 1 mm AMAD particles in an adult lung model. Radiat Protect Dosim 95:239-247; 2001.
28. Harvey RP, Hamby DM, Benke RR. Age-specific uncertainty of the I-131 ingestion dose conversion factor. Health Phys 84:334-343; 2003.
29. Helton JC, Johnson JD, Oberkampf WL, Storlie CB. A samplingbased computational strategy for the representation of epistemic uncertainty in model predictions with evidence theory. Albuquerque, NM: Sandia National Laboratory; Report #5557; 2006.
30. Helton JC. Conceptual and computational basis for the quantification of margins and uncertainty. Albuquerque, NM: Sandia National Laboratory; Report #3055; 2009.
31. Helton JC, Sallaberry CJ. Illustration of sampling-based approaches to the calculation of expected dose in performance assessments for the proposed high level radioactive waste repository at Yucca Mountain, Nevada. Albuquerque, NM: Sandia National Laboratory; Report #1353; 2007.
32. Hunink MGM. Decision making in the face of uncertainty and resource constraints: examples from trauma imaging. Radiol 235:375-383; 2005.
33. Ibrekk H, Morgan MG. Graphical communication of uncertain quantities to non-technical people. Risk Analysis 7: 519-529; 1987.
34. International Organization for Standardization. Guide to the expression of uncertainty in measurement (GUM). Geneva: ISO 1995.
35. Jenkins AM, Gremillion LL. The effects of color enhanced information presentation. In: Proceedings of the 2nd International Conference on Information Systems, Cambridge, MA, 7-9 December 1981. Pireas, Greece: IC-ININFO; 1981; 121-134.
36. Johnson EJ, Payne JW, Bettman JR. Information displays and preference reversals. Organizational Behavior Human Decision Processes 42:1-21; 1988.
37. Jones DA, Kay AL. Uncertainty analysis for estimating flood frequencies for ungauged catchments using rainfall-runoff models. Advances Water Resources 30:1190-1204; 2007.
38. Kahneman D, Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 47:263-291; 1979.
39. Kahneman D, Slovic P, Tversky A. Judgment under uncertainty: heuristics and biases. Cambridge: Cambridge University Press; 1982.
40. Kirschenbaum SS, Arruda JE. Effects of graphic and verbal probability information on command decision making. Human Factors 36:406-418; 1994.
41. Klawiter B. An investigation into the potential for eochemical/ geoarchaeological provenance of Prairie du Chien cherts. Minneapolis, MN: University of Minnesota; 2000. Thesis.
42. Lewandowsky S, Spence I. Discriminating strata in scatterplots. J Am Statistical Assoc 84:682-688; 1989.
43. Lindenschmidt KE, Fleischbein K, Baborowski M. Structural uncertainty in a river water quality modeling system. Ecological Modeling 204:289-300; 2007.
44. MacGregor D, Slovic P. Graphic representation of judgmental information. HumanYComputer Interact 2:179-200; 1986.
45. Makinson KA. Tissue weighting factors: derivation and parametric analysis. Corvallis, OR: Oregon State University; 2009. Thesis.
46. McCarthy MA, Burgman MA, Ferson S. Logistic sensitivity and bounds for extinction risks. Ecological Modeling 86: 297-303; 1996.
47. McCarthy MA, Thompson CJ, Possingham HP. Theory for designing nature reserves for single species. The Am Naturalist 165:250-257; 2005.
48. McMichael CE, Hope AS. Predicting streamflow response to fire-induced landcover change: implications of parameter uncertainty in the MIKE SHE model. J Environmental Management 84:245-256; 2007.
49. Mokhtari A, Moore CM, Yang H, Jaykus LA, Morales R, Cates SC, Cowen P. Consumer-phase salmonella enterica serovar enteritidis risk assessment for egg-containing food products. Risk Analysis 26:753-768; 2006.
50. Monni S, Perala P, Regina K. Uncertainty in agricultural CH4 and NO2 emissions from FinlandVpossibilities to increase accuracy in emission estimates. Mitigation Adaptation Strategies Global Change 12:545-571; 2007.
51. Napier BA, Fellows JR, Krupka KM. Soil-to-plant concentration ratios for assessing food-chain pathways in biosphere models. Richland, WA: Pacific Northwest National Laboratory; Report No. PNNL-16741 (NUREG/CR-6941); 2007.
52. National-Scale Air Toxics Assessment. Limitations in the 1996 national-scale air toxics assessment: uncertainty.Washington, DC: U.S. Environmental Protection Agency; 2007. Available at www.epa.gov/ttn/atw/nata/ roy/page15.html. Accessed 1 October 2007.
53. Neal JC, Atkinson PM, Hutton CW. Flood inundation model updating using an ensemble Kalman filter and spatially distributed measurements. J Hydrol 336:401-415; 2007.
54. Neumann MB, Gunten UV, Gujer W. Uncertainty in prediction of disinfection performance. Water Research 41: 2371-2378; 2007a.
55. Neumann MB, Gunten VU, Gujer W. Sources of parameter uncertainty in predicting treatment performance: the case of preozonation in drinking water engineering. Environmental Sci Technol 41:3991-3996; 2007b.
56. Nichols JD, Hines JE, Mackenzie DI, Seamans ME, Gutierrez RJ. Occupancy estimation and modeling with multiple states and state uncertainty. Ecology 88:1395-1400; 2007.
57. Peters J, Verhoest NE, Samson R, Van Meirvenne M, Cockx L, De Baets Bernard. Uncertainty propagation in vegetation distribution models based on ensemble classifiers. Ecological Modeling 220:791-804; 2009.
58. Pinker S. A theory of graph comprehension. In: Freedle R, ed. Artificial intelligence and the future of testing. Hillsdale, NJ: Erlbaum; 1990.
59. Pleil JD, Kim D, Prah JD, Rapport SM. Exposure reconstruction for reducing uncertainty in risk assessment: example using MTBE biomarkers and a simple pharmacokinetic model. Biomarkers 12:331-348; 2007.
60. Ramsey FL, Schafer DW. The statistical sleuth. Pacific Grove: Duxbry; 2002.
61. Regan HM, Hope BK, Ferson S. Analysis and portrayal of uncertainty in a food-web exposure model. Human Ecological Risk Assessment 8:1757-1777; 2002.
62. Rodi WL. Error analysis in the joint event location/seismic calibration inverse problem. In: 29th Monitoring Research Review: ground-based nuclear explosion monitoring technologies. Denver, CO. Washington, DC: U.S. Department of Energy; 2007: 454-462.
63. Saltelli A. Sensitivity analysis. Chichester, UK: John Wiley and Sons; 2000.
64. Schapira MM, Nattinger AB, McHorney CA. Frequency or probability?A qualitative study of risk communication formats used in health care. Med Decision Making 21:459-467; 2001.
65. Schwartz DR, Howell WC. Optimal stopping performance under graphic and numerical CRT formatting. Human Factors 27:433-444; 1985.
66. Smith JE, Heath LS. Identifying influences on model uncertainty: an application using a forest carbon budget model. Environmental Management 27:253-267; 2001.
67. Sniedovich M. The art and science of modeling decision-making under severe uncertainty. Decision-Making Manufacturing Services 1:109-134; 2007.
68. Spence I, Kutlesa N, Rose DL. Using color to code quantity in spatial displays. J Experimental Psychol Applied 5:383-412; 1999.
69. Stone ER, Yates JF, Parker AM. Effects of numerical and graphical displays on professed risk-taking behavior. J Experimental Psychol Applied 3:243-256; 1997.
70. Storlie CB, Helton JC. Multiple predictor smoothing methods for sensitivity analysis. Albuquerque, NM: Sandia National Laboratory; Report #4693; 2006.
71. Su Y, Davis BJ, Furutani KM, Herman MG, Robb RA. Dosimetry accuracy as a function of seed localization uncertainty in permanent prostate brachytherapy: increased seed number correlates with less variability in prostate dosimetry. Phys Med Biol 52:3105-3119; 2007.
72. Troffaes MCM, Gosling JP. Robust detection of exotic infectious diseases in animal herds: a comparative study of two decision methodologies under severe uncertainty. In: 7th International Symposium on Imprecise Probability: Theories and applications. Innsbruck, Austria: University of Innsbruck; 2011.
73. Tung Y-K, Yen B-C. Hydrosystems engineering uncertainty analysis. New York: The McGraw-Hill Companies, Inc.; 2005.
74. Tversky A, Kahneman D. Rational choice and the framing of decisions. J Business 59:251-278; 1986.
75. Vandenberghe V, Bauwens W, Vanrolleghem PA. Evaluation of uncertainty propagation into river water quality predictions to guide future monitoring campaigns. Environmental Modeling Software 22:725-732; 2007.
76. van der Sluijs JP, Craye M, Funtowicz SO, Kloprogge P, Ravetz J, Risbey J. Combining quantitative and qualitative measures of uncertainty in model-based environmental assessment: the NUSAP System. Risk Analysis 25(2):481-492; 2005; 111-119.
77. Vose D. Risk analysis: a quantitative guide. New York: Wiley; 2000.
78. Wackerly DD, Mendenhall W, Scheaffer RL. Mathematical statistics with applications. Pacific Grove: Duxbry; 2002: 151-154.
79. Wang K. Vibration analysis of cracked composite bendingtorsion beams for damage diagnosis. Virginia Polytechnic Institute and State University; 2004. Dissertation.
80. Wardekker AJ, van der Sluijs JP, Janssen PHM, Kloprogge P, Petersen AC. Uncertainty communication in environmental assessments: view from the Dutch science-policy interface. Environ Science & Policy 11(7):627-641; 2008.
81. Whyatt JD, Metcalfe SE, Nicholson J, Derwent RG, Page T, Stedman JR. Regional scale modeling of particulate matter in the UK, source attribution and an assessment of uncertainties. Atmospheric Environment 41:3315-3327; 2007.
82. Wickens CD, Gempler K, Morphew ME. Workload and reliability of predictor displays in aircraft traffic avoidance. Transportation Human Factors J 2:99-126; 2000.