Going beyond the single number: Using probabilistic risk assessment to improve risk management

Human and Ecological Risk Assessment (HERA)

Volumn 2, Issue 4, 1996, Pages 1008-1034

  Thompson, Kimberly M ^a   Graham, John D ^a  

^a HARVARD CENTER FOR RISK ANALYSIS   (United States)

Author keywords

Cost benefit analysis; Decision analysis; Risk characterization; Uncertainty; Value of information; Variability

Indexed keywords

EID: 21444442339     PISSN: 10807039     EISSN: None     Source Type: Journal    
DOI: 10.1080/10807039609383660     Document Type: Article

References (108)

1. Adams, M.R., Hanna, C.A., Mayernick, J.A., and Mendez, W.M. 1994. Probabilistic health risk assessment for exposures to estuary sediments and biota contaminated with polychlorinated biphenyls, polychlorinated terphenyls, and other toxic substances. Risk Anal. 14, 4, 577-594.
2. AIHC (American Industrial Health Council). 1992. Improving Risk Characterization. Washington, DC, American Industrial Health Council, September.
3. AIHC (American Industrial Health Council). 1995. Advances in Risk Characterization. Washington, DC, American Industrial Health Council, November.
4. Anderson, P.D. and Yuhas, A.L. 1996. Improving risk management by characterizing reality: A benefit of probabilistic risk assessment. Hum. Ecol. Risk Assess. 2, 1, 55-58.
5. Arrow, K.J., Cropper, M.L., Eads, G.C., Hahn, R.W., Lave, L.B., Noll, R.G., Portney, P.R., Russell, M., Schmalensee, R., Smith, V.K., and Stavins, R.N. 1996. Is there a role for benefit-cost analysis in environmental, health, and safety regulation? Science 272, 221-222.
6. Baird, S.J.S., Cohen, J.T., Graham, J.D., Shlyakhter, A.I., and Evans, J.S. 1996 Noncancer risk assessment: A probabilistic alternative to current practice. Hum. Ecol. Risk Assess. 2, 1, 79-102.
7. Bevington, P.R. 1969. Data Reduction and Error Analysis for the Physical Sciences. New York, McGraw-Hill.
8. Bloom, D.L., Byrne, D.M., and Andresen, J.M. 1993. Communicating Risk to Senior EPA Policy Makers: A Focus Group Study. Produced for U.S. EPA Office of Air Quality Planning and Standards, March 1993.
9. Bogen, K.T. 1990. Uncertainty in Environmental Health Risk Assessment. New York, Garland Publishing.
10. Bogen, K.T. 1994. A note on compounded conservatism. Risk Anal. 14, 4, 379-381.
11. Bogen, K.T. and Spear, R.C. 1987. Integrating uncertainty and variability in environmental risk assessment. Risk Anal. 7, 427-436.
12. Brand, K.P. and Small, M.J. 1995. Updating uncertainty in an integrated risk assessment: Conceptual framework and methods. Risk Anal. 15, 6, 719-732.
13. Browner, C. 1995. Policy for Risk Characterization. Memorandum from Carol Browner, EPA Administrator dated March 21, 1995.
14. Burmaster, D.E. and Bloomfield, L.R. 1996. Mathematical properties of the risk equation when variance is present. Hum. Ecol. Risk Assess. 2, 2, 348-355.
15. Burmaster, D.E. and Edelmann, K. 1996. Are all distributions of risk with the same 95th percentile equally acceptable? Hum. Ecol. Risk Assess. In press.
16. Burmaster, D.E. and Harris, R.H. 1993. The magnitude of compounding conservatisms in Superfund risk assessments. Risk Anal. 13, 2, 131-143.
17. Burmaster, D.E., Lloyd, K.J., and Thompson, K.M. 1995. The need for new methods to backcalculate soil cleanup targets in interval and probabilistic cancer risk assessments. Hum. Ecol. Risk Assess. 1, 1, 89-100.
18. Burmaster, D.E. and Thompson, K.M. 1995. Backcalculating cleanup targets in probabilistic risk assessments when acceptability of cancer risk is defined under different risk management policies. Hum. Ecol. Risk Assess. 1, 1, 101-120.
19. Carrington, C.D. 1996. Logical probability and risk assessment. Hum. Ecol.Risk Assess. 2, 1, 62-78.
20. Cohen, J.T., Lampson, M.A., and Bowers, T.S. 1996. The use of two-stage Monte Carlo simulation techniques to characterize uncertainty and variability in risk analysis. Submitted to Hum. Ecol. Risk Assess. 2, 939-972.
21. CRARM (Commission on Risk Assessment and Risk Management). 1996. Risk Assessment and Risk Management in Regulatory Decision Making, Draft Report. Washington, DC, Commission on Risk Assessment and Risk Management, June.
22. Cox, D.C. and Baybutt, P. 1981. Methods of uncertainty analysis: A comparative survey. Risk Anal. 1, 4, 251-258.
23. Cullen, A.C. 1994. Measures of compounding conservatism in probabilistic risk assessment. Risk Anal. 14, 4, 389-393.
24. Cullen, A.C. 1995. The sensitivity of probabilistic risk assessment results to alternative model structures: A case study for municipal waste incineration. J. Air Waste Manage. Assoc. 45, 538-546.
25. Cullen, A.C. and Frey, H.C. 1996. Use of Probabilistic Techniques in Exposure Assessment: A Handbook for Addressing Variability and Uncertainty in Models and Inputs. In preparation.
26. Dakins, M.E., Toll, J.E., and Small, M.J. 1994. Risk-based environmental remediation: Decision framework and role of uncertainty. Environ. Tox. Chem. 13, 12, 1907-1915.
27. Dakins, M.E., Toll, J.E., Small, M.J., and Brand, K.P. 1996. Risk-based environmental remediation: Bayesian Monte Carlo analysis and the expected value of sample information. Risk Anal. 16, 1, 67-80.
28. Davies, J.C. 1996. Comparing Environmental Risks. Washington, DC, Resources for the Future.
29. Eschenroeder, A.Q. and Faeder, E.J. 1988. A Monte Carlo analysis of health risks from PCB-contaminated mineral oil transformer fires. Risk Anal. 8, 291-299.
30. Evans, J.S., Graham, J.D., Gray, G.M., and Sielken, R.L. 1994a. A distributional characterization of cancer risk from formaldehyde exposure. Risk Anal. 14, 1, 25-34.
31. Evans, J.S., Gray, G.M., Sielken, R.L., Smith, A.E., Valdez-Flores, C., and Graham, J.D. 1994b. Use of probabilistic expert judgment in uncertainty analysis of carcinogenic potency. Regul. Toxicol. Pharmacol. 20, 15-36.
32. Evans, J.S., Hawkins, N., and Graham, J. 1988. The value of monitoring for radon in the home: A decision analysis. JAPCA 38, 11, 1380-1385.
33. Finkel, A.M. 1990. Confronting Uncertainty in Risk Management: A Guide for Decision Makers. Washington, DC, Center for Risk Management, Resources for the Future.
34. Finkel, A.M. 1991. Edifying presentation of risk estimates: Not as easy as it seems. J. Policy Anal. Manage. 10, 2, 296-303.
35. Finkel, A.M. 1994. Stepping out of your own shadow: A didactic example of how facing uncertainty can improve decision-making. Risk Anal. 14, 5, 751-761.
36. Finkel, A.M. and Evans, J.S. 1987. Evaluation the benefits of uncertainty reduction in environmental health risk management. JAPCA 37, 1164-1171.
37. Finley, B.L. and Paustenbach, D.J. 1994. The benefits of probabilistic exposure assessment: Three case studies involving contaminated air, water, and soil. Risk Anal. 14, 1, 53-73.
38. Freudenberg, W.R. and Rursch, J.A. 1994. The risks of 'putting the numbers in context:' A cautionary tale. Risk Anal. 14, 6, 949-950.
39. Frey, H.C. 1992. Quantitative Analysis of Uncertainty and Variability in Environmental Policy Making. Washington, DC, Directorate for Science and Policy Programs, American Association for the Advancement of Science, September.
40. Frey, H.C. and Rhodes, D.S. 1996. Characterizing, simulating, and analyzing variability and uncertainty: An illustration of methods using an air toxics emissions example. Hum. Ecol. Risk Assess. 2, 4, 762-797.
41. Graham, J.D. 1987. Cancer in the courtroom: Risk assessment in the post-benzene era. J. Policy Anal. Manage. 6, 3, 432-450.
42. Graham, J.D. and Henrion, M. 1984. A probabilistic analysis of the passive-restraint question. Risk Anal. 4, 1, 25-40.
43. Graham, J.D. and Wiener, J.B. 1995. Risk Versus Risk: Tradeoffs in Protecting Health and the Environment. Cambridge, MA, Harvard University Press.
44. Gramlich, E.M. 1981. Benefit-Cost Analysis of Government Programs. Englewood Cliffs, NJ, Prentice-Hall, Inc.
45. Habicht, F.H. 1992. Guidance on Risk Characterization for Risk Managers and Risk Assessors. Memorandum from F. Henry Habicht, EPA Deputy Administrator dated February 26, 1992 (reprinted Appendix B in NAS, 1994).
46. Haimes, Y.Y., Barry, T. and Lambert, J.H. 1994. When and how you can specify a probability distribution when you don't know much. Risk Anal. 14, 5, 661-706.
47. Hammitt, J.K. and Cave, J.A.K. 1991. Research Planning for Food Safety: A Value-of-Information Approach. Santa Monica, CA, Rand.
48. Hattis, D. 1996. Strategies for Assessing Human Variability in Susceptibility, and Using Variability to Infer Human Risks. Prepared for International Life Sciences Institute, February.
49. Hattis, D. and Barlow, K. 1996. Human interindividual variability in cancer risks - Technical and management challenges. Hum. Ecol. Risk Assess. 2, 1, 194-220.
50. Hattis, D. and Burmaster, D.E. 1994. Assessment of variability and uncertainty distributions for practical risk analysis. Risk Anal. 14, 5, 713-730.
51. Hawkins, N.C. 1991. Conservatism in maximally exposed individual (MEI) predictive exposure assessments: A first cut analysis. Regul. Toxicol. Pharmacol. 14, 107-117.
52. Helton, J.C. 1993. Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliability Eng. Syst. Saf. 42, 327-367.
53. Hoffman, F.O. 1996. Personal communication with F. Owen Hoffman, SENES Oak Ridge Inc., Center for Risk Analysis, September 26.
54. Hoffman, F.O. and Hammonds, J.S. 1994. Propagation of uncertainty in risk assessments: The need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. Risk Anal. 14, 5, 661-706.
55. Hoffman, F.O., Simon, S.L., and Thiessen, K.M. 1996. The role of uncertainty analysis in dose reconstruction and risk assessment. Presented at the 31st Annual Meeting of the National Council on Radiation Protection and Measurements in Arlington, VA, April 1995.
56. Howard, R.A. 1980. An assessment of decision analysis. Operations Res. 28, 1, 4-27.
57. IAEA (International Atomic Energy Agency). 1989. Evaluating the Reliability of Predictions Using Environmental Transfer Models. Vienna, Austria: International Atomic Energy Agency, Safety Practice Publications of the IAEA, IAEA Safety Series No. 100.
58. Ibrekk, H. and Morgan, M.G. 1983. Graphical communication of uncertain quantities to nontechnical people. Risk Anal. 7, 4, 519-529.
59. Iman, R.L., and Helton, J.C. 1988. An investigation of uncertainty and sensitivity analysis techniques for computer models. Risk Anal. 8, 1, 71-90.
60. (IUD vs. API) Industrial Union Department v. American Petroleum Institute. 1980. 448 U.S. Sup. Ct., 607.
61. Johnson, B.B. and Slovic, P. 1994. 'Improving' risk communication and risk management: Legislated solutions or legislated disasters? Risk Anal. 14, 6, 905-906.
62. Johnson, B.B. and Slovic, P. 1995. Presenting uncertainty in health risk assessment: Initial studies of its effects on risk perception and trust. Risk Anal. 15, 4, 485-494.
63. Keeney, R.L. 1990. Mortality risks due to economic expenditures. Risk Anal. 10, 147-159.
64. Keeney, R.L. 1994. Mortality risks induced by the costs of regulations. J. Risk Uncert. 6, 95-110.
65. Keeney, R.L. and Raiffa, H. 1976. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. New York, John Wiley.
66. Kocher, D.C. and Hoffman, F.O. 1991. Regulating environmental carcinogens: Where do we draw the line? Environ. Sci. Tech. 25, 12, 1987-1989.
67. Lave, L.B., Ennever, F.K., Rosenkranz, H.S., and Omenn, G.S. 1988. Information value of the rodent bioassay. Nature 336, 631-633.
68. Lipton, J. and Gillett, J.W. 1992. Uncertainty in risk assessment: Exceedence frequencies, acceptable risk, and risk-based decision making. Regul. Toxicol. Pharmacol. 15, 51-61.
69. Lipton, J., Shaw, W.D., Holmes, J., and Patterson, A. 1995. Short communication: Selecting input distributions for use in Monte Carlo simulations. Regul. Toxicol. Pharmacol. 21, 192-198.
70. MacIntosh, D.M., Suter, G.W., and Hoffman, F.O. 1994. Uses of probabilistic exposure models in ecological risk assessments of contaminated sites. Risk Anal. 14, 4, 405-420.
71. McCarthy, M.A., Burgman, M.A., and Ferson, S. 1995. Sensitivity analysis for models of population viability. Biol. Conserv. 73, 93-100.
72. McKone, T.E. 1994. Uncertainty and variability in human exposures to soil contaminants through homegrown food: A Monte Carlo assessment. Risk Anal. 14, 4, 449-463.
73. McKone, T.E. and Bogen, K.T. 1991. Predicting uncertainties in risk assessment. Environ. Sci. Technol. 25, 10, 1674-1681.
74. McKone, T.E. and Ryan, P.B. 1989. Human exposure to chemicals through food chains: An uncertainty analysis. Environ. Sci. Technol. 23, 9, 1154-1163.
75. Morgan, M.G. and Henrion, M. 1990. Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. New York, Cambridge University Press.
76. Mullahy, J. and Manning, W. 1995. Statistical issues in cost-effectiveness analysis. In: Valuing Health Care: Costs, Benefits, and Effectiveness of Pharmaceutical and Other Medical Technologies, Ch. 8 (Sloan, F.A., Ed.). Cambridge, England, Cambridge University Press.
77. NRC (National Research Council). 1994. Science and Judgment in Risk Assessment. Washington, DC, National Academy Press, National Academy of Sciences.
78. NRC (National Research Council). 1996. Understanding Risk: Informing Decisions in a Democratic Society. Washington, DC, National Academy Press, National Academy of Sciences.
79. Nichols, A.L. and Zeckhauser, R.J. 1988. The perils of prudence: How conservative risk assessments distort regulation. Reg. Toxicol. Pharmacol. 8, 61-75.
80. North, D.W. 1983. Quantitative analysis as a basis for decision under TSCA. ACS Symposium Series 213, 181-195.
81. North, D.W., Selker, F.K., and Guardino, T. 1992. The value of research: on health effects of ingested inorganic arsenic. In: Proceedings of the International Conference on Arsenic Exposure and Health Effects (Chappell, W., Ed.). Northwood, UK, Society for Environmental Geochemistry and Health, Science Reviews Ltd., 1-20.
82. OMB (Office of Management and Budget), 1996. Economic Analysis of Federal Regulations Under Executive Order 12866, Washington, DC, Executive Office of the President.
83. Padgett, J. and Richmond, H. 1983. The process of establishing and revising National Ambient Air Quality Standards. JAPCA 33, 1, 13-16.
84. Pate-Cornell, E. 1996. Uncertainties in risk analysis: Six levels of treatment. Reliability Eng. Syst. Saf. In press. October.
85. Paustenbach, D.J., Meyer, D.M., Sheenan, P.J., and Lau, V. 1991. An assessment and quantitative uncertainty analysis of the health risks to workers exposed to chromium contaminated soils. Toxicol. Ind. Health 7, 159-196.
86. Portney, P.R. and Stavins, R.N. 1993. Regulatory review of environmental policy: The potential role of health-health analysis. Cambridge, MA, JFK School of Government, Harvard University, CSIA Discussion Paper 93-04, June.
87. Price, P.S., Su, S.H., Harrington, J.R., and Keenan, R.E. 1996. Uncertainty and variability in indirect exposure assessments: An analysis of exposure to tetrachlorodibenzo-p-dioxin from a beef consumption pathway. Risk Anal. 16, 2, 263-277.
88. Raiffa, H. 1968. Decision Analysis: Introductory Lectures on Choices Under Uncertainty. Reading, MA, Addison-Wesley Publishing.
89. Raiffa, H. and Schlaifer, R.O. 1961. Applied Statistical Decision Theory. Cambridge, MA, Harvard University Press.
90. Reichard, E.G. and Evans, J.S. 1989. Assessing the value of hydrogeologic information for risk-based remedial action decisions. Water Resources Res. 25, 7, 1451-1460.
91. Richardson, G.M. 1996. Deterministic versus probabilistic risk assessment: Strengths and weaknesses in a regulatory context. Hum. Ecol. Risk Assess. 2, 1, 44-54.
92. Rosenthal, A., Gray, G.M., and Graham, J.D. 1992. Legislating acceptable cancer risk from exposure to toxic chemicals. Ecol. Law Quart. 19, 269-362.
93. Seiler, F.A. 1987. Error propagation for large errors. Risk Anal. 7, 4, 509-518.
94. Seiler, F.A. and Alvarez, J.L. 1996. On the selection of distributions for stochastic variables. Risk Anal. 16, 1, 5-18.
95. Smith, R.L. 1994. Use of Monte Carlo simulation for human exposure assessment at a Superfund site. Risk Anal. 14, 4, 433-440.
96. Taylor, A.C. 1993. Using objective and subjective information to develop distributions for probabilistic exposure assessment. J. Expos. Anal. Environ. Epidemiol. 3, 3, 285-298.
97. Taylor, A.C., Evans, J.S., and McKone, T.E. 1993. The value of animal test information in environmental control decisions. Risk Anal. 13, 4, 403-412.
98. Tengs, T.O., Adams, M.E., Pliskin, J.S., Safran, D.G., Siegel, J.E., Weinstein, M.C., and Graham, J.D. 1995. Five-hundred life-saving interventions and their cost-effectiveness. Risk Anal. 15, 3, 369-390.
99. Thompson, K.M. 1995. Evaluation of National Exposure Assessment Information for Improving Risk Management Decisions. Sc.D. Thesis, Harvard University School of Public Health, January 1995.
100. Thompson, K.M., Burmaster, D.E., and Crouch, E.A.C. 1992. Monte Carlo techniques for quantitative uncertainty analysis in public health risk assessments. Risk Anal. 12, 1, 53-63.
101. USEPA (U.S. Environmental Protection Agency). 1994. Use of Monte Carlo Simulation in Risk Assessments. Philadelphia, PA, US Environmental Protection Agency, Region III, EPA 903-F-94-001, February.
102. USEPA (U.S. Environmental Protection Agency). 1995a. Use of Monte Carlo Simulation in Risk Assessments. Denver, CO, US Environmental Protection Agency, Region VIII, Superfund Technical Guidance, RA-10, September.
103. USEPA (U.S. Environmental Protection Agency). 1996a. Proposed Guidelines for Carcinogen Risk Assessment. Washington, DC, U.S. Environmental Protection Agency, EPA/600/P-92/003C, April.
104. USEPA (U.S. Environmental Protection Agency). 1996b. Exposure Factors Handbook, External Review Draft. Washington, DC, U.S. Environmental Protection Agency, EPA/600/P-95/002B, August.
105. Weinstein, M.C. 1983. Cost-effectiveness priorities for cancer prevention. Science 221, 4605, 17-23.
106. Weinstein, M.C. and Stason, W.B. 1977. Foundations of cost-effectiveness analysis for health and medical practices. New Engl. J. Med. 296, 13, 716-721.
107. Wilson, R. 1979. Analyzing the daily risks of life. Technol. Rev. February, 41-46.
108. Zeckhauser, R.J. and Viscusi, W.K. 1990. Risk within reason. Science 248, 559-564.