Use of expert judgment in exposure assessment: Part 2. Calibration of expert judgments about personal exposures to benzene

Journal of Exposure Analysis and Environmental Epidemiology

Volumn 13, Issue 1, 2003, Pages 1-16

  Walker, Katherine D ^a,b   Catalano, Paul ^a   Hammitt, James K ^a   Evans, John S ^a  

^a HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^b NONE   (United States)

Author keywords

Benzene; Calibration; Expert; Exposure assessment; Probabilistic risk analysis; Risk management; Subjective judgment

Indexed keywords

BENZENE;

AIR ANALYSIS; AIR MONITORING; AIR POLLUTION; AMBIENT AIR; ARTICLE; CALIBRATION; DECISION MAKING; ENVIRONMENTAL EXPOSURE; EXPERT SYSTEM; HEALTH SURVEY; QUALITY CONTROL; RISK ASSESSMENT; RISK MANAGEMENT; SCORING SYSTEM; STATISTICAL ANALYSIS;

AIR POLLUTION, INDOOR; BENZENE; CALIBRATION; ENVIRONMENTAL EXPOSURE; ENVIRONMENTAL POLLUTANTS; HUMANS; OBSERVER VARIATION; PERCEPTION; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT;

EID: 0345270415     PISSN: 10534245     EISSN: None     Source Type: Journal    
DOI: 10.1038/sj.jea.7500253     Document Type: Article

References (42)

1. Bevington P.R. Data Reduction and Error Analysis for the Physical Sciences. McGraw-Hill, New York, 1969.
2. Bostrom A., Fischhoff B., and Morgan M.G. Characterizing mental models of hazardous processes: a methodology and an application to radon, J Soc Issues 1992: 48(4): 85-100.
3. Bostrom A., Atman C., Fischhoff B., and Morgan M.G. Evaluating risk communications: completing and correcting mental models of hazardous processes: Part II. Risk Anal 1994: 14(5): 789-798.
4. Box G.E.P., Hunter W.G., and Hunter J.S. Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building. Wiley, New York, 1978.
5. Brier G.W. Verification of forecasts expressed in terms of probability. Mon Weather Rev 1950: 78(1): 1-3.
6. Christensen-Szalanski J.J.J., and Beach L.R. The citation bias: fad and fashion in the judgment and decision literature. Am Psychol 1984: 39: 75-79.
7. Christensen-Szalanski J.J.J., and Bushyhead J.B. Physicians' use of probabilistic information in a real clinical setting. J Exp Psychol Hum Percept Perform 1981: 7: 928-935.
8. Cooke R.M. Experts in Uncertainty: Opinion and Subjective Probability in Science. Oxford University Press, New York, 1991.
9. Cooke R.M., Mendel M., and Thys W. Calibration and information in expert resolution: a classical approach. Automatica 1988: 24: 87-94.
10. DeGroot M., Fienberg S. The comparison and evaluation of forecasters. The Statistician 1983: 32: 12-22.
11. Desmet A.A., Fryback D.G., and Thombury J.R. A second look at the utility of radiographic skull examination for trauma. AJR Am J Roentgenol 1979: 132: 95-99.
12. Evans J.S., Cooper D.W., and Kinney P.L. On the propagation of error in air pollution measurements. Environ Monit Assess 1984: 4: 139-153.
13. Evans J.S., Graham J.D., Gray G.M., and Sielken R.L. A distributional approach to characterizing low-dose cancer risk. Risk Anal 1994: 14(1): 25-34.
14. Fiering M., Wilson R., Kleiman E., and Zeise L. Statistical distributions of health risk. Civ Eng Syst 1984: 1: 129-138.
15. Hawkins N.C., and Evans J.S. Subjective estimation of toluene exposures: a calibration study of industrial hygienists. Appl Ind Hyg J 1989: 4(3): 61-68.
16. Henrion M., and Fischhoff B. Assessing uncertainty in physical constants. Am J Phys 1986: 54(9): 791-798.
17. Hynes M.E., and Van Marke E.H. Reliability of embankment performance predictions. In: Mechanics in Engineering, 1st ASCE-EMD Specialty Conference, University of Waterloo, May 26-28, 1976 (as cited in Cooke, 1991).
18. Lichtenstein S.B., Fischhoff B., Phillips L. Calibration of probabilities: the state of the art to 1980. In: Kahneman D., Slovic P., and Tversky A. (Eds.), Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press, New York, 1982.
19. Macintosh D.L., Xue J., Özkaynak H., Spengler J.D., and Ryan P.B. A population-based exposure model for benzene. J Exposure Anal Environ Epidemiol 1995: 5(3): 375-403.
20. Matheson J.E., and Winkler R.L. Scoring rules for continuous probability distributions. Manage Sci 1976: 22: 1087-1096.
21. Morgan M.G., and Henrion M. Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. Cambridge University Press, New York, 1990.
22. Mullin T.M. Understanding and supporting the process of probabilistic estimation, 1986. PhD dissertation. As cited in Morgan and Henrion, 1990. Carnegie Mellon University, Pittsburgh.
23. Murphy A.H. Scalar and vector partitions of the probability score: Part I. Two-state situation. J Appl Meteorol 1972: 11: 273-282.
24. Murphy A.H., A new vector partition of the probability score. J Appl Meteorol 1973: 12: 595-600.
25. Murphy A.H., and Winkler R.L. Reliability of subjective probability forecasts of precipitation and temperature. Appl Stat 1977: 26: 41-47.
26. Murphy A.H., and Winkler R.L. Diagnostic verification of probability forecasts. Int J Forecast 1992: 7: 435-455.
27. Pellizzari E. Concentrations of benzene in ambient, indoor, and personal air in Region V NHEXAS study. Personal communication, 1998.
28. Pellizzari E., Lioy P., Whitmore R., Freeman N., Clayton C.A., Rodes C., and Thomas K. Quality Systems and Implementation Plan for Human Exposure Assessment. Research Triangle Institute, Research Triangle Park, NC, 1995.
29. Raiffa H. Decision Analysis. Addison-Wesley, Reading, MA, 1968.
30. Samet J.H., Shevitz A., Fowle J., and Singer D.E. Hospitalization decisions in febrile intravenous drug users. Am J Med 1990: 89: 53-57.
31. Seiler F.A. Error propagation for large errors. Risk Anal 1987: 7(4): 509-518.
32. Sexton K. Informed decisions about protecting and promoting public health: rationale for a national human exposure assessment survey. J Exposure Anal Environ Epidemiol 1995: 5(3): 233-256.
33. Shlyakhter A.I., Kammen D.M., Broido C.L., and Wilson R. Quantifying the credibility of energy projections from trends in past data - the United States energy sector. Energ Policy 1994: 22(2): 119-130.
34. Taylor A.C., Evans J.S., and McKone T.E. The value of animal test information in environmental control decisions. Risk Anal 1993: 13(4): 403-412.
35. Thompson K., and Evans J.S. The value of improved national exposure information for perchloroethylene (perc); a case study for dry cleaners. Risk Anal 1997: 17(2): 253-271.
36. Tierney W.M., Fitzgerald J., McHenry R., Roth B., Psaty B., Stump D., and Anderson K. Physicians' estimates of the probability of myocardial infarction in emergency room patients with chest pain. Med Decis Making 1986: 6(1): 12-17.
37. Van Lenthe J. ELI: an interactive elicitation technique for subjective probability. Organ Behav Decis Process 1993: 55: 379-413.
38. Walker K.D., Macintosh D., and Evans J.S. Use of expert judgment in exposure assessment: Part I. Characterization of personal exposure to benzene. J Exposure Anal Environ Epidemiol 2001: 11: 308-322.
39. Wallace L. Environmental exposure to benzene: an update. Environ Health Perspect 1996: 104(Suppl. 6): 1129-1139.
40. Williams D.A. The analysis of binary responses from toxicological experiments involving reproduction and teratogenicity. Biometrics 1975: 31: 949-952.
41. Winkler R.L., and Poses R.M. Evaluating and combining physicians' probabilities of survival in an intensive care unit. Manage Sci 1993: 39(12): 1526-1543.
42. Yaniv I., and Foster D.P. Precision and accuracy of judgmental estimation. J Behav Decis Making 1997: 10(1): 21-32.