Quantifying expert opinion in the UK water industry: An experimental study

Journal of the Royal Statistical Society Series D: The Statistician

Volumn 49, Issue 4, 2000, Pages 455-477

  Garthwaite, Paul H ^a   O'Hagan, Anthony ^b  

^a OPEN UNIVERSITY   (United Kingdom)

^b Walton Hall ^*

Author keywords

Assessment tasks; Elicitation tools; Prior probability; Quantiles; Subjective judgment; Variance components

Indexed keywords

EID: 0004575802     PISSN: 00390526     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9884.00246     Document Type: Article

References (26)

1. Barclay, S. and Peterson, C. R. (1973) Two methods for assessing probability distributions. Technical Report 73-1. Decisions and Designs, McLean.
2. Beach, L. R. and Solak, F. (1969) Subjective estimates of acceptable error. Organiznl Behav. Hum. Perform., 4, 212-251.
3. Bolger, F. and Wright, G. (1994) Assessing the quality of expert judgement: issues and analysis. Decisn Support Syst., 11, 1-24.
4. Christensen-Szalanski, J. J. J. and Busheyhead, J. B. (1981) Physicians' use of probabilistic information in a real clinical setting. J. Exptl Psychol. Hum. Perceptn Perform., 7, 928-935.
5. Dawes, R. M., Faust, D. and Meehl, P. E. (1989) Clinical versus actuarial judgement. Science, 243, 1668-1673.
6. Garthwaite, P. H. (1989) Fractile assessments for a linear regression model: an experimental study. Organiznl Behav. Hum. Decisn Process., 43, 188-206.
7. Green, P. J. (1995) Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82, 711-732.
8. Hammond, K. R. (1993) Naturalistic decision making from a Brunswikian viewpoint: its past, present, future. In Decision Making in Action: Models and Methods (eds G. Klein, J. Orasanu, R. Calderwood and C. E. Zsambok), pp. 205-227. Norwood: Ablex.
9. Hogarth, R. M. (1975) Cognitive processes and the assessment of subjective probability distributions (with discussion). J. Am. Statist. Ass., 70, 271-294.
10. Hora, S. C., Hora, J. A. and Dodd, N. G. (1992) Assessment of probability distributions for continuous random variables: a comparison of the bisection and fixed value methods. Organiznl Behav. Hum. Decisn Process., 51, 135-155.
11. Keren, G. (1991) Calibration and probability judgements: conceptual and methodological issues. Acta Psychol., 77, 217-273.
12. Kleinmuntz, D. N., Fennema, M. G. and Peecher, M. E. (1996) Conditional assessment of subjective probabilities: identifying the benefits of decomposition. Organiznl Behav. Hum. Decisn Process., 66, 1-15.
13. Lathrop, R. G. (1967) Perceived variability. J. Exptl Psychol., 73, 498-502.
14. Lichtenstein, S., Fischhoff, B. and Phillips, L. D. (1982) Calibration of probabilities: the state of the art to 1980. In Judgement under Uncertainty: Heuristics and Biases (eds D. Kahneman, P. Slovic and A. Tversky), pp. 306-334. Cambridge: Cambridge University Press.
15. O'Hagan, A. (1995) Fractional Bayes factors for model comparison (with discussion). J. R. Statist. Soc. B, 57, 99-138.
16. _(1997) The ABLE story: Bayesian asset management in the water industry. In The Practice of Bayesian Analysis (eds S. French and J. Q. Smith), pp. 173 -198. London: Arnold.
17. _(1998) Eliciting expert beliefs in substantial practical applications. Statistician, 47, 21-35.
18. O'Hagan, A., Glennie, E. B. and Beardsall, R. E. (1992) Subjective modelling and Bayes linear estimation in the UK water industry. Appl. Statist., 41, 563-577.
19. Osherson, D., Shafir, E., Krantz, D. H. and Smith, E. E. (1997) Probability bootstrapping: improving prediction by fitting extensional models to knowledgeable but incoherent probability judgements. Organiznl Behav. Hum. Decisn Process., 69, 1-8.
20. Peterson, C. R., Snapper, K. H. and Murphy, A. H. (1972) Credible interval temperature forecasts. Bull. Am. Meteorol. Soc., 53, 966-970.
21. Pitz, G. F. (1974) Subjective probability distributions for imperfectly known quantities. In Knowledge and Cognition (ed. L. W. Gregg). New York: Wiley.
22. Ravinder, H. V., Kleinmuntz, D. N. and Dyer, J. S. (1988) The reliability of subjective probabilities obtained through decomposition. Mangmnt Sci., 34, 186-199.
23. Stewart, T. R., Roebber, P. J. and Bosart, L. F. (1997) The importance of the task in analysing expert judgement. Organiznl Behav. Hum. Decisn Process., 69, 205-219.
24. Van Lenthe, J. (1993) ELI: an interactive elicitation technique for subjective probability distributions. Organiznl Behav. Hum. Decisn Process., 55, 379-413.
25. Wright, G., Rowe, G., Bolger, F. and Gammah, J. (1994) Coherence, calibration and expertise in judgemental probability forecasting. Organiznl Behav. Hum. Decisn Process., 57, 1-25.
26. Yates, F. J., McDaniel, L. S. and Brown, E. S. (1991) Probabilistic forecasts of stock prices and earnings: the hazards of nascent expertise. Organiznl Behav. Hum. Decisn Process., 49, 60-79.