Comparison of a new expert elicitation model with the Classical Model, equal weights and single experts, using a cross-validation technique

Reliability Engineering and System Safety

Volumn 96, Issue 10, 2011, Pages 1292-1310

  Flandoli, F ^a   Giorgi, E ^a,b   Aspinall, W P ^c   Neri, A ^b  

^a UNIVERSITY OF PISA   (Italy)

^b SEZIONE DI PISA   (Italy)

^c ASPINALL AND ASSOCIATES   (United Kingdom)

Author keywords

Cooke Classical Model; Cross validation; Expected Relative Frequency model; Expert elicitation; Expert judgement; Subjective probability

Indexed keywords

CLASSICAL MODEL; CROSS VALIDATION; EXPERT ELICITATION; EXPERT JUDGEMENT; RELATIVE FREQUENCIES; SUBJECTIVE PROBABILITY;

DECISION SUPPORT SYSTEMS;

UNCERTAINTY ANALYSIS;

EID: 79960992105     PISSN: 09518320     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ress.2011.05.012     Document Type: Article

References (26)

1. R.M. Cooke Experts in Uncertainty 1991 Oxford University Press New York
2. J.B. Kadane, and L.J. Wolfson Experiences in elicitation J R Stat Soc D - Stat 47 1 1998 3 19 (Pubitemid 128469059)
3. G. Woo The Mathematics of Natural Catastrophes 1999 Imperial College Press Singapore
4. T. OHagan Elicitation Significance 2 2005 84 86
5. A. OHagan Uncertain Judgements: Eliciting Experts Probabilities 2006 John Wiley & Sons Chichester
6. W.P. Aspinall Structured elicitation of expert judgement for probabilistic hazard and risk assessment in volcanic eruptions H.M. Mader, S.G. Coles, C.B. Connor, L.J. Connor, Statistics in Volcanology - Special Publications of IAVCEI No. 1; London, the Geological Society for IAVCEI 2006 15 30
7. R.M. Cooke On the performance of social network and likelihood-based expert weighting schemes Reliab Eng Syst Saf 93 2008 745 756
8. R.M. Cooke TU Delft expert judgment data base Reliab Eng Syst Saf 93 2008 657 674
9. R.T. Clemen Comment on Cookes classical method Reliab Eng Syst Saf 93 2008 760 765
10. R.M. Cooke Response to discussants Reliab Eng Syst Saf 93 2008 775 777
11. Giorgi E. Expert Elicitation and Event Trees: An Application in Volcanology. Masters Thesis, Università di Pisa, Pisa; 2008 [in Italian].
12. M. Kynn The "heuristics and biases" in expert elicitation J Roy Stat Soc A 171 2008 239 264
13. W.P. Aspinall A route to more tractable expert advice Nature 463 2010 294 295 10.1038/463294a
14. M. Stone Cross-validation: a review Math Operationsforsch Stat Ser Stat 9 1978 127 139
15. X. Wang, and J.V. Zidek Selecting likelihood weights by cross-validation Ann Stat 33 2005 463 500 (Pubitemid 41053711)
16. L. Breiman, and J.H. Friedman Predicting multivariate responses in multiple linear regression. With discussion and a reply by the authors J R Stat Soc 59 1 1997 3 54 (Pubitemid 127686939)
17. 〈http://en.wikipedia.org/wiki/Cross-validation-(statistics)〉.
18. S.-W. Lin, and C.-H. Cheng The reliability of aggregated probability judgments obtained through Cookes classical model J Model Manage 4 2 2009 149 161
19. S.-W. Lin, and C.-H. Cheng Can Cookes model sift out better experts and produce well-calibrated aggregated probabilities? Proc IEEE IEEM 2008 425 429
20. Cooke R. Rejoinder to Effects of overconfidence and dependence on aggregated probability judgments by Lin S-W, and Huang S-W. J Model Manage, in press.
21. W.P. Aspinall Rejoinder to "Discussion: Response to discussants" by Roger Cooke (Reliability Engineering and System Safety 2008;93:775777) Reliab Eng Syst Saf 94 2009 675 676 10.1016/j.ress.2008.05.005
22. Neri A, et al. Prodotto D2.5.3.5, Versione aggiornata dellAlbero degli Eventi del Vesuvio e dei Campi Flegrei con particolare riferimento ai rami e agli scenari eruttivi studiati, Technical report of the SPEED Project, 2008 (in Italian).
23. A. Neri Developing an event tree for probabilistic hazard and risk assessment at Vesuvius J Volcanol Geotherm Res 178 2008 397 415 10.1016/j.jvolgeores.2008.05.014
24. P.J. Baxter Emergency planning and mitigation at Vesuvius: A new evidence-based approach J Volcanol Geotherm Res 178 2008 454 473 10.1016/j.jvolgeores.2008.08.015
25. Faraway JJ. Practical Regression and ANOVA using R, 2002. 〈 http://cran.r-project.org/doc/contrib/Faraway-PRA.pdf 〉.
26. R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; 2008, URL 〈 http://www.R-project.org 〉.