Expert judgement elicitation for risk assessments of critical infrastructures

Journal of Risk Research

Volumn 7, Issue 6, 2004, Pages 643-656

  Cooke, R M ^a   Goossens, L H J ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Critical infrastructures; Expert judgement; Risk assessment

Indexed keywords

BEHAVIORAL RESEARCH; DECISION MAKING; FAILURE ANALYSIS; MATHEMATICAL MODELS; NUCLEAR POWER PLANTS; PARAMETER ESTIMATION; PROBABILITY; PROBLEM SOLVING; PUBLIC POLICY; RELIABILITY;

CRITICAL INFRASTRUCTURES; EXPERT JUDGEMENT; PROBABILITY ASSESSMENTS; QUANTITATIVE ASSESSMENT;

RISK ASSESSMENT;

EID: 3342878524     PISSN: 13669877     EISSN: None     Source Type: Journal    
DOI: 10.1080/1366987042000192237     Document Type: Conference Paper

References (44)

1. Bedford, T. J. and Cooke, R. M. (2001) Probabilistic Risk Analysis, Foundations and Methods, Cambridge: Cambridge University Press.
2. Bradley, R. (1953) Some statistical methods in taste testing and quality evaluation, Biometrica 9, 22-38.
3. Brockhoff, K. (1975) The performance of forecasting groups in computer dialogue and face to face discussions, in H. Linstone and M. Turoff (eds) The Delphi Method, Techniques and Applications, pp. 291-321. Reading Mass: Addison Wesley.
4. Budnitz, R. J., Apostolakis, G., Boore, D. M., Cluff, L. S., Coppersmith, K. J., Cornell, C. A. and Morris, P. A. (1998) Use of technical expert panels: applications tp probabilistic seismic hazard analysis, Risk Analysis 18(4), 463-69.
5. Clemen, R. T. and Winkler, R. L. (1999) Combining probability distributions from experts in risk analysis, Risk Analysis 19(2), 187-203.
6. Cojazzi, G. and Fogli, D. (2000) Benchmark Exercise on Expert Judgement Techniques in PSA Level 2, extended final report, European Commission EUR 19739, Brussels-Luxembourg.
7. Cojazzi, G., Fogli, D., Grassini, G. and Coe, I. M. (2000) Benchmarking structured expert judgement methodologies for the assessment of hydrogen combustion in a generic evolutionary PWR, in S. Kondo and K. Furuta (eds) PSAM5 - Probabilistic Safety Assessment and Management 2, pp. 1151-57. Tokyo: Universal Academy Press.
8. Comer, K., Seaver, D., Stillwell, W. and Gaddy, C. (1984) Generating Human Reliability Estimates Using Expert Judgement I and II, NUREG/CR-3688, Washington, DC: USNRC.
9. Cooke, R. M. (1991) Experts in Uncertainty, Oxford: Oxford University Press.
10. Cooke, R. M. (1994) Uncertainty in dispersion and deposition in accident consequence modeling assessed with performance-based expert judgment, Reliability Engineering and System Safety 45, 35-46.
11. Cooke, R. M. and Solomatine, D. (1992) EXCALIBR Integrated System for Processing Expert Judgements version 3.0, User's manual, prepared under contract for Directorate-General XII, Delft: Delft University of Technology.
12. Cooke, R. M. and Jager, E. (1998) A probabilistic model for the failure frequency of underground gas pipelines, Risk Analysis 18(4), 511-27.
13. Cooke, R. M. and Goossens, L. H. J. (2000) Procedures Guide for Structured Expert Judgement, Report EUR 18820, Brussels-Luxembourg.
14. Cooke, R. M., Mendel, M. and Thys, W. (1988) Calibration and information in expert resolution: a classical approach, Automatica 24, 87-94.
15. Cooke, R. M., French, S. and van Steen, J. F. J. (1990) The use of expert judgement in risk analysis, Report to the European Space Agency, Delft: Delft University of Technology.
16. Cooke, R. M., Goossens, L. H. J. and Kraan, B. C. P. (1994) Methods for CEC/USNRC accident consequence uncertainty analysis of dispersion and deposition - performance based aggregating of expert judgements and PARFUM method for capturing modelling uncertainty, Prepared for the Commission of European Communities, EUR 15856.
17. Cooke, R. M., Jager, S. E. and Geervliet, (1996) Failure frequency of underground gas pipelines, in P. C. Cacciabue and I. A. Papazoglou (eds) Probabilistic Safety Assessment and Management 2, pp. 992-99, New York: Springer.
18. David, H. (1963) The Method of Paired Comparisons, London: Charles Griffin.
19. Goossens, L. H. J. and Cooke, R. M. (1997) Applications of some risk assessment techniques: Formal expert judgement and Accident Sequence Precursors, Safety Science 26(1/2), 35-48.
20. Goossens, L. H. J. and Harper, F. T. (1998) Joint EC/USNRC expert judgement driven radiological protection uncertainty analysis, Journal Radiological Protection 18(4), 249-64.
21. Goossens, L. H. J. and Kelly, G. N. (2000) Expert judgement and accident consequence uncertainty analysis (COSYMA). Special Issue of Radiation Protection Dosimetry, 90(3), 291-384.
22. Goossens, L. H. J., Cooke, R. M. and van Steen, J. F. J. (1989) Expert Opinions in Safety Studies, Report to the Dutch Ministry of Housing, Physical Planning and Environment, Delft: Delft University of Technology.
23. Goossens, L. H. J., Cooke, R. M., Woudenberg, F. and van der Torn, P. (1992) Probit Functions and Expert Judgement: Main report: protocol and results; Appendices report: backgrounds, variables and data, Report prepared for the Ministry of Housing, Physical Planning and Environment, the Netherlands; Delft University of Technology, Safety Science Group and Department of Statistics, Stochastics and Operations Research, and Municipal Health Service, Rotterdam, Section Environmental Health, October.
24. Goossens, L. H. J., Cooke, R. M. and Kraan, B. C. P. (1996) Evaluation of Weighting Schemes for Expert Judgement Studies, Final report prepared under contract Grant No. Sub 94-FIS-040 for the Commission of European Communities, Directorate-General for Science, Research and Development, XII-F-6, Delft University of Technology, Delft/NL, December.
25. Goossens, L. H. J., Cooke, R. M., Woudenberg, F. and van der Torn, P. (1998) Expert judgement and lethal toxicity of inhaled chemicals, Journal of Risk Research 1, 117-33.
26. Goossens, L., Cooke, R. and Kraan, B. (1998) Evaluation of weighting schemes for expert judgement studies, in A. Mosleh and R. Bari (eds) Proceedings of the 4th International Conference on Probabilistic Safety Assessment and Management, pp. 1937-42. New York: Springer.
27. Granger Morgan, M. and Henrion, M. (1990) Uncertainty. A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis, Cambridge: Cambridge University Press.
28. Gustafson, D., Shulka, R., Delbecq, A. and Walster, A. (1973) A comparative study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups and nominal groups, Organisational Behaviour and Human Performance 9, 280-91.
29. Hale, A. R., Costa, M. A. F., Goossens, L. H. J. and Smit, K. (1999) Relative importance of maintenance management influences on equipment failure and availability in relation to major hazards, in G. I. Schuëller and P. Kafka (eds) Safety and Reliability ESREL '99 2, pp. 1327-32, Rotterdam: A. A. Balkema.
30. Hale, A. R., Goossens, L. H. J., Costa, M. A. F., Smit, K. and Matos, L. (2000) Expert judgement for assessment of management influences on risk control, in M. P. Cottam (ed.) Foresight and Precaution 2, pp. 1077-82. A.A. Balkema, Rotterdam/Brookfield.
31. Helmer, O. (1966) Social Technology, New York: Basic Books.
32. Hogarth, R. (1987) Judgement and Choice, New York: Wiley.
33. Hora, S. and Iman, R. (1989) Expert opinion in risk analysis: the NUREG-1150 methodology, Nuclear Science and Engineering, 102, 323.
34. Kahneman, D., Slovic, P. and Tversky, A. (eds) (1982) Judgement under Uncertainty, Heuristics and Biases, Cambridge: Cambridge University Press.
35. Kaplan, S. (1992). 'Expert information' versus 'expert opinions'. Another approach to the problem of eliciting/combining/using expert knowledge in PRA, Reliability Engineering and System Safety 35, 61-72.
36. Keeney, R. L. and Von Winterfeldt, D. (1989) On the uses of expert judgment on complex technical problems, IEEE Transactions on Engineering Management 36(2), 83-6.
37. Kraan, B. C. P. and Cooke, R. M. (2000) Processing expert judgements in accident consequence modelling, Radiation Protection Dosimetry 90(3), 311-15.
38. Rodic, Lj. (2000) Reliability of landfill technology, PhD thesis, Delft: Eburon.
39. Rodic-Wiersma, Lj. and Goossens, L. H. J. (2001) Landfill technology performance: more than technology alone, in R. Cossu (ed.) Sardinia 2001: Eighth international Waste Management and Landfill Symposium, Sardinia, 1-5 October, Cagliari: CISA.
40. Slijkhuis, K., Frijters, M., Cooke, R. and Vrouwenvelder, A. (1998) Probability of flooding: an uncertainty analysis, in K. Lydersen, Hansen & Sandtorv (eds) Safety and reliability, Balkema, Rotterdam, pp. 1419-25.
41. Thurstone, L. L. (1927) A law of comparative judgment, Psychological Review 34, 273-86.
42. USNRC (1990) Severe accident risks: an assessment for five US nuclear power plants. Report NUREG-1150, Washington, DC: USNRC.
43. Van der Fels-Klerx, I. H. J., Goossens, L. H. J., Saatkamp, H. W. and Horst, S. H. S. (2002) Use of a heterogeneous expert panel - elicitation of quantitative data from a heterogeneous expert panel: formal process and application in animal health, Risk Analysis 22, 67-81.
44. Van Elst, N. P. (1997) Betrouwbaarheid Beweegbare Waterkeringen [Reliability of Movable Water Barriers], Delft: Delft University Press, WBBM report Series 35.