Eliciting fuzzy distributions from experts for ranking conceptual risk model components

Environmental Modelling and Software

Volumn 36, Issue , 2012, Pages 19-34

  Page, T ^a   Heathwaite, A L ^a   Thompson, L J ^b   Pope, L ^c   Willows, R ^c  

^a LANCASTER UNIVERSITY   (United Kingdom)

^b LANCASTER UNIVERSITY   (United Kingdom)

^c ENVIRONMENT AGENCY   (United Kingdom)

Author keywords

Elicitation; Expert opinion; Fuzzy number; Phosphorus; Uncertainty; Water framework directive

Indexed keywords

ELICITATION; EXPERT OPINION; FUZZY NUMBERS; UNCERTAINTY; WATER FRAMEWORK DIRECTIVES;

CATCHMENTS; EXPERIMENTS; PHOSPHORUS; RISK ASSESSMENT; RUNOFF; WATER CONSERVATION;

FUZZY SETS;

CATCHMENT; CONNECTIVITY; ENVIRONMENTAL MODELING; EXPERIMENTAL STUDY; EXPERT SYSTEM; FUZZY MATHEMATICS; HYDROLOGICAL REGIME; HYPOTHESIS TESTING; NUMERICAL MODEL; QUESTIONNAIRE SURVEY; RANKING; RISK ASSESSMENT; UNCERTAINTY ANALYSIS; WATER PLANNING;

ENGLAND; UNITED KINGDOM; WALES;

EID: 84861183238     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2011.03.001     Document Type: Article

References (60)

1. Ahmadi-Nedushan B., St-Hilaire A., Bérubé M., Ouarda T.B.M.J., Robichaud é In stream flow determination using a multiple input fuzzy-based rule system. A case study. River Research and Applications 2008, 24:279-292.
2. Albaum G., Best R., Hawkins D. Continuous vs discrete semantic differential ratings scales. Psychological Reports 1981, 49:90-97.
3. Aspinall W. A route to more tractable expert advice. Nature 2010, 463(21):294-295.
4. Ayyub B.M. Elicitation of Expert Opinions for Uncertainty and Risks 2001, CRC Press, Boca Raton.
5. Bilal M.A. 2000. Methods for Expert-Opinion Elicitation of Probabilities and Consequences for Corps Facilities. U.S. Army Corps of Engineers Institute for Water Resources Alexandria, VA 22315, December 2000 IWR Report-00-R-10.
6. Boorman D.B., Hollis J.M., Lilly A. Hydrology of Soil Types: a Hydrologically-based Classification of the Soils of the United Kingdom 1995, Institute of Hydrology Report No.126, Institute of Hydrology/Natural Environment Research Council, Wallingford, UK.
7. Boring R., Gertman D., Joe G., Marble J., Galyean W., Blackwood L., Blackman H. Simplified Expert Elicitation Guideline for Risk Assessment of Operating Events June 2005, Idaho National Laboratory: Department of Energy National Laboratory, Idaho Falls, Idaho, Available from. http://www.inl.gov/technicalpublications/Documents/3310952.pdf.
8. Chen S.M. Fuzzy system reliability analysis using fuzzy number arithmetic operations. Fuzzy Sets and Systems 1994, 64(1):31-38.
9. Clemen R.T., Reilly T. Making Hard Decisions 2001, Duxbury/Thompson Learning, Pacific Grove, California.
10. Clemen R.T., Winkler R.L. Combining probability distributions from experts in risk analysis. Risk Analysis 1999, 19(2):187-203.
11. Cooke R.M., El Saadany S., Huang X. On the performance of Social network and likelihood based expert weighting Schemes. Reliability Engineering System Safety. 2008, 93:745-756.
12. Cooke R.M. Experts in Uncertainty: Opinion and Subjective Probability in Science 1991, Oxford University Press, New York, NY.
13. Cornelissen A.M.G., van den Berg J., Koops W.J., Kaymak U. Elicitation of expert knowledge for fuzzy evaluation of agricultural production systems. Agriculture Ecosystems and Environment 2003, 95:1-18.
14. Daneshkhah, A., 2004. Psychological Aspects Influencing Elicitation of Subjective Probability. BEEP Working Paper. (accessed July 2006). http://www.shef.ac.uk/beep/publications.html.
15. Dubois D., Prade H. New results about properties and semantics of fuzzy set-theoretic operators. Proceedings of the Symposium on Policy Analysis and Information Systems 1980, 59-75. Plenum Press, Durham, North Carolina. P.P. Wang, S.K. Chang (Eds.).
16. Dubois D., Prade H. A review of fuzzy set aggregation connectives. Information Sciences 1985, 36(1-2):85-121.
17. Environment Agency. Uncertainty assessment for phosphorus risk to surface waters. Environment Agency Science Report SC050035/SR. Bristol, England. 2011.
18. Ferraro D.O. Fuzzy knowledge-based model for soil condition assessment in argentinean cropping systems. Environmental Modelling & Software 2009, 24(3):359-370.
19. Ford D.N., Sterman J.D. Expert knowledge elicitation to improve Mental and formal models. System Dynamics Review 1997, 14(4):309-340.
20. Funtowicz S., Ravetz J. Uncertainty and Quality in Science for Policy 1990, Kluwer Academic Publishers, Dordrecht, The Netherlands.
21. Gburek W.J., Sharpley A.N., Heathwaite A.L., Folmar G.J. Phosphorus management at the watershed scale: a modification of the phosphorus index. Journal of Environmental Quality. 2000, 29(1):130-144.
22. Granger Morgan M., Pitelka L., Shevliakova E. Elicitation of expert judgments of climate change impacts on forest ecosystems. Climatic Change 2001, 49(3):279-307.
23. Hanss M. Applied Fuzzy Arithmetic, an Introduction with Engineering Applications 2005, Springer.
24. Heathwaite A.L., Dils R.M., Liu S., Carvalho L., Brazier R.E., Pope L., Hughes M., Phillips G., May L. A tiered risk-based approach for predicting diffuse and point source phosphorus losses in agricultural areas. Science of the Total Environment 2005, 344(1-3):225-239.
25. Hilton J., O'Hare M., Bowes J., Jones I. How green is my river? A new paradigm of eutrophication in rivers. Science of the Total Environment 2006, 365:66-83.
26. Hora, S., Jensen, M., 2002. Expert judgement elicitation, Swedish radiation protection authority report 2002:19 ISSN: 0282-4434.
27. Jenkinson, D., 2005. The Elicitation of Probabilities - A Review of the Statistical Literature. BEEP Working Paper. (accessed July 2006). http://www.shef.ac.uk/beep/publications.html.
28. Jorde K, Schneider M, Peter A, Zoellner F., 2001. Fuzzy based models for the valuation of fish habitat quality and in stream flow assessment. In: Proceedings of the 3rd International Symposium on Environmental Hydraulics. 5-8 December, Tempe, Arizona.
29. Kadane J., Wolfson L.J. Experiences in elicitation. Journal of the Royal Statistical Society: Series D (The Statistician) 1998, 47(1):3-19.
30. Judgments Under Uncertainty: Heuristics and Biases 1982, Cambridge University Press, Cambridge. D. Kahneman, P. Slovic, A. Tversky (Eds.).
31. Knol A.B., Slottje P., van der Sluijs J.P., Lebret E. The use of expert elicitation in environmental health impact assessment: a seven step procedure. Environmental Health 2010, 9:19.
32. Krayer von Krauss M.P., Casman E.A., Small M.J. Elicitation of expert judgments of uncertainty in the risk assessment of herbicide-tolerant oilseed crops. Risk Analysis 2004, 24(6):1515.
33. Krueger T., Page T., Hubacek K., Smith L.E.D., Hiscock K.M. The role of expert opinion in environmentalmodelling. EnvironmentalModelling & Software 2012, 36:4-18.
34. Lemunyon J.L., Gilbert R.G. The concept and need for a phosphorus assessment tool. Journal of Production Agriculture 1993, 6:483-486.
35. Llorens E., Comas J., Martí E., Riera J.L., Sabater F., Poch M. Integrating empirical and heuristic knowledge in a kbs to approach stream eutrophication. Ecological Modelling 2009, 220(18):2162-2172.
36. Mainstone C.P., Parr W. Phosphorus in rivers - ecology and management. Science of the Total Environment 2002, 282-283:25-47.
37. McNeil B.J., Pauker S.G. On the framing of medical decisions. Decision Making: Descriptive, Normative, and Prescriptive Interactions 1988, 562-568. Cambridge University Press, Cambridge, UK. D.E. Bell, H. Raiffa, A. Tversky (Eds.).
38. Meyer M.A., Booker J.M. Eliciting and Analyzing Expert Judgment: a Practical Guide 1991, Academic Press, London, UK.
39. Meyer M.A., Butterfield K.B., Murray W.S., Smith R.E., Booker J.M. Guidelines for eliciting expert Judgment as probabilities or fuzzy logic. Fuzzy Logic and Probability Applications: Bridging the Gap 2002, SIAM, Philadelphia. T.J. Ross, J.M. Booker, W.J. Parkinson (Eds.).
40. Moller H., Berkes F., Lyver P.O., Kislalioglu M. Combining science and traditional ecological knowledge: monitoring populations for co-management. Ecology and Society 2004, 9(3):2. http://www.ecologyandsociety.org/vol9/iss3/art2/.
41. Morgan M.G., Henrion M. Uncertainty: a Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis 1990, Cambridge University Press, New York.
42. Oakley, J.E., O'Hagan, A., 2005. Uncertainty in prior elicitations: a nonparametric approach. Research Report No. 521/02. Department of Probability and Statistics, University of Sheffield.
43. O'Hagan A., Buck C.E., Daneshkhah A., Eiser J.R., Garthwaite P.H., Jenkinson D.J., Oakley J.E., Rakow T. Uncertain Judgements: Eliciting Experts' Probabilities 2006, John Wiley & Sons Ltd, Chichester.
44. O'Hagan A. Probabilistic uncertainty specification: overview, elaboration techniques and their application to a mechanistic model of carbon flux. Environmental Modelling & Software 2012, 36:35-48.
45. O'Hagan A. Eliciting expert beliefs in substantial practical applications. The Statistician 1998, 47(1):21-35.
46. O'Leary R.A., Choy S.L., Murray J.V., Kynn M., Denham R., Martin T.G., Mengersen K. Comparison of three expert elicitation methods for logistic regression on predicting the presence of the threatened brush-tailed rock-wallaby petrogale penicillata. Environmetrics 2009, 20(4):379-398.
47. Pollino C.A., Woodberry O., Nicholson A., Korb K., Hart B.T. Parameterisation and evaluation of a Bayesian network for use in an ecological risk assessment. Environmental Modelling & Software 2007, 22(8):1140-1152.
48. Roman H.A., Walker K., Tyral W., Conner L., Richmond H.M., Hubbel B.J., Kinney P.L. Expert Judgment assessment of the mortality impact of changes in ambient fine particulate matter in the U.S. Environmental Science and Technology 2008, 42:2268-2274.
49. Rowe G., Wright G. The delphi technique as a forecasting tool: issues and analysis. International Journal of Forecasting 1999, 15(4).
50. Salski A. Ecological applications of fuzzy logic. Ecological Applications of Fuzzy Logic, in Ecological Informatics, Understanding Ecology by Biologically-Inspired Computation 2003, Springer, New York. F. Recknagel (Ed.).
51. Sandri S.A., Dubois D., Kalfsbeek H.W. Elicitation, assessment, and pooling of expert judgments using possibility theory. IEEE Transactions on Fuzzy Systems 1995, 3(3):313-335.
52. Schulte R.P.O., Melland A.R., Fenton O., Herlihy M., Richards K., Jordan P. Modelling soil phosphorus decline: expectations of water framework directive policies. Environmental Science and Policy 2010, 13(6):472-484.
53. Stiber N.A., Small M.J., Pantazidou M. Site-specific updating and aggregation of Bayesian belief network models for multiple experts. Risk Analysis 2004, 24(6):1529-1538.
54. van der Sluijs J.P. A way out of the credibility crisis of models used in integrated environmental assessment. Futures 2002, 34(2):133-146.
55. Viney N.R., Sivapalan M., Deeley D. A conceptual model of nutrient mobilisation and transport applicable at large catchment scales. Journal of Hydrology 2000, 240(1-2):23-44.
56. Winkler R.L., Hora S.C., Baca R.G. The Quality of Expert Judgment Elicitations. Nuclear Regulatory Commission Contract NRC-02-88-005 1992, Center for Nuclear Waste Regulatory Analyses, San Antonio, Texas.
57. Xing H., Huang S.H., Shi J. Rapid development of knowledge-based systems via integrated knowledge acquisition. Journal of Artificial Intelligence for Engineering Design, Analysis and Manufacturing 2003, 17(3):221-234.
58. Yu D., Park W.S. Combination and evaluation of expert opinions characterized in terms of fuzzy probabilities. Annals of Nuclear Energy 2000, 27:713-726.
59. Zadeh L.A. Fuzzy sets. Information and Control 1965, 8(3):338-353.
60. Zadeh L. Fuzzy sets as the basis for a theory of possibility. Fuzzy Sets and Systems 1978, 1:3-28.