Elicitator: An expert elicitation tool for regression in ecology

Environmental Modelling and Software

Volumn 25, Issue 1, 2010, Pages 129-145

  James, Allan ^a   Choy, Samantha Low ^a   Mengersen, Kerrie ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Bayesian statistics; Ecology; Elicitation software; Expert elicitation; Expert opinion; Java; Regression

Indexed keywords

BAYESIAN STATISTICS; ELICITATION SOFTWARE; EXPERT ELICITATION; EXPERT OPINION; JAVA; REGRESSION;

BAYESIAN NETWORKS; COMPUTER SOFTWARE; OCEAN HABITATS; PROBABILITY DENSITY FUNCTION; REGRESSION ANALYSIS; RISK ANALYSIS; RISK ASSESSMENT; RISK PERCEPTION; SAFETY FACTOR;

ECOLOGY;

BAYESIAN ANALYSIS; ECOLOGICAL MODELING; ENVIRONMENTAL MODELING; EXPERT SYSTEM; GEOGRAPHICAL KNOWLEDGE; GIS; KNOWLEDGE BASED SYSTEM; REGRESSION ANALYSIS; SOFTWARE;

EID: 69949149491     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2009.07.003     Document Type: Article

References (60)

1. Accad A., Low Choy S.J., Pullar D., and Rochester W. Bioregional classification via model-based clustering. In: Zerger A., and Argent R.M. (Eds). MODSIM 2005 International Congress on Modelling and Simulation (2005), Modelling and Simulation Society of Australia and New Zealand 1326-1332 December 2005
2. Al-Awadhi A.S., and Garthwaite P.H. Quantifying expert opinion for modelling fauna and habitat distributions. Computational Statistics 21 1 (2006) 121-140
3. Alho J.M., Kangras J., and Kolehmainen O. Uncertainty in expert predictions of the ecological consequences of forest plans. Applied Statistics 45 (1996) 1-14
4. Austin M. Spatial prediction of species distribution: an interface between ecological theory and statistical modelling. Ecological Modelling 157 2-3 (2002) 101-118
5. Ayyub B.M. Elicitation of Expert Opinions for Uncertainty and Risks (2001), CRC Press, Florida, USA
6. Bedrick E.J., Christensen R., and Johnson W. A new perspective on priors for generalized linear models. Journal of the American Statistical Association 91 436 (1996) 1450-1460
7. Boyce M.S., Irwin L.L., and Barker R. Demographic meta-analysis: synthesizing vital rates for Spotted Owls. Journal of Applied Ecology 42 (2005) 38-49
8. Branscum A.J., Johnson W.O., and Thurmond M.C. Bayesian beta regression: applications to household expenditure data and genetic distance between foot-and-mouth disease viruses. Australian and New Zealand Journal of Statistics 49 3 (2007) 287-301
9. de Bustamante Simas A., and Rocha A.V. The Betareg Package. Version 1.2 (2008). http://medipe.psu.ac.th/cran-r/web/packages/betareg/index.html
10. Chaloner K., Church T., Louis T.A., and Matts J.P. Graphical elicitation of a prior distribution for a clinical trial. The Statistician, Special Issue: Conference on Practical Bayesian Statistics, 1992 42 4 (1993) 341-353
11. Chaloner, K.M., Duncan, G.T., 1983. Assessment of a Beta prior distribution: PM elicitation. The Statistician, Proceedings of the 1982 I.O.S. Annual Conference on Practical Bayesian Statistics (Mar.-Jun., 1983) 32 (1/2), 174-180.
12. Chen Y., Hipel K.W., Kilgour D.M., and Zhu Y. A strategic classification support system for brownfield redevelopment. Environmental Modelling & Software 24 (2009) 647-654
13. Clark K.E., Applegate J.E., Niles L.J., and Dobkin D.S. An objective means of species status assessment: adapting the Delphi technique. Wildlife Society Bulletin 34 (2006) 419-425
14. Du Mouchel W. A Bayesian model and a graphical elicitation procedure for multiple comparisons. In: Bernardo J.M., de Groot M.H., Lindley D.V., and Smith A.F.M. (Eds). Bayesian Statistics 3 (1988), Oxford University Press, Oxford, UK 127-145
15. Denham R., and Mengersen K. Geographically assisted elicitation of expert opinion for regression models. Bayesian Analysis 2 1 (2007) 99-136
16. Ellison A.M. Bayesian inference in ecology. Ecology Letters 7 (2004) 509-520
17. Ferrari S., and Cribari-Neto F. Beta regression for modelling rates and proportions. Journal of Applied Statistics 31 7 (2004) 799-815
18. Ferraro D.O. Fuzzy knowledge-based model for soil condition assessment in Argentinean cropping systems. Environmental Modelling & Software 24 (2009) 359-370
19. Fleishman E., Nally R.M., Fay J.P., and Murphy D.D. Modeling and predicting species occurrence using broad-scale environmental variables: an example with butterflies of the great basin. Conservation Biology 15 6 (2001) 1674-1685
20. Garthwaite P.H., and O'Hagan A. Quantifying expert opinion in the UK water industry: an experimental study. The Statistician 49 (2000) 455-477
21. Greco S., Matarazzo B., and Slowinski R. Rough set theory for multicriteria decision analysis. European Journal of Operational Research 129 (2001) 1-47
22. Gilbert D. JFreeChart API Documentation (2008). http://www.jfree.org/jfreechart/api/javadoc/index.html Available from:
23. Guisan A., and Zimmermann N.E. Predictive habitat distribution models in ecology. Ecological Modelling 135 2-3 (2000) 147-186
24. Hughes G., and Madden L.V. Some methods for eliciting expert knowledge of plant disease epidemics and their application in cluster sampling for disease incidence. Crop Protection 21 (2002) 203-215
25. JRI - Java/R Interface. JRI API Documentation (2006). http://www.rforge.net/JRI/index.html Project website: http://www.rforge.net/JRI/index.html
26. Kadane J.B., Dickey J.M., Winkler R.L., Smith W.S., and Peters S.C. Interactive elicitation of opinion for a normal linear model. Journal of the American Statistical Association 75 (1980) 845-854
27. Kadane J.B., and Wolfson L.J. Experiences in elicitation. The Statistician 47 (1998) 3-19
28. Kuhnert P.M., Martin T.G., Mengersen K., and Possingham H.P. Assessing the impacts of grazing levels on bird density in woodland habitat: a Bayesian approach using expert opinion. Environmetrics 16 (2005) 717-747
29. Kynn, M., 2005. Eliciting expert knowledge for Bayesian logistic regression in species habitat modelling in natural resources. PhD thesis, Queensland University of Technology.
30. Kynn, M., 2006. Designing elicitor: Software to graphically elicit expert priors for logistic regression models in ecology. http://www.winbugs-development.org.uk/elicitor/files/designing.elicitor. pdf.
31. Kynn M. The "heuristics and biases" bias in expert elicitation. Journal of the Royal Statistical Society, Series A 171 1 (2008) 239-264
32. Leal J., Wordsworth S., Legood R., and Blair E. Eliciting expert opinion for economic models: an applied example. Value in Health 10 3 (2007) 195-203
33. Lindley D. Reconciliation of probability distributions. Operations Research 31 5 (1983) 866-880
34. Low Choy S.J., Mengersen K., and Rousseau J. Encoding expert opinion on skewed nonnegative distributions. Journal of Applied Probability and Statistics 3 1 (2008) 1-21
35. Low Choy, S., James, A., Mengersen, K., 2009b. Expert elicitation and its interface with technology: a review with a view to designing Elicitator. In: Braddock, R., et al. (Eds.), 18th IMACS World Congress - MODSIM09 International Congress on Modelling and Simulation, December 2009. ISBN: 978-0-9758400-7-8, pp. 4269-4275.
36. Low Choy, S., Murray, J., James, A., Mengersen, K. Indirect elicitation from ecological experts: from methods and software to habitat modelling and rock-wallabies. In: O'Hagan, A., West, M. (Eds.), Handbook of Applied Bayesian Analysis. Oxford University Press, Oxford, UK, in press.
37. Low Choy S.J., O'Leary R., and Mengersen K. Elicitation by design for ecology: using expert opinion to inform priors for Bayesian statistical models. Ecology 90 1 (2009) 265-277
38. Low Choy, S., Stewart-Koster, B., Kelly, A., Eyre, T., Mengersen, K. M., 2005. Identifying good condition in native vegetation: a Bayesian regression and decision theoretic approach. Pages 435-441 in A. Zerger and R.M. Argent, editors. MODSIM 2005 International Congress on Modelling and Simulation. Modelling and Simulation Society of Australia and New Zealand, Canberra, Australia.
39. Mahmoud M., Liu Y., Hartmann H., Stewart S., Wagener T., Semmens D., Stewart R., Gupta H., Dominguez D., Dominguez F., Hulse D., Letcher R., Rashleigh B., Smith C., Street R., Ticehurst J., Twery M., van Delden H., Waldick R., White D., and Winter L. A formal framework for scenario development in support of environmental decision-making. Environmental Modelling & Software 24 (2009) 798-808
40. Manel S., Williams H., and Ormerod S. Evaluating presence-absence models in ecology: the need to account for prevalence. Journal of Applied Ecology 38 (2001) 921-931
41. Marin J.M., and Robert C. Bayesian Core: A Practical Approach to Computational Bayesian Statistics (2007), Springer, New York
42. Martin T.G., Kuhnert P.M., Mengersen K., and Possingham H.P. The power of expert opinion in ecological models: a Bayesian approach examining the impact of livestock grazing on birds. Ecological Applications 15 1 (2005) 266-280
43. McCullagh P., and Nelder J.A. Generalized Linear Models. second ed. (1989), Chapman & Hall, London
44. Mouton A.M., De Baets B., and Goethals P.L.M. Knowledge-based versus data-driven fuzzy habitat suitability models for river management. Environmental Modelling & Software 24 (2009) 982-993
45. Murray J., Low Choy S.J., Possingham H., and Goldizen A. The importance of ecological scale for wildlife conservation in naturally fragmented environment: a case study of the brush-tailed rock-wallaby (Petrogale penicillata). Biological Conservation 141 (2008) 7-22
46. Murray J.V., Goldizen A.W., O'Leary R.A., McAlpine C.A., Possingham H.P., and Low Choy S.J. How useful is expert opinion for predicting the distribution of a species within and between regions? A case study using brush-tailed rock-wallabies (Petrogale penicillata. Journal of Applied Ecology 46 (2009) 842-851
47. MySQL AB. MySQL Reference Manual (2008), Sun Microsystems, Inc. http://dev.mysql.com/doc/index.html Manual available from:
48. O'Hagan A. The ABLE story: Bayesian asset management in the water industry. In: French S., and Smith J.Q. (Eds). The Practice of Bayesian Analysis (1997), Arnold, London 173-198
49. O'Hagan A., Buck C.E., Daneshkhah A., Eiser J.R., Garthwaite P.H., Jenkinson D.J., Oakley J.E., and Rakow T. Uncertain Judgements: Eliciting Expert Probabilities (2006), Wiley, United Kingdom
50. O'Leary R.A., Low Choy S.J., Murray J.V., Kynn M., Denham R., Martin T.G., and Mengersen K. Comparison of three expert elicitation methods for logistic regression on predicting the presence of the threatened brush-tailed rock-wallaby Petrogale penicillata. Environmetrics 20 (2009) 379-398
51. Paterson B., Stuart-Hill G., Underhill L.G., Dunne T.T., Schinzel B., Brown C., Beytell B., Demas F., Lindeque P., Tagg J., and Chris Weaver C. A fuzzy decision support tool for wildlife translocations into communal conservancies in Namibia. Environmental Modelling & Software 23 (2008) 521-534
52. R Development Core Team. R: A Language and Environment for Statistical Computing (2008), R Foundation for Statistical Computing, Vienna, Austria. http://cran.r-project.org/manuals.html Software manual available from: http://cran.r-project.org/manuals.html
53. Refsgaard J.C., van der Sluijs J.P., Højberg A.L., and Vanrolleghem P.A. Uncertainty in the environmental modelling process: a framework and guidance. Environmental Modelling & Software 22 (2007) 1543-1556
54. Spetzler C.S., and Staël von Holstein C.-A.S. Probability encoding in decision analysis. Management Science 22 3 (1975) 340-358
55. Spiegelhalter D.J., Thomas A., Best N.G., and Lunn D. WinBUGS Version 1.4 User Manual (2003), MRC Biostatistics Unit, Cambridge
56. Universal Transverse Mercator Coordinate System. Wikipedia, the Free Encyclopedia (2009, June 1). http://en.wikipedia.org/wiki/Universal_Transverse_Mercator_coordinate_sy stem Retrieved June 9, 2009, from:
57. Urbanek S. RServe Documentation (2006). http://rosuda.org/Rserve/doc.shtml Available from:
58. Van der Sluijs J.P., Risbey J.S., and Ravetz J. Uncertainty assessment of VOC emissions from paint in the Netherlands using the NUSAP system. Environmental Monitoring and Assessment 105 (2005) 229-259
59. Venables W.N., and Ripley B.R. Modern Applied Statistics Using S-Plus. fourth ed. (2002), Springer-Verlag
60. Winkler R. The assessment of prior distributions in Bayesian analysis. Journal of the American Statistical Association 62 (1967) 776-800