Prevalence, thresholds and the performance of presence-absence models

Methods in Ecology and Evolution

Volumn 5, Issue 1, 2014, Pages 54-64

  Lawson, Callum R ^a,b   Hodgson, Jenny A ^c   Wilson, Robert J ^a   Richards, Shane A ^d  

^a UNIVERSITY OF EXETER   (United Kingdom)

^b NETHERLANDS INSTITUTE OF ECOLOGY NIOO KNAW   (Netherlands)

^c UNIVERSITY OF LIVERPOOL   (United Kingdom)

^d DURHAM UNIVERSITY   (United Kingdom)

Author keywords

Area under the curve (AUC); Cohen's kappa; Concordance index; Deviance; Explanatory power; Goodness of fit; R squared; Sensitivity; Specificity; True skill statistic (TSS)

Indexed keywords

EID: 84892455871     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.12123     Document Type: Article

References (31)

1. Allouche, O., Tsoar, A. & Kadmon, R. (2006) Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS). Journal of Applied Ecology, 43, 1223-1232.
2. Bean, W.T., Stafford, R. & Brashares, J.S. (2011) The effects of small sample size and sample bias on threshold selection and accuracy assessment of species distribution models. Ecography, 35, 250-258.
3. Bennie, J., Hodgson, J.A., Lawson, C.R., Holloway, C.T.R., Roy, D.B., Brereton, T., Thomas, C.D. & Wilson, R.J. (2013) Range expansion through fragmented landscapes under a variable climate. Ecology Letters, 16, 921-929 in press.
4. Bolker, B.M. (2008) Ecological Models and Data in R. Princeton University Press, Princeton, NJ.
5. Elith, J. & Leathwick, J.R. (2009) Species distribution models: ecological explanation and prediction across space and time. Annual Review of Ecology, Evolution, and Systematics, 40, 677-697.
6. Fielding, A. (2007) Cluster and Classification Techniques for the Biosciences. Cambridge University Press, Cambridge.
7. Fielding, A.H. & Bell, J.F. (1997) A review of methods for the assessment of prediction errors in conservation presence/absence models. Environmental conservation, 24, 38-49.
8. Foody, G.M. (2011) Impacts of imperfect reference data on the apparent accuracy of species presence-absence models and their predictions. Global Ecology and Biogeography, 20, 498-508.
9. Gigerenzer, G. (2003) Reckoning with Risk: Learning to Live With Uncertainty. Penguin, London.
10. Guisan, A. & Zimmermann, N.E. (2000) Predictive habitat distribution models in ecology. Ecological Modelling, 135, 147-186.
11. Hand, D.J. (1997) Construction and Assessment of Classification Rules. Wiley, Chichester.
12. Hirzel, A.H., Le Lay, G., Helfer, V., Randin, C. & Guisan, A. (2006) Evaluating the ability of habitat suitability models to predict species presences. Ecological Modelling, 199, 142-152.
13. Jiménez-Valverde, A. & Lobo, J. (2006) The ghost of unbalanced species distribution data in geographical model predictions. Diversity and Distributions, 12, 521-524.
14. Kunin, W.E. (1998) Extrapolating species abundance across spatial scales. Science, 281, 1513-1515.
15. Liu, C., White, M. & Newell, G. (2011) Measuring and comparing the accuracy of species distribution models with presence-absence data. Ecography, 34, 232-243.
16. Liu, C.R., Berry, P.M., Dawson, T.P. & Pearson, R.G. (2005) Selecting thresholds of occurrence in the prediction of species distributions. Ecography, 28, 385-393.
17. Lobo, J.M., Jiménez-Valverde, A. & Real, R. (2008) AUC: a misleading measure of the performance of predictive distribution models. Global Ecology and Biogeography, 17, 145-151.
18. McPherson, J., Jetz, W. & Rogers, D.J. (2004) The effects of species' range sizes on the accuracy of distribution models: ecological phenomenon or statistical artefact? Journal of Applied Ecology, 41, 811-823.
19. Moilanen, A., Wilson, K.A. & Possingham, H.P. (2009) Spatial Conservation Prioritization: Quantitative Methods and Computational Tools. Oxford University Press, Oxford.
20. Murphy, A. & Winkler, R. (1987) A general framework for forecast verification. Monthly Weather Review, 115, 1330-1338.
21. Nakagawa, S. & Schielzeth, H. (2012) A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, 4, 133-142.
22. Pearce, J. & Ferrier, S. (2000) Evaluating the predictive performance of habitat models developed using logistic regression. Ecological Modelling, 133, 225-245.
23. Peterson, A.T., Soberón, J., Pearson, R.G., Anderson, R.P., Martínez-Meyer, E., Nakamura, M. & Araújo, M.B. (2011) Ecological Niches and Geographic Distributions. Princeton University Press, Oxford.
24. Phillips, S.J. & Elith, J. (2010) POC plots: calibrating species distribution models with presence-only data. Ecology, 91, 2476-2484.
25. Phillips, S.J. & Elith, J. (2013) On estimating probability of presence from use-availability or presence-background data. Ecology, 94, 1409-1419.
26. Royle, J.A., Chandler, R.B., Yackulic, C. & Nichols, J.D. (2012) Likelihood analysis of species occurrence probability from presence-only data for modelling species distributions. Methods in Ecology and Evolution, 3, 545-554.
27. Vaughan, I. & Ormerod, S. (2005) The continuing challenges of testing species distribution models. Journal of Applied Ecology, 42, 720-730.
28. Warren, D.L. & Seifert, S.N. (2011) Ecological niche modeling in Maxent: the importance of model complexity and the performance of model selection criteria. Ecological Applications, 21, 335-342.
29. Wilks, D.S. (2011) Statistical Methods in the Atmospheric Sciences, 3rd edn. Elsevier/Academic Press, London.
30. Wolpert, D.H. & Macready, W.G. (1997) No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1, 67-82.
31. Yackulic, C.B., Chandler, R., Zipkin, E.F., Royle, J.A., Nichols, J.D., Campbell Grant, E.H. & Veran, S. (2012) Presence-only modelling using MAXENT: when can we trust the inferences? Methods in Ecology and Evolution, 4, 236-243.