Pseudo-absences, pseudo-models and pseudo-niches: Pitfalls of model selection based on the area under the curve

International Journal of Geographical Information Science

Volumn 26, Issue 11, 2012, Pages 2049-2063

  Golicher, Duncan ^a,b   Ford, Andrew ^b   Cayuela, Luis ^c   Newton, Adrian ^b  

^a DEPARTAMENTO DE CONSERVACIÓN DE LA BIODIVERSIDAD   (Mexico)

^b BOURNEMOUTH UNIVERSITY   (United Kingdom)

^c UNIVERSIDAD REY JUAN CARLOS   (Spain)

Author keywords

model selection; species distribution modelling

Indexed keywords

ACCURACY ASSESSMENT; ECOLOGICAL MODELING; GAUSSIAN METHOD; NICHE; PREDICTION; TREE;

EID: 84869432608     PISSN: 13658816     EISSN: 13623087     Source Type: Journal    
DOI: 10.1080/13658816.2012.719626     Document Type: Article

References (44)

1. Akaike, H. 1974. New look at statistical-model identification. IEEE Transactions on Automatic Control, AC19(6): 716-723.
2. Anderson, R.P. 2003. Real vs. artefactual absences in species distributions: tests for oryzomys albigularis (rodentia: Muridae) in venezuela. Journal of Biogeography, 30(4): 591-605.
3. Araújo, M.B. 2004. Would climate change drive species out of reserves? An assessment of existing reserve-selection methods. Global Change Biology, 10(9): 1618-1626.
4. Araújo, M.B. and Rahbek, C. 2007. Conserving biodiversity in a world of conflicts. Journal of Biogeography, 34(2): 199-200.
5. Austin, M. 2007. Species distribution models and ecological theory: a critical assessment and some possible new approaches. Ecological Modelling, 200(1-2): 1-19.
6. Berry, P.M. 2002. Modelling potential impacts of climate change on the bioclimatic envelope of species in Britain and Ireland. Global Ecology and Biogeography, 11(6): 453-462.
7. Bini, L.M. 2006. Challenging Wallacean and Linnean shortfalls: knowledge gradients and conservation planning in a biodiversity hotspot. Diversity and Distributions, 12(5): 475-482.
8. Breiman, L. 1984. Classification and regression trees, Belmont, CA: Wadsworth.
9. Broenniman, O. 2006. Do geographic distribution, niche property and life form explain plants' vulnerability to global change?. Global Change Biology, 12(6): 1079-1093.
10. Burnham, K.P. 2001. Suggestions for presenting the results of data analyses. Journal of Wildlife Management, 65(3): 373-378.
11. Chatfield, C. 1995. Model uncertainty, data mining and statistical inference. Journal of the Royal Statistical Society, Series A, 158: 419-466.
12. Egan, J.P. 1975. Signal detection theory and ROC analysis, New York: Academic Press.
13. Elith, J., Burgman, M.A. and Regan, H.M. 2002. Mapping epistemic uncertainties and vague concepts in predictions of species distribution. Ecological Modelling, 157(2-3): 313-329.
14. Elith, J. 2006. Novel methods improve prediction of species' distributions from occurrence data. Ecography, 29(2): 129-151.
15. Elith, J. and Leathwick, J. 2007. Predicting species distributions from museum and herbarium records using multiresponse models fitted with multivariate adaptive regression splines. Diversity and Distributions, 13(3): 265-275.
16. Engler, R., Guisan, A. and Rechsteiner, L. 2004. An improved approach for predicting the distribution of rare and endangered species from occurrence and pseudo-absence data. Journal of Applied Ecology, 41(2): 263-274.
17. Freeman, E. 2007. PresenceAbsence: An R Package for Presence-Absence Model Evaluation, Ogden, UT: USDA Forest Service, Rocky Mountain Research Station.
18. García, A. 2006. Using ecological niche modelling to identify diversity hotspots for the herpetofauna of pacific lowlands and adjacent interior valleys of Mexico. Biological Conservation, 130(1): 25-46.
19. Golicher, D.J. 2008. Applying climatically associated species pools to the modelling of compositional change in tropical Montane forests. Global Ecology and Biogeography, 17(2): 262-273.
20. Graham, C.H. 2004. New developments in museum-based informatics and applications in biodiversity analysis. Trends in Ecology & Evolution, 19(9): 497-503.
21. Hanley, J.A. and McNeil, B.J. 1982. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143: 29-36.
22. Hastie, T., 2008. gam: Generalized Additive Models [online]. R package version 1.0. Available from:[Accessed May 2011]. http://cran.r-project.org/ (http://cran.r-project.org/)
23. Hernandez, P.A. 2006. The effect of sample size and species characteristics on performance of different species distribution modeling methods. Ecography, 29(5): 773-785.
24. Kuper, W. 2006. Deficiency in African plant distribution data-missing pieces of the puzzle. Botanical Journal of the Linnean Society, 150(3): 355-368.
25. Lennon, J.J. 2000. Red-shifts and red herrings in geographical ecology. Ecography, 23(1): 101-113.
26. Lobo, J.M., Jiménez-Valverde, A. and Real, R. 2008. AUC: a misleading measure of the performance of predictive distribution models. Global Ecology and Biogeography, 17(2): 145-151.
27. Moilanen, A. 2006. Uncertainty analysis for regional-scale reserve selection. Conservation Biology, 20: 1688-1697.
28. Newton, A.C. and Oldfield, S. 2008. Red listing the world's tree species: a review of recent progress. Endangered Species Research, 6: 137-147.
29. Papes, M. and Gaubert, P. 2007. Modelling ecological niches from low numbers of occurrences: assessment of the conservation status of poorly known viverrids (mammalia, carnivora) across two continents. Diversity and Distributions, 13: 890-902.
30. Pearson, R.G. 2007. Predicting species distributions from small numbers of occurrence records: a test case using cryptic geckos in Madagascar. Journal of Biogeography, 34(1): 102-117.
31. Peterson, A.T. and Kluza, D.A. 2003. New distributional modelling approaches for gap analysis. Animal Conservation, 6: 47-54.
32. Peterson, A.T., Papes, M. and Soberon, J. 2008. Rethinking receiver operating characteristic analysis applications in ecological niche modeling. Ecological Modelling, 213(1): 63-72.
33. Peterson, A.T. and Vieglais, D.A. 2001. Predicting species invasions using ecological niche modeling: new approaches from bioinformatics attack a pressing problem. Bioscience, 51(5): 363-371.
34. Phillips, S.J., Anderson, R.P. and Schapire, R.E. 2006. Maximum entropy modeling of species geographic distributions. Ecological Modelling, 190(3-4): 231-259.
35. R Development Core Team. 2010. R: a language and environment for statistical computing, Vienna: R Foundation for Statistical Computing.
36. Schlather, M., 2008. RandomFields: simulation and analysis of random fields. R package version 1.3.35. Available from:[Accessed May 2011]. http://cran.r-project.org/ (http://cran.r-project.org/)
37. Stockwell, D.R.B. 2006. Improving ecological niche models by data mining large environmental datasets for surrogate models. Ecological Modelling, 192(1-2): 188-196.
38. Stockwell, D.R.B. and Noble, I.R. 1992. Induction of sets of rules from animal distribution data-a robust and informative method of data-analysis. Mathematics and Computers in Simulation, 33(5-6): 385-390.
39. Swets, J. 1988. Measuring the accuracy of diagnostic systems. Science, 240: 1285-1293.
40. Swets, J.A., Dawes, R.M. and Monahan, J. 2000. Better decisions through science. Scientific American, 283: 82-87.
41. Thuiller, W., Lavorel, S. and Araújo, M.B. 2005. Niche properties and geographical extent as predictors of species sensitivity to climate change. Global Ecology and Biogeography, 14(4): 347-357.
42. Whittaker, R.J. 2005. Conservation biogeography: assessment and prospect. Diversity and Distributions, 11(1): 3-23.
43. Williams, K.J. 2012. Which environmental variables should I use in my biodiversity model?. International Journal of Geographical Information Science,: 1-39. doi:10.1080/13658816.2012.698015
44. Wisz, M.S. 2008. Effects of sample size on the performance of species distribution models. Diversity and Distributions, 14: 763-773.