Discrimination capacity in species distribution models depends on the representativeness of the environmental domain

Global Ecology and Biogeography

Volumn 22, Issue 4, 2013, Pages 508-516

  Jiménez Valverde, Alberto ^a   Acevedo, Pelayo ^a,b   Barbosa, A Márcia ^c,d   Lobo, Jorge M ^e   Real, Raimundo ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

^b INSTITUTO DE INVESTIGACIÓN EN RECURSOS CINEGÉTICOS IREC CSIC UCLM JCCM   (Spain)

^c UNIVERSITY OF ÉVORA   (Portugal)

^d IMPERIAL COLLEGE LONDON   (United Kingdom)

^e MUSEO NACIONAL DE CIENCIAS NATURALES   (Spain)

Author keywords

Area under the ROC curve; Calibration; Classification; Contingency matrix; Discrimination; Probability; Reliability; Species distribution modelling; Uncertainty

Indexed keywords

CALIBRATION; COMPARATIVE STUDY; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; INNOVATION; NUMERICAL MODEL; PROBABILITY; SPATIAL DISTRIBUTION;

EID: 84874693063     PISSN: 1466822X     EISSN: 14668238     Source Type: Journal    
DOI: 10.1111/geb.12007     Document Type: Article

References (51)

1. Acevedo, P., Jiménez-Valverde, A., Lobo, J.M. & Real, R. (2012) Delimiting the geographical background in species distribution modelling. Journal of Biogeography, 39, 1383-1390.
2. Barve, N., Barve, V., Jiménez-Valverde, A., Lira-Noriega, A., Maher, S.P., Peterson, A.T., Soberón, J. & Villalobos, F. (2011) The crucial role of the accessibility area in ecological niche modeling and species distribution modeling. Ecological Modelling, 222, 1810-1819.
3. Copas, J.B. (1989) Unweighted sum of squares test for proportions. Applied Statistics, Journal of the Royal Statistical Society Series C, 38, 71-80.
4. Coppus, S.F.P., van der Veen, F., Opmeer, B.C., Mol, B.W.J. & Bossuyt, P.M.M. (2009) Evaluating prediction models in reproductive medicine. Human Reproduction, 24, 1774-1778.
5. Diamond, G.A. (1992) What price perfection? Calibration and discrimination of clinical prediction models. Journal of Clinical Epidemiology, 45, 85-89.
6. Fawcett, T. (2006) An introduction to ROC analysis. Pattern Recognition Letters, 27, 861-874.
7. Feeley, K.J. & Silman, M.R. (2011) Keep collecting: accurate species distribution modelling requires more collections than previously thought. Diversity and Distributions, 17, 1132-1140.
8. Fielding, A.H. & Bell, J.F. (1997) A review of methods for the assessment of prediction errors in conservation presence/absence models. Environmental Conservation, 24, 38-49.
9. Flach, P.A. (2010) ROC analysis. Encyclopedia of machine learning (ed. by C. Sammut and G.I. Webb), pp. 869-875. Springer, New York.
10. Franklin, J. (2009) Mapping species distributions. Spatial inference and prediction. Cambridge University Press, Cambridge.
11. Hand, D.J. (2006) Classifier technology and the illusion of progress. Statistical Science, 21, 1-15.
12. Harrell, F.E., Lee, K.L., Califf, R.M., Pryor, D.B. & Rosati, R.A. (1984) Regression modelling strategies for improved prognostic prediction. Statistics in Medicine, 3, 143-152.
13. Harrell, F.E., Lee, K.L. & Mark, D.B. (1996) Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statistics in Medicine, 15, 361-387.
14. Hilden, J. (1991) The area under the ROC curve and its competitors. Medical Decision Making, 11, 95-101.
15. Hirzel, A.H., Le Lay, G., Helfer, V., Randin, C. & Guisan, A. (2006) Evaluating the ability of habitat suitability models to predict species presences. Ecological Modelling, 199, 142-152.
16. Hosmer, D.W. & Lemeshow, S. (2000) Applied logistic regression, 2nd edn. Wiley, New York.
17. Hosmer, D.W., Hosmer, T., le Cessie, S. & Lemeshow, S. (1997) A comparison of goodness-of-fit tests for the logistic regression model. Statistics in Medicine, 16, 965-980.
18. Jiménez-Valverde, A. (2012) Insights into the area under the receiver operating characteristic curve (AUC) as a discrimination measure in species distribution modelling. Global Ecology and Biogeography, 21, 498-507.
19. Jiménez-Valverde, A. & Lobo, J.M. (2007) Threshold criteria for conversion of probability of species presence to either-or presence-absence. Acta Oecologica, 31, 361-369.
20. Jiménez-Valverde, A., Lobo, J.M. & Hortal, J. (2008) Not as good as they seem: the importance of concepts in species distribution modelling. Diversity and Distributions, 14, 885-890.
21. Jiménez-Valverde, A., Lira-Noriega, A., Soberón, J. & Peterson, A.T. (2010) Marshalling existing biodiversity data to evaluate biodiversity status and trends in planning exercises. Ecological Research, 25, 947-957.
22. Jovani, R. & Tella, J.L. (2006) Parasite prevalence and sample size: misconceptions and solutions. Trends in Parasitology, 22, 214-218.
23. Keren, G. (1991) Calibration and probability judgments: conceptual and methodological issues. Acta Psychologica, 77, 217-273.
24. Kramer, A.A. & Zimmerman, J.E. (2007) Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Critical Care Medicine, 35, 2052-2056.
25. Krzanowski, W.J. & Hand, D.J. (2009) ROC curves for continuous data. Chapman & Hall, Boca Raton, FL.
26. Legendre, P. (1993) Spatial autocorrelation: trouble or new paradigm? Ecology, 74, 1659-1673.
27. Lemeshow, S. & Hosmer, D.W. (1982) A review of goodness of fit statistics for use in the development of logistic regression models. American Journal of Epidemiology, 115, 92-106.
28. Lesaffre, E. & Albert, A. (1989) Partial separation in logistic discrimination. Journal of the Royal Statistical Society: Series B (Methodological), 51, 109-116.
29. Lobo, J.M. (2008) More complex distribution models or more representative data? Biodiversity Informatics, 5, 14-19.
30. Lobo, J.M., Jiménez-Valverde, A. & Real, R. (2008) AUC: a misleading measure of the performance of predictive distribution models. Global Ecology and Biogeography, 17, 145-151.
31. Matheny, M.E., Ohno-Machado, L. & Resnic, F.S. (2005) Discrimination and calibration of mortality risk prediction models in interventional cardiology. Journal of Biomedical Informatics, 38, 367-375.
32. Miller, M.E., Hui, S.L. & Tierney, W. (1991) Validation techniques for logistic regression models. Statistics in Medicine, 10, 1213-1226.
33. Murphy, A.H. & Winkler, R.L. (1992) Diagnostic verification of probability forecasts. International Journal of Forecasting, 7, 435-455.
34. Pearce, J. & Ferrier, S. (2000) Evaluating the predictive performance of habitat models developed using logistic regression. Ecological Modelling, 133, 225-245.
35. Peterson, A.T., Papeş, M. & Soberón, J. (2008) Rethinking receiver operating characteristic analysis applications in ecological niche modelling. Ecological Modelling, 213, 63-72.
36. Peterson, A.T., Soberón, J., Pearson, R.G., Anderson, R.P., Martínez-Meyer, E., Nakamura, M. & Araújo, M.B. (2011) Ecological niches and geographic distributions. Princeton University Press, Princeton.
37. Phillips, S.J. & Elith, J. (2010) POC plots: calibrating species distribution models with presence-only data. Ecology, 91, 2476-2484.
38. Poole, R.W. (1974) An introduction to quantitative ecology. McGraw-Hill, New York.
39. R Development Core Team (2009) R: a language and environment for statistical computing. Version 2.10.1. R Foundation for Statistical Computing, Vienna, Austria. Available at: http://www.R-project.org.
40. Rocchini, D., Hortal, J., Lenygel, S., Lobo, J.M., Jiménez-Valverde, A., Ricotta, C., Bacaro, G. & Chiarucci, A. (2011) Uncertainty in species distribution mapping and the need for maps of ignorance. Progress in Physical Geography, 35, 211-226.
41. Romdal, T.S., Colwell, R.K. & Rahbek, C. (2005) The influence of band sum area, domain extent, and range sizes on the latitudinal mid-domain effect. Ecology, 86, 235-244.
42. Royle, J.A., Chandler, R.B., Yackulic, C. & Nichols, J.D. (2012) Likelihood analysis of species occurrence probability from presence-only data for modelling species distributions. Methods in Ecology and Evolution, 3, 545-554.
43. Rykiel, E.J. (1996) Testing ecological models: the meaning of validation. Ecological Modelling, 90, 229-244.
44. Sanders, F. (1963) On subjective probability forecasting. Journal of Applied Meteorology, 2, 191-201.
45. Sing, T., Sander, O., Beerenwinkel, N. & Lengauer, T. (2009) ROCR: visualizing the performance of scoring classifiers. R package version 1.0-4. Available at: http://CRAN.R-project.org/package=ROCR (accessed January 2011).
46. Soetaert, K. & Herman, P.M.J. (2009) A practical guide to ecological modelling. Springer, Dordrecht.
47. Swets, J.A., Dawes, R.M. & Monahan, J. (2000) Better decision through science. Scientific American, 283, 82-87.
48. Terribile, L.C., Diniz-Filho, J.A.F. & De Marco, P. (2010) How many studies are necessary to compare niche-based models for geographic distributions? Inductive reasoning may fail at the end. Brazilian Journal of Biology, 70, 263-269.
49. Thomas, L.C., Banasik, J. & Crooks, J.N. (2001) Recalibrating scorecards. Journal of the Operational Research Society, 52, 981-988.
50. Vaughan, I.P. & Ormerod, S.J. (2005) The continuing challenges of testing species distribution models. Journal of Applied Ecology, 42, 720-730.
51. Whittaker, R.J., Araújo, M.B., Jepson, P., Ladle, R.J., Watson, J.E.M. & Willis, K.J. (2005) Conservation biogeography: assessment and prospect. Diversity and Distributions, 11, 3-23.