Performance metrics and variance partitioning reveal sources of uncertainty in species distribution models

Ecological Modelling

Volumn 309-310, Issue , 2015, Pages 48-59

  Watling, James I ^a   Brandt, Laura A ^b   Bucklin, David N ^a   Fujisaki, Ikuko ^a   Mazzotti, Frank J ^a   Romañach, Stephanie S ^c   Speroterra, Carolina ^a  

^a UNIVERSITY OF FLORIDA   (United States)

^b U S FISH AND WILDLIFE SERVICE   (United States)

^c U S GEOLOGICAL SURVEY   (United States)

Author keywords

Climate envelope; Niche model; Sensitivity analysis; Spatial analysis

Indexed keywords

ALGORITHMS; CLIMATE MODELS; COMPUTATIONAL COMPLEXITY; CONSERVATION; ECOLOGY; FORECASTING; FORESTRY; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS;

CLIMATE ENVELOPE; CONSERVATION PLANNING; EMISSIONS SCENARIOS; GENERAL CIRCULATION MODEL; PERFORMANCE METRICS; SOURCES OF UNCERTAINTY; SPATIAL ANALYSIS; SPECIES DISTRIBUTION MODELS;

POPULATION DISTRIBUTION;

ALGORITHM; CONSERVATION PLANNING; GEOGRAPHICAL DISTRIBUTION; MAPPING; RARE SPECIES; UNCERTAINTY ANALYSIS; VERTEBRATE;

UNITED STATES;

VERTEBRATA;

EID: 84929470723     PISSN: 03043800     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ecolmodel.2015.03.017     Document Type: Article

References (73)

1. Allouche O., Tsoar A., Kadmon R. Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS). J. Appl. Ecol. 2006, 43:1223-1232.
2. Alvarado-Serrano D.F., Knowles L.L. Ecological niche models in phylogeographic studies: applications, advances and precautions. Mol. Ecol. Resour. 2014, 14:233-248.
3. Araújo M.B., Peterson A.T. Uses and misuses of bioclimatic envelope modeling. Ecology 2012, 93:1527-1539.
4. Barve N., Barve V., Jiménez-Valverde A., Lira-Noriega A., Maher S.P., Peterson A.T., Soberón J., Villalobos S. The crucial role of the accessible area in ecological niche modeling and species distribution modeling. Ecol. Model. 2011, 222:1810-1819.
5. Benscoter A.M., Reece J.S., Noss R.F., Brandt L.A., Mazzotti F.J., Romañach S.S., Watling J.I. Threatened and endangered subspecies with vulnerable ecological traits also have high susceptibility to sea level rise and habitat fragmentation. PLoS ONE 2013, 8:e70647.
6. Blaustein R.J. Biodiversity hotspot: the Florida panhandle. Bioscience 2008, 58:784-790.
7. Booth T.H., Nix H.A., Busby J.R., Hutchinson M.F. BIOCLIM: the first species distribution modelling package, its early applications and relevance to most current MaxEnt studies. Divers. Distrib. 2014, 20:1-9.
8. Braunisch V., Coppes J., Arlettaz R., Suchant R., Schmid H., Bollman K. Selecting from correlated climate variables: a major source of uncertainty for predicting species distributions under climate change. Ecography 2013, 36:971-983.
9. Breiman L. Random forests. Mach. Learn. 2001, 45:15-32.
10. Bucklin D.B., Basille M., Benscoter A.M., Brandt L.A., Mazzotti F.J., Romañach S.S., Speroterra C., Watling J.I. Comparing species distribution models constructed with different subsets of environmental predictors. Divers. Distrib. 2015, 21:23-35.
11. Bucklin D.B., Watling J.I., Speroterra C., Brandt L.A., Mazzotti F.J., Romañach S.S. Climate downscaling effects on predictive ecological models: a case study for threatened and endangered vertebrates in the southeastern United States. Reg. Environ. Change 2013, 13:57-68.
12. Buisson L., Thuiller W., Casajus N., Lek S., Grenouillet G. Uncertainty in ensemble forecasting of species distribution. Glob. Change Biol. 2010, 16:1145-1157.
13. Burnham K.P., Anderson D.R. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach 2002, Springer, New York, USA.
14. Carroll C., Dunk J.R., Moilanen A. Optimizing resiliency of reserve networks to climate change: multispecies conservation planning in the Pacific Northwest, USA. Glob. Change Biol. 2010, 16:891-904.
15. Catano C.P., Romañach S.S., Beerens J.M., Pearlstine L.G., Brandt L.A., Hart K.M., Mazzotti F.J., Trexler J.C. Using scenario planning to evaluate the impacts of climate change on wildlife populations and communities in the Florida Everglades. Environ. Manage. 2014, 10.1007/s00267-014-0397-5.
16. Cruz-Cárdenas G., López-Mata L., Villaseñor J.L., Ortiz E. Potential species distribution modeling and the use of principal component analysis as predictor variables. Rev. Mexicana Biodiver. 2014, 85:189-199.
17. Cutler D.R., Edwards T.C., Beard K.H., Cutler A., Hess K.T., Gibson J., Lawler J.J. Random forests for classification in ecology. Ecology 2007, 88:2783-2792.
18. Diniz-Filho J.A.F., Bini L.M., Rangel T.R., Loyola R.D., Hof C., Nogués-Bravo D., Araújo M.B. Partitioning and mapping uncertainties in ensembles of forecasts of species turnover under climate change. Ecography 2009, 32:897-906.
19. Dormann C.F., et al. Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography 2013, 36:27-46.
20. Dormann C.F., Purschke O., García Márquez J.R., Lautenbach S., Schröder S. Components of uncertainty in species distribution analysis: a case study of the Great Grey Shrike. Ecology 2008, 89:3371-3386.
21. Elith J., Burgman M.A., Regan H.M. Mapping epistemic uncertainties and vague concepts in predictions of species distribution. Ecol. Model. 2002, 157:313-329.
22. Elith J., et al. Novel methods improve prediction of species' distributions from occurrence data. Ecography 2006, 29:129-151.
23. Elith J., Leathwick J.R., Hastie T. A working guide to boosted regression trees. J. Anim. Ecol. 2008, 77:802-813.
24. Elith J., Phillips S.J., Hastie T., Dudík M., Chee Y.E., Yates C.J. A statistical explanation of MaxEnt for ecologists. Divers. Distrib. 2011, 17:43-57.
25. Fielding A.H., Bell J.F. A review of methods for the assessment of prediction errors in conservation presence/absence models. Environ. Conserv. 1997, 24:38-49.
26. Fitzpatrick M.C., Gotelli N.J., Ellison A.M. MaxEnt versus MaxLike: empirical comparisons with ant species distributions. Ecosphere 2013, 4:55.
27. Fourcade Y., Engler J.O., Rodder D., Secondi J. Mapping species distributions with MAXENT using a geographically biased sample of presence data: a performance assessment of methods for correcting sampling bias. PLoS ONE 2014, 9:e97122.
28. Franklin J. Mapping Species Distributions 2009, Cambridge University Press, Cambridge.
29. Gritti E.S., Duputié A., Massol F., Chuine I. Estimating consensus and associated uncertainty between inherently different species distribution models. Meth. Ecol. Evol. 2013, 4:442-452.
30. Guisan A., Zimmerman N.E., Elith J., Graham C.H., Phillips S., Peterson A.T. What matters most for predicting the occurrences of trees: techniques, data, or species characteristics?. Ecol. Monogr. 2007, 77:615-630.
31. Hanspach J., Kühn I., Schweiger O., Pompe S., Klotz S. Geographical patterns in prediction errors of species distribution models. Glob. Ecol. Biogeogr. 2011, 20:779-788.
32. Heikkinen R.K., Luoto M., Araújo M.B., Virkkala R., Thuiller W., Sykes M.T. Methods and uncertainties in bioclimate envelope modeling under climate change. Prog. Phys. Geogr. 2006, 30:751-777.
33. Hernandez P.A., Graham C.H., Master L.L., Albert D.L. The effect of sample size and species characteristics on performance of different species distribution modeling methods. Ecography 2006, 29:773-785.
34. Hijmans R.J., Cameron S.E., Parra J.L., Jones P.G., Jarvis A. Very high resolution interpolated climate surfaces for global land areas. Int. J. Clim. 2005, 25:1965-1978.
35. Hirzel A.H., Hausser J., Chessel D., Perrin N. Ecological-niche factor analysis: how to compute habitat-suitability maps without absence data?. Ecology 2002, 83:2027-2036.
36. Jaeschke A., Bittner T., Jentsch A., Reineking B., Schlumprecht H., Beierkuhnlein C. Biotic interactions in the face of climate change: a comparison of three modelling approaches. PLoS ONE 2012, e51472.
37. Kampichler C., Wieland R., Calmé S., Weissenberger H., Arriaga-Weiss S. Classification in conservation biology: a comparison of five machine-learning methods. Ecol. Inform. 2010, 5:441-450.
38. Knight G.R., Oetting J.B., Cross L. Atlas of Florida's Natural Heritage - Biodiversity, Landscapes, Stewardship, and Opportunities 2011, Florida State University, Tallahassee.
39. Lobo J.M., Jiménez-Valverde A., Real R. AUC: a misleading measure of the performance of predictive distribution models. Glob. Ecol. Biogeogr. 2007, 17:145-151.
40. Lobo J.M., Jiménez-Valverde A., Hortal J. The uncertain nature of absences and their importance in species distribution modelling. Ecography 2010, 33:103-114.
41. Luoto M., Virkkala R., Heikkinen R.K. The role of land cover in bioclimatic models depends on spatial resolution. Glob. Ecol. Biogeogr. 2007, 16:34-42.
42. Marmion M., Parviainen M., Luoto M., Heikkinen R.K., Thuiller W. Evaluation of consensus methods in predictive species distribution modelling. Divers. Distrib. 2009, 15:59-69.
43. McCullugh P., Nelder J.A. Generalized Linear Models 1989, Chapman and Hall, New York, New York, USA. second edition.
44. Muñoz J., Felicísimo A.M. Comparison of statistical methods commonly used in predictive modelling. J. Veg. Sci. 2004, 15:285-292.
45. Nakicenović N., et al. Intergovernmental Panel on Climate Change Special Report on Emissions Scenarios 2000, Cambridge University Press, United Kingdom, Cambridge.
46. New M., Lister D., Hulme M., Makin I. A high-resolution data set of surface climate over global land areas. Clim. Res. 2002, 21:1-25.
47. Nicholls R.J., Hanson S., Herweijer C., Patmore N., Hallegatte S., Corfee-Morlot J., Chateau J., Muir-Wood R. Ranking port cities with high exposure and vulnerability to climate extremes: exposure estimates. Environment working paper no. 1 2008, Organization for Economic Co-operation and Development, Paris.
48. Nix H.A. A biogeographic analysis of Australian elapid snakes. Atlas of elapid snakes if Australia: Australian flora and fauna series 7 1986, 4-15. Bureau of Flora and Fauna, Canberra. R. Longmore (Ed.).
49. Oliver T.H., Gillings S., Giardello M., Rapacciuolo G., Brereton T.M., Siriwardena G.M., Roy D.B., Pywell R., Fuller R.J. Population density but not stability can be predicted from species distribution models. J. Appl. Ecol. 2012, 49:581-590.
50. Oppel S., Meirinho A., Ramírez I., Gardner B., O'Connell A.F., Miller P.I., Louzao M. Comparison of five modelling techniques to predict spatial distribution and abundance of seabirds. Biol. Conserv. 2012, 156:94-104.
51. Pagel J., Schurr F.M. Forecasting species ranges by statistical estimation of ecological niches and spatial population dynamics. Glob. Ecol. Biogeogr. 2012, 21:293-304.
52. Peters G.P., Andrew R.M., Boden T., Canadell J.G., Ciais P., La Quéré C., Marland G., Raupach M.R., Wilson C. The challenge to keep global warming below 2°C. Nat. Clim. Change 2013, 3:4-6.
53. Phillips S.J., Anderson R.P., Schapire R.E. Maximum entropy modeling of species geographic distributions. Ecol. Model. 2006, 190:231-259.
54. Phillips S.J., Dudík M., Elith J., Graham C.H., Lehmann A., Leathwick J., Ferrier S. Sample selection bias and presence-only distribution models: implications for background and pseudo-absence data. Ecol. Appl. 2009, 19:181-197.
55. R Development Core Team R: A Language and Environment for Statistical Computing 2013, R Foundation for Statistical Computing, Austria, Vienna, http://www.r-project.org (accessed 20.05.13).
56. Real R., Márquez A.L., Olivero J., Estrada A. Species distribution models in climate change scenarios are still not useful for informing public policy: an uncertainty assessment using fuzzy logic. Ecography 2010, 33:304-314.
57. Reece J.S., Noss R.F., Oetting J., Hoctor T., Volk M. A vulnerability assessment of 300 species in Florida: threats from sea level rise, land use and climate change. PLoS ONE 2013, 8:e80658.
58. Royle J.A., Chandler R.B., Yackulic C., Nichols J.D. Likelihood analysis of species occurrence probability from presence-only data for modelling species distributions. Methods Ecol. Evol. 2012, 3:545-554.
59. SAS Institute SAS 9.4 User's Guide. Cary, NC 2013.
60. Shirley S.M., Yang Z., Hutchinson R.A., Alexander J.D., McGarigal K., Betts M.G. Species distribution modeling for the people: unclassified landsat TM imagery predicts bird occurrence at fine resolutions. Divers. Distrib. 2013, 2013:1-12.
61. Stefanova L., Misra V., Chan S., Griffin M., O'Brien J.J., Smith T.J. A proxy for high-resolution regional reanalysis for the southeast United States: assessment of precipitation variability in dynamically downscaled reanalyses. Clim. Dynam. 2012, 38:2449-2466.
62. Stein B.A. States of the Union: Ranking America's Biodiversity 2002, NatureServe, Arlington, VA.
63. Synes N.W., Osborne P.E. Choice of predictor variables as a source of uncertainty in continental-scale species distribution modelling under climate change. Glob. Ecol. Biogeogr. 2011, 20:904-914.
64. Tabor K., Williams J.W. Globally downscaled climate projections for assessing the conservation impacts of climate change. Ecol. Appl. 2010, 20:554-565.
65. Thuiller W., Georges D., Engler R. Package 'biomod2': Ensemble Platform for Species Distribution Modeling 2014, Available at cran.r-project.org/web/packages/biomod2/.
66. Tsoar A., Allouche O., Steinitz O., Rotem D., Kadmon R. A comparative evaluation of presence-only methods for modelling species distribution. Divers. Distrib. 2007, 13:397-405.
67. University of Florida Florida Population Studies, Bulletin 168, April 2014 2014, University of Florida Bureau of Economic and Business Research, Gainesville, FL.
68. Valle M., van Katwijk M.M., de Jong D.J., Bouma T.J., Schipper A.M., Chust G., Benito B.M., Garmendia J.M., Borja A. Comparing the performance of species distribution models of Zostera marina: implications for conservation. J. Sea Res. 2013, 83:56-64.
69. VanDerWal J., Shoo L.P., Graham C., Williams S.E. Selecting pseudo-absence data for presence-only distribution modeling: how far should you stray from what you know?. Ecol. Model. 2009, 220:589-594.
70. Watling J.I., Romañach S.S., Bucklin D.N., Speroterra C., Brandt L.A., Pearlstine L.G., Mazzotti F.J. Do bioclimate variables improve performance of climate envelope models?. Ecol. Model. 2012, 246:79-85.
71. Wenger S.J., Som N.A., Dauwalter D.C., Isaak D.J., Neville H.M., Luce C.H., Dunham J.B., Young M.K., Fausch K.D., Rieman B.E. Probabilistic accounting of uncertainty in forecasts of species distributions under climate change. Glob. Change Biol. 2013, 19:3343-3354.
72. Wilson K.A., Westphal M.I., Possinghamn H.P., Elith J. Sensitivity of conservation planning to different approaches to using predicted species distribution data. Biol. Conserv. 2005, 122:99-112.
73. Wisz W.S., Guisan A. Do pseudo-absence selection strategies influence species distribution models and their predictions? An information-theoretic approach based on simulated data. BMC Ecol. 2009, 9:8.