A robust test of spatial predictive models: Geographic cross-validation

Journal of Environmental Informatics

Volumn 17, Issue 2, 2011, Pages 91-101

  Lieske, D J ^a,b   Bender, D J ^a  

^a UNIVERSITY OF CALGARY   (Canada)

^b MOUNT ALLISON UNIVERSITY   (Canada)

Author keywords

Accuracy; Generalizability; Geographic cross validation; Predictive models

Indexed keywords

ACCURACY ASSESSMENT; AUTOCORRELATION; HABITAT CONSERVATION; HABITAT STRUCTURE; PREDICTION; PRIORITIZATION; SAMPLER; SOCIAL STRUCTURE; SPATIAL ANALYSIS; SPECIALIST; THEORETICAL STUDY;

CISTOTHORUS PLATENSIS;

EID: 79959614299     PISSN: 17262135     EISSN: 16848799     Source Type: Journal    
DOI: 10.3808/jei.201100191     Document Type: Article

References (41)

1. Augustin, N.H., Mugglestone, M.A., and Buckland, S.T. (1996). An autologistic model for the spatial distribution of wildlife, J. Appl. Ecol., 33, 339-347. doi:10.2307/2404755
2. Augustin, N.H., Mugglestone, M.A., and Buckland, S.T. (1998). The role of simulation in modelling spatially correlated data, Environmetrics, 9, 175-196. doi:10.1002/(SICI)1099-095X(19 9803/04)9: 2<175:: AID-ENV294>3.0.CO;2-2
3. Burnham, K.P., and Anderson, D.R. (2002). Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach. Springer, New York, pp. 488.
4. Diniz-Filho, J.A.F., Rangel, T.F.L.V.B., and Bini, L.M. (2008). Model selection and information theory in geographical ecology, Global Ecol. Biogeogr., 17, 479-488. doi:10.1111/j.1466-8238.2008.0039 5. x
5. Dormann, C.F. (2007). Effects of incorporating spatial autocorrelation into the analysis of species distribution data, Global Ecol. Biogeogr., 16, 129-138. doi:10.1111/j.1466-8238. 2006.00279.x
6. Elith, J., Graham, C.H., Anderson, R.P., Dudik, M., Ferrier, S., Guisan, A., Hijmans, R.J., Huettmann, F., Leathwick, J.R., Lehmann, A., Li, J., Lohmann, L.G., Loiselle, B.A., Manion, G., Moritz, C., Nakamura, M., Nakazawa, Y., McC. Overton, J., Peterson, A.T., and Phillips, S.J. (2006). Novel methods improve prediction of species' distributions from occurrence data, Ecography, 29, 129-151. doi:10.1111/j.2006.0906-7590.04596.x
7. Environmental Systems Research Institute. (2002). ArcGIS version 8.3. Environmental Systems Research Institute, Redlands, California.
8. Fielding, A.H., and Haworth, P.F. (1995). Testing the generality of bird-habitat models. Conserv. Biol., 9, 1466-1481. doi:10.1046/j. 1523-1739.1995.09061466.x
9. Fielding, A.H. (2002). Appropriate characteristics of an accuracy measure. Predicting species occurrences: issues of accuracy and scale (ed. by J.M. Scott, J.M., P.J. Heglund, M.L. Morrison, J.B. Haufler, M.G. Raphael, W.A. Wall, W.A. and F.B. Samson), Island Press, pp. 271-280.
10. Fielding, A.H., and Bell, J.F. (1997). A review of methods for the assessment of prediction errors in conservation presence/absence models. Environ. Conserv., 24, 38-49. doi:10.1017/S0376892997 000088
11. Foody, G.M. (2004). Spatial nonstationarity and scale dependency in the relationship between species richness and environmental determinants for the sub-Saharan endemic avifauna, Global Ecol. Biogeogr., 13, 315-320. doi:10.1111/j.1466-822X.2004.00097.x
12. Fortin, M.J., and Dale, M.R.T. (2005). Spatial analysis: a guide for ecologists, Cambridge University Press, New York.
13. Fotheringham, A.S., Brunsdon, C., and Charlton, M. (2002). Geographically weighted regression, Wiley & Sons, Ltd., Chichester, England.
14. Friedl, M.A., McIver, D.K., Hodges, J.C.F., Zhang, X.Y., Muchoney, D., Strahler, A.H., Woodcock, C.E., Gopal, S., Schneider, A., Cooper, A., Baccini, A., Gao, F., and Schaaf, C. (2002). Global land cover mapping from MODIS: algorithms and early results, Remote Sens. Environ., 83, 287-302. doi:10.1016/S0034-4257(02)00078-0
15. Guisan, A., Lehmann, A., Ferrier, S., Austin, M., Overton, J. MC. C. Aspinall R., and Hastie T. (2006). Making better biogeographical predictions of species' distributions. J. Appl. Ecol., 43, 386-392. doi: 10.1111/j.1365-2664.2006.01164.x
16. Harrell Jr., F.E. (2001). Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. Springer, New York, pp. 568.
17. Harrell Jr., F.E., Lee, K.L., and Mark, D.B. (1996). Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors, Stat. Med., 15, 361-387. doi:10.1002/(SICI)1097-0258 (19960229) 15:4 <361::AID-SIM168>3.0.CO;2-4
18. Hastie, T.J., and Tibshirani, R.J. (1990). Generalized Additive Models, Chapman & Hall/CRC, New York.
19. Huete, A., Didan, K., Miura, T., Rodriguez, E.P., Gao, X., and Ferreira, L.G. (2002). Overview of the radiometric and biophysical performance of the MODIS vegetation indices, Remote Sensing of the Environment, 83,195-213. doi:10.1016/S0034-4257(02)000 96-2
20. Ihaka, R., and Gentleman, R. (1996). R: a language for data analysis and graphics, J. Comput. Graph. Statistics, 5, 299-314. doi:10.230 7/1390807
21. Jetz, W., Rahbek, C., and Lichstein, J.W. (2005). Local and global approaches to spatial data analysis in ecology, Global Ecol. Biogeogr., 14, 97-98. doi:10.1111/j.1466-822X.2004.00129.x
22. Justice, A.C., Covinsky, K.E., and Berlin, J.A. (1999) Assessing the generalizability of prognostic information, Annals of Internal Medicine, 130, 515-524.
23. Kissling, W.D., and Carl, G. (2008). Spatial autocorrelation and the selection of simultaneous autoregressive models, Global Ecol. Biogeogr., 17, 59-71.
24. Legendre, P. (1993) Spatial autocorrelation: trouble or new paradigm? Ecology, 74, 1659-1673. doi:10.2307/1939924
25. Lieske, D.J., and Bender, D.J. (2009). Accounting for the influence of geographic location and spatial autocorrelation in environmental models: a comparative analysis using North American songbirds, J. Env. Inform., 13, 12-32. doi:10.3808/jei.200900137
26. McCullagh, P., and Nelder, J.A. (1999). Generalized linear models, CRC Press, New York.
27. Menke, S.B., Holway, D.A., Fisher, R.N., and Jetz, W. (2009). Characterizing and predicting species distributions across environments and scales: Argentine ant occurrences in the eye of the beholder, Global Ecol. Biogeogr., 18, 50-63. doi:10.1111/j.1466-8238.2008.00420.x
28. Mitchell, T.D., and Jones, P.D. (2005). An improved method of constructing a database of monthly climate observations and associated high-resolution grids, Int. J. Climatol., 25, 693-712. doi: 10.1002/joc.1181
29. Ontario Partners in Flight. (2006) Ontario Landbird Conservation Plan: Boreal Hardwood Transition (North American Bird Conservation Region 12): priorities, objectives and recommended actions. Version 1.0. EC/MNR.
30. Oreskes, N., Shrader-Frechette, K., and Belitz, K. (1994). Verification, validation, and confirmation of numerical models in the earth sciences, Science, 263, 641-646. doi:10.1126/science.263.5147.641
31. Pearce, J., and Ferrier, S. (2000). Evaluating the predictive performance of habitat models developed using logistic regression, Ecol. Model., 133, 225-245. doi:10.1016/S0304-3800(00)00322-7
32. Pearce, J., Ferrier, S., and Scotts, D. (2001). An evaluation of the predictive performance of distributional models for flora and fauna in north-east New South Wales, J. Environ. Manage., 62, 171-184. doi:10.1006/jema.2001.0425
33. Randin, C.F., Dirnbock, C., Dullinger, S., Zimmermann, N.E., Zappa, M., and Guisan, A. (2006). Are niche-based species distribution models transferable in space? J. Biogeogr., 33, 1689-1703. doi:10. 1111/j.1365-2699.2006.01466.x
34. Rich, T.D., Beardmore, C.J., Berlanga, H., Blancher, P.J., Bradstreet, M.S.W., Butcher, S., Demarest, D.W., Dunn, E.H., Hunter, W.C., Inigo-Elias, E.E., Kennedy, J.A., Martell, M.A., Panjabi, A.O., Pashley, D.N., Rosenberg, K.V., Rustay, C.M., Wendt, J.S., and Will, C.T. (2004). Partners in Flight North American Landbird Conservation Plan. Cornell Lab of Ornithology. Ithaca, NY.
35. Robbins, C.S., Bystrak, D., and Geissler, P.H. (1986). The breeding bird survey: its first fifteen years, 1965-1979. U.S. Fish & Wildlife Service Publication, pp.157.
36. Segurado, P., and Araujo, M.B. (2004). An evaluation of methods for modelling species distributions. J. Biogeogr., 31, 1555-1568. doi: 10.1111/j.1365-2699.2004.01076.x
37. U.S. Geological Survey Survey. (1996). GTopo30. http://edcdaac.usgs. gov/ gtopo30 /w10090.asp, Sioux Falls, South Dakota.
38. Vaughan, I.P., and Ormerod, S.J. (2003). Improving the quality of distribution models for conservation by addressing shortcomings in the field collection of training data. Conserv. Biol., 17, 1601-1611. doi:10.1111/j.1523-1739.2003.00359.x
39. Vaughan, I.P., and Ormerod, S.J. (2005). The continuing challenges of testing species distribution models, J. Appl. Ecol., 42, 720-730. doi:10.1111/j.1365-2664.2005.01052.x
40. Verbyla D.L. and Litvaitis J.A. (1989). Resampling methods for evaluating classification accuracy of wildlife habitat Models. Environ. Manage., 13, 783-787. doi: 10.1007/BF01868317
41. Zweig, M.H., and Campbell, G. (1993). Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine, Clinical Chemistry, 39, 561-571.