A review of methods for the assessment of prediction errors in conservation presence/absence models

Environmental Conservation

Volumn 24, Issue 1, 1997, Pages 38-49

  Fielding, Alan H ^a   Bell, John F ^b  

^a MANCHESTER METROPOLITAN UNIVERSITY   (United Kingdom)

^b University of Cambridge Local Examinations Syndicate   (United Kingdom)

Author keywords

Classifier; Data partitioning; Habitat relationships; Habitat association model; Threshold; Validation

Indexed keywords

DISTRIBUTION PREDICATION; ENDANGERED SPECIES; HABITAT DATA; METHODOLOGY; PREDICTION ERROR;

ARTICLE; ECOLOGY; ENVIRONMENTAL HEALTH; ENVIRONMENTAL PROTECTION; PREDICTION; SPECIES;

EID: 0030953391     PISSN: 03768929     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0376892997000088     Document Type: Article

References (58)

1. Aebischer, N.J., Robertson, P.A. & Kenward, R.E (1993) Compositional analysis of habitat use from animal radio-tracking data. Ecology 74: 1313-25.
2. Altman, D.G., Lausen, B., Sauerbrei, W. & Schumacher, M. (1994) Dangers of using 'optimal' cutpoints in the evaluation of prognostic factors. Journal of the National Cancer Institute 86: 829-35.
3. Anon. (1995) Bird conservation: the science and the action preface. Conclusions and recommendations. Ibis 137: S3-S7.
4. Augustin, N.H., Mugglestone, M.A. & Buckland, S.T. (1996) An autologistic model for the spatial distribution of wildlife. Journal of Applied Ecology 33: 339-47.
5. Austin, M.P. & Gaywood, M.J. (1994) Current problems of environmental gradients and species response curves in relation to continuum theory. Journal of Vegetation Science 5: 473-82.
6. Austin, M.P., Nicholls, A.O., Doherty, M.D. & Meyers, J.A. (1994) Determining species response functions to an environmental gradient by means of a beta function. Journal of Vegetation Science 5: 215-28.
7. Baldessarini, R.J., Finklestein, S. & Arana, G.W. (1983) The predictive power of diagnostic tests and the effect of prevalence of illness. Archives of General Psychiatry 40: 569-73.
8. Blayo, F., Chevenal, Y., Guérin-Dugué, A., Chentouf, R., Aviles-Cruz, C., Madrenas, J., Moreno, M. & Voz, J.L. (1995) Enhanced learning for evolutive neural architecture. Deliverable R3-B4-P Task B4: Benchmarks. ESPIRIT Basic Research Project Number 6891. Available from ftp.dice.ucl.ac.be/pub/neural-nets/ELANA/databases.
9. Bocard, D., Legendre, P. & Drapeau, P. (1992) Partialling out the spatial component of ecological variation. Ecology 73: 1045-55.
10. Bocard, D. & Legendre, P. (1994) Environmental control and spatial structure in ecological communities: an example using oribatid mites (Acari, Oribata). Environmental and Ecological Statistics 1: 37-62.
11. Brennan, L.A., Block, W.M. & Gutiérrez, R.J. (1986) The use of multivariate statistics for developing habitat suitability index models. In: Wildlife 2000: Modelling Habitat Relationships of Terrestrial Vertebrates, ed. J.A. Verner, M.L. Morrison & C.J. Ralph, pp. 177-82. Madison, WI, USA: University of Wisconsin Press.
12. Buckland, S.T. & Elston, D.A. (1993) Empirical models for the spatial distribution of wildlife. Journal of Applied Ecology 30: 478-95.
13. Capen, D.E., Fenwick, J.W., Inkley, D.B. & Boynton, A.C. (1986) Multivariate models of songbird habitat in New England forests. In: Wildlife 2000: Modelling Habitat Relationships of Terrestrial Vertebrates, ed. J.A. Verner, M.L. Morrison and C.J. Ralph, pp. 171-75. Madison, WI, USA: University of Wisconsin Press.
14. Cederlund, G. & Sand, H. (1994) Home-range size in relation to age and sex in moose. Journal of Mammology 75: 1005-12.
15. Chatfield, C. (1995) Model uncertainty, data mining and statistical inference. Journal of the Royal Statistical Society, Series A. 158: 419-66.
16. Deleo, J.M. (1993) Receiver operating characteristic laboratory (ROCLAB): software for developing decision strategies that account for uncertainty. In: Proceedings of the Second International Symposium on Uncertainty Modelling and Analysis, pp. 318-25. College Park, MD: IEEE Computer Society Press.
17. Deleo, J.M. & Campbell, G. (1990) The fuzzy receiver operating characteristic function and medical decisions with uncertainty. In: Proceedings of the First International Symposium on Uncertainty Modelling and Analysis, pp. 694-9. College Park, MD: IEEE Computer Society Press.
18. Donázar, J.A., Hiraldo, F. & Bustamante, J. (1993) Factors influencing nest site selection, breeding density and breeding success in bearded vulture (Gypaetus barbatus). Journal of Applied Ecology 30: 504-14.
19. Fielding, A.H. & Haworth, P.F.(1995) Testing the generality of bird-habitat models. Conservation Biology 9: 1466-81.
20. Forbes, A.D. (1995) Classification algorithm evaluation: five performance measures based on confusion matrices. Journal of Clinical Monitoring 11: 189-206.
21. Harper, J.L. (1977) Population Biology of Plants. London, UK: Academic Press: 892 pp.
22. Harvey, H.J. (1995) The National Trust and nature conservation: Prospects for the future. Biological Journal of the Linnean Society 56, Suppl. A: 231-48.
23. Hengveld, R. (1994) Biogeographical ecology. Journal of Biogeography 21: 341-51.
24. Hohmann, U. (1994) Status specific habitat use in the common buzzard Buteo buteo. In: Raptor Conservation Today, ed. B.U. Meyburg & R.D. Chancellor, pp. 359-66. Berlin, Germany: WWGBP/Pica Press.
25. Hosmer, D.W. & Lemeshow, S. (1989) Applied Logistic Regression. New York, USA: Wiley: 307 pp.
26. Huberty, C.J. (1994) Applied Discriminant Analysis. New York, USA: Wiley Interscience: 466 pp.
27. Kettlewell, H.B.D. (1955) Recognition of appropriate backgrounds by pale and dark phases of Lepidoptera. Nature 175: 943-44.
28. Kraemer, H.C. (1988) Assessment of 2 X 2 associations: Generalisation of signal detection methodology. The American Statistician 42: 37-49.
29. Landis, J.R. & Koch, G.G. (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159-74.
30. Legendre, P. (1993) Spatial autocorrelation: trouble or new paradigm. Ecology 74: 1659-73.
31. Lynn, H., Mohler, C.L., DeGloria, S.D. & McCulloch, C.E. (1995) Error assessment in decision-tree models applied to vegetation analysis. Landscape Ecology 10: 323-35.
32. Ma, Z. & Redmond, R.L.(1995) Tau coefficients for accuracy assessment of classifications of remote sensing data. Photogrammetric Engineering & Remote Sensing 61: 435-39.
33. Manly, B.F.J., McDonald, L.L. & Thomas, D.L. (1992) Resource Selection by Animals: Statistical Design and Analysis for Field Studies. London, UK: Chapman & Hall: 177 pp.
34. Morrison, M.L., Marcot, B.G. & Mannan, R.W. (1992) Wildlife Habitat Relationships. Concepts and Applications. Madison, WI, USA: University Wisconsin Press: 341 pp.
35. Morrison, M.L., Timoss, I.C. & With, K.A. (1987) Development and testing linear regression models predicting bird-habitat relationships. Journal of Wildlife Management 51: 247-53.
36. Newton, I. (1979) Population Ecology of Raptors. Berkhamstead, UK: Poyser: 399 pp.
37. Okland, R.H. & Eilertsen, O. (1994) Canonical correspondence analysis with variation partitioning: some comments and an application. Journal of Vegetation Science 5: 117-26.
38. Osborne, P.E. & Tigar, B.J. (1992) Interpreting bird atlas data using logistic models: an example from Lesotho, Southern Africa. Journal of Applied Ecology 29: 55-62.
39. Pereira, J.M.C. & Itami, R.C. (1991) GIS-based habitat modelling using logistic multiple regression: a study of the Mt. Graham red squirrel. Photogrammetric Engineering & Remote Sensing 57: 1475-86.
40. Ratcliffe, D. (1993) The Peregrine Falcon. Second Edition. London, UK: T. & A.D. Poyser: 454 pp.
41. Reed, J.M. & Dobson, A.P. (1993) Behavioural constraints and conservation biology. Trends in Ecology and Evolution 8: 253-5.
42. Rencher, A.C. (1995) Methods of Multivariate Analysis. New York, USA: Wiley: 627 pp.
43. Rotenberry, J.T. (1986) Habitat relationships of shrubsteppe birds: even 'good' models cannot predict the future. In: Wildlife 2000: Modelling Habitat Relationships of Terrestrial Vertebrates, ed. J.A. Verner, M.L. Morrison & C.J. Ralph, pp. 217-21. Madison, WI, USA: University of Wisconsin Press.
44. Ruttimann, U.E. (1994) Statistical approaches to development and validation of predictive instruments. Critical Care Clinics 10: 19-35.
45. Schaafsma, W. & van Vark, G.N. (1979) Classification and discrimination problems with applications. Part IIa. Statistica Neerlandica 33:91-126.
46. Schooley, R.L. (1994) Annual variation in habitat selection: patterns concealed by pooled data. Journal of Wildlife Management 58: 367-74.
47. Schamberger, M.L. & O'Neil, L.J. ( 1986) Concepts and constraints of habitat-model testing. In: Wildlife 2000: Modelling Habitat Relationships of Terrestrial Vertebrates, ed. J.A. Verner, M.L. Morrison & C.J. Ralph, pp 5-10. Madison, WI, USA: University of Wisconsin Press.
48. Schwede, G., Hubert, H. & McShea, W. (1993) Social and spatial organization of female white-tailed deer, Odocoileus virginianus, during the fawning season. Animal Behaviour 45: 1007-17.
49. Smith, P.A. (1994) Autocorrelation in logistic regression modelling of species' distributions. Global Ecology and Biogeography Letters 4: 47-61.
50. Solonen, T. (1993) Spacing of birds of prey in Southern Finland. Ornis Fennica 70: 129-43.
51. Stauffer, D.F. & Best, L.B. (1986) Effects of habitat type and sample size on habitat suitability index models. In: Wildlife 2000: Modelling Habitat Relationships of Terrestrial Vertebrates, ed. J. A. Verner, M. L. Morrison & C. J. Ralph, pp. 71-77. Madison, WI, USA: University of Wisconsin Press.
52. Stillman, R.A. & Brown, A.F. (1994) Population sizes and habitat sizes of upland breeding birds in the South Pennines, England. Biological Conservation 69: 307-14.
53. Stockwell, D.R.B. (1992) Machine learning and the problem of prediction and explanation in ecological modelling. Ph.D. Thesis, Australian National University.
54. Turney, P. (1995) Cost-sensitive classification:empirical evaluation of a hybrid genetic decision tree induction algorithm. Journal of Artificial Intelligence Research 2: 369-409.
55. Verbyla, D.L. & Litaitis, J.A. (1989) Resampling methods for evaluating classification accuracy of wildlife habitat models. Environmental Management 13: 783-7.
56. Weir, D. & Picozzi, N. (1983) Dispersion of buzzards in Speyside. British Birds 76: 66-78.
57. Wiens, J.A., Rotenberry, J.T. & Van Home, B. (1987) Habitat occupancy patterns of North American shrubsteppe birds: the effects of spatial scale. OIKOS 48: 132-47.
58. Zweig, M.H. & Campbell, G. (1993) Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clinical Chemistry 39: 561-77