Improving classification accuracy assessments with statistical bootstrap resampling techniques

GIScience and Remote Sensing

Volumn 44, Issue 3, 2007, Pages 237-250

  Weber, Keith T ^a   Langille, Jackie ^b  

^a IDAHO STATE UNIVERSITY   (United States)

^b CENTRAL WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BOOTSTRAPPING; CONFIDENCE INTERVAL; IMAGE CLASSIFICATION; IMAGERY; MAXIMUM LIKELIHOOD ANALYSIS; REMOTE SENSING;

EID: 34447272659     PISSN: 15481603     EISSN: None     Source Type: Journal    
DOI: 10.2747/1548-1603.44.3.237     Document Type: Article

References (51)

1. Binaghi E., Brivio, P. A., Ghezzi, P., and A. Rampini, 1999, "A Fuzzy Set-Based Accuracy Assessment of Soft Classification," Pattern Recognition Letters, 20:935-948.
2. Boardman, J. W., 1993, "Automating Spectral Unmixing of AVIRIS Data Using Convex Geometry Concepts," in Summaries of the Fourth Annual JPL Airborne Geoscience Workshop, Arlington, VA: JPL Publication 93-26, 11-14.
3. Cohen, J., 1992, Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Earlbaum Associates, 567 p.
4. Collins, J. B. and C. E. Woodcock, 1996, "An Assessment of Several Linear Change Detection Techniques for Mapping Forest Mortality Using Multitemporal Landsat TM Data," Remote Sensing of Environment, 56:66-77.
5. Congalton, R. G., 1991, "A Review of Assessing the Accuracy of Classifications of Remotely Sensed Data," Remote Sensing of Environment, 37:35-46.
6. Congalton, R. G. and K. Green, 1999, Assessing the Accuracy of Remotely Sensed Data: Principles and Practices. Boca Raton, FL: Lewis Publishers. 160 p.
7. Eastman, R. J. 2003, Idrisi Kilimanjaro Guide to GIS and Image Processing, Worcester, MA: Clark University Laboratory.
8. Efron, B., 1979, "Bootstrap Methods: Another Look at the Jackknife," Annals of Statistics, 7(1):1-26.
9. Ercanoglu, M., Weber, K. T., Langille, J. M., and R. Neves, 2006, "Modeling Wildland Fire Susceptibility Using Fuzzy Systems," GIScience and Remote Sensing, 43(3):268-282.
10. Foody, G. M., 2002, "Status of Land Cover Classification Accuracy Assessment," Remote Sensing of Environment, 80:185-201.
11. Foody, G. M., 2004, "Thematic Map Comparison: Evaluating the Statistical Significance of Differences in Classification Accuracy," Photogrammetric Engineering and Remote Sensing, 70:627-633.
12. Foody, G. M. and A. Mathur, 2006, "The Use of Small Training Sets Containing Mixed Pixels for Accurate Hard Image Classification: Training on Mixed Spectral Responses for Classification by a SVM," Remote Sensing of Environment, 103:179-189.
13. Foody, G. M., Mathur, A., Sanchez-Hernandez, C., and D. S. Boyd, 2006, Training set size requirements for the classification of a specific class: Remote Sensing of Environment, 104:1-14.
14. Glenn, N. F., Mundt, J. T., Weber, K. T., Prather, T. S., Lass, L. W., and J. Pettingill, 2005, "Hyperspectral Data Processing for Repeat Detection of Small Infestations of Leafy Spurge," Remote Sensing of Environment, 95:399-412.
15. Gokhale, B. and K. T. Weber, 2006, "Modeling Cheatgrass Using Quickbird Imagery," in Weber, K. T. (Ed.), Final Report: Detection, Prediction, Impact, and Management of Invasive Plants using GIS, Pocatello, ID: Idaho State University, 77-84.
16. Good, P. I., 2005, Resampling Methods: A Practical Guide to Data Analysis, 3rd ed., Boston, MA: Birkhauser, 218 p.
17. Hall, P., 2003, "A Short Prehistory of the Boostrap," Statistical Science, 18(2):158-167.
18. Ingebritsen, S. E., and R. J. P. Lyon, 1985, "Principal Components Analysis of Multi-temporal Image Pairs," International Journal of Remote Sensing, 6(5):687-696.
19. Isaaks, E. H., and Srivastava, R. M., 1990, Introduction to Applied Geostatistics, New York, NY: Oxford University Press, 592 p.
20. Janssen, L. L. F. and F. J. M. van der Wel, 1994, "Accuracy Assessment of Satellite Derived Land-Cover Data: A Review," Photogrammetric Engineering and Remote Sensing, 60(4):419-426.
21. Jones, H. L., 1956, "Investigating the Properties of a Sample Mean by Employing Random Subsample Means," Journal of the American Statistical Association, 51:54-83.
22. Kriegler, F. J. W., Malila, A., Nalepka, R. F., and W. Richardson, 1969, "Preprocessing Transformations and Their Effects on Multi-spectral Recognition," in Proceedings of the Sixth International Symposium on Remote Sensing of Environment, Ann Arbor, MI: University of Michigan, 97-131.
23. Lass, L. W., Prather, T. S., Glenn, N. F., Weber, K. T., Mundt, J. T., and J. Pettingill, 2005, "A Review of Remote Sensing of Invasive Weeds and Example of the Early Detection of Spotted Knapweed (Centaurea maculosa) and babysbreath (Gypsophila paniculata) with a hyperspectral sensor," Weed Science, 53:242-251.
24. Lillesand, T. M. and R. W. Kiefer, 2000, Remote Sensing and Image Interpretation, 4th ed., New York, NY: John Wiley and Sons, 724 p.
25. Longley, P. A., Goodchild, M. F., Maguire, D. J., and D. W. Rhind, 2005, Geographic Information Systems and Science, 2nd ed., New York, NY. John Wiley and Sons, 515 p.
26. Ma, Z. and R. L. Redmond, 1995, "Tau Coefficient for Accuracy Assessment of Classification of Remote Sensing Data," Photogrammetric Engineering and Remote Sensing, 61(4):435-439.
27. Mahalanobis, P. C., 1946, "Sample Surveys of Crop Yields in India," Sankhya, 7:269-280.
28. McKay, R. J. and N. A. Campbell, 1982, "Variable Selection Techniques in Discriminant Analysis II: Allocation," British Journal of Mathematical and Statistical Psychology, 35:30-41.
29. McMahan, J. B. and K. T. Weber, 2003, "Validation Alternatives for Classified Imagery," in Weber, K. T. (Ed.), Final Report: Wildfire Effects on Rangeland Ecosystems and Livestock Grazing in Idaho, Pocatello, ID: Idaho State University, 70-73
30. McMahan, J. B., Weber, K. T., and J. D. Sauder, 2002, "Using Remote Sensing Data in Urban Sprawl and Green Space Analyses," Intermountain Journal of Sciences, 8(1):30-37.
31. Miller, H. J., 2004, "Tobler's First Law and Spatial Analysis," Annals of the Association of American Geographers, 94(2):284-289.
32. Mundt, J. T., Glenn, N. F., Weber, K. T. and J. A. Pettingill, 2006, "Assessing Detection Limits and Confidence from Classification Accuracy," Remote Sensing of the Environment, 105:34-40.
33. Mundt, J. T., Glenn, N. F., Weber, K. T., Prather, T. S., Lass, L. W., and J. A. Pettingill, 2005, "Discrimination of Hoary Cress and Determination of its Detection Limits via Hyperspectral Image Processing and Accuracy Assessment Techniques," Remote Sensing of Environment, 96(1):509-517.
34. NBII (National Biological Information Infrastructure), 2006, "USGS-NPS Vegetation Mapping Program: Accuracy Assessment Procedures: Computational Issues" [http://biology.usgs.gov/npsveg /aa/sect5.html], accessed February 9, 2006.
35. Okeke, F. and A. Karnieli, 2006, "Methods for Fuzzy Classification and Accuracy Assessment of Historical Aerial Photographs for Vegetation Change Analyses. Part I: Algorithm Development," International Journal of Remote Sensing, 24(1-2):153-176.
36. Ray, T. W. and B. C. Murray, 1998, "Non-linear Spectral Mixing in Desert Vegetation," Remote Sensing of Environment, 55:59-64.
37. Richards, J. A., 2005, Remote Sensing Digital Image Analysis, New York, NY: Springer-Verlag, 360 p.
38. Roberts, D. A., Gardner, M., Church, R., Ustin, S. L., Scheer, G. J., and R. O. Green, 1998, "Mapping Chaparral in the Santa Monica Mountains Using Multiple End-member Spectral Mixture Models," Remote Sensing of Environment, 65:267-279.
39. Rouse, J. W., Haas, R. H., Schell, J. A., and D. W. Deering, 1973, "Monitoring Vegetation Systems in the Great Plains with ERTS," in Third ERTS Symposium, Washington, DC: NASA SP-351-1, 309-317.
40. Sauder, J., McMahan, J. B., and K. T. Weber, 2003, "Fuzzy Classification of Heterogeneous Vegetation in a Complex Arid Ecosystem," African Journal of Range and Forage Science, 20(2):126.
41. Savage, S. L., 2005, Vegetation Dynamics in Yellowstone's Northern Range: 1985-1999, unpubl. M.S. thesis, Montana State University, 139 p.
42. Singh, A., 1989, "Review Article: Digital Change Detection Techniques Using Remotely Sensed Data," International Journal of Remote Sensing, 10(6):989-1003.
43. Snedecor, G. W. and W. G. Cochran, 1967, Statistical Methods, Ames, IA: The Iowa State University Press, 524 p.
44. Steele, B. M., Winne, J. C., and R. L. Redmond, 1998, "Estimation and Mapping of Misclassification Probabilities for Thematic Land Cover Maps," Remote Sensing of Environment, 66(2):192-202.
45. Stehman, S. V. and R. L. Czaplewski, 1998, "Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles," Remote Sensing of Environment, 64:331-344.
46. Taylor, B. L. and T. Gerodette, 1993, "The Uses of Statistical Power in Conservation Biology: The Vaquita and Northern Spotted Owl," Conservation Biology, 7(3):489-500.
47. Titus, K., Mosher, J. A., and B. K. Williams, 1984, "Chance-Corrected Classification for Use in Discriminant Analysis: Ecological Applications," American Midlands Naturalist, 111:1-7.
48. Tobler, W. R., 1970, "A Computer Movie Simulating Urban Growth in the Detroit Region," Economic Geography, 46:234-240.
49. Van Niel, T. G., McVicar, T. R., and B. Datt, 2005, "On the Relationship between Training Sample Size and Data Dimensionality: Monte Carlo Analysis of Broadband Multi-temporal Classification," Remote Sensing of Environment, 98(4):468-480.
50. Verbyla, D. L. and S. H. Boles, 2000, "Bias in Land Cover Change Estimates Due to Misregistration," International Journal of Remote Sensing, 21(18):3553-3560.
51. Weber, K. T., 2006, "Challenges of Integrating Geospatial Technologies into Rangeland Research and Management," Rangeland Ecology and Management, 59:38-43.