Design and analysis for thematic map accuracy assessment: Fundamental principles

Remote Sensing of Environment

Volumn 64, Issue 3, 1998, Pages 331-344

  Stehman, Stephen V ^a   Czaplewski, Raymond L ^b  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b ROCKY MOUNTAIN RESEARCH STATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MAPPING; PARAMETER ESTIMATION; PROBABILITY; REMOTE SENSING; SAMPLING; STATISTICAL METHODS;

LAND COVER CLASSIFICATION; RESPONSE DESIGN; SAMPLING DESIGN; THEMATIC MAP ACCURACY ASSESSMENT;

MAPS;

ACCURACY ASSESSMENT; DESIGN; THEMATIC MAPPING;

EID: 0032084126     PISSN: 00344257     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0034-4257(98)00010-8     Document Type: Article

References (65)

1. Aronoff S. The map accuracy report. a user's view Photogramm. Eng. Remote Sens. 48:1982;1309-1312.
2. Atkinson P.M., Curran P.J. Defining an optimal size of support for remote sensing investigations. IEEE Trans. Geosci. Remote Sens. 33:1995;768-776.
3. Bauer M.E., Burk T.E., Ek A.R.et al. Satellite inventory of Minnesota forest resources. Photogramm. Eng. Remote Sens. 60:1994;287-298.
4. Card D.H. Using known map category marginal frequencies to improve estimates of thematic map accuracy. Photogramm. Eng. Remote Sens. 48:1982;431-439.
5. Chrisman N.R. The error component in spatial data. Maguire D.J., Goodchild M.F., Rhind D.W. Geographical Information Systems - Volume 1. Principles:1991;165-174 Longman, New York.
6. Cibula W.G., Nyquist M.O. Use of topographic and climatological models in a geographical data base to improve Landsat MSS classification for Olympic National Park. Photogramm. Eng. Remote Sens. 53:1987;67-75.
7. Clerke, W., Czaplewski, R. L., Campbell, J., and Fahringer, J. (1994), Assessing the accuracy of a regional land cover classification. In Spatial Accuracy Assessment in Natural Resources and Environmental Sciences (H. T. Mowrer, R. L. Czaplewski, and R. H. Hamre, Eds.), General Technical Report RM-GTR-277, USDA Forest Service, Fort Collins, CO, p. 508.
8. Cochran W.G. Sampling Techniques. 3:1977;Wiley, New York.
9. Conese C., Maselli F. Use of error matrices to improve area estimates with maximum likelihood classification procedures. Remote Sens. Environ. 40:1992;113-124.
10. Congalton R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 37:1991;35-46.
11. Congalton R.G., Green K. A practical look at the sources of confusion in error matrix generation. Photogramm. Eng. Remote Sens. 59:1993;641-644.
12. Congalton R.G., Green K., Teply J. Mapping old growth forests on national forest and park lands in the Pacific Northwest from remotely sensed data. Photogramm. Eng. Remote Sens. 59:1993;529-535.
13. Curran P.J., Williamson H.D. Sample size for ground and remotely sensed data. Remote Sens. Environ. 20:1986;31-41.
14. Czaplewski, R. L. (1992), Accuracy assessment of remotely sensed classifications with multi-phase sampling and the multivariate composite estimator. In Proceedings of the 16th International Biometrics Conference, Hamilton, New Zealand, Volume 2, p. 22.
15. Czaplewski, R. L. (1994), Variance approximations for assessments of classification accuracy, Research Paper RM-316, USDA, Forest Service, Rocky Mountain Forest and Range Experiment Station, Fort Collins, CO, 29 pp.
16. Czaplewski, R. L. (1998), Accuracy assessments using two-phase stratified random sampling, cluster plots and the multivariate composite estimator. In Spatial Accuracy in Natural Resource Analysis, (H. T. Mowrer and R. G. Congalton, Eds.), Ann Arbor Press, Chelsea, MI, in press.
17. Dicks S.E., Lo T.H.C. Evaluation of thematic map accuracy in a land-use and land-cover mapping program. Photogramm. Eng. Remote Sens. 56:1990;1247-1252.
18. Edwards T.C. Jr., Moisen G.G., Cutler D.R. Assessing map accuracy in a remotely-sensed ecoregion-scale cover-map. Remote Sens. Environ. 63:1998;73-83.
19. Felix N.A., Binney D.L. Accuracy assessment of a Landsat-assisted vegetation map of the coastal plain of the Arctic National Wildlife Refuge. Photogramm. Eng. Remote Sens. 55:1989;475-478.
20. Fenstermaker L.K. A proposed approach for national to global scale error assessments. Proc. GIS/LIS '91. 1:1991;293-300.
21. Fiorella M., Ripple W.J. Determining successional stage of temperate coniferous forests with Landsat satellite data. Photogramm. Eng. Remote Sens. 59:1993;239-246.
22. Fisher P. The pixel. a snare and a delusion Int. J. Remote Sens. 18:1997;679-685.
23. Fitzpatrick-Lins K. Comparison of sampling procedures and data analysis for a land-use and land-cover map. Photogramm. Eng. Remote Sens. 47:1981;343-351.
24. Franklin S.E., Peddle D.R., Wilson B.A., Blodgett C.F. Pixel sampling of remotely sensed digital imagery. Comput. Geosci. 17:1991;759-775.
25. Fung T., LeDrew E. The determination of optimal threshold levels for change detection using various accuracy indices. Photogramm. Eng. Remote Sens. 54:1988;1449-1454.
26. George T.H. Aerial verification of polygonal resource maps. A low-cost approach to accuracy assessment Photogramm. Eng. Remote Sens. 52:1986;839-846.
27. Gopal S., Woodcock C. Theory and methods for accuracy assessment of thematic maps using fuzzy sets. Photogramm. Eng. Remote Sens. 60:1994;181-188.
28. Hammond T.O., Verbyla D.L. Optimistic bias in classification accuracy assessment. Int. J. Remote Sens. 17(6):1996;1261-1266.
29. Hord R.M., Brooner W. Land-use map accuracy criteria. Photogramm. Eng. Remote Sens. 42:1976;671-677.
30. Janssen L.L.F., van der Wel F.J.M. Accuracy assessment of satellite derived land-cover data. A review Photogramm. Eng. Remote Sens. 60:1994;419-426.
31. Knick S.T., Rotenberry J.T., Zarriello T.J. Supervised classification of Landsat Thematic Mapper imagery in a semi-arid rangeland by nonparametric discriminant analysis. Photogramm. Eng. Remote Sens. 63:1997;79-86.
32. Lauver C.L., Whistler J.L. A hierarchical classification of Landsat TM imagery to identify natural grassland areas and rare species habitat. Photogramm. Eng. Remote Sens. 59:1993;627-634.
33. Lepkowski, J., and Bowles, J. (1996), Sampling error software for personal computers. The Survey Statistician 35:10-17. (Also available through the American Statistical Association Survey Research Methods Section homepage, http://www.stat.ncsu.edu/info/srms/srms.html ).
34. Martin L.R.G. Accuracy assessment of Landsat-based visual change detection methods applied to the rural-urban fringe. Photogramm. Eng. Remote Sens. 55:1989;209-215.
35. Martin L.R.G., Howarth P.J. Change-detection accuracy assessment using SPOT multispectral imagery of the rural-urban fringe. Remote Sens. Environ. 30:1989;55-66.
36. McGwire K.C., Friedl M., Estes J.E. Spatial structure, sampling design and scale in remotely-sensed imagery of a California savanna woodland. Int. J. Remote Sens. 14:1993;2137-2164.
37. McGwire K.C., Estes J.E., Star J.L. A comparison of maximum likelihood-based supervised classification strategies. Geocarto Int. 11(2):1996;3-13.
38. Merchant, J. W., Yang, L., and Yang, W. (1993), Validation of continental-scale land cover data bases developed from AVHRR data. In Proceedings of the PECORA Conference, 24-26 August, pp. 63-72.
39. Moisen G.G., Edwards T.C. Jr., Cutler D.R. Spatial sampling to assess classification accuracy of remotely sensed data. Michener W.K., Brunt J.W., Stafford S.G. Environmental Information Management and Analysis. Ecosystem to Global Scales:1994;159-176 Taylor and Francis, New York.
40. Riley R.H., Phillips D.L., Schuft M.J., Garcia M.C. Resolution and error in measuring land-cover change. effects on estimating net carbon release from Mexican terrestrial ecosystems Int. J. Remote Sens. 18:1997;121-137.
41. San Miguel-Ayanz J., Biging G.S. An iterative classification approach for mapping natural resources from satellite imagery. Int. J. Remote Sens. 17:1996;957-981.
42. San Miguel-Ayanz J., Biging G.S. Comparison of single-stage and multi-stage classification approaches for cover type mapping with TM and SPOT data. Remote Sens. Environ. 59:1997;92-104.
43. Särndal C.E., Swensson B., Wretman J. Model-Assisted Survey Sampling. 1992;Springer-Verlag, New York.
44. Senseman, G. M., Bagley, C. F., and Tweddale, S. A. (1995), Accuracy assessment of the discrete classification of remotely-sensed digital data for land-cover mapping, USACERL Technical Report EN-95/04, U.S. Army Corps of Engineers, Champaign, IL.
45. Smith T.M.F. Comment on History and development of the theoretical foundations of survey based estimation and analysis. Survey Methodol. 16:1990;26-29.
46. Stehman S.V. Comparison of systematic and random sampling for estimating the accuracy of maps generated from remotely sensed data. Photogramm. Eng. Remote Sens. 58:1992;1343-1350.
47. Stehman S.V. Thematic map accuracy assessment from the perspective of finite population sampling. Int. J. Remote Sens. 16:1995;589-593.
48. Stehman S.V. Use of auxiliary data to improve the precision of estimators of thematic map accuracy. Remote Sens. Environ. 58:1996;169-176. a.
49. Stehman, S. V. (1996b), Sampling design and analysis issues for thematic map accuracy assessment. In Proceedings of the 1996 ACSM/ASPRS Annual Convention, ASPRS Technical Papers, Vol. 1, pp. 372-380.
50. Stehman S.V. Estimating standard errors of accuracy assessment statistics under cluster sampling. Remote Sens. Environ. 60:1997;258-269. a.
51. Stehman S.V. Selecting and interpreting measures of thematic classification accuracy. Remote Sens. Environ. 62:1997;77-89. b.
52. Stehman, S. V., and Czaplewski, R. L. (1997), Basic structures of a statistically rigorous thematic accuracy assessment. In Proceedings of the 1997 ACSM/ASPRS Annual Convention, ASPRS Technical Papers, Vol. 3, pp. 543-553.
53. Stehman S.V., Overton W.S. Spatial sampling. Arlinghaus S.L., Griffith D.A. Practical Handbook of Spatial Statistics. 1996;31-63 CRC Press, Boca Raton, FL.
54. Stenback J.M., Congalton R.G. Using thematic mapper imagery to examine forest understory. Photogramm. Eng. Remote Sens. 56:1990;1285-1290.
55. Steven M.D. Ground truth. an underview Int. J. Remote Sens. 8:1987;1033-1038.
56. Stoms D.M. Validating large-area land cover databases with maplets. Geocarto Int. 11(2):1996;87-95.
57. Todd W.J., Gehring D.G., Harmon J.F. Landsat wild land mapping accuracy. Photogrammetric Engineering and Remote Sensing. 46:1980;509-520.
58. Verbyla D.L., Hammond T.O. Conservative bias in classification accuracy assessment due to pixel-by-pixel comparison of classified images with reference grids. Int. J. Remote Sens. 16:1995;581-587.
59. Vujakovic P. Monitoring extensive 'buffer zones' in Africa. an application of satellite imagery Biol. Conservation. 39:1987;195-208.
60. Walsh S.J., Lightfoot D.R., Butler D.R. Recognition and assessment of error in geographic information systems. Photogramm. Eng. Remote Sens. 53:1987;1423-1430.
61. Warren S.D., Johnson M.O., Goran W.D., Diersing V.E. An automated, objective procedure for selecting representative field sample sites. Photogramm. Eng. Remote Sens. 56:1990;333-335.
62. Wickware G.M., Howarth P.J. Change detection in the Peace-Athabasca Delta using digital Landsat data. Remote Sens. Environ. 11:1981;9-25.
63. Williams, M. T., and Beach, D. J. C. (1995), ACAS 0.4: accuracy assessment system program manual, U.S. Department of Agriculture, Forest Service, Rocky Mountain Forest and Range Experiment Station, Fort Collins, CO, 33 pp. + source code.
64. Zhu Z., Ohlen D.O., Czaplewski R.L., Burgan R.E. Alternative method to validate the seasonal land cover regions of the conterminous United States. Mowrer H.T., Czaplewski R.L., Hamre R.H. Spatial Accuracy Assessment in Natural Resources and Environmental Sciences. 1996;409-418 USDA Forest Service, Fort Collins, CO. General Technical Report RM-GTR-277.
65. Zhuang X., Engel B.A., Xiong X., Johannsen C.J. Analysis of classification results of remotely sensed data and evaluation of classification algorithms. Photogramm. Eng. Remote Sens. 61:1995;427-433.