Designing a multi-objective, multi-support accuracy assessment of the 2001 National Land Cover Data (NLCD 2001) of the conterminous United States

Photogrammetric Engineering and Remote Sensing

Volumn 74, Issue 12, 2008, Pages 1561-1571

  Stehman, Stephen V ^a   Wickham, James D ^b   Wade, Timothy G ^b   Smith, Jonathan H ^c  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b U S ENVIRONMENTAL PROTECTION AGENCY   (United States)

^c U S GEOLOGICAL SURVEY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PHOTOGRAMMETRY;

ACCURACY ASSESSMENT; CLUSTER SAMPLING; DIFFERENT STAGES; DIVERSE APPLICATIONS; GENERAL STRUCTURES; NATIONAL LAND-COVER DATUM; SAMPLING DESIGN; TWO-STAGE CLUSTER SAMPLING;

TREES (MATHEMATICS);

ACCURACY ASSESSMENT; CLUSTER ANALYSIS; DATA INTERPRETATION; DATABASE; LAND COVER; SAMPLING;

NORTH AMERICA; UNITED STATES;

EID: 57649120959     PISSN: 00991112     EISSN: None     Source Type: Journal    
DOI: 10.14358/PERS.74.12.1561     Document Type: Article

References (79)

1. Alexander, R.B., R.A. Smith, and G.E. Schwarz, 2004. Estimates of diffuse phosphorus sources in surface waters of the United States using a spatially referenced watershed model, Water Science and Technology, 49:1-10.
2. Amundson, R., Y. Guo, and P. Gong, 2003. Soil diversity and land use in the United States, Ecosystems, 6:470-482.
3. Balzter, H., E. Talmon, W. Wagner, D. Gaveau, S. Plummer, J.J. Yu, S. Quegan, M. Davidson, T.L. Toan, M. Gluck, A. Shvidenko, S. Nilsson, K. Tansey, A. Luckman, and C. Schmullius, 2002. Accuracy assessment of a large-scale forest cover map of central Siberia from synthetic aperture radar, Canadian Journal of Remote Sensing, 28:719-737.
4. Baraldi, A., L. Bruzzone, and P. Blonda, 2005. Quality assessment of classification and cluster maps without ground truth knowledge, IEEE Transactions on Geoscience and Remote Sensing, 43:857-873.
5. Beret, F., J.T. Morissette, R.A. Fernandes, J.L. Champeaux, R.B. Myneni, J. Chen, S. Plummer, M. Weiss, C. Bacour, S. Garrigues, and J.E. Nickeson, 2006. Evaluation of the representativeness of networks of sites for the global validation and intercomparison of land biophysical products: Proposition of the CEOS-BELMANIP, IEEE Transactions on Geoscience and Remote Sensing, 44:1794-1803.
6. Biging, G.S., D.R. Colby, and R.G. Congalton, 1998. Sampling systems for change detection accuracy assessment, Remote Sensing Change Detection: Environmental Monitoring Methods and Applications (R.S. Lunetta and C.D. Elvidge, editors), Ann Arbor Press, Chelsea, Michigan, pp. 281-308.
7. Brabec, E., S. Schulte, and P. Richards, 2002. Impervious surfaces and water quality: A review of current literature and its implications for watershed planning, Journal of Planning Literature, 16:499-514.
8. Brewer, K., 2002. Combined Survey Sampling Inference: Weighting Basu's Elephants, Arnold Publishers, London, 316 p.
9. Cihlar, J., R. Latifovic, J. Chen, J. Beaubien, and Z. Li, 2000a. Selecting representative high resolution sample images for land cover studies, Part 1: Methodology, Remote Sensing of Environment, 71:26-42.
10. Cihlar, J., R. Latifovic, J. Chen, J. Beaubien, Z. Li, and S. Magnussen, 2000b. Selecting representative high resolution sample images for land cover studies, Part 2: Application to estimating land cover composition, Remote Sensing of Environment, 72:127-138.
11. Cochran, W.G., 1977. Sampling Techniques, Third edition, John Wiley & Sons, New York.
12. Cohen, W.B., T.K. Maiersperger, D.P. Turner, W.D. Ritts, D. Pflugmacher, R.E. Kennedy, A. Kirschbaum, S.W. Running, M. Costa, and S.T. Gower, 2006. MODIS land cover and LAI Collection 4 product quality across nine sites in the western hemisphere, IEEE Transactions on Geoscience and Remote Sensing, 44:1843-1857.
13. Congalton, R.G., and K. Green, 1993. A practical look at the sources of confusion in error matrix generation, Photogrammetric Engineering & Remote Sensing, 59(6):641-644.
14. DeLiberty, T.L., and D.R. Legates, 2003. Interarinual and seasonal variability of modelled soil moisture in Oklahoma, International Journal of Climatology, 23:1057-1086.
15. Deming, W.E., 1960, Sampling Design in Business Research, John Wiley & Sons, New York.
16. Deville, J.-C., and Y. Tillé, 2004. Efficient balanced sampling: The cube method, Biometrika, 91:893-912.
17. Dungan, J.L., 2006. Focusing on feature-based differences in map comparison, Journal of Geographical Systems, 8:131-143.
18. Durbrow, R.P., N.B. Burns, J.R. Richardson, and C.W. Berish, 2001. Southeastern ecological framework: A planning tool for managing ecosystem integrity, Proceedings of the 2001 Georgia Water Resources Conference, 26-27 March, University of Georgia, Athens, Georgia.
19. Edwards, T.C., Jr., G.G. Moisen, and D.R. Cutler, 1998. Assessing map accuracy in an ecoregion-scale cover-map, Remote Sensing of Environment, 63:73-83.
20. Franklin, J., D. Beardsley, H. Gordon, D.K. Simons, and J.M. Rogan, 2001. Evaluating errors in a digital vegetation map with forest inventory data and accuracy assessment using fuzzy sets, Transactions in GIS, 5:285-304.
21. Fuller, R.M., B.K. Wyatt, and C.J. Barr, 1998. Countryside survey from ground and space: Different perspectives, complementary results, Journal of Environmental Management, 54:101-126.
22. Gill, S.J., J. Milliken, D. Beardsley, and R. Warbington, 2000. Using a mensuration approach with FIA vegetation plot data to assess the accuracy of tree size and crown closure classes in a vegetation map of Northeastern California, Remote Sensing of Environment, 73:298-306.
23. Hagen, A., 2003. Fuzzy set approach to assessing similarity of categorical maps, International Journal of Geographical Information Science, 17:235-249.
24. Hagen-Zanker, A., 2006. Map comparison methods that simultaneously address overlap and structure, Journal of Geographical Systems, 8:165-185.
25. Hargrove, W.W., F.M. Hoffman, and P.F. Hessburg, 2006. Mapcurves: A quantitative method for comparing categorical maps, Journal of Geographical Systems, 8:187-208.
26. Heilman, G.E., Jr., J.R. Strittholt, N.C. Slosser, and D.A. Dellasala, 2002. Forest fragmentation of the conterminous United States: Assessing forest intactness through road density and spatial characteristics, BioScience, 52:411-422.
27. Heinz Center (The H. John Heinz III Center for Science, Economics, and the Environment), 2002. The State of the Nation's Ecosystems: Measuring the Lands, Waters and Living Resources of the United States, Cambridge University Press, Cambridge, UK.
28. Hess, G.R., and J.M. Bay, 1997. Generating confidence intervals for some measures of landscape pattern, Landscape Ecology, 12:309-320.
29. Hess, G.R., 1994. Pattern and error in landscape ecology: A commentary, Landscape Ecology, 9:305.
30. Hollister, J.W., M.L. Gonzalez, J.F. Paul, P.V. August, and J.L. Copeland, 2004. Assessing the accuracy of National Land Cover Dataset area estimates at multiple spatial extents, Photogrammetric Engineering & Remote Sensing, 70(3):405-414.
31. Homer, C., J. Dewitz, J. Fry, M. Coan, N. Hossain, C. Larson, N. Herold, A. McKerrow, J.N. VanDriel, and J.D. Wickham, 2007. Completion of the 2001 National Land Cover Database for the conterminous United States, Photogrammetric Engineering & Remote Sensing, 73(3):337-341.
32. Homer, C., C. Huang, L. Yang, B. Wylie, and M. Coan, 2004. Development of a 2001 National Land Cover Database for the United States, Photogrammetric Engineering & Remote Sensing, 70(7):829-840.
33. Johnson, C.B., G.W. Weaver, and D.P. Larsen, 1999. A comparison of land use and land cover data in watersheds of the Mid-Atlantic region, USA, Environmental Practice, 1:209-226.
34. Latifovic, R., and I. Olthof, 2004. Accuracy assessment using sub-pixel fractional error matrices of global land cover products derived from satellite data, Remote Sensing of Environment, 90:153-165.
35. Latifovic, R., Z. Zhu, J. Cihlar, C. Giri, and I. Olthof, 2004. Land cover mapping of North and Central America - Global Land Cover 2000, Remote Sensing of Environment, 89:116-127.
36. Lawler, J.J., D. White, and L.L. Master, 2003. Integrating representation and vulnerability: two approaches for prioritizing areas for conservation, Ecological Applications, 13:1762-1772.
37. Marshall, C.H., R.A. Pielke, Sr., L.T. Steyaert, and D.A. Willard, 2004. The impact of antbropogenic land-cover change on the Florida peninsula sea breezes and warm season sensible weather, Monthly Weather Review, 132:28-52.
38. Mayaux, P., H. Eva, J. Gallego, A.H. Strahler, M. Herold, S. Agrawal, S. Naumov, E.E. De Miranda, C.M. Di Bella, C. Ordoyne, Y. Kopin, and P.S. Roy, 2006. Validation of the Global Land Cover 2000 map, IEEE Transactions on Geoscience and Remote Sensing, 44:1728-1739.
39. Mayer, A.L., and G.N. Cameron, 2003. Landscape characteristics, spatial extent, and breeding bird diversity in Ohio, USA, Diversity and Distributions 9:297-312.
40. McGarigal, K., and B.J. Marks, 1995. FRAGSTATS: Spatial Pattern Analysis Program for Quantifying Landscape Structure, USDA Forest Service General Technical Report PNW-351.
41. Moisen, G.G., T.C. Edwards, Jr., and D.R. Cutler, 1994. Spatial sampling to assess classification accuracy of remotely sensed data, Environmental Information Management and Analysis: Ecosystem to Global Scales (W.K. Michener, J.W. Brunt, and S.G. Stafford, editors), Taylor and Francis, New York, pp. 159-176.
42. Morisette, J.T., J.L. Privette, A. Strahler, P. Mayaux, and C.O. Justice, 2004. Validation of global land-cover products by the Committee on Earth Observing Satellites, Remote Sensing and GIS Accuracy Assessment (R.S. Lunetta and J.G. Lyon, editors), CRC Press, New York, pp. 31-40.
43. Muchoney, D.M., A.H. Strahler, J. Hodges, and J. LoCastro, 1999. The IGBP DISCover confidence sites and the system for terrestrial ecosystem parametrization: Tools for validating global land-cover data, Photogrammetric Engineering & Remote Sensing, 65:1061-1067.
44. Nolan, B.T., K.J. Hitt, and B.C. Ruddy, 2002. Probability of nitrate contamination of recently recharged ground waters in the conterminous United States, Environmental Science and Technology, 36:2138-2145.
45. Nusser, S.M., and E.E. Klaas, 2003. Survey methods for assessing land cover map accuracy, Environmental and Ecological Statistics, 10:309-331.
46. Nusser, S.M., and J.J. Goebel, 1997. The National Resources Inventory: A long-term multi-resource monitoring program, Environmental and Ecological Statistics, 4:181-204.
47. Pontius, R.G., Jr., and M.L. Cheuk, 2006. A generalized cross-tabulation matrix to compare soft-classified maps at multiple spatial resolutions, International Journal of Geographical Information Science, 20:1-30.
48. Powell, R.L., N. Matzke, C. de Souza, Jr., M. Clark, I. Numata, L.L. Hess, and D.A. Roberts, 2004. Sources of error in accuracy assessment of thematic land-cover maps in the Brazilian Amazon, Remote Sensing of Environment, 90:221-234.
49. Power, C., A. Simms, and R. White, 2001. Hierarchical fuzzy pattern matching for the regional comparison of land use maps, International Journal of Geographical Information Science, 15:77-100.
50. Radeloff, V.C., R.B. Hammer, S.I. Stewart, J.S. Fried, S.S. Holcomb, and J.F. McKeefry, 2005. The wildland-urban interface in the United States, Ecological Applications, 15:799-805.
51. Risser, P.G., J.R. Karr, and R.T.T. Forman, 1984, Landscape Ecology: Directions and Approaches, Illinois Natural History Survey Special Publication Number 2, Champaign, Illinois.
52. Riitters, K.H., J.D. Wickham, R.V. O'Neill, K.B. Jones, E.R. Smith, J.W. Coulston, T.G. Wade, and J.H. Smith, 2002. Fragmentation of continental United States forests, Ecosystems, 5:815-822.
53. Royall, R.M., and K.R. Eberhardt, 1975. Variance estimates for the ratio estimator, Sankhya C, 37:43-52.
54. Särndal, C.E., B. Swensson, and J. Wretman, 1992. Model-Assisted Survey Sampling, Springer-Verlag, New York.
55. SC DHEC, 2004. Total Maximum Daily Load for Big Wateree Creek: Station CW-072 Fecal Coliform, South Carolina Department of Health and Environmental Control.
56. Scepan, J., 1999. Thematic validation of high-resolution global landcover data sets, Photogrammetric Engineering & Remote Sensing, 65(11):1051-1060.
57. Schmidt, K.M., J.P. Manakis, C.C. Hardy, W.J. Hann, and D.L. Bunnell, 2002. Development of Coarse-scale Spatial Data for Wildland Fire and Fuel Management, United States Department of Agriculture, Forest Service, Rocky Mountain Research Station, General Technical Report RMRS-87, Fort Collins, Colorado.
58. Sheeder, S.A., J.A. Lynch, and J. Grimm, 2002. Modeling atmospheric nitrogen deposition and transport in the Chesapeake Bay Watershed, Journal of Environmental Quality, 31:1194-1206.
59. Smith, S.V., W.H. Renwick, J.D. Bartley, and R.W. Buddemeier, 2002. Distribution and significance of small, artificial water bodies across the United States landscape, The Science of the Total Environment, 299:21-36.
60. Steele, B.M., 2005. Maximum posterior probability estimators of map accuracy, Remote Sensing of Environment, 99:254-270.
61. Stehman, S.V., and J.D. Wickham, 2006. Assessing accuracy of net change derived from land cover maps, Photogrammetric Engineering & Remote Sensing, 72(1):175-185.
62. Stehman, S.V., 2004. Sampling designs for accuracy assessment of large-area, land-cover maps: Challenges and future directions, Remote Sensing and GIS Accuracy Assessment (R.S. Lunetta and J.G. Lyon, editors), CRC Press, New York, pp. 13-29.
63. Stehman, S.V., J.D. Wickham, J.H. Smith, and L. Yang, 2003. Thematic accuracy of the 1992 National Land-Cover Data (NLCD) for the Eastern United States: Statistical methodology and regional results, Remote Sensing of Environment, 86:500-516.
64. Stehman, S.V., 2001. Statistical rigor and practical utility in thematic map accuracy assessment, Photogrammetric Engineering & Remote Sensing, 67(6):727-734.
65. Stehman, S.V., 2000. Practical implications of design-based sampling inference for thematic map accuracy assessment, Remote Sensing of Environment, 72:35-45.
66. Stehman, S.V., R.L. Czaplewski, S.M. Nusser, L. Yang, and Z. Zhu, 2000. Combining accuracy assessment of land-cover maps with environmental monitoring programs, Environmental Monitoring and Assessment, 64:115-126.
67. Stehman, S.V., 1999. Basic probability sampling designs for thematic map accuracy assessment, International Journal of Remote Sensing, 20:2423-2441.
68. Stehman, S.V., and R.L. Czaplewski, 1998. Design and analysis for thematic map accuracy assessment: Fundamental principles, Remote Sensing of Environment, 64:331-344.
69. Treves, A., L. Naughton-Treves, E.K. Harpers, D.J. Mladenoff, R.A. Rose, T.A. Sickley, and A.P. Wydeven, 2004. Predicting human-carnivore conflict: A spatial model derived from 25 years of data on wolf predation on livestock, Conservation Biology, 18:114-125.
70. USEPA, 2003. EPA's Draft Report on the Environment: Technical Document, EPA 600-R-03-050, U.S. Environmental Protection Agency, Washington, D.C., URL: http://www.epa.gov/roe/roe/html/roePDF.htm (last date accessed 20 August 2008).
71. USFS, 1992. Forest Service Resource Inventories: An Overview, USGPO 1992-341-350/60861, U. S. Department of Agriculture, Forest Service, Forest Inventory, Economics, and Recreation Research, Washington, D.C.
72. Valliant, R., A.H. Dorfman, and R.M. Royall, 2000. Finite Population Sampling and Inference: A Prediction Approach, John Wiley & Sons, New York.
73. Vogelmann, J.E., S.M. Howard, L. Yang, C.R. Larson, B.K. Wylie, and N. Van Driel, 2001. Completion of the 1990s National Land Cover Data set for the conterminous United States from Landsat Thematic mapper data and ancillary data sources, Photogrammetric Engineering & Remote Sensing, 67(5):650-662.
74. Volstad, J.H., N.E. Roth, G. Mercurio, M.T. Southerland, and D.E. Strebel, 2003. Using environmental stressor information to predict the ecological status of Maryland non-tidal streams as measured by biological indicators, Environmental Monitoring and Assessment, 84:219-242.
75. White, R., 2006. Pattern based map comparisons, Journal of Geographical Systems, 8:145-164.
76. Wickham, J.D., S.V. Stehman, J.H. Smith, and L. Yang, 2004a, Thematic accuracy of the 1992 National Land-cover Data for the western United States, Remote Sensing of Environment, 91:452-468.
77. Wickham, J.D., S.V. Stehman, J.H. Smith, T.G. Wade, and L. Yang, 2004b, A priori evaluation of two-stage cluster sampling for accuracy assessment of large-area land-cover maps, International Journal of Remote Sensing, 25:1235-1252.
78. Wulder, M.A., S.E. Franklin, J.C. White, J. Linke, and S. Magnussen, 2006. An accuracy assessment framework for large-area land cover classification products derived from medium-resolution satellite data, International Journal of Remote Sensing, 27:663-683.
79. Zhu, Z., L. Yang, S.V. Stehman, and R.L. Czaplewski, 2000. Accuracy assessment for the U. S. Geological Survey regional land-cover mapping program: New York and New Jersey region, Photogrammetric Engineering & Remote Sensing, 66(12):1425-1435.