Probability sampling protocol for thematic and spatial quality assessment of classification maps generated from spaceborne/airborne very high resolution images

IEEE Transactions on Geoscience and Remote Sensing

Volumn 52, Issue 1, 2014, Pages 701-760

  Baraldi, Andrea ^a   Boschetti, Luigi ^a,b   Humber, Michael L ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF IDAHO   (United States)

Author keywords

Contingency matrix; Error matrix; Land cover change (LCC) detection; Land cover classification; Maps comparison; Nonprobability sampling; Ontology; Overlapping area matrix (OAMTRX); Probability sampling; Quality indicator of operativeness (OQI); Spatial quality indicator (SQI); Taxonomy; Thematic quality indicator (TQI)

Indexed keywords

ERROR MATRICES; LAND COVER CLASSIFICATION; LAND-COVER CHANGE; OVERLAPPING AREA; PROBABILITY SAMPLING; QUALITY INDICATORS; SPATIAL QUALITY;

ESTIMATION; MAPS; MATRIX ALGEBRA; ONTOLOGY; POPULATION STATISTICS; QUALITY ASSURANCE; SEMANTICS; SOFTWARE TESTING; TAXONOMIES;

PROBABILITY;

ERROR ANALYSIS; IMAGE CLASSIFICATION; IMAGE RESOLUTION; LAND COVER; MODEL VALIDATION; PIXEL; PROBABILITY; QUICKBIRD; SAMPLING; SATELLITE IMAGERY; SOFTWARE; SPATIAL ANALYSIS; TAXONOMY; THEMATIC MAPPING;

EID: 84887522825     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2013.2243739     Document Type: Article

References (148)

1. O. Sjahputera, C. H. Davis, B. Claywell, N. J. Hudson, J. M. Keller, M. G. Vincent, Y. Li, M. Klaric, and C. R. Shyu, "GeoCDX: An automated change detection and exploitation system for high resolution satellite imagery, " in Proc. IEEE IGARSS, Boston, MA, USA, Jul. 6-11, 2008, pp. 467-470.
2. G. Gutman, A. C. Janetos, C. O. Justice, E. F. Moran, J. F. Mustard, R. R. Rindfuss, D. Skole, B. L. Turner, and M. A. Cochrane, Eds., Land Change Science. Dordrecht, The Netherlands: Kluwer, 2004.
3. A Quality Assurance Framework for Earth Observation, ver. 4.0, GEO/CEOSS, Geneva, Switzerland, Jan. 2010. [Online]. Available: http://qa4eo.org/docs/ QA4EO-Principles-v4.0.pdf
4. GEO. (2005, Feb. 16). The Global Earth Observation System of Systems (GEOSS) 10-Year Implementation Plan, Geneva, Switzerland, (accessed on 10 January 2012). [Online]. Available: http://www.earthobservations. org/docs/10-Year%20Implementation%20Plan.pdf
5. A. Baraldi, "Impact of radiometric calibration and specifications of spaceborne optical imaging sensors on the development of operational automatic remote sensing image understanding systems, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 2, no. 2, pp. 104-134, Jun. 2009.
6. A. Baraldi, V. Puzzolo, P. Blonda, L. Bruzzone, and C. Tarantino, "Automatic spectral rule-based preliminary mapping of calibrated Landsat TM and ETM+ images, " IEEE Trans. Geosci. Remote Sens., vol. 44, no. 9, pp. 2563-2586, Sep. 2006.
7. A. Baraldi, L. Durieux, D. Simonetti, G. Conchedda, F. Holecz, and P. Blonda, "Automatic spectral rule-based preliminary classification of radiometrically calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/ OrbView/GeoEye and DMC/SPOT-1/-2 imagery - Part I: System design and implementation, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1299-1325, Mar. 2010.
8. A. Baraldi, L. Durieux, D. Simonetti, G. Conchedda, F. Holecz, and P. Blonda, "Automatic spectral rule-based preliminary classification of radiometrically calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/ OrbView/GeoEye and DMC/SPOT-1/-2 imagery - Part II: Classification accuracy assessment, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1326-1354, Mar. 2010.
9. A. Baraldi, L. Durieux, D. Simonetti, G. Conchedda, F. Holecz, and P. Blonda, "Corrections to Automatic spectral rule-based preliminary classification of radiometrically calibrated SPOT-4/-5/IRS, AVHRR/ MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/ SPOT-1/-2 imagery, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, p. 1635, Mar. 2010.
10. A. Baraldi, M. Gironda, and D. Simonetti, "Operational two-stage stratified topographic correction of spaceborne multi-spectral imagery employing an automatic spectral rule-based decision-tree preliminary classifier, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 1, pp. 112-146, Jan. 2010.
11. A. Baraldi, T. Wassenaar, and S. Kay, "Operational performance of an automatic preliminary spectral rule-based decision-tree classifier of spaceborne very high resolution optical images, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 9, pp. 3482-3502, Sep. 2010.
12. A. Baraldi, "Fuzzification of a crisp near-real-time operational automatic spectral-rule-based decision-tree preliminary classifier of multisource multispectral remotely sensed images, " IEEE Trans. Geosci. Remote Sens., vol. 49, no. 6, pp. 2113-2134, Jun. 2011.
13. A. Baraldi, "Vision goes symbolic without loss of information within the preattentive vision phase: The need to shift the learning paradigm from Machine-Learning (from examples) to Machine-Teaching (by rules) at the first stage of a two-stage hybrid remote sensing image understanding system, Part I: Introduction, " in Earth Observation. Rijeka, Croatia: InTech, 2012, pp. 63-98.
14. A. Baraldi, "Vision goes symbolic without loss of information within the preattentive vision phase: The need to shift the learning paradigm from Machine-Learning (from examples) to Machine-Teaching (by rules) at the first stage of a two-stage hybrid remote sensing image understanding system, Part II: Introduction, " in Earth Observation. Rijeka, Croatia: InTech, 2012, pp. 99-136.
15. A. Baraldi, "Satellite image automatic mapper (SIAM™) - A turnkey software executable for automatic near real-time multi-sensor multiresolution spectral rule-based preliminary classification of spaceborne multi-spectral images, " Recent Patents Space Technol., vol. 1, no. 2, pp. 81-106, Dec. 2011.
16. A. Baraldi and L. Boschetti, "Operational automatic remote sensing image understanding systems: Beyond Geographic Object-Based and Object-Oriented Image Analysis (GEOBIA/GEOOIA) - Part 1: Introduction, " Remote Sens., vol. 4, no. 9, pp. 2694-2735, Sep. 2012.
17. A. Baraldi and L. Boschetti, "Operational automatic remote sensing image understanding systems: Beyond Geographic Object-Based and Object-Oriented Image Analysis (GEOBIA/GEOOIA) - Part 2: Novel system architecture, information/knowledge representation, algorithm design and implementation, " Remote Sens., vol. 4, no. 9, pp. 2768-2817, Sep. 2012.
18. P. Zamperoni, "Plus ça va, moins ça va, " Pattern Recognit. Lett., vol. 17, no. 7, pp. 671-677, Jun. 1996.
19. E. Diamant, "Machine Learning: When and Where the Horses Went Astray?" in Machine Learning, Y. Zhang, Ed. Rijeka, Croatia: InTech, 2010, pp. 1-18.
20. M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis and Machine Vision. London, U.K.: Chapman & Hall, 1994.
21. D. Marr, Vision. New York, NY, USA: Freeman, 1982.
22. F. Wang, "Fuzzy supervised classification of remote sensing images, " IEEE Trans. Geosci Remote Sens., vol. 28, no. 2, pp. 194-201, Mar. 1990. (Pubitemid 20666545)
23. R. Capurro and B. Hjørland, The concept of information, Annual Review of Information Science and Technology, B. Cronin, Ed., Medford, NJ, USA: Information Today Inc., 2003, vol. 37, ch. 8, pp. 343-411. [Online]. Available: http://www.capurro.de/infoconcept.html (Pubitemid 36140490)
24. R. Capurro, Hermeneutics and the Phenomenon of Information., in Metaphysics, Epistemology, and Technology. Research in Philosophy and Technology, vol. 19. Amsterdam, The Netherlands: Elsevier, 2000, pp. 79-85.
25. M. F. Goodchild, M. Yuan, and T. J. Cova, "Towards a general theory of geographic representation in GIS, " Int. J. Geogr. Inf. Sci., vol. 21, no. 3, pp. 239-260, Jan. 2007. (Pubitemid 46470283)
26. A. D. Tonchev and C. D. Tonchev, Method for Measuring the Overall Operational Performance of Hydrocarbon Facilities, Patent 20 080 262 898, Oct. 23, 2008. [Online]. Available: http://www.faqs.org/ patents/app/20080262898
27. C. Mason and E. R. Kandel, "Central Visual Pathways, " in Principles of Neural Science, E. Kandel and J. Schwartz, Eds. Norwalk, CT, USA: Appleton and Lange, 1991, pp. 420-439.
28. P. Gouras, "Color Vision, " in Principles of Neural Science, E. Kandel and J. Schwartz, Eds. Norwalk, CT, USA: Appleton and Lange, 1991, pp. 467-479.
29. E. R. Kandel, "Perception of Motion, Depth and Form, " in Principles of Neural Science, E. Kandel and J. Schwartz, Eds. Norwalk, CT, USA: Appleton and Lange, 1991, pp. 441-466.
30. H. R. Wilson and J. R. Bergen, "A four mechanism model for threshold spatial vision, " Vis. Res., vol. 19, no. 1, pp. 19-32, 1979. (Pubitemid 9091881)
31. S. P. Vecera and M. J. Farah, "Is visual image segmentation a bottomup or an interactive process?" Percept. Psychophys., vol. 59, no. 8, pp. 1280-1296, Nov. 1997. (Pubitemid 127459265)
32. V. Cherkassky and F. Mulier, Learning from Data: Concepts, Theory, and Methods. New York, NY, USA: Wiley, 1998.
33. P. Mather, Computer Processing of Remotely-Sensed Images - An Introduction. Chichester, U.K.: Wiley, 1994.
34. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
35. T. Matsuyama and V. Shang-Shouq Hwang, SIGMA - A Knowledge- Based Aerial Image Understanding System. New York, NY, USA: Plenum, 1990.
36. K. Pakzad, J. Bäckner, and S. Growe, Knowledge based moorland interpretation using a hybrid system for image analysis, " in Proc. ISPRS Conf., Munich, Germany, Sep. 8-10, 1999, pp. 1103-1110. [Online]. Available: http://www.tnt.uni-hannover.de/papers/view.php? ind=1999&ord= Authors&mod=ASC
37. S. Growe, "Knowledge based interpretation of multisensor and multitemporal remote sensing images, " Int. Arch. Photogramm. Remote Sens., vol. 32, pt. 7-4-3 W6, pp. 130-138, Jun. 1999.
38. M. Baatz and A. Schäpe, "Multi-resolution Segmentation: An optimization approach for high quality multi-scale image segmentation, " J. Photogramm. Remote Sens., vol. 58, no. 3, pp. 12-23, 2000.
39. G. J. Hay and G. Castilla, "Object-based image analysis: Strengths, Weaknesses, Opportunities and Threats (SWOT), " in Proc. 1st Int. Conf. OBIA, Salzburg, Austria, Jul. 4-5, 2006, pp. 1-3.
40. G. J. Hay and G. Castilla, "Geographic object-based image analysis (GEOBIA): A new name for a new discipline, " in Object-Based Image Analysis: Spatial Concepts for Knowledge-driven Remote Sensing Applications, T. Blaschke, S. Lang, and G. J. Hay, Eds. New York, NY, USA: Springer-Verlag, 2008, ch. 1.4, pp. 81-92.
41. J. Marroquin, S. Mitter, and T. Poggio, "Probabilistic solution of illposed problems in computational vision, " J. Amer. Stat. Assoc., vol. 82, no. 397, pp. 76-89, Mar. 1987.
42. M. Bertero, T. Poggio, and V. Torre, "Ill-posed problems in early vision, " Proc. IEEE, vol. 76, no. 8, pp. 869-889, Aug. 1988.
43. P. Corcoran and A. Winstanley, "Using Texture to Tackle the Problem of Scale in Landcover Classification, " in Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications, T. Blaschke, S. Lang, and G. J. Hay, Eds. New York, NY, USA: Springer-Verlag, 2008, pp. 113-132.
44. M. Petrou and P. Sevilla, Image Processing: Dealing with Texture. Chichester, U.K.: Wiley, 2006.
45. D. C. Burr and M. C. Morrone, "A Nonlinear Model of Feature Detection, " in Nonlinear Vision: Determination of Neural Receptive Fields, Functions, and Networks, R. B. Pinter and N. Bahram, Eds. Boca Raton, FL, USA: CRC Press, 1992, pp. 309-327.
46. J. Hadamard, "Sur les problemes aux derivees partielles et leur signification physique, " Princeton Univ. Bull., vol. 13, pp. 49-52, 1902.
47. Q. Iqbal and J. K. Aggarwal, "Image retrieval via isotropic and anisotropic mappings, " in Proc. IAPR Workshop Pattern Recognit. Inf. Syst., Setubal, Portugal, Jul. 6-8, 2001, pp. 34-49, 2001.
48. CEOS Working Group on Calibration and Validation, Land Product Validation Subgroup, accessed on 10 January 2012. [Online]. Available: http://lpvs.gsfc.nasa.gov/
49. S. V. Stehman, "Selecting and interpreting measures of thematic classification accuracy, " Remote Sens. Environ., vol. 62, no. 1, pp. 77-89, Oct. 1997. (Pubitemid 28052020)
50. R. S. Lunetta and C. D. Elvidge, Remote sensing and Change Detection: Environmental Monitoring Methods and Applications. Chelsea, MI, USA: Ann Arbor Press, 1998.
51. R. G. Congalton and K. Green, Assessing the Accuracy of Remotely Sensed Data. Boca Raton, FL, USA: Lewis Publishers, 1999.
52. A. Baraldi, L. Bruzzone, and P. Blonda, "Quality assessment of classification and cluster maps without ground truth knowledge, " IEEE Trans. Geosci. Remote Sens., vol. 43, no. 4, pp. 857-873, Apr. 2005.
53. G. M. Foody, "Status of land cover classification accuracy assessment, " Remote Sens. Environ., vol. 80, no. 1, pp. 185-201, Apr. 2002. (Pubitemid 34271212)
54. C. Persello and L. Bruzzone, "A novel protocol for accuracy assessment in classification of very high resolution images, " IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1232-1244, Mar. 2010.
55. S. V. Stehman and R. L. Czaplewski, "Design and analysis for thematic map accuracy assessment: Fundamental principles, " Remote Sens. Environ., vol. 64, no. 3, pp. 331-344, Jun. 1998. (Pubitemid 29363299)
56. R. G. Pontius, "Quantification error versus location error in comparison of categorical maps, " Photogramm. Eng. Remote Sens., vol. 66, no. 8, pp. 1011-1016, Aug. 2000.
57. L. Wald, T. Ranchin, and M. Mangolini, "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images, " Photogramm. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, Jun. 1997.
58. Z. Wang and A. C. Bovik, "A universal image quality index, " IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002. (Pubitemid 34554870)
59. L. Alparone, S. Baronti, A. Garzelli, and F. Nencini, "A global quality measurement of pan-sharpened multispectral imagery, " IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 313-317, Oct. 2004.
60. W. S. Overton and S. V. Stehman, "The Horvitz-Thompson theorem as a unifying perspective for probability sampling:With examples from natural resource sampling, " Amer. Stat., vol. 49, no. 3, pp. 261-268, Aug. 1995.
61. F. Van Coillie, R. Pires, N. Van Camp, and S. Gautama, "Quantitative segmentation evaluation for large scale mapping purposes, " Int. Arch. Phtotogramm., Remote Sens. Spatial Inf. Sci., vol. 38, no. 4/C1, p. 6, 2008 (accessed on 10 Jan. 2012). [Online]. Available: https://biblio. ugent.be/publication/854114
62. F. Van Coillie, N. Van Camp, R. De Wulf, L. Bral, and S. Gautama, "Segmentation quality evaluation for large scale mapping purposes in Flanders, Belgium, " in Proc. Int. Arch. Phtotogramm., Remote Sens. Spatial Inf. Sci., 2010, pp. 1-4. [Online]. Available: https://biblio.ugent. be/publication/1220278
63. S. V. Stehman, "Comparing thematic maps based on map value, " Int. J. Remote Sens., vol. 20, no. 12, pp. 2347-2366, Jan. 1999. (Pubitemid 29485682)
64. L. A. Zadeh, "Fuzzy sets, " Inf. Control, vol. 8, no. 3, pp. 338-353, Jun. 1965.
65. B. Kosko, Fuzzy Thinking. London, U.K.: Flamingo, 1994.
66. K. Kuzera and R. G. Pontius, "Importance of matrix construction for multiple-resolution categorical map comparison, " GISci. Remote Sens., vol. 45, no. 3, pp. 249-274, 2008.
67. M. Beauchemin and K. Thomson, "The evaluation of segmentation results and the overlapping area matrix, " Int. J. Remote Sens., vol. 18, no. 18, pp. 3895-3899, Dec. 1997.
68. O. Ahlqvist, "Extending post-classification change detection using semantic similarity metrics to overcome class heterogeneity: A study of 1992 and 2001 U.S. National Land Cover Databases changes, " Remote Sens. Environ., vol. 112, no. 3, pp. 1226-1241, Mar. 2008. (Pubitemid 351296264)
69. R. Laurini and D. Thompson, Fundamentals of Spatial Information Systems. San Diego, CA, USA: Academic, 1992.
70. H. Mizen, C. Dolbear, and G. Hart, "Ontology ontogeny: Understanding how an ontology is created and developed, " in Proc. 1st Int. Conf. GeoS, Mexico City, Mexico, Nov. 29/30, 2005, pp. 15-29. (Pubitemid 43775035)
71. F. T. Fonseca, M. J. Egenhofer, P. Agouris, and G. Camara, "Using ontologies for integrated geographic information systems, " Trans. GIS, vol. 6, no. 3, pp. 231-257, Jun. 2002. (Pubitemid 34829672)
72. N. Guarino, "Formal ontology, conceptual analysis and knowledge representation, " Int. J. Hum. Comput. Studies, vol. 43, no. 5/6, pp. 625-640, Nov./Dec. 1995.
73. J. F. Sowa, Knowledge representation: Logical, philosophical, and computational foundations. Cambridge, MA, USA: MIT Press, 2000.
74. O. Ahlqvist, "Using uncertain conceptual spaces to translate between land cover categories, " Int. J. Geogr. Inf. Sci., vol. 19, no. 7, pp. 831-857, Aug. 2005. (Pubitemid 41269457)
75. C. C. Feng and D. M. Flewelling, "Assessment of semantic similarity between land use/land cover classification systems, " Comput., Environ. Urban Syst., vol. 28, no. 3, pp. 229-246, May 2004. (Pubitemid 38356039)
76. M. Kavouras and M. Kokla, "A method for the formalization and integration of geographical categorizations, " Int. J. Geogr. Inf. Sci., vol. 16, no. 5, pp. 439-453, Jul. 2002. (Pubitemid 34834305)
77. A. K. Shackelford and C. H. Davis, "A hierarchical fuzzy classification approach for high-resolution multispectral data over urban areas, " IEEE Trans. Geosci. Remote Sens., vol. 41, no. 9, pp. 1920-1932, Sep. 2003.
78. C. Shannon, "A mathematical theory of communication, " Bell Syst. Tech. J., vol. 27, pp. 379-423, Jul.-Oct. 1948.
79. S. Lang, "Object-based image analysis for remote sesning applications: Modeling reality - Dealing with complexity, " in Object-Based Image Analysis-Spatial Concepts for Knowledge-driven Remote Sensing Applications, T. Blaschke, S. Lang, and G. J. Hay, Eds. New York, NY, USA: Springer-Verlag, 2008, ch. 1.1, pp. 3-27.
80. P. Läscher, D. Burghardt, and R. Weibel, "Ontology-driven enrichment of spatial databases, " in Proc. 10th ICA Workshop Gen. Multiple Represent., Moscow, Russia, Aug. 2/3, 2007, pp. 1-13. [Online]. Available: http://www.geo.uzh.ch/~luescher/publications/luescher-genws2007.pdf
81. G. Schaepman-Strub, M. E. Schaepman, T. H. Painter, S. Dangel, and J. V. Martonchik, "Reflectance quantities in optical remote sensingdefinitions and case studies, " Remote Sens. Environ., vol. 103, no. 1, pp. 27-42, Jul. 2006. (Pubitemid 43867588)
82. M. Herold, C. Woodcock, A. Di Gregorio, P. Mayaux, A. S. Belward, J. Latham, and C. Schmullius, "A joint initiative for harmonization and validation of land cover datasets, " IEEE Trans. Geosci. Remote Sens., vol. 44, no. 7, pp. 1719-1727, Jul. 2006. (Pubitemid 44109493)
83. R. Richter and D. Schläpfer, Atmospheric/Topographic Correction for Satellite Imagery - ATCOR-2/3 User Guide, ReSe Appl. Schläpfer, Wil, Switzerland, Version 8.0.2. [Online]. Available: http://www.rese.ch/pdf/ atcor3-manual.pdf
84. R. Richter and D. Schläpfer, Atmospheric/Topographic Correction for Airborne Imagery - ATCOR-4 User Guide, ReSe Appl. Schläpfer, Wil, Switzerland, Version 6.2 BETA. [Online]. Available: http:// www.dlr.de/eoc/ Portaldata/60/Resources/dokumente/5-tech-mod/ atcor4-manual-2012.pdf
85. W. Dorigo, R. Richter, R. F. Baret, R. Bamler, and W. Wagner, "Enhanced automated canopy characterization from hyperspectral data by a novel two step radiative transfer model inversion approach, " Remote Sens., vol. 1, no. 4, pp. 1139-1170, Nov. 2009.
86. D. Schläpfer, R. Richter, and A. Hueni, "Recent developments in operational atmospheric and radiometric correction of hyperspectral imagery, " in Proc. 6th EARSeL SIG IS Workshop, Tel-Aviv, Israel, Mar. 16-19, 2009, pp. 1-7.
87. S. Liang, Quantitative Remote Sensing of Land Surfaces. Hoboken, NJ, USA: Wiley, 2004.
88. D. Maniates and D. Mollicone, "Options for sampling and stratification for national forest inventories to implement REDD+ under the UNFCCC, " Carbon Bal. Manage., vol. 5, no. 9, pp. 1-14, Dec. 2010.
89. eCognition Elements User Guide 4, Definiens Imaging GmbH, Munich, Germany, 2004.
90. Developer 8 Reference Book, Definiens AG, Munich, Germany, 2011.
91. T. Esch, M. Thiel, M. Bock, A. Roth, and S. Dech, "Improvement of image segmentation accuracy based on multiscale optimization procedure, " IEEE Geosci. Remote Sens. Lett., vol. 5, no. 3, pp. 463-467, Jul. 2008.
92. M. Nuebert, H. Herold, and G. Meinel, "Assessing image segmentation quality - Concepts, methods and application, " in Object-Based Image Analysis-Spatial Concepts for Knowledge-driven Remote Sensing Applications, T. Blaschke, S. Lang, and G. J. Hay, Eds. New York, NY, USA: Springer-Verlag, 2008, ch. 8.3, pp. 769-784.
93. P. S. Chavez, "An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data, " Remote Sens. Environ., vol. 24, no. 3, pp. 459-479, Apr. 1988.
94. P. H. Swain and S. M. Davis, Remote Sensing: The Quantitative Approach. New York, NY, USA: McGraw Hill, 1978.
95. Group on Earth Observations. (2008, Nov.). GEO Announces Free and Unrestricted Access to Full Landsat Archive: Universal Availability of Cost-Free Satellite Data and Images will Revolutionize The Use of Earth Observations for Decision-Making, Geneva, Switzerland. [Online]. Available: www.fabricadebani.ro/ userfiles/GEO-press-release.doc
96. ESA, (accessed 9 Sep. 2012) About GMES - Overview. [Online]. Available: http://www.esa.int/esaLP/SEMRRI0DU8E-LPgmes-0.html
97. GMES, (accessed 10 Jan. 2012) GMES Info. [Online]. Available: http:// www.gmes.info
98. USGS, (accessed 9 Sep. 2012) Web-Enabled Landsat Data (WELD) Project. [Online]. Available: http://landsat.usgs.gov/WELD.php
99. A. K. Shackelford and C. H. Davis, "A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas, " IEEE Trans. Geosci. Remote Sens., vol. 41, no. 10, pp. 2354-2363, Oct. 2003.
100. A. Baraldi and F. Parmiggiani, "Urban area classification by multispectral SPOT images, " IEEE Trans. Geosci. Remote Sens., vol. 28, no. 4, pp. 674-680, Jul. 1990. (Pubitemid 20737878)
101. Y. I. Zhang, "A survey on evaluation methods for image segmentation, " Pattern Recognit., vol. 29, no. 8, pp. 1335-1346, Aug. 1996.
102. H. Zhang, J. Fritts, and S. Goldman, "Image segmentation evaluation: A survey of unsupervised methods, " Comput. Vis. Image Understand., vol. 110, no. 2, pp. 260-280, May 2008. (Pubitemid 351509773)
103. G. M. Foody, "Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy, " Photogramm. Eng. Remote Sens., vol. 70, no. 5, pp. 627-633, May 2004. (Pubitemid 39081774)
104. A. Wu, Z. Li, and J. Cihlar, "Effects of land cover type and greenness on advanced very high resolution radiometer bidirectional reflectances: Analysis and removal, " J. Geophys. Res., vol. 100, no. D5, pp. 9179-9192, Jan 1995. (Pubitemid 26437931)
105. J. D. Shepherd and J. R. Dymond, "BRDF correction of vegetation in AVHRR imagery, " Remote Sens. Environ., vol. 74, no. 3, pp. 397-408, Dec. 2000. (Pubitemid 32139643)
106. T. Danaher, "An empirical BRDF correction for landsat TM and ETM+ imagery, " in Proc. 11th Aust. Remote Sens. Photogramm. Conf., Brisbane, Australia, 2002, pp. 2654-2657.
107. E. Vermote, D. Tanré, J. L. Deuzé, M. Herman, and J. J. Morcrette, Second Simulation of the Satellite Signal in the Solar Spectrum (6S), 6S User Guide Version 2, Lab. Opt. Atmos., Villeneuve d'Ascq, France, (accessed 10 Jan. 2012). [Online]. Available: http://www.rsgis.ait.ac.th/ ~honda/textbooks/advrs/6smanv2.0-P1.pdf
108. M. P. Bishop and J. D. Colby, "Anisotropic reflectance correction of SPOT-3 HRV imagery, " Int. J. Remote Sens., vol. 23, no. 10, pp. 2125-2131, May 2002. (Pubitemid 34514541)
109. M. P. Bishop, J. F. Shroder, and J. D. Colby, "Remote sensing and geomorphometry for studying relief production in high mountains, " Geomorphology, vol. 55, no. 1-4, pp. 345-361, Sep. 2003. (Pubitemid 37232057)
110. DigitalGlobe. Radiometric Use of QuickBird Imagery, Longmont, CO, USA, (accessed 10 Jan. 2012). [Online]. Available: http://www. digitalglobe.com/ downloads/QuickBird-technote-raduse-v1.pdf
111. T. Lillesand and R. Kiefer, Remote Sensing and Image Interpretation. New York, NY, USA: Wiley, 1979.
112. L. Leigh, D. Helder, I. Behnert, A. Deadman, N. Fox, U. M. Leloglu, H. Ozen, and D. Griffith, "Tuz Gölä site characteristics, " in Proc. IEEE IGARSS, Jul. 24-29, 2011, pp. 3871-3874.
113. F. Li, D. L. B. Jupp, and M. Thankappana, "Using high resolution DSM data to correct the terrain illumination effect in Landsat data, " in Proc. 19th Int. Congr. Modelling Simul., Perth, Australia, Dec. 12-16, 2011, pp. 2402-2408.
114. X. Wu, S. Collings, and P. Caccetta, "BRDF and illumination calibration for very high resolution imaging sensors, " in Proc. IEEE IGARSS, Jul. 25-30, 2010, pp. 3162-3165.
115. M. Humber, A. Baraldi, and L. Boschetti, "Automatic near real-time preliminary classification of spaceborne/airborne multi-spectral images: Accuracy validation of the Satellite Image Automatic Mapper (SIAM™) and Atmospheric/Topographic Correction (ATCOR)-Spectral Classification (SPECL) software products in operating mode, " Remote Sensing, 2013.
116. (accessed on 1 Nov. 2010). [Online]. Available: http://www.digitalglobe. com/index.php/70/Product+Samples
117. T. Novack, T. Esch, H. Kux, and U. Stilla, "Machine learning comparison between WorldView-2 and QuickBird-2 simulated imagery regarding object-based urban land cover classification, " Remote Sens., vol. 3, no. 10, pp. 2263-2282, Oct. 2011.
118. C. Tarantino, M. Adamo, G. Pasquariello, F. Lovergine, P. Blonda, and V. Tomaselli, "8-band image data processing of the WorldView-2 satellite in a wide area of applications, " in Earth Observation. Rijeka, Croatia: InTech, 2012, pp. 137-152.
119. H. Z. Mohd Shafri, M. A. Mohd Salleh, and A. Ghiyamat, "Hyperspectral remote sensing of vegetation using red edge position techniques, " Amer. J. Appl. Sci., vol. 3, no. 6, pp. 1864-1871, Jun. 2006.
120. M. Boschetti, L. Boschetti, S. Oliveri, L. Casati, and I. Canova, "Tree species mapping with Airborne hyper-spectral MIVIS data: The Ticino Park study case, " Int. J. Remote Sens., vol. 28, no. 6, pp. 1251-1261, Mar. 2007. (Pubitemid 46455018)
121. K. Richter, T. B. Hank, F. Vuolo, W. Mauser, and G. D'Urso, "Optimal exploitation of the Sentinel-2 spectral capabilities for crop leaf area index mapping, " Remote Sens., vol. 4, no. 3, pp. 561-582, Feb. 2012.
122. G. Chander, B. L. Markham, and D. L. Helder, "Summary of current radiometric calibration coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI sensors, " Remote Sens. Environ., vol. 113, no. 5, pp. 893-903, May 2009.
123. S. V. Stehman and J. D. Wickham, "Pixels, blocks of pixels, and polygons: Choosing a spatial unit for thematic accuracy assessment, " Remote Sens. Environ., vol. 115, no. 12, pp. 3044-3055, Dec. 2011.
124. J. Brinkworth, Software Quality Management. New York, NY, USA: Prentice-Hall, 1992.
125. F. Salge, "Semantic accuracy, " in Elements of Spatial Data Quality, S. C. Guptill and J. L. Morisson, Eds. Oxford, U.K.: Elsevier, 1995, pp. 139-151.
126. Y. Bishr and Y., "Overcoming the semantic and other barriers to GIS interoperability, " Int. J. Geogr. Inf. Sci., vol. 12, no. 4, pp. 299-314, Jun. 1998. (Pubitemid 28388686)
127. R. G. Pontius, Jr. and M. Millones, "Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment, " Int. J. Remote Sens., vol. 32, no. 15, pp. 4407-4429, Aug. 2011.
128. R. G. Pontius and J. Connors, "Expanding the conceptual, mathematical and practical methods for map comparison, " in Proc. Conf. Spatial Accuracy, Lisbon, Portugal, 2006, pp. 64-79.
129. R. Nishii and S. Tanaka, "Accuracy and inaccuracy assessments in landcover classification, " IEEE Trans. Geosci. Remote Sens., vol. 37, no. 1, pp. 491-498, Jan. 1999.
130. W. R. Tobler, "A computer movie simulating urban growth in the Detroit region, " Econom. Geogr., vol. 46, no. 2, pp. 234-240, Jun. 1970.
131. M. Baatz, C. Hoffmann, and G. Willhauck, "Progressing from objectbased to object-oriented image analysis, " in Object-Based Image Analysis-Spatial Concepts for Knowledge-driven Remote Sensing Applications, T. Blaschke, S. Lang, and G. J. Hay, Eds. New York, NY, USA: Springer-Verlag, 2008, ch. 1.4, pp. 29-42.
132. J. C. Bezdek, T. Reichherzer, G. S. Lim, and Y. Attikiouzel, "Multipleprototype classifier design, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 28, no. 1, pp. 67-79, Feb. 1998.
133. T. Mitchell, Machine Learning. New York, NY, USA: McGraw-Hill, 1997.
134. Y. V. Venkatesh and S. Kumar Raja, "On the classification of multispectral satellite images using the multilayer perceptron, " Pattern Recognit., vol. 36, no. 9, pp. 2161-2175, Sep. 2003. (Pubitemid 36726830)
135. W. Kaydos, Operational Performance Measurement: Increasing Total Productivity. Boca Raton, FL, USA: CRC Press, 1999.
136. M. Page-Jones, The Practical Guide to Structured Systems Design. Englewood Cliffs, NJ, USA: Prentice-Hall, 1988.
137. G. Zhou and M. Kafatos, "Future Intelligent Earth Observing Satellites (FIEOS), " in Proc. ISPRS/FIEOS Conf., 2002, pp. 1-8. [Online]. Available: http://www.isprs.org/proceedings/XXXIV/part1/paper/00031.pdf
138. ENVI 4.3, User Manual, ITT Industries Inc., Whiteplains, NY, USA, 2006.
139. J. Slootweg, J. P. Hettelingh, W. Tamis, and M. van't Zelfde, "Harmonizing European Land Cover Maps, " Netherlands Environmental Assessment Agency, The Hague, The Netherlands, (accessed on 6 Nov. 2012). [Online]. Available: http://www.rivm.nl/bibliotheek/ digitaaldepot/PBL-CCE-SR05- Chapter3.pdf
140. O. Cerba, K. Charvat, and J. Jezek, "Data Harmonization Towards CORINE Land Cover, " Univ. of West Bohemia, Pilsen, Czech Republic, (accessed on 6 Nov. 2012). [Online]. Available: www.efita.net/apps/ accesbase/bindocload.asp
141. H. Couclelis, "What geographic information science is NOT: Three theses, " in Proc. GIScience Conf., Columbus, OH, USA, Sep. 18-21, 2012.
142. J. Tian and D. M. Chen, "Optimization in multi-scale segmentation of high-resolution satellite images for artificial feature recognition, " Int. J. Remote Sens., vol. 28, no. 20, pp. 4625-4644, Oct. 2007. (Pubitemid 47471117)
143. L. A. Dupigny-Giroux and J. E. Lewis, "A moisture index for surface characterization over a semiarid area, " Photogramm. Eng. Remote Sens., vol. 65, no. 8, pp. 937-945, Aug. 1999. (Pubitemid 29368618)
144. D. Hubel and T. Wiesel, "Receptive fields of single neurons in the cat's striate cortex, " J. Physiol., vol. 148, no. 3, pp. 574-591, Oct. 1959.
145. J. Mutch and D. Lowe, "Object class recognition and localization using sparse features with limited receptive fields, " Int J. Comput. Vis., vol. 80, no. 1, pp. 45-57, Oct. 2008.
146. T. N. Wiesel and D. H. Hubel, "Spatial and chromatic interactions in the lateral geniculate body of the rhesus monkey, " J. Neurophys., vol. 29, no. 6, pp. 1115-1156, Nov. 1966.
147. A. Jain and G. Healey, "A multiscale representation including opponent color features for texture recognition, " IEEE Trans. Image Process., vol. 7, no. 1, pp. 124-128, Jan. 1998. (Pubitemid 128745330)
148. Anonymous ftp. [Online]. Available: ftp://ftp.iluci.org/Paper/ TGRS-2012-00550, otherwise, http://doi.pangaea.de/10.1594/ PANGAEA.806528? format=html