Operational automatic remote sensing image understanding systems: Beyond geographic object-based and object-oriented image analysis (GEOBIA/GEOOIA). Part 2: Novel system architecture, information/knowledge representation, algorithm design and implementation

Remote Sensing

Volumn 4, Issue 9, 2012, Pages 2768-2817

  Baraldi, Andrea ^a   Boschetti, Luigi ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Categorical variable, computer vision; Continuous variable; Decision tree classifier; Deductive learning from rules; Geographic object based image analysis (GEOBIA); Geographic object oriented image analysis (GEOOIA); Image classification; Inductive learning from either labeled or unlabeled data; Inference; Machine learning; Physical model; Prior knowledge; Radiometric calibration; Remote sensing; Satellite image automatic mapper (SIAM ); Statistical model; Strengths weakness opportunities and threats (SWOT) analysis of a project; Syntactic inference system

Indexed keywords

CATEGORICAL VARIABLES; CONTINUOUS VARIABLES; DEDUCTIVE LEARNING; GEOGRAPHIC OBJECT-BASED IMAGE ANALYSIS; INFERENCE; INFERENCE SYSTEMS; OBJECT-ORIENTED IMAGE ANALYSIS; PHYSICAL MODEL; PRIOR KNOWLEDGE; RADIOMETRIC CALIBRATIONS; SATELLITE IMAGES; STATISTICAL MODELS; STRENGTHS WEAKNESS OPPORTUNITIES AND THREATS (SWOT) ANALYSIS OF A PROJECT; UNLABELED DATA;

COMPUTER VISION; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGE RECONSTRUCTION; IMAGE UNDERSTANDING; ITERATIVE METHODS; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; QUALITY ASSURANCE; REMOTE SENSING; SYNTACTICS;

IMAGE SEGMENTATION;

EID: 84870711428     PISSN: None     EISSN: 20724292     Source Type: Journal    
DOI: 10.3390/rs4092768     Document Type: Article

References (94)

1. Gutman, G., Janetos, A.C., Justice, C.O., Moran, E.F., Mustard, J.F., Rindfuss, R.R., Skole, D., Turner, B.L., Cochrane, M.A., Eds. Land Change Science: Observing, Monitoring and Understanding Trajectories of Change on the Earth's Surface (Remote Sensing and Digital Image Processing); Kluwer: Dordrecht, The Netherlands, 2004.
2. GEO/CEOSS. A Quality Assurance Framework for Earth Observation; Version 3.0; July 2009. Available online: http://calvalportal.ceos.org/cvp/c/document_library/get_file?p_l_id=17516& folderId=17835&name=DLFE-304.pdf (accessed on 10 January 2012).
3. Baraldi, A.; Boschetti, L. Operational automatic remote sensing image understanding systems: Beyond Geographic Object-Based and Object-Oriented Image Analysis (GEOBIA/GEOOIA). Part 1: Introduction. Remote Sens. 2012, 4, 2694-2735.
4. Baatz, M.; Hoffmann, C.; Willhauck, G. Progressing from Object-Based to Object-Oriented Image Analysis. In Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications; Chapter 1.4; Blaschke, T., Lang, S., Hay, G.J., Eds.; Springer-Verlag: New York, NY, USA, 2008; pp. 29-42.
5. Definiens Imaging GmbH. eCognition User Guide 4; Definiens Imaging GmbH: Munich, Germany, 2004.
6. Definiens Imaging GmbH. Developer 8 Reference Book; Definiens Imaging GmbH: Munich, Germany, 2011.
7. Esch, T.; Thiel, M.; Bock, M.; Roth, A.; Dech, S. Improvement of image segmentation accuracy based on multiscale optimization procedure. IEEE Geosci. Remote Sens. Lett. 2008, 5, 463-467.
8. Baatz, M.; Schäpe, A. Multiresolution segmentation: An optimization approach for high quality multi-scale image segmentation. ISPRS J. Photogramm. 2000, 58, 12-23.
9. Nuebert, M.; Herold, H.; Meinel, G. Assessing Image Segmentation Quality: Concepts, Methods and Application. In Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications; Chapter 8.3; Blaschke, T., Lang, S., Hay, G.J., Eds.; Springer-Verlag: New York, NY, USA, 2008; pp. 769-784.
10. Sonka, M.; Hlavac, V.; Boyle, R. Image Processing, Analysis and Machine Vision; Chapman & Hall: London, UK, 1994.
11. Capurro, R.; HjØrland, B. The concept of information. Annu. Rev. Inform. Sci. Technol. 2003, 37, 343-411.
12. Capurro, R. Hermeneutics and the Phenomenon of Information. In Metaphysics, Epistemology, and Technology: Research in Philosophy and Technology; JAI/Elsevier: Amsterdam, The Netherlands, 2000; Volume 19, pp. 79-85.
13. Shannon, C. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379-423, 623-656.
14. Marr, D. Vision; Freeman and C: New York, NY, USA, 1982.
15. Baraldi, A. Vision Goes Symbolic without Loss of Information within the Preattentive Vision Phase: The Need to Shift the Learning Paradigm from Machine-Learning (from Examples) to Machine-Teaching (by Rules) at the First Stage of a Three-Stage Hybrid Remote Sensing Image Understanding System-Part I and Part II. In Earth Observation; InTech Open Access Publisher: Rijeka, Croatia, 2012; pp. 63-136.
16. Baraldi, A. Impact of radiometric calibration and specifications of spaceborne optical imaging sensors on the development of operational automatic remote sensing image understanding systems. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2009, 2, 104-134.
17. Baraldi, A.; Puzzolo, V.; Blonda, P.; Bruzzone, L.; Tarantino, C. Automatic spectral rule-based preliminary mapping of calibrated Landsat TM and ETM+ images. IEEE Trans. Geosci. Remote Sens. 2006, 44, 2563-2586.
18. Baraldi, A.; Durieux, L.; Simonetti, D.; Conchedda, G.; Holecz, F.; Blonda, P. Automatic spectral rule-based preliminary classification of radiometrically calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye and DMC/SPOT-1/-2 imagery-Part I: System design and implementation. IEEE Trans. Geosci. Remote Sens. 2010, 48, 1299-1325.
19. Baraldi, A.; Durieux, L.; Simonetti, D.; Conchedda, G.; Holecz, F.; Blonda, P. Automatic spectral rule-based preliminary classification of radiometrically calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye and DMC/SPOT-1/-2 imagery-Part II: Classification accuracy assessment. IEEE Trans. Geosci. Remote Sens. 2010, 48, 1326-1354.
20. Baraldi, A.; Gironda, M.; Simonetti, D. Operational two-stage stratified topographic correction of spaceborne multi-spectral imagery employing an automatic spectral rule-based decision-tree preliminary classifier. IEEE Trans. Geosci. Remote Sens. 2010, 48, 112-146.
21. Baraldi, A.; Wassenaar, T.; Kay, S. Operational performance of an automatic preliminary spectral rule-based decision-tree classifier of spaceborne very high resolution optical images. IEEE Trans. Geosci. Remote Sens. 2010, 48, 3482-3502.
22. Baraldi, A. Fuzzification of a crisp near-real-time operational automatic spectral-rule-based decision-tree preliminary classifier of multisource multispectral remotely sensed images. IEEE Trans. Geosci. Remote Sens. 2011, 49, 2113-2134.
23. ™)-A turnkey software button for automatic near-real-time multi-sensor multi-resolution spectral rule-based preliminary classification of spaceborne multi-spectral images. Recent Patents Space Tech. 2011, 1, 81-106.
24. Baraldi, A.; Bruzzone, L.; Blonda, P. Quality assessment of classification and cluster maps without ground truth knowledge. IEEE Trans. Geosci. Remote Sens. 2005, 43, 857-873.
25. Matsuyama, T.; Hwang, V.S. SIGMA: A Knowledge-Based Aerial Image Understanding System; Plenum Press: New York, NY, USA, 1990.
26. Pakzad, K.; Bückner, J.; Growe, S. Knowledge Based Moorland Interpretation Using a Hybrid System for Image Analysis. In Proceedings of ISPRS WG III/ 2 & 3 Workshop "Automatic Objects from Digital Imagery", Munich, Germany, 8-10 September 1999. Available online: http://www.tnt.uni-hannover.de/papers/view.php?ind=1999&ord=Authors&mod=ASC (accessed on 10 January 2012).
27. Growe, S. Knowledge based interpretation of multisensor and multitemporal remote sensing images. Int. Arch. Photogramm. Remote Sens. 1999, 32, Part 7-4-3 W6, 130-138.
28. Shackelford, A.K.; Davis, C.H. A hierarchical fuzzy classification approach for high-resolution multispectral data over urban areas. IEEE Trans. Geosci. Remote Sens. 2003, 41, 1920-1932.
29. Shackelford, A.K.; Davis, C.H. A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas. IEEE Trans. Geosci. Remote Sens. 2003, 41, 2354-2363.
30. Shackelford, A.K. Development of Urban Area Geospatial Information Products from High Resolution Satellite Imagery Using Advanced Image Analysis Techniques. Ph.D. Dissertation, University of Missouri, Colombia, MO, USA, 2004.
31. Nagao, M.; Matsuyama, T. A Structural Analysis of Complex Aerial Photographs; Plenum Press: New York, NY, USA, 1980.
32. Lang, S. Object-Based Image Analysis for Remote Sensing Applications: Modeling Reality: Dealing with Complexity. In Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications; Chapter 1.1; Blaschke, T., Lang, S., Hay, G.J., Eds.; Springer-Verlag: New York, NY, USA, 2008; pp. 3-27.
33. Hay, G.J.; Castilla, G. Object-Based Image Analysis: Strengths, Weaknesses, Opportunities and Threats (SWOT). In Proceedings of 1st International Conference on Object-Based Image Analysis (OBIA), Salzburg, Austria, 4-5 July 2006. Available online: www.commission4.isprs.org/obia06/ Papers/01_Opening%20Session/OBIA2006_Hay_Castilla.pdf (accessed on 10 January 2012).
34. Hay, G.J.; Castilla, G. Geographic Object-Based Image Analysis (GEOBIA): A New Name for a New Discipline. In Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications; Chapter 1.4; Blaschke, T., Lang, S., Hay, G.J., Eds.; Springer-Verlag: New York, NY, USA, 2008; pp. 81-92.
35. Richter, R.; Schlapfer, D. Atmospheric/Topographic Correction for Satellite Imagery: ATCOR-2/3 User Guide; Version 8.0.2; ReSe: Wil, Switzerland, August 2011. Available online: http://www.rese.ch/pdf/atcor3_manual.pdf (accessed on 10 January 2012).
36. Richter, R.; Schlapfer, D. Atmospheric/Topographic Correction for Airborne Imagery: ATCOR-4 User Guide; Version 6.2 BETA, ReSe: Wil, Switzerland, February 2012. Available online: http://www.dlr.de/eoc/Portaldata/60/Resources/dokumente/5_tech_mod/atcor4_manual_2012.pdf (accessed on 10 January 2012).
37. Dorigo, W.; Richter, R.; Baret, F.; Bamler, R.; Wagner, W. Enhanced automated canopy characterization from hyperspectral data by a novel two step radiative transfer model inversion approach. Remote Sens. 2009, 1, 1139-1170.
38. Schlapfer, D.; Richter, R.; Hueni, A. Recent Developments in Operational Atmospheric and Radiometric Correction of Hyperspectral Imagery. In Proceedings of 6th EARSeL SIG IS Workshop, Tel Aviv, Israel, 16-19 March 2009. Available online: http://www.earsel6th.tau.ac.il/~earsel6/CD/PDF/earsel-PROCEEDINGS/3054%20Schl%20pfer.pdf (accessed on 14 July 2012).
39. Kathryn, M.; Korenberg, M. On the use of separable Volterra networks to model discrete-time Volterra systems. IEEE Trans. Geosci. Remote Sens. 2001, 12, 174-175.
40. Page-Jones, M. The Practical Guide to Structured Systems Design; Prentice-Hall: Englewood Cliffs, NJ, USA, 1988.
41. Schaepman-Strub, G.; Schaepman, M.E.;Painter, T.H.; Dangel, S.; Martonchik, J.V. Reflectance quantities in optical remote sensing-Definitions and case studies. Remote Sens. Environ. 2006, 103, 27-42.
42. Chavez, P.S. An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data. Remote Sens. Environ. 1988, 24, 459-479.
43. Stehman, S.V.; Czaplewski, R.L. Design and analysis for thematic map accuracy assessment: Fundamental principles. Remote Sens. Environ. 1998, 64, 331-344.
44. Stratified Sampling. Available online: http://nestor.coventry.ac.uk/~nhunt/meths/strati.html (accessed on 11 September 2012).
45. Mather, P. Computer Processing of Remotely-Sensed Images: An Introduction; John Wiley & Sons: Chichester, UK, 1994.
46. Bishop, C.M. Neural Networks for Pattern Recognition; Clarendon Press: Oxford, UK, 1995.
47. Crocetto, N.; Tarantino, E. A class-oriented strategy for features extraction from multidate ASTER imagery. Remote Sens. 2009, 1, 1171-1189.
48. Bishop, M.P.; Colby, J.D. Anisotropic reflectance correction of SPOT-3 HRV imagery. Int. J. Remote Sens. 2002, 23, 2125-2131.
49. Bishop, M.P.; Shroder, J.F.; Colby, J.D. Remote sensing and geomorphometry for studying relief production in high mountains. Geomorphology 2003, 55, 345-361.
50. Netanyahu, N.; Le Moigne, J.; Masek, J.G. Georegistration of Landsat data via robust matching of multiresolution features. IEEE Trans. Geosci. Remote Sens. 2004, 42, 1586-1600.
51. Baraldi, A.; Parmiggiani, F. Combined detection of intensity and chromatic contours in color images. Opt. Eng. 1996, 35, 1413-1439.
52. Pesaresi, M.; Benediktsson, J.A. A new approach for the morphological segmentation of high-resolution satellite imagery. IEEE Trans. Geosci. Remote Sens. 2001, 39, 309-320.
53. Cherkassky, V.; Mulier, F. Learning from Data: Concepts, Theory, and Methods; Wiley: New York, NY, USA, 1998.
54. Liang, S. Quantitative Remote Sensing of Land Surfaces; John Wiley and Sons: Hoboken, NJ, USA, 2004.
55. Ruiz, L.A.; Recio, J.A.; Fernández-Sarría, A.; Hermosilla, T. A feature extraction software tool for agricultural object-based image analysis. Comput. Electron. Agr. 2011, 76, 284-296.
56. Trias-Sanz, R. Texture orientation and period estimator for discriminating between forests, orchards, vineyards, and tilled fields. IEEE Trans. Geosci. Remote Sens. 2006, 44, 2755-2760.
57. Corcoran, P.; Winstanley, A. Using Texture to Tackle the Problem of Scale in Landcover Classification. In Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications; Blaschke, T., Lang, S., Hay, G.J., Eds.; Springer-Verlag: New York, NY, USA, 2008; pp. 113-132.
58. Petrou, M.; Sevilla, P. Image Processing: Dealing with Texture; John Wiley & Sons: Chichester, UK, 2006.
59. Goodchild, M.F.; Yuan, M.; Cova, T.J. Towards a general theory of geographic representation in GIS. Int. J. Geogr. Inf. Sci. 2007, 21, 239-260.
60. Conrad, C.; Fritsch, S.; Zeidler, J.; Rücker, G.; Dech, S. Per-field irrigated crop classification in arid Central Asia using SPOT and ASTER data. Remote Sens. 2010, 2, 1035-1056.
61. Gibbes, C.; Adhikari, S.; Rostant, L.; Southworth, J.; Qiu, Y. Application of object based classification and high resolution satellite imagery for savanna ecosystem analysis. Remote Sens. 2010, 2, 2748-2772.
62. Heumann, B.W. An object-based classification of mangroves using a hybrid decision tree-Support Vector Machine approach. Remote Sens. 2011, 3, 2440-2460.
63. Kamal, M.; Phinn, S. Hyperspectral data for mangrove species mapping: A comparison of pixel-based and object-based approach. Remote Sens. 2011, 3, 2222-2242.
64. Wang, F. Fuzzy supervised classification of remote sensing images. IEEE Trans. Geosci. Remote Sens. 1990, 28, 194-201.
65. Congalton, R.G.; Green, K. Assessing the Accuracy of Remotely Sensed Data; Lewis Publishers: Boca Raton, FL, USA, 1999.
66. Swain, P.H.; Davis, S.M. Remote Sensing: The Quantitative Approach; McGraw Hill: New York, NY, USA, 1978.
67. Cootes, T.F.; Taylor, C.J. Statistical Models of Appearance for Computer Vision; Imaging Science and Biomedical Engineering, University of Manchester, Manchester, UK, 2004. Available online: www.isbe.man.ac.uk/~bim/Models/app_model.ps.gz (accessed on 10 January 2012).
68. GEO. GEO 2007-2009 Work Plan: Toward Convergence; 2008. Available online: http://earthobservations.org (accessed on 10 January 2012).
69. GEO. The Global Earth Observation System of Systems (GEOSS) 10-Year Implementation Plan; 2005. Available online: http://www.earthobservations.org/docs/10-Year%20Implementation%20 Plan.pdf (accessed on 10 January 2012).
70. EU Landslide Early Warning Integrated Project: LEWIS-EVG1-CT-2001-00055. Deliverable N. 20, Last Version; Report on Software Package for Warning Map Production; 28 June 2005.
71. Zadeh, L.A. Fuzzy sets. Inform. Control 1965, 8, 338-353.
72. Kosko, B. Fuzzy Thinking; Flamingo: London, UK, 1994.
73. Yuan, H.; Van Der Wiele, C.F.; Khorram, S. An automated artificial neural network system for land use/land cover classification from Landsat TM imagery. Remote Sens. 2009, 1, 243-265.
74. Elmahboub, W.; Scarpace, F.; Smith, B. A highly accurate classification of TM data through correction of atmospheric effects. Remote Sens. 2009, 1, 278-299.
75. Potter, J.F. Haze and sun effects on automatic classification of satellite data-Simulation and correction in scanners and imagery systems for Earth observation. Proc. SPIE 1974, 51, 73-83.
76. Shorter, N.; Kasparis, T. Automatic vegetation identification and building detection from a single nadir aerial image. Remote Sens. 2009, 1, 731-757.
77. Baraldi, A.; Boschetti, L. Fine Resolution Automated Mapping. In Proceedings of Land Cover and Land Use Change (LCLUC) Science Team Meeting, Alexandria, VA, USA, 6 October 2011.
78. Kleyn, L.; Mangara, P.; Remas, H. Implementation of Automatic Spectral Rule-Based Preliminary Mapping for Enhanced Object-Based Classification of South African Land Cover Classes. In Proceedings of AfricaGEO Conference, Cape Town, South Africa, 31 May-2 June 2011; Paper ID 57.
79. Web-Enabled Landsat data (WELD) Project. Available online: http://landsat.usgs.gov/WELD.php (accessed on 11 September 2012).
80. National Land Cover Data (NLCD 2006). 2006. Available online: http://www.epa.gov/mrlc/ nlcd-2006.html (accessed on 11 September 2012).
81. ™) from the Web-Enabled Landsat Data set (WELD) at the US scale. Remote Sens. Environ. 2012, in preparation.
82. ™) and Spectral Classification (SPECL) software products. Remote Sens. 2012, in preparation.
83. Meteosat Second Generation. Available online: http://www.eumetsat.int/Home/Main/Satellites/ MeteosatSecondGeneration/index.htm (accessed on 11 September 2012).
84. Navulur, K. Multispectral Image Analysis Using the Object-Oriented Paradigm; CRC Press: Boca Raton, FL, USA, 2007.
85. Pao, Y. Adaptive Pattern Recognition and Neural Networks; Addison-Wesley: Reading, MA, USA, 1989.
86. Jain, A.; Healey, G. A multiscale representation including opponent color features for texture recognition. IEEE Trans. Image Process. 1998, 7, 124-128.
87. Jain, A.; Farrokhnia F.; Unsupervised texture segmentation using Gabor filters. Pattern Recog. 1991, 24, 1167-1186.
88. Bandos, T.V.; Bruzzone, L.; Camps-Valls, G. Classification of hyperspectral images with regularized linear discriminant analysis. IEEE Trans. Geosci. Remote Sens. 2009, 47, 862-873.
89. Huang, C.; Song, K.; Kim, S.; Townshend, J.R.G.; Davis, P.; Masek, J.G.; Goward, S.N. Use of a dark object concept and support vector machines to automate forest cover change analysis. Remote Sens. Environ. 2008, 112, 970-985.
90. Hansen, M.C.; Roy, D.P.; Lindquist, E.; Adusei, B.; Justice, C.O.; Altstatt, A. A method for integrating MODIS and Landsat data for systematic monitoring of forest cover and change in the Congo Basin. Remote Sens. Environ. 2008, 112, 2495-2513.
91. GMES. Available online: http://www.gmes.info (accessed on 10 January 2012).
92. Shyu, C.-R.; Klaric, M.; Scott, G.J.; Barb, A.S.; Davis, C.H.; Palaniappan, K. GeoIRIS: Geospatial Information Retrieval and Indexing System-Content mining, semantics modeling, and complex queries. IEEE Trans. Geosci. Remote Sens. 2007, 45, 839-852.
93. Mantovani, S.; Natali, S.; Baraldi, A. Soil Mapper® Multi-Sensor and Multi-Temporal Applications for Semantic-Based Image Information Mining. In Geoscience Visual Analytics, NATO Science for Peace and Security Series C: Environmental Security; Springer: Dordrecht, The Netherlands 2009; Part 3, pp. 167-176.
94. Zhou, G.; Kafatos, M. Future Intelligent Earth Observing Satellites (FIEOS). In Proceedings of ISPRS Comission I Mid-Term Symposium in Conjunction with Pecora 15/Land Satellite Information IV Conference, Denver, CO, USA, 10-15 November 2002. Available online: http://www.isprs.org/commission1/proceedings02/paper/00031.pdf (accessed on 10 January 2012).