Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 86, Issue , 2013, Pages 21-40

  Ok, Ali Ozgun ^a  

^a MERSIN UNIVERSITY   (Turkey)

Author keywords

Building detection; Graph cuts; Satellite imagery; Shadow evidence

Indexed keywords

GRAPH THEORY; GRAPHIC METHODS; ITERATIVE METHODS; SATELLITE IMAGERY;

AUTOMATED DETECTION; BUILDING DETECTION; BUILDING REGIONS; GRAPH CUT; MULTISPECTRAL IMAGES; NOVEL METHODOLOGY; SHADOW EVIDENCE; SPATIAL RELATIONSHIPS;

BUILDINGS;

AUTOMATION; BUILDING; DETECTION METHOD; GEOEYE-1; NUMERICAL MODEL; OPTIMIZATION; PROBABILITY; SATELLITE IMAGERY; SPECTRAL ANALYSIS;

EID: 84884735033     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2013.09.004     Document Type: Article

References (90)

1. Adeline K.R.M., Chen M., Briottet X., Pang S.K., Paparoditis N. Shadow detection in very high spatial resolution aerial images: a comparative study. ISPRS Journal of Photogrammetry and Remote Sensing 2013, 80:21-38.
2. Ahmadi S., Zoej M.J.V., Ebadi H., Moghaddam H.A., Mohammadzadeh A. Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours. International Journal of Applied Earth Observation and Geoinformation 2010, 12(3):150-157.
3. Akçay, H.G., Aksoy, S., 2010. Building detection using directional spatial constraints. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 1932-1935.
4. Aksoy S., Yalniz I.Z., Tasdemir K. Automatic detection and segmentation of orchards using very high resolution imagery. IEEE Transactions on Geoscience and Remote Sensing 2012, 50(8):3117-3131.
5. Awrangjeb M., Ravanbakhsh M., Fraser C.S. Automatic detection of residential buildings using LIDAR data and multispectral imagery. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(5):457-467.
6. Baillard C., Maitre H. 3-D reconstruction of urban scenes from aerial stereo imagery: a focusing strategy. Computer Vision and Image Understanding 1999, 76(3):244-258.
7. Baillard C., Dissard O., Jamet O., Maître H. Extraction and textural characterization of above-ground areas from aerial stereo pairs: a quality assessment. ISPRS Journal of Photogrammetry and Remote Sensing 1998, 53(2):130-141.
8. Baltsavias E.P. Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems. ISPRS Journal of Photogrammetry and Remote Sensing 2004, 58(3-4):129-151.
9. Benediktsson J.A., Pesaresi M., Arnason K. Classification and feature extraction for remote sensing images from urban areas based on morphological transformations. IEEE Transactions on Geoscience and Remote Sensing 2003, 41(9):1940-1949.
10. Bouziani M., Goita K., He D.-C. Rule-based classification of a very high resolution image in an urban environment using multispectral segmentation guided by cartographic data. IEEE Transactions on Geoscience and Remote Sensing 2010, 48(8):3198-3211.
11. Boykov Y., Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004, 26(9):1124-1137.
12. Boykov Y., Veksler O., Zabih R. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001, 23(11):1222-1239.
13. Brenner C. Building reconstruction from images and laser scanning. International Journal of Applied Earth Observation and Geoinformation 2005, 6(3-4):187-198.
14. Bresenham J.E. Algorithm for computer control of a digital plotter. IBM Systems Journal 1965, 4(1):25-30.
15. Cao G., Yang X. Man-made object detection in aerial images using multi-stage level set evolution. International Journal of Remote Sensing 2007, 28(8):1747-1757.
16. Chung K.-L., Lin Y.-R., Huang Y.-H. Efficient shadow detection of colour aerial images based on successive thresholding scheme. IEEE Transactions on Geoscience and Remote Sensing 2009, 47(2):671-682.
17. Collins R.T., Jaynes C.O., Cheng Y.-Q., Wang X., Stolle F., Riseman E.M., Hanson A.R. The ascender system: automated site modeling from multiple aerial images. Computer Vision and Image Understanding 1998, 72(2):143-162.
18. Cord M., Declercq D. Three-dimensional building detection and modeling using a statistical approach. IEEE Transactions on Image Processing 2001, 10(5):715-723.
19. Cord M., Jordan M., Cocquerez J.-P. Accurate building structure recovery from high resolution aerial imagery. Computer Vision and Image Understanding 2001, 82(2):138-173.
20. Croitoru A., Doytsher Y. Monocular right-angle building hypothesis generation in regularized urban areas by pose clustering. Photogrammetric Engineering and Remote Sensing 2003, 69(2):151-169.
21. Cui, S., Yan, Q., Reinartz, P., 2011. Graph search and its application in building extraction from high resolution remote sensing imagery, Search Algorithms and Applications. Nashat Mansour (Ed.), InTech.
22. Fischer A., Kolbe T.H., Lang F., Cremers A.B., Förstner W., Plümer L., Steinhage V. Extracting buildings from aerial images using hierarchical aggregation in 2D and 3D. Computer Vision and Image Understanding 1998, 72(2):185-203.
23. Fradkin M., Maitre H., Roux M. Building detection from multiple aerial images in dense urban areas. Computer Vision and Image Understanding 2001, 82(3):181-207.
24. Gevers T., Smeulders A.W.M. Color-based object recognition. Pattern Recognition 1999, 32(3):453-464.
25. Haala N., Brenner C. Interpretation of urban surface models using 2d building information. Computer Vision and Image Understanding 1998, 72(2):204-214.
26. Haala N., Brenner C. Virtual city models from laser altimeter and 2d map data. Photogrammetric Engineering and Remote Sensing 1999, 65(7):787-795.
27. Haala N., Kada M. An update on automatic 3D building reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(6):570-580.
28. Hermosilla T., Ruiz L.A., Recio J.A., Estornell J. Evaluation of automatic building detection approaches combining high resolution images and LIDAR data. Remote Sensing 2011, 3(12):1188-1210.
29. Hongjian Y., Shiqiang Z. 3D building reconstruction from aerial CCD image and sparse laser sample data. Optics and Lasers in Engineering 2006, 44(6):555-566.
30. Huertas A., Nevatia R. Detecting buildings in aerial images. Computer Vision, Graphics, and Image Processing 1988, 41(2):131-152.
31. Inglada J. Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features. ISPRS Journal of Photogrammetry and Remote Sensing 2007, 62(3):236-248.
32. Irvin R.B., McKeown D.M. Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Transactions on Systems, Man, and Cybernetics 1989, 19(6):1564-1575.
33. Izadi M., Saeedi P. Three-dimensional polygonal building model estimation from single satellite images. IEEE Transactions on Geoscience and Remote Sensing 2012, 50(6):2254-2272.
34. Jaynes C., Riseman E., Hanson A. Recognition and reconstruction of buildings from multiple aerial images. Computer Vision and Image Understanding 2003, 90(1):68-98.
35. Karantzalos K., Paragios N. Recognition-driven two-dimensional competing priors toward automatic and accurate building detection. IEEE Transactions on Geoscience and Remote Sensing 2009, 47(1):133-144.
36. Katartzis A., Sahli H. A stochastic framework for the identification of building rooftops using a single remote sensing image. IEEE Transactions on Geoscience and Remote Sensing 2008, 46(1):259-271.
37. Khoshelham K., Nardinocchi C., Frontoni E., Mancini A., Zingaretti P. Performance evaluation of automated approaches to building detection in multi-source aerial data. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(1):123-133.
38. Kim T., Muller J.-P. A technique for 3D building reconstruction. Photogrammetric Engineering and Remote Sensing 1998, 64(9):923-930.
39. Kim T.J., Muller J.P. Development of a graph-based approach for building detection. Image and Vision Computing 1999, 17(1):3-14.
40. Kim Z., Nevatia R. Automatic description of complex buildings from multiple images. Computer Vision and Image Understanding 2004, 96(1):60-95.
41. Koc-San D., Turker M. A model-based approach for automatic building database updating from high-resolution space imagery. International Journal of Remote Sensing 2012, 33(13):4193-4218.
42. Kolmogorov V., Zabih R. What energy functions can be minimized via graph cuts?. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004, 26(2):147-159.
43. Krishnamachari S., Chellappa R. Delineating buildings by grouping lines with MRFs. IEEE Transactions on Image Processing 1996, 5(1):164-168.
44. Lafarge F., Descombes X., Zerubia J., Pierrot-Deseilligny M. Automatic building extraction from DEMs using an object approach and application to the 3D-city modeling. ISPRS Journal of Photogrammetry and Remote Sensing 2008, 63(3):365-381.
45. Lee D.S., Shan J., Bethel J.S. Class-guided building extraction from Ikonos imagery. Photogrammetric Engineering and Remote Sensing 2003, 69(2):143-150.
46. Lin C., Nevatia R. Building detection and description from a single intensity image. Computer Vision and Image Understanding 1998, 72(2):101-121.
47. Liow Y.T., Pavlidis T. Use of shadows for extracting buildings in aerial images. Computer Vision, Graphics, and Image Processing 1990, 49(2):242-277.
48. Mayer H. Automatic object extraction from aerial imagery-a survey focusing on buildings. Computer Vision and Image Understanding 1999, 74(2):138-149.
49. McGlone, J.C., Shufelt, J.A., 1994. Projective and object space geometry for monocular building extraction. In: Proc. of Computer Vision and Pattern Recognition, pp. 54-61.
50. McKeown D.M., Cochran S.D., Ford S.J., McGlone J.C., Shufelt J.A., Yocum D.A. Fusion of HYDICE hyperspectral data with panchromatic imagery for cartographic feature extraction. IEEE Transactions on Geoscience and Remote Sensing 1999, 37(3):1261-1277.
51. McLachlan G.J., Peel D. Finite mixture models 2000, Wiley, New York.
52. Mohan R., Nevatia R. Using perceptual organization to extract 3D structures. IEEE Transactions on Pattern Analysis and Machine Intelligence 1989, 11(11):1121-1139.
53. Noronha S., Nevatia R. Detection and modeling of buildings from multiple aerial images. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001, 23(5):501-518.
54. Ok A.O., Senaras C., Yuksel B. Automated detection of arbitrarily shaped buildings in complex environments from monocular VHR optical satellite imagery. IEEE Transactions on Geoscience and Remote Sensing 2013, 51(3):1701-1717.
55. Otsu N. A threshold selection method from gray-level histograms. Automatica 1975, 11:285-296.
56. Paparoditis N., Cord M., Jordan M., Cocquerez J.P. Building detection and reconstruction from mid- and high-resolution aerial imagery. Computer Vision and Image Understanding 1998, 72(2):122-142.
57. Peng J., Liu Y.C. Model and context-driven building extraction in dense urban aerial images. International Journal of Remote Sensing 2005, 26(7):1289-1307.
58. Peng J., Zhang D., Liu Y.C. An improved snake model for building detection from urban aerial images. Pattern Recognition Letters 2005, 26(5):587-595.
59. Pesaresi M., Benediktsson J.A. A new approach for the morphological segmentation of high-resolution satellite imagery. IEEE Transactions on Geoscience and Remote Sensing 2001, 39(2):309-320.
60. Polidorio, A.M., Flores, F.C., Imai, N.N., Tommaselli, A.M.G., Franco, C., 2003. Automatic shadow segmentation in aerial colour images, XVI Brazilian Symposium on Computer Graphics and Image Processing, pp. 270-277.
61. Poulain V., Inglada J., Spigai M., Tourneret J.-Y., Marthon P. High-resolution optical and sar image fusion for building database updating. IEEE Transactions on Geoscience and Remote Sensing 2011, 49(8):2900-2910.
62. Rother C., Kolmogorov V., Blake A. Grabcut: interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 2004, 23(3):309-314.
63. Rottensteiner F., Trinder J., Clode S., Kubik K. Building detection by fusion of airborne laser scanner data and multi-spectral images: performance evaluation and sensitivity analysis. ISPRS Journal of Photogrammetry and Remote Sensing 2007, 62(2):135-149.
64. Rüther H., Martine H.M., Mtalo E.G. Application of snakes and dynamic programming optimisation technique in modeling of buildings in informal settlement areas. ISPRS Journal of Photogrammetry and Remote Sensing 2002, 56(4):269-282.
65. Sarabandi, P., Yamazaki, F., Matsuoka, M., Kiremidjian, A., 2004. Shadow detection and radiometric restoration in satellite high resolution images. In: IEEE International Geoscience and Remote Sensing, Symposium, pp. 3744-3747.
66. Schindler K. An overview and comparison of smooth labeling methods for land-cover classification. IEEE Transactions on Geoscience and Remote Sensing 2012, 50(11):4534-4545.
67. Senaras C., Özay M., Vural F.Y. Building detection with decision fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2013, 6(3):1295-1304.
68. Shackelford A.K., Davis C.H. A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas. IEEE Transactions on Geoscience and Remote Sensing 2003, 41(10):2354-2363.
69. Shufelt, J.A., 1996. Exploiting photogrammetric methods for building extraction in aerial images. International Archives of Photogrammetry and Remote Sensing 31 (Part B6), pp. 74-79.
70. Shufelt J.A. Performance evaluation and analysis of monocular building extraction from aerial imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999, 21(4):311-326.
71. Shufelt J.A., McKeown D.M. Fusion of monocular cues to detect man-made structures in aerial imagery. CVGIP-Image Understanding 1993, 57(3):307-330.
72. Sirmacek B., Unsalan C. Urban-area and building detection using SIFT keypoints and graph theory. IEEE Transactions on Geoscience and Remote Sensing 2009, 47(4):1156-1167.
73. Sohn G., Dowman I. Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction. ISPRS Journal of Photogrammetry and Remote Sensing 2007, 62(1):43-63.
74. Stassopoulou A., Caelli T. Building detection using bayesian networks. International Journal of Pattern Recognition and Artificial Intelligence 2000, 14(6):715-733.
75. Sümer E., Turker M. An adaptive fuzzy-genetic algorithm approach for building detection using high-resolution satellite images. Computers, Environment and Urban Systems 2013, 39:48-62.
76. Suveg I., Vosselman G. Reconstruction of 3D building models from aerial images and maps. ISPRS Journal of Photogrammetry and Remote Sensing 2004, 58(3-4):202-224.
77. Tack F., Buyuksalih G., Goossens R. 3D building reconstruction based on given ground plan information and surface models extracted from spaceborne imagery. ISPRS Journal of Photogrammetry and Remote Sensing 2012, 67:52-64.
78. Teke M., Başeski E., Ok A.Ö., Yüksel B., Şenaras Ç. Multi-spectral false colour shadow detection. Photogrammetric Image Analysis 2011, 109-119. Springer, Berlin Heidelberg, Berlin, Heidelberg. U. Stilla, F. Rottensteiner, H. Mayer, B. Jutzi, M. Butenuth (Eds.).
79. Tournaire O., Brédif M., Boldo D., Durupt M. An efficient stochastic approach for building footprint extraction from digital elevation models. ISPRS Journal of Photogrammetry and Remote Sensing 2010, 65(4):317-327.
80. Tsai V.J.D. A comparative study on shadow compensation of colour aerial images in invariant colour models. IEEE Transactions on Geoscience and Remote Sensing 2006, 44(6):1661-1671.
81. Tupin F., Roux M. Detection of building outlines based on the fusion of SAR and optical features. ISPRS Journal of Photogrammetry and Remote Sensing 2003, 58(1-2):71-82.
82. Turker M., San B.T. Detection of collapsed buildings caused by the 1999 Izmit, Turkey earthquake through digital analysis of post-event aerial photographs. International Journal of Remote Sensing 2004, 25(21):4701-4714.
83. Ünsalan C., Boyer K.L. A system to detect houses and residential street networks in multispectral satellite images. Computer Vision and Image Understanding 2005, 98(3):423-461.
84. Vallet B., Pierrot-Deseilligny M., Boldo D., Brédif M. Building footprint database improvement for 3D reconstruction: a split and merge approach and its evaluation. ISPRS Journal of Photogrammetry and Remote Sensing 2011, 66(5):732-742.
85. Vestri C. Using range data in automatic modeling of buildings. Image and Vision Computing 2006, 24(7):709-719.
86. Wegner J.D., Hansch R., Thiele A., Soergel U. Building detection from one orthophoto and high-resolution InSAR data using conditional random fields. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2011, 4(1):83-91.
87. Wegner, J.D., Soergel, U., Rosenhahn, B., 2011b. Segment-based building detection with conditional random fields, In: Stilla, U., Gamba, P., Juergens, C., Maktav, D. (Eds.). Proceedings of 6th IEEE/GRSS/ISPRS Joint Urban Remote Sensing Event, pp. 205-208.
88. Weidner U., Förstner W. Towards automatic building extraction from high-resolution digital elevation models. ISPRS Journal of Photogrammetry and Remote Sensing 1995, 50(4):38-49.
89. Xiao J., Gerke M., Vosselman G. Building extraction from oblique airborne imagery based on robust façade detection. ISPRS Journal of Photogrammetry and Remote Sensing 2012, 68:56-68.
90. Zhang Y. Optimisation of building detection in satellite images by combining multispectral classification and texture filtering. ISPRS Journal of Photogrammetry and Remote Sensing 1999, 54(1):50-60.