Robust rooftop extraction from visible band images using higher order CRF

IEEE Transactions on Geoscience and Remote Sensing

Volumn 53, Issue 8, 2015, Pages 4483-4495

  Li, Er ^a   Femiani, John ^a   Xu, Shibiao ^b   Zhang, Xiaopeng ^b   Wonka, Peter ^c,d  

^a ARIZONA STATE UNIVERSITY   (United States)

^b INSTITUTE OF AUTOMATION   (China)

^c Arizona State University   (United States)

^d KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

Author keywords

Buildings; rooftops conditional random field (CRF); shadows

Indexed keywords

BUILDINGS; EXTRACTION; PIXELS; RANDOM PROCESSES;

BUILDING EXTRACTION; COMPLEX STRUCTURE; CONDITIONAL RANDOM FIELD; HIGHER ORDER POTENTIALS; PRE-SEGMENTATION; SHADOWS; SHAPE FEATURES; STATE-OF-THE-ART METHODS;

IMAGE PROCESSING;

CLASSIFICATION; COMPARATIVE STUDY; EXPERIMENTAL STUDY; EXTRACTION METHOD; IMAGING METHOD; PIXEL;

EID: 85027931830     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2015.2400462     Document Type: Article

References (38)

1. A. O. Ok, "Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts," ISPRS J. Photogramm. Remote Sens., vol. 86, pp. 21-40, Dec. 2013.
2. C. Brenner, "Building reconstruction from images and laser scanning," Int. J. Appl. Earth Observ. Geoinf., vol. 6, no. 3/4, pp. 187-198, Mar. 2005.
3. C. Ünsalan and K. L. Boyer, "A system to detect houses and residential street networks in multispectral satellite images," Comput. Vis. Image Understand., vol. 98, no. 3, pp. 423-461, Jun. 2005.
4. Z. Liu, J. Wang, and W. P. Liu, "Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform," in Proc. IEEE IGARSS, Jul. 2005, vol. 4, pp. 2250-2253.
5. S. Cui, Q. Yan, and P. Reinartz, "Graph search and its application in building extraction from high resolution remote sensing imagery," in Search Algorithms and Applications. Shanghai, China: InTech, 2011.
6. Z. Liu, S. Cui, and Q. Yan, "Building extraction from high resolution satellite imagery based on multi-scale image segmentation and model matching," in Proc. Int. Workshop EORSA, Jun. 2008, pp. 1-7.
7. D. Marr, "Early processing of visual information," Philos. Trans. Roy. Soc. London B, Biol. Sci., vol. 275, no. 942, pp. 483-519, Oct. 1976.
8. X. Ren and J. Malik, "Learning a classification model for segmentation," in Proc. 9th IEEE Int. Conf. Comput. Vis., 2003, pp. 10-17.
9. H. Akcay and S. Aksoy, "Building detection using directional spatial constraints," in Proc. IEEE IGARSS, 2010, pp. 1932-1935.
10. A. Ok, C. Senaras, and B. Yuksel, "Automated detection of arbitrarily shaped buildings in complex environments from monocular VHR optical satellite imagery," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 3, pp. 1701-1717, Mar. 2013.
11. M. Cote and P. Saeedi, "Automatic rooftop extraction in nadir aerial imagery of suburban regions using corners and variational level set evolution," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pp. 313-328, Jan. 2013.
12. C. Benedek, X. Descombes, and J. Zerubia, "Building development monitoring in multitemporal remotely sensed image pairs with stochastic birth-death dynamics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 33-50, Jan. 2012.
13. S. Müller and D. W. Zaum, "Robust building detection in aerial images," in Proc. Int. Arch. Photogramm. Remote Sens., 2005, pp. 143-148.
14. L. Martinez Fonte, S. Gautama, W. Philips, and W. Goeman, "Evaluating corner detectors for the extraction of man-made structures in urban areas," in Proc. IEEE IGARSS, 2005, vol. 1-8, pp. 237-240.
15. B. Sirmacek and C. Ünsalan, "Urban-area and building detection using sift keypoints and graph theory," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 4, pp. 1156-1167, Apr. 2009.
16. B. Sirmacek and C. Ünsalan, "A probabilistic framework to detect buildings in aerial and satellite images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 211-221, Jan. 2011.
17. A. Katartzis and H. Sahli, "A stochastic framework for the identification of building rooftops using a single remote sensing image," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 1, pp. 259-271, Jan. 2008.
18. M. S. Nosrati and P. Saeedi, "A novel approach for polygonal rooftop detection in satellite/aerial imageries," in Proc. 16th IEEE Int. Conf. Image Process., 2009, pp. 1689-1692.
19. R. B. Irvin and D. M. McKeown Jr., "Methods for exploiting the relationship between buildings and their shadows in aerial imagery," IEEE Trans. Syst., Man, Cybern., vol. 19, no. 6, pp. 1564-1575, Nov./Dec. 1989.
20. C. Lin, A. Huertas, and R. Nevatia, "Detection of buildings using perceptual grouping and shadows," in Proc. IEEE CVPR, 1994, pp. 62-69.
21. C. Lin and R. Nevatia, "Building detection and description from a single intensity image," Comput. Vis. Image Understand., vol. 72, no. 2, pp. 101-121, Nov. 1998.
22. T. Kim, T. Javzandulam, and T.-Y. Lee, "Semiautomatic reconstruction of building height and footprints from single satellite images," in Proc. IEEE IGARSS, 2007, pp. 4737-4740.
23. T. Kim and J.-P. Muller, "Development of a graph-based approach for building detection," ImageVis.Comput., vol. 17, no. 1, pp. 3-14, Jan. 1999.
24. Y.-T. Liow and T. Pavlidis, "Use of shadows for extracting buildings in aerial images," Comput. Vis. Graph. Image Process., vol. 49, no. 2, pp. 242-277, Feb. 1990.
25. B. Sirmacek and C. Ünsalan, "Building detection from aerial images using invariant color features and shadow information," in Proc. 23rd ISCIS, 2008, pp. 1-5.
26. J. Femiani and E. Li, "Graph cuts to combine multiple sources for feature extraction," in Proc. IMAGE, Dayton, OH, USA, 2014.
27. J. Femiani, E. Li, A. Razdan, and P. Wonka, "Shadow-based rooftop segmentation in visible band images," IEEE Sel. Topics Appl. Earth Observ. Remote Sens., to be published.
28. J. Wegner, U. Soergel, and B. Rosenhahn, "Segment-based building detection with conditional random fields," in Proc. JURSE, Apr. 2011, pp. 205-208.
29. D. Zoran and Y. Weiss, "Natural images, Gaussian mixtures and dead leaves," in Proc. NIPS, 2012, pp. 1745-1753.
30. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive foreground extraction using iterated graph cuts," in ACM Trans. Graph., vol. 23, no. 3, pp. 309-314, Aug. 2004.
31. M. Tkalcic and J. F. Tasic, "Colour spaces: Perceptual, historical and applicational background," in Proc. IEEE EUROCON Comput. Tool Region 8, 2003, vol. 1, pp. 304-308.
32. J. A. Bilmes et al., A Gentle Tutorial of the EM Algorithm and Its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models, vol. 4. Berkeley, CA, USA: International Computer Science Institute, 1998, p. 126.
33. K.-L. Chung, Y.-R. Lin, and Y.-H. Huang, "Efficient shadow detection of color aerial images based on successive thresholding scheme," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 2, pp. 671-682, Feb. 2009.
34. V. J. Tsai, "A comparative study on shadow compensation of color aerial images in invariant color models," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1661-1671, Jun. 2006.
35. N. Shorter and T. Kasparis, "Automatic vegetation identification and building detection from a single nadir aerial image," Remote Sens., vol. 1, no. 4, pp. 731-757, Oct. 2009.
36. M. Chikr El-Mezouar, N. Taleb, K. Kpalma, and J. Ronsin, "Vegetation extraction from IKONOS imagery using high spatial resolution index," J. Appl. Remote Sens., vol. 5, no. 1, 2011, Art. ID. 053543.
37. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary & region segmentation of objects in ND images," in Proc. 8th IEEE ICCV, 2001, vol. 1, pp. 105-112.
38. P. Kohli, L. Ladický, and P. Torr, "Robust higher order potentials for enforcing label consistency," Int. J. Comput. Vis., vol. 82, no. 3, pp. 302-324, May 2009.