Multiscale geoscene segmentation for extracting urban functional zones from VHR satellite images

Remote Sensing

Volumn 10, Issue 2, 2018, Pages

  Zhang, Xiuyuan ^a   Du, Shihong ^a   Wang, Qiao ^b   Zhou, Weiqi ^c  

^a PEKING UNIVERSITY   (China)

^b NANJING INSTITUTE OF ENVIRONMENTAL SCIENCES   (China)

^c RESEARCH CENTER FOR ECO ENVIRONMENTAL SCIENCES   (China)

Author keywords

Functional zone; Multiscale image segmentation; Object based image analysis; Urban landscape; VHR images

Indexed keywords

DEVELOPING COUNTRIES; IMAGE ANALYSIS; IMAGE PROCESSING; URBAN PLANNING;

FUNCTIONAL ZONES; MULTI-SCALE IMAGE SEGMENTATION; OBJECT BASED IMAGE ANALYSIS; URBAN LANDSCAPE; VHR IMAGES;

IMAGE SEGMENTATION;

EID: 85042529151     PISSN: None     EISSN: 20724292     Source Type: Journal    
DOI: 10.3390/rs10020281     Document Type: Article

References (86)

1. Luck, M.;Wu, J. A gradient analysis of urban landscape pattern: A case study from the Phoenix metropolitan region, Arizona, USA. Landsc. Ecol. 2002, 17, 327-339
2. Matsuoka, R.H.; Kaplan, R. People needs in the urban landscape: Analysis of landscape and urban planning contributions. Landsc. Urban Plan. 2008, 84, 7-19. [CrossRef]
3. Yuan, N.J.; Zheng, Y.; Xie, X.; Wang, Y.; Zheng, K.; Xiong, H. Discovering urban functional zones using latent activity trajectories. IEEE Trans. Knowl. Data Eng. 2015, 27, 712-725. [CrossRef]
4. Zhang, X.; Du, S.;Wang, Q. Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data. ISPRS J. Photogramm. 2017, 132, 170-184. [CrossRef]
5. Wu, J.; Hobbs, R.J. (Eds.) Key Topics in Landscape Ecology; Cambridge University Press: New York, NY, USA, 2007, ISBN 13 9780521616447
6. Hu, T.; Yang, J.; Li, X.; Gong, P. Mapping urban land use by using Landsat images and open social data. Remote Sens. 2016, 8, 151. [CrossRef]
7. Cheng, G.; Han, J.; Guo, L.; Liu, Z.; Bu, S.; Ren, J. Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images. IEEE Trans. Geosci. Remote Sens. 2015, 53, 4238-4249. [CrossRef]
8. Zhang, X.; Du, S.; Wang, Y.C. Semantic classification of heterogeneous urban scenes using intrascene feature similarity and interscene semantic dependency. IEEE J. Sel. Top. Appl. 2015, 8, 2005-2014. [CrossRef]
9. Carreira, J.; Caseiro, R.; Batista, J.; Sminchisescu, C. Semantic segmentation with second-order pooling. In Proceedings of the Computer Vision-ECCV, Florence, Italy, 7-13 October 2012; Springer: Berlin/Heidelberg, Germany, 2012; pp. 430-443
10. Hu, F.; Xia, G.S.; Hu, J.; Zhang, L. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sens. 2015, 7, 14680-14707. [CrossRef]
11. Rhinane, H.; Hilali, A.; Berrada, A. Detecting slums from SPOT data in Casablanca Morocco using an object based approach. J. Geogr. Inf. Syst. 2011, 3, 217-224
12. Tang, H.; Maitre, H.; Boujemaa, N.; Jiang, W. On the relevance of linear discriminative features. Inf. Sci. 2010, 180, 3422-3433. [CrossRef]
13. Cheng, G.; Guo, L.; Zhao, T.; Han, J.; Li, H.; Fang, J. Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA. Int. J. Remote Sens. 2013, 34, 45-59. [CrossRef]
14. Zou, Q.; Ni, L.; Zhang, T.; Wang, Q. Deep learning based feature selection for remote sensing scene classification. IEEE Geosci. Remote Sens. 2015, 12, 2321-2325. [CrossRef]
15. Cheng, G.; Han, J.; Lu, X. Remote Sensing Image Scene Classification: Benchmark and State of the Art. Proc. IEEE 2017, 150, 1865-1883. [CrossRef]
16. Zhou, B.; Lapedriza, A.; Xiao, J.; Torralba, A.; Oliva, A. Learning deep features for scene recognition using places database. In Advances in Neural Information Processing Systems, Proceedings of the 27th International Conference on Neural Information Processing Systems; Montreal, QC, Canada, 8-13 December 2014; MIT Press: Cambridge, MA, USA, 2014; pp. 487-495
17. Teney, D.; Brown, M.; Kit, D.; Hall, P. Learning similarity metrics for dynamic scene segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7-12 June 2015; pp. 2084-2093
18. Baatz, M.; Schape, A. Multiresolution Segmentation-An optimization approach for high quality multi-scale image segmentation. In Proceedings of the AGIT-Symposium XII, Salzburg, Austria, 5-7 July 2000; pp. 12-23
19. Hay, G.J.; Blaschke, T.; Marceau, D.J.; Bouchard, A. A comparison of three image-object methods for the multiscale analysis of landscape structure. ISPRS J. Photogramm. 2003, 57, 327-345. [CrossRef]
20. Meinel, G.; Neubert, M. A comparison of segmentation programs for high resolution remote sensing data. Int. Arch. Photogr. Remote Sens. 2004, 35, 1097-1105
21. Silveira, M.; Nascimento, J.C.; Marques, J.S.; Marçal, A.R.; Mendonça, T.; Yamauchi, S.; Maeda, J.; Rozeira, J. Comparison of segmentation methods for melanoma diagnosis in dermoscopy images. IEEE J. Sel. Top. Signal Process. 2009, 3, 35-45. [CrossRef]
22. Pertuz, S.; Garcia, M.A.; Puig, D. Focus-aided scene segmentation. Comput. Vis. Image Underst. 2015, 133, 66-75. [CrossRef]
23. Wang, J.Z.; Li, J.; Gray, R.M.;Wiederhold, G. Unsupervised multiresolution segmentation for images with low depth of field. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23, 85-90. [CrossRef]
24. Heiden, U.; Heldens, W.; Roessner, S.; Segl, K.; Esch, T.; Mueller, A. Urban structure type characterization using hyperspectral remote sensing and height information. Landsc. Urban Plan. 2012, 105, 361-375. [CrossRef]
25. Zhang, X.; Du, S. A linear Dirichlet mixture model for decomposing scenes: Application to analyzing urban functional zonings. Remote Sens. Environ. 2015, 169, 37-49. [CrossRef]
26. Voltersen, M.; Berger, C.; Hese, S.; Schmullius, C. Object-based land cover mapping and comprehensive feature calculation for an automated derivation of urban structure types at block level. Remote Sens. Environ. 2014, 154, 192-201. [CrossRef]
27. Kirchhoff, T.; Trepl, L.; Vicenzotti, V. What is landscape ecology? An analysis and evaluation of six different conceptions. Landsc. Res. 2013, 38, 33-51. [CrossRef]
28. Nielsen, M.M.; Ahlqvist, O. Classification of different urban categories corresponding to the strategic spatial level of urban planning and management using a SPOT4 scene. J. Spat. Sci. 2015, 60, 99-117. [CrossRef]
29. Bhaskaran, S.; Paramananda, S.; Ramnarayan, M. Per-pixel and object-oriented classification methods for mapping urban features using Ikonos satellite data. Appl. Geogr. 2010, 30, 650-665. [CrossRef]
30. Myint, S.W.; Gober, P.; Brazel, A.; Grossman-Clarke, S.;Weng, Q. Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery. Remote Sens. Environ. 2011, 115, 1145-1161. [CrossRef]
31. Yu, Q.; Gong, P.; Clinton, N.; Biging, G.; Kelly, M.; Schirokauer, D. Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery. Photogramm. Eng. Remote Sens. 2006, 72, 799-811. [CrossRef]
32. Huang, X.; Yuan, W.; Li, J.; Zhang, L. A new building extraction postprocessing framework for high-spatial-resolution remote-sensing imagery. IEEE J. Sel. Top. Appl. 2017, 10, 654-668. [CrossRef]
33. Grinias, I.; Panagiotakis, C.; Tziritas, G. MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images. ISPRS J. Photogramm. 2016, 122, 145-166. [CrossRef]
34. Benedek, C.; Descombes, X.; Zerubia, J. Building development monitoring in multitemporal remotely sensed image pairs with stochastic birth-death dynamics. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34, 33-50. [CrossRef] [PubMed]
35. Cheng, G.; Han, J. A survey on object detection in optical remote sensing images. ISPRS J. Photogramm. 2016, 117, 11-28. [CrossRef]
36. Zhou, W.; Cadenasso, M.L.; Schwarz, K.; Pickett, S.T. Quantifying spatial heterogeneity in urban landscapes: Integrating visual interpretation and object-based classification. Remote Sens. 2014, 6, 3369-3386. [CrossRef]
37. Zhang, X.; Du, S. Learning selfhood scales for urban land cover mapping with very-high-resolution VHR images. Remote Sens. Environ. 2016, 178, 172-190
38. Belgiu, M.; Dragut, L. Comparing supervised and unsupervised multiresolution segmentation approaches for extracting buildings from very high resolution imagery. ISPRS J. Photogramm. 2014, 96, 67-75. [CrossRef] [PubMed]
39. Clinton, N.; Holt, A.; Scarborough, J.; Yan, L.; Gong, P. Accuracy assessment measures for object-based image segmentation goodness. Photogramm. Eng. Remote Sens. 2010, 76, 289-299. [CrossRef]
40. Dragut, L.; Tiede, D.; Levick, S.R. ESP: A tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data. Int. J. Geogr. Inf. Sci. 2010, 24, 859-871. [CrossRef]
41. Witharana, C.; Civco, D.L. Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure euclidean distance 2 (ED2). ISPRS J. Photogramm. 2014, 87, 108-121. [CrossRef]
42. Hay, G.J.; Castilla, G. Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline. In Object-Based Image Analysis; Springer: Berlin/Heidelberg, Germany, 2008; pp. 75-89, ISBN 13 9783540770572
43. Suykens, J.A.; Vandewalle, J. Least squares support vector machine classifiers. Neural Process. Lett. 1999, 9, 293-300. [CrossRef]
44. Benz, U.C.; Hofmann, P.; Willhauck, G.; Lingenfelder, I.; Heynen, M. Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information. ISPRS J. Photogramm. 2004, 58, 239-258. [CrossRef]
45. Blaschke, T.; Hay, G.J. Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multiscale landscape structure. Int. Arch. Photogramm. 2001, 34, 22-29
46. Wang, F.; Hall, G.B. Fuzzy representation of geographical boundaries in GIS. Int. J. Geogr. Inf. Syst. 1996, 10, 573-590
47. Yao, Y.; Li, X.; Liu, X.; Liu, P.; Liang, Z.; Zhang, J.; Mai, K. Sensing spatial distribution of urban land use by integrating points-of-interest and GoogleWord2Vec model. Int. J. Geogr. Inf. Sci. 2016, 31, 1-24. [CrossRef]
48. Dragut, L.; Csillik, O.; Eisank, C.; Tiede, D. Automated parameterisation for multi-scale image segmentation on multiple layers. ISPRS J. Photogramm. 2014, 88, 119-127. [CrossRef] [PubMed]
49. Liu, X.; He, J.; Yao, Y.; Zhang, J.; Liang, H.; Wang, H.; Hong, Y. Classifying urban land use by integrating remote sensing and social media data. Int. J. Geogr. Inf. Sci. 2017, 31, 1675-1696. [CrossRef]
50. Weinberger, K.Q.; Saul, L.K. Distance metric learning for large margin nearest neighbor classification. J. Mach. Learn. Res. 2009, 10, 207-244
51. Montanges, A.P.; Moser, G.; Taubenböck, H.; Wurm, M.; Tuia, D. Classification of urban structural types with multisource data and structured models. In Proceedings of the Urban Remote Sensing Event (JURSE), IEEE, Lausanne, Switzerland, 30 March-1 April 2015; pp. 1-4
52. Duro, D.C.; Franklin, S.E.; Dubé, M.G. A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery. Remote Sens. Environ. 2012, 118, 259-272. [CrossRef]
53. Peña-Barragán, J.M.; Ngugi, M.K.; Plant, R.E.; Six, J. Object-based crop identification using multiple vegetation indices, textural features and crop phenology. Remote Sens. Environ. 2011, 115, 1301-1316. [CrossRef]
54. Borgström, S.; Elmqvist, T.; Angelstam, P.; Alfsen-Norodom, C. Scale mismatches in management of urban landscapes. Ecol. Soc. 2006, 11, 16. [CrossRef]
55. Wen, D.; Huang, X.; Zhang, L.; Benediktsson, J.A. A novel automatic change detection method for urban high-resolution remotely sensed imagery based on multiindex scene representation. IEEE Trans. Geosci. Remote 2016, 54, 609-625. [CrossRef]
56. Zhao, W.; Du, S. Scene classification using multi-scale deeply described visual words. Int. J. Remote Sens. 2016, 37, 4119-4131. [CrossRef]
57. Garrigues, S.; Allard, D.; Baret, F.;Weiss, M. Quantifying spatial heterogeneity at the landscape scale using variogram models. Remote Sens. Environ. 2006, 103, 81-96. [CrossRef]
58. Sweeney, K.E.; Roering, J.J.; Ellis, C. Experimental evidence for hillslope control of landscape scale. Science 2015, 349, 51-53. [CrossRef] [PubMed]
59. Vihervaara, P.; Mononen, L.; Auvinen, A.P.; Virkkala, R.; Lü, Y.; Pippuri, I.; Valkama, J. How to integrate remotely sensed data and biodiversity for ecosystem assessments at landscape scale. Landsc. Ecol. 2015, 30, 501-516. [CrossRef]
60. Boutell, M.R.; Luo, J.; Shen, X.; Brown, C.M. Learning multi-label scene classification. Pattern Recognit. 2004, 37, 1757-1771. [CrossRef]
61. Farabet, C.; Couprie, C.; Najman, L.; LeCun, Y. Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35, 1915-1929. [CrossRef] [PubMed]
62. Tao, D.; Cheng, J.; Lin, X.; Yu, J. Local structure preserving discriminative projections for RGB-D sensor-based scene classification. Inf. Sci. 2015, 320, 383-394. [CrossRef]
63. Bosch, A.; Zisserman, A.; Muñoz, X. Scene classification via pLSA. In Proceedings of the Computer Vision-ECCV 2006, Graz, Austria, 7-13 May 2006; pp. 517-530
64. Blaschke, T. Object based image analysis for remote sensing. ISPRS J. Photogramm. 2010, 65, 2-16. [CrossRef]
65. Laliberte, A.S.; Rango, A.; Havstad, K.M.; Paris, J.F.; Beck, R.F.; McNeely, R.; Gonzalez, A.L. Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico. Remote Sens. Environ. 2004, 93, 198-210. [CrossRef]
66. Powers, R.P.; Hay, G.J.; Chen, G. How wetland type and area differ through scale: A GEOBIA case study in Alberta's Boreal Plains. Remote Sens. Environ. 2012, 117, 135-145. [CrossRef]
67. Stow, D.; Hamada, Y.; Coulter, L.; Anguelova, Z. Monitoring shrubland habitat changes through object-based change identification with airborne multispectral imagery. Remote Sens. Environ. 2008, 112, 1051-1061. [CrossRef]
68. Brassel, K.E.; Weibel, R. A review and conceptual framework of automated map generalization. Int. J. Geogr. Inf. Syst. 1988, 2, 229-244. [CrossRef]
69. Lamonaca, A.; Corona, P.; Barbati, A. Exploring forest structural complexity by multi-scale segmentation of VHR imagery. Remote Sens. Environ. 2008, 112, 2839-2849. [CrossRef]
70. Tang, H.; Shen, L.; Qi, Y.; Chen, Y.; Shu, Y.; Li, J.; Clausi, D.A. A multiscale latent Dirichlet allocation model for object-oriented clustering of VHR panchromatic satellite images. IEEE Trans. Geosci. Remote Sens. 2013, 51, 1680-1692. [CrossRef]
71. Wang, J.F.; Zhang, T.L.; Fu, B.J. A measure of spatial stratified heterogeneity. Ecol. Indic. 2016, 67, 250-256. [CrossRef]
72. Plexida, S.G.; Sfougaris, A.I.; Ispikoudis, I.P.; Papanastasis, V.P. Selecting landscape metrics as indicators of spatial heterogeneity-A comparison among Greek landscapes. Int. J. Appl. Earth Obs. 2014, 26, 26-35. [CrossRef]
73. Waclaw, B.; Bozic, I.; Pittman, M.E.; Hruban, R.H.; Vogelstein, B.; Nowak, M.A. A spatial model predicts that dispersal and cell turnover limit intratumour heterogeneity. Nature 2015, 525, 261-264. [CrossRef] [PubMed]
74. Davies, K.F.; Chesson, P.; Harrison, S.; Inouye, B.D.; Melbourne, B.A.; Rice, K.J. Spatial heterogeneity explains the scale dependence of the native-exotic diversity relationship. Ecology 2005, 86, 1602-1610. [CrossRef]
75. Regulska, E.; Kolaczkowska, E. Landscape patch pattern effect on relationships between soil properties and earthworm assemblages: A comparison of two farmlands of different spatial structure. Pol. J. Ecol. 2015, 63, 549-558. [CrossRef]
76. Zhou, W.; Pickett, S.T.; Cadenasso, M.L. Shifting concepts of urban spatial heterogeneity and their implications for sustainability. Landsc. Ecol. 2017, 32, 15-30. [CrossRef]
77. Forman, R.T. Land Mosaics: The Ecology of Landscapes and Regions; Cambridge University: Cambridge, UK, 1995; pp. 42-46
78. Naveh, Z.; Lieberman, A.S. Landscape Ecology: Theory and Application; Springer: New York, NY, USA, 2013; pp. 157-163, ISBN 13 9780387940595
79. Malavasi, M.; Carboni, M.; Cutini, M.; Carranza, M.L.; Acosta, A.T. Landscape fragmentation, land-use legacy and propagule pressure promote plant invasion on coastal dunes: A patch-based approach. Landsc. Ecol. 2014, 29, 1541-1550. [CrossRef]
80. Mairota, P.; Cafarelli, B.; Boccaccio, L.; Leronni, V.; Labadessa, R.; Kosmidou, V.; Nagendra, H. Using landscape structure to develop quantitative baselines for protected area monitoring. Ecol. Indic. 2013, 33, 82-95. [CrossRef]
81. Seidl, R.; Lexer, M.J.; Jäger, D.; Hönninger, K. Evaluating the accuracy and generality of a hybrid patch model. Tree Physiol. 2005, 25, 939-951. [CrossRef] [PubMed]
82. Burnett, C.; Blaschke, T. A multi-scale segmentation/object relationship modelling methodology for landscape analysis. Ecol. Model. 2003, 168, 233-249. [CrossRef]
83. Hay, G.J.; Marceau, D.J. Multiscale object-specific analysis (MOSA): An integrative approach for multiscale landscape analysis. In Remote Sensing Image Analysis: Including the Spatial Domain; Springer: Berlin, Germany, 2004; pp. 71-92
84. Clark, B.J.F.; Pellikka, P.K.E. Landscape analysis using multiscale segmentation and object orientated classification. Recent Adv. Remote Sens. Geoinf. Process. Land Degrad. Assess. 2009, 8, 323-341
85. Fu, B.; Liang, D.; Nan, L. Landscape ecology: Coupling of pattern, process, and scale. Chin. Geogr. Sci. 2011, 21, 385-391. [CrossRef]
86. Wu, J. Key concepts and research topics in landscape ecology revisited: 30 years after the Allerton Park workshop. Landsc. Ecol. 2013, 28, 1-11. [CrossRef]