Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 132, Issue , 2017, Pages 170-184

  Zhang, Xiuyuan ^a   Du, Shihong ^a   Wang, Qiao ^b  

^a PEKING UNIVERSITY   (China)

^b NANJING INSTITUTE OF ENVIRONMENTAL SCIENCES   (China)

Author keywords

Hierarchical semantic cognition; Image classification; Point of interest; Urban functional zone

Indexed keywords

IMAGE CLASSIFICATION; STATISTICS; SUPPORT VECTOR MACHINES; URBAN PLANNING;

CLASSIFICATION METHODS; COGNITION STRUCTURE; FUNCTIONAL ZONES; HIERARCHICAL RELATIONS; LATENT DIRICHLET ALLOCATIONS; POINT OF INTEREST; SEMANTIC COGNITIONS; VERY HIGH RESOLUTION;

SEMANTICS;

IMAGE CLASSIFICATION; LAND COVER; MANAGEMENT PRACTICE; SATELLITE DATA; SATELLITE IMAGERY; SUPPORT VECTOR MACHINE; URBAN AREA; URBAN PLANNING;

BEIJING [CHINA]; CHINA;

EID: 85029435998     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2017.09.007     Document Type: Article

References (66)

1. Baatz, M., Schape, A., Multiresolution segmentation: an optimization approach for high quality multi-scale image segmentation. Angew. Geogr. Informationsverarbeitung 12 (2000), 12–23.
2. Benz, U.C., Hofmann, P., Willhauck, G., Lingenfelder, I., Heynen, M., Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information. ISPRS J. Photogramm. Rem. Sens. 58:3 (2004), 239–258.
3. Blei, D.M., Ng, A.Y., Jordan, M.I., Latent Dirichlet allocation. J. Mach. Learn. Res. 3 (2003), 993–1022.
4. Bosch, A., Zisserman, A., Muñoz, X., Scene classification via pLSA. European Conference on Computer Vision, 2006, Springer, Berlin Heidelberg, 517–530.
5. Boutell, M.R., Luo, J., Shen, X., Brown, C.M., Learning multi-label scene classification. Pattern Recogn. 37:9 (2004), 1757–1771.
6. Breiman, L., Random forests. Mach. Learn. 45 (2001), 5–32.
7. Burnett, C., Blaschke, T., A multi-scale segmentation/object relationship modelling methodology for landscape analysis. Ecol. Model. 168:3 (2003), 233–249.
8. Cao, L., Fei-Fei, L., Spatially coherent latent topic model for concurrent segmentation and classification of objects and scenes. 2007 IEEE 11th International Conference on Computer Vision, 2007, IEEE, 1–8.
9. Cleve, C., Kelly, M., Kearns, F.R., Moritz, M., Classification of the wildland–urban interface: a comparison of pixel-and object-based classifications using high-resolution aerial photography. Comput. Environ. Urban Syst. 32 (2008), 317–326.
10. Cohen, G., Hierarchical models in cognition: do they have psychological reality?. Eur. J. Cogn. Psychol. 12:1 (2000), 1–36.
11. Diggle, P.J., Besag, J., Gleaves, J.T., Statistical analysis of spatial point patterns by means of distance methods. Biometrics, 1976, 659–667.
12. Drăguţ, L., Tiede, D., Levick, S.R., ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data. Int. J. Geogr. Inform. Sci. 24:6 (2010), 859–871.
13. Drăguţ, L., Csillik, O., Eisank, C., Tiede, D., Automated parameterisation for multi-scale image segmentation on multiple layers. ISPRS J. Photogr. Rem. Sens. 88 (2014), 119–127.
14. Du, S., Zhang, F., Zhang, X., Semantic classification of urban buildings combining VHR image and GIS data: an improved random forest approach. ISPRS J. Photogr. Rem. Sens. 105 (2015), 107–119.
15. Duchenne, O., Joulin, A., Ponce, J., A graph-matching kernel for object categorization. 2011 International Conference on Computer Vision, 2011, IEEE, 1792–1799.
16. Farabet, C., Couprie, C., Najman, L., LeCun, Y., Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35:8 (2013), 1915–1929.
17. Farahzadeh, E., Cham, T.J., Li, W., Semantic and spatial content fusion for scene recognition. New Development in Robot Vision, 2015, Springer, Berlin Heidelberg, 33–53.
18. Fu, B., Liang, D., Nan, L., Landscape ecology: coupling of pattern, process, and scale. Chin. Geogra. Sci 21:4 (2011), 385–391.
19. Gahegan, M., Ehlers, M., A framework for the modelling of uncertainty between remote sensing and geographic information systems. ISPRS J. Photogr. Rem. Sens. 55:3 (2000), 176–188.
20. Gatrell, A.C., Bailey, T.C., Diggle, P.J., Rowlingson, B.S., Spatial point pattern analysis and its application in geographical epidemiology. Trans. Inst. Brit. Geogr., 1996, 256–274.
21. Haase, P., Spatial pattern analysis in ecology based on Ripley's K-function: introduction and methods of edge correction. J. Veg. Sci. 6:4 (1995), 575–582.
22. Heiden, U., Heldens, W., Roessner, S., Segl, K., Esch, T., Mueller, A., Urban structure type characterization using hyperspectral remote sensing and height information. Landscape Urban Planning 105:4 (2012), 361–375.
23. Hu, T., Yang, J., Li, X., Gong, P., Mapping urban land use by using Landsat images and open social data. Rem. Sens., 8(2), 2016, 151.
24. Indyk, P., Motwani, R., Approximate nearest neighbors: towards removing the curse of dimensionality. Thirtieth ACM Symposium on Theory of Computing, 1998, ACM.
25. Johnson, B., Xie, Z., Classifying a high resolution image of an urban area using super-object information. ISPRS J. Photogramm. Rem. Sens. 83 (2013), 40–49.
26. Kontschieder, P., Bulo, S.R., Pelillo, M., Bischof, H., Structured labels in random forests for semantic labelling and object detection. IEEE Trans. Pattern Anal. Mach. Intell. 36:10 (2014), 2104–2116.
27. Laliberte, A.S., Rango, A., Havstad, K.M., Paris, J.F., Beck, R.F., McNeely, R., Gonzalez, A.L., Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico. Remote Sens. Environ. 93 (2004), 198–210.
28. Li, L.J., Su, H., Xing, E.P., Fei-Fei, L., 2010. Object bank: a high-level image representation for scene classification & semantic feature sparsification. In: Advances in Neural Information Processing Systems, pp. 1378–1386.
29. Lillesand, T., Kiefer, R.W., Chipman, J., Remote Sensing and Image Interpretation. 2014, John Wiley & Sons.
30. Lienou, M., Maître, H., Datcu, M., Semantic annotation of satellite images using latent dirichlet allocation. IEEE Geosci. Remote Sens. Lett. 7:1 (2010), 28–32.
31. Matsuoka, R.H., Kaplan, R., People needs in the urban landscape: analysis of landscape and urban planning contributions. Landscape Urban Planning 84:1 (2008), 7–19.
32. McKenzie, G., Janowicz, K., Gao, S., Yang, J.A., Hu, Y., POI pulse: a multi-granular, semantic signatures-based information observatory for the interactive visualization of big geosocial data. Cartographica 50:2 (2014), 71–85.
33. Memarsadeghi, N., Mount, D.M., Netanyahu, N.S., Le Moigne, J., A fast implementation of the ISODATA clustering algorithm. Int. J. Comput. Geom. Appl. 17:01 (2007), 71–103.
34. Montanges, A.P., Moser, G., Taubenböck, H., Wurm, M., Tuia, D., Classification of urban structural types with multisource data and structured models. 2015 Joint Urban Remote Sensing Event (JURSE), 2015, IEEE, 1–4.
35. Neis, P., Zipf, A., Analyzing the contributor activity of a volunteered geographic information project—the case of OpenStreetMap. ISPRS Int. J. Geo-Inform. 1:2 (2012), 146–165.
36. Oquab, M., Bottou, L., Laptev, I., Sivic, J., Learning and transferring mid-level image representations using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, 1717–1724.
37. Payne, A., Singh, S., Indoor vs. outdoor scene classification in digital photographs. Pattern Recogn. 38:10 (2005), 1533–1545.
38. Peña-Barragán, J.M., Ngugi, M.K., Plant, R.E., Six, J., Object-based crop identification using multiple vegetation indices, textural features and crop phenology. Remote Sens. Environ. 115:6 (2011), 1301–1316.
39. Pertuz, S., Garcia, M.A., Puig, D., Focus-aided scene segmentation. Comput. Vis. Image Underst. 133 (2015), 66–75.
40. Rahmani, S., Strait, M., Merkurjev, D., Moeller, M., Wittman, T., An adaptive IHS pan-sharpening method. IEEE Geosci. Remote Sens. Lett. 7:4 (2010), 746–750.
41. Rhinane, H., Hilali, A., Berrada, A., Hakdaoui, M., Detecting slums from SPOT data in Casablanca Morocco using an object based approach. J. Geogr. Inform. Syst., 3(03), 2011, 217.
42. Ri, C.Y., Yao, M., Bayesian network based semantic image classification with attributed relational graph. Multimedia Tools Appl. 74:13 (2015), 4965–4986.
43. Serrano, N., Savakis, A., Luo, J., A computationally efficient approach to indoor/outdoor scene classification. Pattern Recognition, 2002. Proceedings. 16th International Conference on, vol. 4, 2002, IEEE, 146–149.
44. Serrano, N., Savakis, A.E., Luo, J., Improved scene classification using efficient low-level features and semantic cues. Pattern Recogn. 37:9 (2004), 1773–1784.
45. Shin, H.B., Residential redevelopment and the entrepreneurial local state: the implications of Beijing's shifting emphasis on urban redevelopment policies. Urban Stud. 46:13 (2009), 2815–2839.
46. Song, W., Wen, D., Wang, K., Liu, T., Zang, M., Satellite image scene classification using spatial information. Sixth International Conference on Graphic and Image Processing (ICGIP 2014), March 2015, International Society for Optics and Photonics pp. 94431K–94431K.
47. Steeves, J.K., Humphrey, G.K., Culham, J.C., Menon, R.S., Milner, A.D., Goodale, M.A., Behavioral and neuroimaging evidence for a contribution of color and texture information to scene classification in a patient with visual form agnosia. J. Cogn. Neurosci. 16:6 (2004), 955–965.
48. Stow, D., Hamada, Y., Coulter, L., Anguelova, Z., Monitoring shrubland habitat changes through object-based change identification with airborne multispectral imagery. Remote Sens. Environ. 112 (2008), 1051–1061.
49. Suykens, J.A., Vandewalle, J., Least squares support vector machine classifiers. Neural Process. Lett. 9:3 (1999), 293–300.
50. Vaduva, C., Gavat, I., Datcu, M., Latent Dirichlet allocation for spatial analysis of satellite images. IEEE Trans. Geosci. Remote Sens. 51:5 (2013), 2770–2786.
51. Wang, J., Chen, Y., He, T., Lv, C., Liu, A., Application of geographic semantic cognition approach in land type classification using Hyperion image: a case study in China. Int. J. Appl. Earth Obs. Geoinf. 12 (2010), S212–S222.
52. Wang, X., Grimson, E., 2008. Spatial latent dirichlet allocation. In: Advances in Neural Information Processing Systems, pp. 1577–1584.
53. Waseem, M., Muhammad, A.N., Khalida, I.N., Decomposition method for solving system of linear equations. Eng. Math. Lett. 2 (2013), 34–41.
54. Wen, D., Huang, X., Zhang, L., Benediktsson, J.A., A novel automatic change detection method for urban high-resolution remotely sensed imagery based on multiindex scene representation. IEEE Trans. Geosci. Remote Sens. 54:1 (2016), 609–625.
55. Yan, R., Liu, Y., Jin, R., Hauptmann, A., On predicting rare classes with SVM ensembles in scene classification. Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP'03). 2003 IEEE International Conference on, vol. 3, 2003, IEEE, III–21.
56. Yang, G., Pu, R., Zhang, J., Zhao, C., Feng, H., Wang, J., Remote sensing of seasonal variability of fractional vegetation cover and its object-based spatial pattern analysis over mountain areas. ISPRS J. Photogramm. Rem. Sens. 77:3 (2013), 79–93.
57. Yao, J., Fidler, S., Urtasun, R., Describing the scene as a whole: joint object detection, scene classification and semantic segmentation. Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, 2012, IEEE, 702–709.
58. Yao, Y., Li, X., Liu, X., Liu, P., Liang, Z., Zhang, J., Mai, K., Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model. Int. J. Geogr. Inform. Sci., 2016, 1–24.
59. Zhang, X., Du, S., A linear Dirichlet mixture model for decomposing scenes: application to analyzing urban functional zonings. Rem. Sens. Environ. 169 (2015), 37–49.
60. Zhang, X., Du, S., Learning selfhood scales for urban land cover mapping with very-high-resolution VHR images. Rem. Sens. Environ. 178 (2016), 172–190.
61. Zhang, X., Du, S., Wang, Y.-C., Semantic classification of heterogeneous urban scenes using intrascene feature similarity and interscene semantic dependency. IEEE J. Sel. Top. Appl. Earth Observations Rem. Sens. 8 (2015), 2005–2014.
62. Zhao, P., Lü, B., Transportation implications of metropolitan spatial planning in mega-city Beijing. Int. Dev. Plan. Rev. 31:3 (2009), 235–261.
63. Zhao, W., Du, S., Scene classification using multi-scale deeply described visual words. Int. J. Rem. Sens. 37:17 (2016), 4119–4131.
64. Zheng, X., Wang, Y., Gan, M., Zhang, J., Teng, L., Wang, K., Shen, Z., Zhang, L., Discrimination of settlement and industrial area using landscape metrics in rural region. Rem. Sens., 8(10), 2016, 845.
65. Zhong, Y., Cui, M., Zhu, Q., Zhang, L., Scene classification based on multifeature probabilistic latent semantic analysis for high spatial resolution remote sensing images. J. Appl. Rem. Sens. 9:1 (2015), 6207–6222.
66. Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., Oliva, A., 2014. Learning deep features for scene recognition using places database. In: Advances in Neural Information Processing Systems, pp. 487–495.