Object-Based Convolutional Neural Network for High-Resolution Imagery Classification

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 10, Issue 7, 2017, Pages 3386-3396

  Zhao, Wenzhi ^a   Du, Shihong ^a   Emery, William J ^b  

^a PEKING UNIVERSITY   (China)

^b UCB 450   (United States)

Author keywords

Convolutional neural network (CNN); deep learning; high resolution image; image classification

Indexed keywords

BUILDINGS; COMPLEX NETWORKS; CONVOLUTION; DEEP LEARNING; IMAGE RECONSTRUCTION; LEARNING SYSTEMS; NEURAL NETWORKS; OFFICE BUILDINGS; REMOTE SENSING; SEMANTICS;

CLASSIFICATION ACCURACY; CLASSIFICATION AND INTERPRETATION; COMPLEX IMAGE PATTERNS; CONVOLUTIONAL NEURAL NETWORK; HIGH RESOLUTION IMAGE; HIGH RESOLUTION IMAGERY; HIGH RESOLUTION REMOTE SENSING IMAGES; OBJECT-BASED CLASSIFICATIONS;

IMAGE CLASSIFICATION;

ACCURACY ASSESSMENT; ARTIFICIAL NEURAL NETWORK; DISASTER MANAGEMENT; IMAGE CLASSIFICATION; IMAGE RESOLUTION; PIXEL; REMOTE SENSING; URBAN PLANNING;

BEIJING [BEIJING (ADS)]; BEIJING [CHINA]; CHINA; GERMANY; ITALY; LOMBARDY; PAVIA; VAIHINGEN;

EID: 85017136781     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2017.2680324     Document Type: Article

References (39)

1. D. Tuia, F. Ratle, F. Pacifici, M. F. Kanevski, and W. J. Emery, "Active learning methods for remote sensing image classification," IEEE Trans. Geoscience Remote Sensing, vol. 47, no. 7, pp. 2218-2232, 2009.
2. L. Bruzzone and L. Carlin, "A multilevel context-based system for classification of very high spatial resolution images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 9, pp. 2587-2600, Sep. 2006.
3. W. Zhao and S. Du, "Spectral-spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4544-4554, Aug. 2016.
4. F. Zhang, B. Du, L. Zhang, and M. Xu, "Weakly supervised learning based on coupled convolutional neural networks for aircraft detection," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 9, pp. 5553-5563, Sep. 2016.
5. Y. Bengio, "Learning deep architectures for ai," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
6. U. C. Benz, P. Hofmann, G. Willhauck, I. Lingenfelder, and M. Heynen, "Multi-resolution, object-oriented fuzzy analysis of remote sensing data for gis-ready information," ISPRS J. Photogrammetry Remote Sens., vol. 58, no. 3, pp. 239-258, 2004.
7. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
8. W. Zhao and S. Du, "Scene classification using multi-scale deeply described visual words," Int. J. Remote Sens., vol. 37, no. 17, pp. 4119-4131, 2016. [Online]. Available: http://dx.doi.org/10.1080/01431161.2016.1207266
9. A. Puissant, J. Hirsch, and C. Weber, "The utility of texture analysis to improve perpixel classification for high to very high spatial resolution imagery," Int. J. Remote Sens., vol. 26, no. 4, pp. 733-745, 2005. [Online]. Available: http://dx.doi.org/10.1080/01431160512331316838
10. W. Zhao, L. Luo, Z. Guo, J. Yue, X. Yu, H. Liu, and J. Wei, "Road extraction in remote sensing images based on spectral and edge analysis," Spectrosc. Spectral Anal., vol. 35, no. 10, pp. 2814-2819, 2015.
11. J. A. Benediktsson, J. A. Palmason, and J. R. Sveinsson, "Classification of hyperspectral data from urban areas based on extended morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 480-491, Mar. 2005.
12. T. C. Bau, S. Sarkar, and G. Healey, "Hyperspectral region classification using a three-dimensional gabor filterbank," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 9, pp. 3457-3464, Sep. 2010.
13. X. Huang, L. Zhang, and P. Li, "A multiscale feature fusion approach for classification of very high resolution satellite imagery based on wavelet transform," Int. J. Remote Sens., vol. 29, no. 20, pp. 5923-5941, 2008. [Online]. Available: http://dx.doi.org/10.1080/01431160802139922
14. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
15. D. Tuia, M. Volpi, M. D. Mura, A. Rakotomamonjy, and R. Flamary, "Automatic feature learning for spatio-spectral image classification with sparse svm," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 10, pp. 6062-6074, Oct. 2014.
16. J. Li et al., "Multiple feature learning for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 3, pp. 1592-1606, Mar. 2015.
17. D. Tuia, R. Flamary, and N. Courty, "Multiclass feature learning for hyperspectral image classification: Sparse and hierarchical solutions," J. Photogrammetry Remote Sens., vol. 105, pp. 272-285, 2015.
18. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
19. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015.
20. Q. V. Le, "Building high-level features using large scale unsupervised learning," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2013, pp. 8595-8598.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2012, pp. 1097-1105.
22. Y. Sun, Y. Chen, X. Wang, and X. Tang, "Deep learning face representation by joint identification-verification," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2014, pp. 1988-1996.
23. L.-J. Li, H. Su, L. Fei-Fei, and E. P. Xing, "Object bank:Ahigh-level image representation for scene classification & semantic feature sparsification," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2010, pp. 1378-1386.
24. Y. Chen, Z. Lin, X. Zhao, G. Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data," IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.
25. W. Zhao, Z. Guo, J. Yue, X. Zhang, and L. Luo, "On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery," Int. J. Remote Sens., vol. 36, no. 13, pp. 3368-3379, 2015. [Online]. Available: http://dx.doi.org/10.1080/2150704X.2015.1062157
26. X. Chen, S. Xiang, C.-L. Liu, and C.-H. Pan, "Vehicle detection in satellite images by hybrid deep convolutional neural networks," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 10, pp. 1797-1801, Oct. 2014.
27. J. Yue, W. Zhao, S. Mao, and H. Liu, "Spectral-spatial classification of hyperspectral images using deep convolutional neural networks," Remote Sens. Lett., vol. 6, no. 6, pp. 468-477, 2015.
28. W. Zhao and S. Du, "Learning multiscale and deep representations for classifying remotely sensed imagery," ISPRS J. Photogrammetry Remote Sens., vol. 113, pp. 155-165, 2016.
29. T. Blaschke, S. Lang, E. Lorup, J. Strobl, and P. Zeil, "Object-oriented image processing in an integrated gis/remote sensing environment and perspectives for environmental applications," Environ. Inf. Planning Politics Public, vol. 2, pp. 555-570, 2000.
30. G. Duveiller, P. Defourny, B. Desclée, and P. Mayaux, "Deforestation in central africa: Estimates at regional, national and landscape levels by advanced processing of systematically-distributed landsat extracts," Remote Sens. Environ., vol. 112, no. 5, pp. 1969-1981, 2008.
31. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.
32. F. Zhang, B. Du, and L. Zhang, "Scene classification via a gradient boosting random convolutional network framework," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1793-1802, Mar. 2016.
33. M. A. Ranzato, F. J. Huang, Y.-L. Boureau, and Y. LeCun, "Unsupervised learning of invariant feature hierarchies with applications to object recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
34. C. Farabet, C. Couprie, L. Najman, and Y. LeCun, "Learning hierarchical features for scene labeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
35. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 580-587.
36. M. Cramer, "The dgpf-test on digital airborne camera evaluation-overview and test design," Photogrammetrie Fernerkundung Geoinf., vol. 2010, no. 2, pp. 73-82, 2010.
37. C. Small, "High spatial resolution spectral mixture analysis of urban reflectance," Remote Sens. Environ., vol. 88, nos. 1/2, pp. 170-186, 2003.
38. A. Darwish, K. Leukert, and W. Reinhardt, "Image segmentation for the purpose of object-based classification," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2003, vol. 3, pp. 2039-2041.
39. S. W. Myint, P. Gober, A. Brazel, S. Grossman-Clarke, and Q. Weng, "Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery," Remote Sens. Environ., vol. 115, no. 5, pp. 1145-1161, 2011.