Fusing local and global features for high-resolution scene classification

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 10, Issue 6, 2017, Pages 2889-2901

  Bian, Xiaoyong ^a,b   Chen, Chen ^c   Tian, Long ^d   Du, Qian ^d  

^a WUHAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b HUBEI PROVINCE KEY LABORATORY OF INTELLIGENT INFORMATION PROCESSING AND REAL TIME INDUSTRIAL SYSTEM   (China)

^c UNIVERSITY OF CENTRAL FLORIDA   (United States)

^d MISSISSIPPI STATE UNIVERSITY   (United States)

Author keywords

Codebookless model (CLM); Feature representation; Image descriptors; Rotation invariance; Saliency detection; Scene classification

Indexed keywords

BENCHMARKING; EXTRACTION; FEATURE EXTRACTION; LAND USE; LEARNING SYSTEMS;

CLASSIFICATION METHODS; CLASSIFICATION PERFORMANCE; EXTREME LEARNING MACHINE; FEATURE REPRESENTATION; HIGH RESOLUTION IMAGE; LOCAL BINARY PATTERNS; LOCAL FEATURE EXTRACTION; SCALE INVARIANT FEATURE TRANSFORMS;

CLASSIFICATION (OF INFORMATION);

DATA SET; IMAGE CLASSIFICATION; IMAGE RESOLUTION; PATTERN RECOGNITION; SATELLITE DATA;

EID: 85018971855     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2017.2683799     Document Type: Article

References (51)

1. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification", in Proc. ACM Int. Conf. Adv. Geogr. Inf. Syst., Nov. 2010, pp. 270-279.
2. Q. Hu, W. B. Wu, T. Xia, Q. Y. Yu, P. Yang, Z. G. Li, and Q. Song, "Exploring the use of google earth imagery and object-based methods in land use/cover mapping", Remote Sens., vol. 5, no. 11, pp. 6026-6042, 2013.
3. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification", IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
4. L. P. Zhang, L. F. Zhang, and B. Du, "Deep learning for remote sensing data: A technical tutorial on the state of the art", IEEE Geosci. Remote Sens. Mag., vol. 4, no. 2, pp. 22-40, Jun. 2016.
5. G. Camps-Valls, D. Tuia, L. Bruzzone, and J. A. Benediktsson, "Advances in hyperspectral image classification: Earth monitoring with statistical learning methods", IEEE Signal Process. Mag., vol. 31, no. 1, pp. 45-54, Jan. 2014.
6. D. G. Lowe, "Distinctive image features from scale-invariant keypoints", Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
7. G. F. Sheng, W. Yang, T. Xu, and H. Sun, "High-resolution satellite scene classification using a sparse coding based multiple feature combination", Int. J. Remote Sens., vol. 33, no. 8, pp. 2395-2412, Apr. 2012.
8. V. Risojevic and Z. Babić, "Aerial image classification using structural texture similarity", in Proc. IEEE Int. Symp. Signal Process. Inf. Technol., 2011, pp. 190-195.
9. V. Risojević, S. Momić, and Z. Babić, "Gabor descriptors for aerial image classification", in Proc. Int. Conf. Adapt. Natural Comput. Algorithms, 2011, pp. 51-60.
10. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope", Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
11. X. W. Zheng, X. Sun, K. Fu, and H. Q. Wang, "Automatic annotation of satellite images via multifeature joint sparse coding with spatial relation constraint", IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 652-656, Jul. 2013.
12. B. Luo, S. J. Jiang, and L. P. Zhang, "Indexing of remote sensing images with different resolutions by multiple features", IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 4, pp. 1899-1912, Aug. 2013.
13. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns", IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
14. Z. H. Guo, L. Zhang, and D. Zhang, "Acompleted modeling of local binary pattern operator for texture classification", IEEE Trans. Image Process., vol. 19, no. 6, pp. 1657-1663, Jun. 2010.
15. C. Chen, B. C. Zhang, H. J. Su, W. Li, and L. Wang, "Land-use scene classification using multi-scale completed local binary patterns", Signal, Image Video Process., vol. 10, no. 4, pp. 745-752, Apr. 2016.
16. X. Y. Bian, C. Chen, Q. Du, and Y. X. Sheng, "Extended multistructure local binary pattern for high-resolution image scene classification", in Proc. IEEE 36th Int. Conf. Geosci. Remote Sens. Symp., 2016, pp. 5134-5137.
17. J. Yang, Y. G. Jiang, A. G. Hauptmann, and C. W. Ngo, "Evaluating bag-of-visual-words representations in scene classification", in Proc. Int. Workshop Multimedia Inf. Retrieval, Sep. 2007, pp. 197-206.
18. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: spatial pyramid matching for recognizing natural scene categories", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2006, pp. 2169-2178.
19. Y. Yang and S. Newsam, "Spatial pyramid co-occurrence for image classification", in Proc. 2011 Int. Conf. Comput. Vis., Nov. 2011, pp. 1465-1472.
20. L. Zhou, Z. T. Zhou, and D. W. Hu, "Scene classification using a multi-resolution bag-of-features model", Pattern Recog., vol. 46, no. 1, pp. 424-433, Jan. 2013.
21. L. J. Zhao, P. Tang, and L. Z. Huo, "Land-use scene classification using a concentric circle-structured multiscale bag-of-visual-words model", IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 12 pp. 4620-4631, Aug. 2014.
22. G. Cheng, J. W. Han, L. Guo, Z. B. Liu, S. H. Bu, and J. C. Ren, "Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images", IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4238-4249, Aug. 2015.
23. R. Negrel, D. Picard, and P. H. Gosselin, "Evaluation of second-order visual features for land-use classification", in Proc. Int. Workshop Content-Based Multimedia Indexing, Jun. 2014, pp. 1-5.
24. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the fisher kernel for large-scale image classification", in Proc. Eur. Conf. Comput. Vis., Sep. 2010, pp. 143-156.
25. F. Zhang, B. Du, and L. P. Zhang, "Saliency-guided unsupervised feature learning for scene classification", IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
26. O. A. B. Penatti, K. Nogueira, and J. A. dos Santos, "Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?" in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2015, pp. 44-51.
27. F. Zhang, B. Du, and L. P. Zhang, "Scene classification via a gradient boosting random convolutional network framework", IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1793-1802, Mar. 2016.
28. K. Nogueira, O. A. B. Penatti, and J. A. dos Santos, "Towards better exploiting convolutional neural networks for remote sensing scene classification", Pattern Recog., vol. 71, pp. 539-556, Jan. 2017.
29. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, "Overfeat: Integrated recognition, localization and detection using convolutional networks", in Proc. Int. Conf. Learn. Represent., arXiv:1312.6229, Apr. 2014.
30. Y. Q. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding", in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.
31. M. Castelluccio, G. Poggi, C. Sansone, and L. Verdoliva, "Land use classification in remote sensing images by convolutional neural networks", arXiv preprint arXiv: 1508.00092, Aug. 2015.
32. C. Szegedy, W. Liu, Y. Q. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Boston, MA, USA, Jun. 2015, pp. 1-9.
33. F. Hu, G. S. Xia, J. W. Hu, and L. P. Zhang, "Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery", Remote Sens., vol. 7, no. 11, pp. 14680-14707, Nov. 2015.
34. H. Jégou, F. Perronnin, M. Douze, J. Sanchez, P. Perez, and C. Schmid, "Aggregating local image descriptors into compact codes", IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1704-1716, Dec. 2012.
35. X. W. Yao, J. W. Han, G. Cheng, X. M. Qian, and L. Guo, "Semantic annotation of high-resolution satellite images via weakly supervised learning", IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3660-3671, Jun. 2016.
36. X. Q. Lu, X. L. Li, and L. C. Mou, "Semi-supervised multi-task learning for scene recognition", IEEE Trans. Cybern., vol. 45, no. 9, pp. 1967-1976, Sep. 2015.
37. J. W. Han, D. W. Zhang, G. Cheng, L. Guo, and J. C. Ren, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning", IEEE Trans. Geosci. Remote Sens., vol. 53, no. 6, pp. 3325-3337, Jun. 2015.
38. G. Cheng, P. C. Zhou, and J. W. Han, "Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images", IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7405-7415, Dec. 2016.
39. G. Cheng and J. W. Han, "A survey on object detection in optical remote sensing images", ISPRS J. Photogramm. Remote Sens., vol. 117, pp. 11-28, Jul. 2016.
40. J. W. Han, P. C. Zhou, D. W. Zhang, G. Cheng, L. Guo, Z. B. Liu, S. H. Bu, and J. Wu, "Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding", ISPRS J. Photogramm. Remote Sens., vol. 89, pp. 37-48, Mar. 2014.
41. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu, "Freeform region description with second-order pooling", IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 6, pp. 1177-1189, Jun. 2015.
42. Q. L. Wang, P. H. Li, L. Zhang, and W. M. Zuo, "Towards effective codebookless model for image classification", Pattern Recog., vol. 59, pp. 63-71, Nov. 2016.
43. C. Stein, "Lectures on the theory of estimation of many parameters", J. Math. Sci., vol. 34, no. 1, pp. 1373-1403, Jul. 1986.
44. J. Y. Zou, W. Li, C. Chen, and Q. Du, "Scene classification using local and global features with collaborative representation fusion", Inf. Sci., vol. 348, pp. 209-226, Jun. 2016.
45. G. B. Huang, H. M. Zhou, X. J. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification", IEEE Trans. Syst. Man Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
46. Z. Z. Zheng, T. X. Zhang, and L. X. Yan, "Saliency model for object detection: searching for novel items in the scene", Opt. Lett., vol. 37, no. 9, pp. 1580-1582, May 2012.
47. L. Liu, L. J. Zhao, Y. L. Long, G. Y. Kuang, and P. Fieguth, "Extended local binary patterns for texture classification", Image Vis. Comput., vol. 30, no. 2, pp. 86-99, Feb. 2012.
48. L. H. Huang, C. Chen, W. Li, and Q. Du, "Remote sensing image scene classification using multi-scale completed local binary patterns and fisher vectors", Remote Sens., vol. 8, no. 6, pp. 1-17, Jun. 2016.
49. G. S. Xia, J. W. Hu, F. Hu, B. G. Shi, X. Bai, Y. F. Zhong, and L. P. Zhang, "AID: A benchmark dataset for performance evaluation of aerial scene classification", IEEE Trans. Geosci. Remote Sens., to be published, 2017.
50. W. Shao, W. Yang, G. S. Xia, and G. Liu, "A hierarchical scheme of multiple feature fusion for high-resolution satellite scene categorization", in Proc. Int. Conf. Comput. Vis. Syst., Jul. 2013, pp. 324-333.
51. S. Z. Chen and Y. L. Tian, "Pyramid of spatial relations for scene-level land use classification", IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, 1947-1957, Apr. 2015.