Deep Feature Fusion for VHR Remote Sensing Scene Classification

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 8, 2017, Pages 4775-4784

  Chaib, Souleyman ^a   Liu, Huan ^a   Gu, Yanfeng ^a   Yao, Hongxun ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Discriminant correlation analysis (DCA); features fusion; scene classification; unsupervised features learning

Indexed keywords

ELECTRICAL ENGINEERING; GEOLOGY;

CORRELATION ANALYSIS; FEATURE DESCRIPTORS; FEATURE EXTRACTOR; REMOTE SENSING TECHNOLOGY; SCENE CLASSIFICATION; SCENE UNDERSTANDING; STATE-OF-THE-ART APPROACH; VERY HIGH RESOLUTION;

REMOTE SENSING;

AERIAL PHOTOGRAPH; CORRELATION; DATA SET; DISCRIMINANT ANALYSIS; GEOMETRY; IMAGE CLASSIFICATION; IMAGE RESOLUTION; LEARNING; NUMERICAL MODEL; REMOTE SENSING; UNSUPERVISED CLASSIFICATION;

EID: 85020105528     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2700322     Document Type: Article

References (46)

1. A. Romero, C. Gatta, and G. Camps-Valls, "Unsupervised deep feature extraction for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1349-1362, Mar. 2016.
2. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. ICCV, 2003, pp. 1470-1478.
3. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), New York, NY, USA, Jun. 2006, pp. 2169-2178.
4. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer, 2002.
5. J. Xia, J. Chanussot, P. Du, and X. He, "(Semi-) supervised probabilistic principal component analysis for hyperspectral remote sensing image classification," IEEE J. Sel. Topics Appl. Earth Observat. Remote Sens., vol. 7, no. 6, pp. 2224-2236, Jun. 2014.
6. A. M. Cheriyadat, "Unsupervised feature learning for aerial scene classification," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 439-451, Jan. 2014.
7. X. Lu, X. Li, and L. Mou, "Semi-supervised multitask learning for scene recognition," IEEE Trans. on, vol. 45, no. 9, pp. 1967-1976, Sep. 2015.
8. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
9. G. Cheng, J. Han, P. Zhou, and L. Guo, "Multi-class geospatial object detection and geographic image classification based on collection of part detectors," ISPRS J. Photogramm. Remote Sens., vol. 98, pp. 119-132, Dec. 2014.
10. G. Cheng, J. Han, L. Guo, Z. Liu, S. Bu, and J. Ren, "Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4238-4249, Aug. 2015.
11. C. Vaduva, I. Gavat, and M. Datcu, "Deep learning in very high resolution remote sensing image information mining communication concept," in Proc. Proc. 20th Eur. Signal Process. Conf. (EUSIPCO), Aug. 2012, pp. 2506-2510.
12. X. Chen, S. Xiang, C.-L. Liu, and C.-H. Pan, "Vehicle detection in satellite images by hybrid deep convolutional neural networks," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 10, pp. 1797-1801, Oct. 2014.
13. C. Tao, H. Pan, Y. Li, and Z. Zou, "Unsupervised spectral-spatial feature learning with stacked sparse autoencoder for hyperspectral imagery classification," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 12, pp. 2438-2442, Dec. 2015.
14. Q. Zou, L. Ni, T. Zhang, and Q. Wang, "Deep learning based feature selection for remote sensing scene classification," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 11, pp. 2321-2325, Nov. 2015.
15. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
16. A. Romero, P. Radeva, and C. Gatta, "Meta-parameter free unsupervised sparse feature learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 8, pp. 1716-1722, Aug. 2015.
17. F. Zhang, B. Du, and L. Zhang, "Scene classification via a gradient boosting random convolutional network framework," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1793-1802, Mar. 2016.
18. K. Nogueira, O. A. B. Penatti, and J. A. dos Santos, "Towards better exploiting convolutional neural networks for remote sensing scene classification," Pattern Recognit., vol. 61, pp. 539-556, Jan. 2017. [Online]. Available: http://www.sciencedirect.com/science/article/pii/-S0031320316301509
19. E. Othman, Y. Bazi, N. Alajlan, H. Alhichri, and F. Melgani, "Using convolutional features and a sparse autoencoder for land-use scene classification," Int. J. Remote Sens., vol. 37, no. 10, pp. 2149-2167, 2016.
20. O. A. B. Penatti, K. Nogueira, and J. A. dos Santos, "Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2015, pp. 44-51.
21. F. Hu, G.-S. Xia, J. Hu, and L. Zhang, "Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery," Remote Sens., vol. 7, no. 11, pp. 14680-14707, 2015. [Online]. Available: http://-www.mdpi.com/2072-4292/7/11/14680
22. G. Cheng, P. Zhou, and J. Han, "Learning rotation-invariant convolutional neural networks for object detection in vhr optical remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7405-7415, Dec. 2016.
23. M. Castelluccio, G. Poggi, C. Sansone, and L. Verdoliva. "Land use classification in remote sensing images by convolutional neural networks." Unpublished paper, 2015. [Online]. Available: https://arxiv.org/abs/1508.00092
24. D. Marmanis, M. Datcu, T. Esch, and U. Stilla, "Deep learning earth observation classification using imagenet pretrained networks," IEEE Geosci. Remote Sens. Lett., vol. 13, no. 1, pp. 105-109, Jan. 2016.
25. G. Sheng, W. Yang, T. Xu, and H. Sun, "High-resolution satellite scene classification using a sparse coding based multiple feature combination," Int. J. Remote Sens., vol. 33, no. 8, pp. 2395-2412, 2012.
26. X. Zheng, X. Sun, K. Fu, and H. Wang, "Automatic annotation of satellite images via multifeature joint sparse coding with spatial relation constraint," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 652-656, Jul. 2013.
27. W. Shao, W. Yang, G. S. Xia, and G. Liu, "A hierarchical scheme of multiple feature fusion for high-resolution satellite scene categorization," in Proc. 9th Int. Conf. Comput. Vis. Syst.-(ICVS), St. Petersburg, Russia, Jul. 2013, pp. 324-333.
28. B. Zhao, Y. Zhong, and L. Zhang, "A spectral-structural bag-of-features scene classifier for very high spatial resolution remote sensing imagery," ISPRS J. Photogram. Remote Sens., vol. 116, pp. 73-85, Jun. 2016.
29. J. Zou, W. Li, C. Chen, and Q. Du, "Scene classification using local and global features with collaborative representation fusion," Inf. Sci., vol. 348, pp. 209-226, Jun. 2016.
30. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems, vol. 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, Eds. Red Hook, NY, USA: Curran & Assoc. Inc, 2012, pp. 1097-1105.
31. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 580-587.
32. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," in Proc. CoRR, 2014, pp. 675-678.
33. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learn. Represent. (ICLR), San Diego, CA, USA, May 2015, pp. 1-14.
34. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets," in Proc. British Mach. Vis. Conf. (BMVC), 2014.
35. C. Liu and H. Wechsler, "A shape- and texture-based enhanced Fisher classifier for face recognition," IEEE Trans. Image Process., vol. 10, no. 4, pp. 598-608, Apr. 2001.
36. J. Yang and J. Y. Yang, "Generalized K-L transform based combined feature extraction," Pattern Recognit., vol. 35, no. 1, pp. 295-297, 2002.
37. J. Yang, J.-Y. Yang, D. Zhang, and J.-F. Lu, "Feature fusion: Parallel strategy vs. serial strategy," Pattern Recognit., vol. 36, no. 6, pp. 1369-1381, Jun. 2003.
38. Q.-S. Sun, S.-G. Zeng, Y. Liu, P.-A. Heng, and D.-S. Xia, "A new method of feature fusion and its application in image recognition," Pattern Recognit., vol. 38, no. 12, pp. 2437-2448, Dec. 2005.
39. J. Yang and X. Zhang, "Feature-level fusion of fingerprint and fingervein for personal identification," Pattern Recognit. Lett., vol. 33, no. 5, pp. 623-628, Apr. 2012.
40. Y. Bi, M. Lv, Y. Wei, N. Guan, and W. Yi, "Multi-feature fusion for thermal face recognition," Infr. Phys. Technol., vol. 77, pp. 366-374, Jul. 2016.
41. J. R. Schott, "Principles of multivariate analysis: A user's perspective," J. Amer. Statist. Assoc., vol. 97, no. 458, 2002.
42. M. Haghighat, M. Abdel-Mottaleb, and W. Alhalabi, "Discriminant correlation analysis: Real-time feature level fusion for multimodal biometric recognition," IEEE Trans. Inf. Forensics Security, vol. 11, no. 9, pp. 1984-1996, Sep. 2016.
43. G. Xia et al. "AID: A benchmark dataset for performance evaluation of aerial scene classification." Unpublished paper, 2016. [Online]. Available: https://arxiv.org/abs/1608.05167
44. Y. Yang and S. Newsam, "Bag-of-visual-words and spatial extensions for land-use classification," in Proc. 18th SIGSPATIAL Int. Conf. Adv. Geograph. Inf. Syst., New York, NY, USA, 2010, pp. 270-279.
45. M. L. Mekhalfi, F. Melgani, Y. Bazi, and N. Alajlan, "Land-use classification with compressive sensing multifeature fusion," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 10, pp. 2155-2159, Oct. 2015.
46. C. C. Chang and C. J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, Apr. 2011, Art. no. 27.