A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 145, Issue , 2018, Pages 23-43

  Han, Wei ^a   Feng, Ruyi ^a   Wang, Lizhe ^a   Cheng, Yafan ^a  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

Author keywords

Deep learning; High resolution remote sensing images; Scene classification; Self label

Indexed keywords

CLASSIFICATION (OF INFORMATION); IMAGE CLASSIFICATION; REMOTE SENSING; SUPERVISED LEARNING;

CLASSIFICATION ABILITY; HIGH RESOLUTION REMOTE SENSING; HIGH RESOLUTION REMOTE SENSING IMAGES; IMAGE SCENE CLASSIFICATION; LEARNING-BASED METHODS; SCENE CLASSIFICATION; SEMI-SUPERVISED METHOD; STATE-OF-THE-ART METHODS;

DEEP LEARNING;

ALGORITHM; DATA SET; DETECTION METHOD; EXPERIMENTAL DESIGN; IMAGE CLASSIFICATION; IMAGE RESOLUTION; NUMERICAL METHOD; NUMERICAL MODEL; REMOTE SENSING; SATELLITE IMAGERY; SUPERVISED LEARNING;

EID: 85035113175     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2017.11.004     Document Type: Article

References (60)

1. Blaschke, T., Object based image analysis for remote sensing. ISPRS J. Photogram. Rem. Sens. 65:1 (2010), 2–16.
2. Blaschke, T., Lang, S., Hay, G., Object-Based Image Analysis: Spatial Concepts for Knowledge-Driven Remote Sensing Applications. 2008, Springer Science & Business Media.
3. Blum, A., Mitchell, T., Combining labeled and unlabeled data with co-training. Proceedings of the Eleventh Annual Conference on Computational Learning Theory, 1998, ACM, 92–100.
4. Cantalloube, H.M., Nahum, C.E., Airborne sar-efficient signal processing for very high resolution. Proc. IEEE 101:3 (2013), 784–797.
5. Castelluccio, M., Poggi, G., Sansone, C., Verdoliva, L. Land Use Classification in Remote Sensing Images by Convolutional Neural Networks < http://arxiv.org/abs/1508.00092> (accessed on 14 August 2015).
6. Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A., 2014. Return of the devil in the details: Delving deep into convolutional nets. In: Proceedings of the British Machine Vision Conference.
7. Cheng, G., Han, J., A survey on object detection in optical remote sensing images. ISPRS J. Photogram. Rem. Sens. 117 (2016), 11–28.
8. Cheng, G., Zhou, P., Han, J., Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images. IEEE Trans. Geosci. Rem. Sens. 54:12 (2016), 7405–7415.
9. Cheng, G., Han, J., Lu, X., Remote sensing image scene classification: benchmark and state of the art. Proc. IEEE 99 (2017), 1–19.
10. Dalal, N., Triggs, B., Histograms of oriented gradients for human detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, CVPR 2005, vol. 1, 2005, IEEE, 886–893.
11. Davenport, E., Cronin, B., Knowledge management: semantic drift or conceptual shift?. J. Educ. Lib. Inf. Sci., 2000, 294–306.
12. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L., Imagenet: a large-scale hierarchical image database. IEEE Conference on Computer Vision and Pattern Recognition, 2009, CVPR 2009, 2009, IEEE, 248–255.
13. Dópido, I., Li, J., Marpu, P.R., Plaza, A., Dias, J.M.B., Benediktsson, J.A., Semisupervised self-learning for hyperspectral image classification. IEEE Trans. Geosci. Rem. Sens. 51:7 (2013), 4032–4044.
14. Dou, M., Chen, J., Chen, D., Chen, X., Deng, Z., Zhang, X., Xu, K., Wang, J., Modeling and simulation for natural disaster contingency planning driven by high-resolution remote sensing images. Fut. Gener. Comp. Syst. 37 (2014), 367–377.
15. Fu, M., Yuan, Y., Lu, X., Unsupervised feature learning for scene classification of high resolution remote sensing image. 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), 2015, IEEE, 206–210.
16. Gamba, P., Human settlements: a global challenge for eo data processing and interpretation. Proc. IEEE 101:3 (2013), 570–581.
17. Gómez-Chova, L., Tuia, D., Moser, G., Camps-Valls, G., Multimodal classification of remote sensing images: a review and future directions. Proc. IEEE 103:9 (2015), 1560–1584.
18. Han, J., Zhang, D., Cheng, G., Guo, L., Ren, J., Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Trans. Geosci. Rem. Sens. 53:6 (2015), 3325–3337.
19. He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778.
20. Hinton, G.E., Osindero, S., Teh, Y.-W., A fast learning algorithm for deep belief nets. Neural Comput. 18:7 (2006), 1527–1554.
21. Hu, F., Xia, G.-S., Hu, J., Zhang, L., Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Rem. Sens. 7:11 (2015), 14680–14707.
22. Janssen, L.L., Middelkoop, H., Knowledge-based crop classification of a landsat thematic mapper image. Int. J. Rem. Sens. 13:15 (1992), 2827–2837.
23. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T., Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, 2014, ACM, 675–678.
24. Jolliffe, I., Principal Component Analysis. 2002, Wiley Online Library.
25. Krizhevsky, A., Sutskever, I., Hinton, G.E., 2012. Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105.
26. Li, X., Wang, L., On the study of fusion techniques for bad geological remote sensing image. J. Amb. Intell. Human. Comput. 6:1 (2015), 141–149.
27. Li, M., Zhou, Z.-H., Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples. IEEE Trans. Syst., Man, Cybernet.-Part A: Syst. Hum. 37:6 (2007), 1088–1098.
28. Li, J., Gamba, P., Plaza, A., A novel semi-supervised method for obtaining finer resolution urban extents exploiting coarser resolution maps. IEEE J. Select. Top. Appl. Earth Observ. Rem. Sens. 7:10 (2014), 4276–4287.
29. Li, X., Guo, Q., Lu, X., Spatiotemporal statistics for video quality assessment. IEEE Trans. Image Process. 25:7 (2016), 3329–3342.
30. Liu, X., Yuan, Y., Zheng, X., Jointly dictionary learning for change detection in multispectral imagery. IEEE Trans. Cybernet. 47:4 (2017), 884–897.
31. Lowe, D.G., Distinctive image features from scale-invariant keypoints. Int. J. Comp. Vis. 60:2 (2004), 91–110.
32. Lu, X., Zheng, X., Yuan, Y., Remote sensing scene classification by unsupervised representation learning. IEEE Trans. Geosci. Rem. Sens., 2017, 1–10.
33. Lu, X., Zheng, X., Li, X., Latent semantic minimal hashing for image retrieval. IEEE Trans. Image Process. 26:1 (2017), 355–368.
34. Luo, X., Wang, M., Dai, G., Chen, X., A novel technique to compute the revisit time of satellites and its application in remote sensing satellite optimization design. Int. J. Aerosp. Eng., 2017, 2017.
35. Ma, X., Wang, H., Wang, J., Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning. ISPRS J. Photogram. Rem. Sens. 120 (2016), 99–107.
36. Narayanan, V., Desai, R., Choudhury, S., 2012. Bootstrapping Image Classification with Sample Evaluation, pp. 1–8.
37. Odena, A., 2016. Semi-Supervised Learning with Generative Adversarial Networks, pp. 1–3, arXiv preprint arXiv:1606.01583.
38. Oliva, A., Torralba, A., Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comp. Vis. 42:3 (2001), 145–175.
39. Olshausen, B.A., Field, D.J., Sparse coding with an overcomplete basis set: a strategy employed by v1?. Vis. Res. 37:23 (1997), 3311–3325.
40. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E., Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12 (2011), 2825–2830.
41. Plaza, A., Plaza, J., Paz, A., Sanchez, S., Parallel hyperspectral image and signal processing [applications corner]. IEEE Sig. Process. Magaz. 28:3 (2011), 119–126.
42. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y. Overfeat: Integrated Recognition, Localization and Detection Using Convolutional Networks, arXiv preprint arXiv:1312.6229.
43. Simonyan, K., Zisserman, A., 2015. Very deep convolutional networks for large-scale image recognition. In: Proceedings of the International Conference on Learning Representations.
44. Springenberg, J.T., 2015. Unsupervised and Semi-Supervised Learning with Categorical Generative Adversarial Networks, pp. 1–20 arXiv preprint arXiv:1511.06390.
45. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., 2015. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9.
46. Triguero, I., García, S., Herrera, F., Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study. Knowl. Inf. Syst. 42:2 (2015), 245–284.
47. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11:December (2010), 3371–3408.
48. Wang, Y., Xu, X., Zhao, H., Hua, Z., Semi-supervised learning based on nearest neighbor rule and cut edges. Knowl.-Based Syst. 23:6 (2010), 547–554.
49. Wang, L., Song, W., Liu, P., Link the remote sensing big data to the image features via wavelet transformation. Clust. Comput. 19:2 (2016), 793–810.
50. Wang, L., Zhang, J., Liu, P., Choo, K.-K.R., Huang, F., Spectral-spatial multi-feature-based deep learning for hyperspectral remote sensing image classification. Soft Comput. 21:1 (2017), 213–221.
51. Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Maı̂tre, H., 2010. Structural high-resolution satellite image indexing. In: ISPRS TC VII Symposium-100 Years ISPRS, vol. 38, pp. 298–303.
52. Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L., Lu, X., Aid: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Rem. Sens. 55:7 (2017), 3965–3981.
53. Yang, Y., Newsam, S., Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, 2010, ACM, 270–279.
54. Yao, X., Han, J., Cheng, G., Qian, X., Guo, L., Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans. Geosci. Rem. Sens. 54:6 (2016), 3660–3671.
55. Yarowsky, D., Unsupervised word sense disambiguation rivaling supervised methods. Proceedings of the 33rd Annual Meeting on Association for Computational Linguistics, 1995, Association for Computational Linguistics, 189–196.
56. Yuan, Y., Zheng, X., Lu, X., Discovering diverse subset for unsupervised hyperspectral band selection. IEEE Trans. Image Process. 26:1 (2017), 51–64.
57. Yu, Y., Guan, H., Zai, D., Ji, Z., Rotation-and-scale-invariant airplane detection in high-resolution satellite images based on deep-hough-forests. ISPRS J. Photogram. Rem. Sens. 112 (2016), 50–64.
58. Zhang, F., Du, B., Zhang, L., Saliency-guided unsupervised feature learning for scene classification. IEEE Trans. Geosci. Rem. Sens. 53:4 (2015), 2175–2184.
59. Zhang, P., Gong, M., Su, L., Liu, J., Li, Z., Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images. ISPRS J. Photogram. Rem. Sens. 116 (2016), 24–41.
60. Zhao, W., Du, S., Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J. Photogram. Rem. Sens. 113 (2016), 155–165.