Hyperspectral imagery classification based on semi-supervised 3-D deep neural network and adaptive band selection

Expert Systems with Applications

Volumn 129, Issue , 2019, Pages 246-259

  Sellami, Akrem ^a,b   Farah, Mohamed ^a   Riadh Farah, Imed ^a,b   Solaiman, Basel ^b  

^a UNIVERSITY OF MANOUBA   (Tunisia)

^b ECOLE DES MINES DE NANTES   (France)

Author keywords

Adaptive dimensionality reduction; Convolutional neural network (CNN); Deep learning; Hyperspectral imagery classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; DEEP LEARNING; DEEP NEURAL NETWORKS; NEURAL NETWORKS; REMOTE SENSING; SAMPLING; SPECTROSCOPY;

ADAPTIVE BAND SELECTION; CLASSIFICATION ACCURACY; CONVOLUTIONAL ENCODERS; CONVOLUTIONAL NEURAL NETWORK; CURSE OF DIMENSIONALITY; DIMENSIONALITY REDUCTION; HYPERSPECTRAL IMAGERY CLASSIFICATIONS; LEARNING-BASED METHODS;

IMAGE CLASSIFICATION;

EID: 85064135871     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2019.04.006     Document Type: Article

References (66)

1. Agarwal, A., El-Ghazawi, T., El-Askary, H., Le-Moigne, J., Efficient hierarchical-pca dimension reduction for hyperspectral imagery. Signal processing and information technology, IEEE international symposium on, 2007, IEEE, 353–356.
2. Badrinarayanan, V., Kendall, A., Cipolla, R., SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (2016), 2481–2495.
3. Bai, X., Guo, Z., Wang, Y., Zhang, Z., Zhou, J., Semisupervised hyperspectral band selection via spectral–spatial hypergraph model. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8:6 (2015), 2774–2783.
4. Chang, C.-I., Wang, S., Constrained band selection for hyperspectral imagery. Geoscience and Remote Sensing, IEEE Transactions on 44:6 (2006), 1575–1585.
5. Chen, P., Jiao, L., Liu, F., Gou, S., Zhao, J., Zhao, Z., Dimensionality reduction of hyperspectral imagery using sparse graph learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10:3 (2017), 1165–1181.
6. Chen, Y., Jiang, H., Li, C., Jia, X., Ghamisi, P., Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Transactions on Geoscience and Remote Sensing 54:10 (2016), 6232–6251.
7. Chen, Y., Lin, Z., Zhao, X., Wang, G., Gu, Y., Deep learning-based classification of hyperspectral data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7:6 (2014), 2094–2107.
8. Chen, Y., Zhao, X., Jia, X., Spectral–spatial classification of hyperspectral data based on deep belief network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8:6 (2015), 2381–2392.
9. Chen, Y., Zhu, L., Ghamisi, P., Jia, X., Li, G., Tang, L., Hyperspectral images classification with Gabor filtering and convolutional neural network. IEEE Geoscience and Remote Sensing Letters 14:12 (2017), 2355–2359.
10. Datta, A., Ghosh, S., Ghosh, A., Combination of clustering and ranking techniques for unsupervised band selection of hyperspectral images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8:6 (2015), 2814–2823.
11. Du, H., Qi, H., Wang, X., Ramanath, R., Snyder, W.E., Band selection using independent component analysis for hyperspectral image processing. Applied imagery pattern recognition workshop, 2003. Proceedings. 32nd, 2003, IEEE, 93–98.
12. Fauvel, M., Chanussot, J., Benediktsson, J.A., Kernel principal component analysis for feature reduction in hyperspectrale images analysis. Signal processing symposium, 2006. NORSIG 2006. Proceedings of the 7th nordic, 2006, IEEE, 238–241.
13. Fauvel, M., Tarabalka, Y., Benediktsson, J.A., Chanussot, J., Tilton, J.C., Advances in spectral-spatial classification of hyperspectral images. Proceedings of the IEEE 101:3 (2013), 652–675.
14. Feng, J., Jiao, L., Liu, F., Sun, T., Zhang, X., Mutual-information-based semi-supervised hyperspectral band selection with high discrimination, high information, and low redundancy. IEEE Transactions on Geoscience and Remote Sensing 53:5 (2015), 2956–2969.
15. Feng, J., Jiao, L., Liu, F., Sun, T., Zhang, X., Unsupervised feature selection based on maximum information and minimum redundancy for hyperspectral images. Pattern Recognition 51 (2016), 295–309.
16. Feng, J., Jiao, L., Zhang, X., Sun, T., Hyperspectral band selection based on trivariate mutual information and clonal selection. IEEE Transactions on Geoscience and Remote Sensing 52:7 (2014), 4092–4105.
17. Ghamisi, P., Chen, Y., Zhu, X.X., A self-improving convolution neural network for the classification of hyperspectral data. IEEE Geoscience and Remote Sensing Letters 13:10 (2016), 1537–1541.
18. He, X., Niyogi, P., Locality preserving projections. Advances in neural information processing systems 16, 2003, MIT Press, 153–160.
19. Hoyer, P.O., Non-negative matrix factorization with sparseness constraints. Journal of Machine Learning Research 5:Nov (2004), 1457–1469.
20. Hu, W., Huang, Y., Wei, L., Zhang, F., Li, H., Deep convolutional neural networks for hyperspectral image classification. Journal of Sensors, 2015, 2015.
21. Huang, H., Li, J., Liu, J., Enhanced semi-supervised local fisher discriminant analysis for face recognition. Future Generation Computer Systems 28:1 (2012), 244–253.
22. Hughes, G., On the mean accuracy of statistical pattern recognizers. IEEE Transactions on Information Theory 14:1 (1968), 55–63.
23. Jamshidpour, N., Safari, A., Homayouni, S., Spectral–spatial semisupervised hyperspectral classification using adaptive neighborhood. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10:9 (2017), 4183–4197.
24. Jia, S., Ji, Z., Qian, Y., Shen, L., Unsupervised band selection for hyperspectral imagery classification without manual band removal. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5:2 (2012), 531–543.
25. Jiang, X., Gong, M., Li, H., Zhang, M., Li, J., A two-phase multiobjective sparse unmixing approach for hyperspectral data. IEEE Transactions on Geoscience and Remote Sensing 56:1 (2018), 508–523.
26. Jiao, L., Feng, J., Liu, F., Sun, T., Zhang, X., Semisupervised affinity propagation based on normalized trivariable mutual information for hyperspectral band selection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8:6 (2015), 2760–2773.
27. Karami, A., Yazdi, M., Asli, A.Z., Noise reduction of hyperspectral images using kernel non-negative tucker decomposition. IEEE Journal of Selected Topics in Signal Processing 5:3 (2011), 487–493.
28. Khan, Z., Shafait, F., Mian, A., Joint group sparse pca for compressed hyperspectral imaging. IEEE Transactions on Image Processing 24:12 (2015), 4934–4942.
29. Kim, S.B., Rattakorn, P., Unsupervised feature selection using weighted principal components. Expert Systems with Applications 38:5 (2011), 5704–5710.
30. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 2012, 1097–1105.
31. Lawrence, S., Giles, C.L., Tsoi, A.C., Back, A.D., Face recognition: A convolutional neural-network approach. IEEE Transactions on Neural Networks 8:1 (1997), 98–113.
32. Li, L., Ge, H., Gao, J., A spectral-spatial kernel-based method for hyperspectral imagery classification. Advances in Space Research 59:4 (2017), 954–967.
33. Lu, X., Wu, H., Yuan, Y., Yan, P., Li, X., Manifold regularized sparse nmf for hyperspectral unmixing. IEEE Transactions on Geoscience and Remote Sensing 51:5 (2013), 2815–2826.
34. Ma, X., Wang, H., Wang, J., Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning. ISPRS Journal of Photogrammetry and Remote Sensing 120 (2016), 99–107.
35. Matsuda, H., Physical nature of higher-order mutual information: Intrinsic correlations and frustration. Physical Review E, 62(3), 2000, 3096.
36. Matteoli, S., Diani, M., Corsini, G., A tutorial overview of anomaly detection in hyperspectral images. IEEE Aerospace and Electronic Systems Magazine 25:7 (2010), 5–28.
37. Pal, M., Foody, G.M., Feature selection for classification of hyperspectral data by svm. IEEE Transactions on Geoscience and Remote Sensing 48:5 (2010), 2297–2307.
38. Pan, B., Shi, Z., An, Z., Jiang, Z., Ma, Y., A novel spectral-unmixing-based green algae area estimation method for goci data. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10:2 (2017), 437–449.
39. Pan, C., Li, J., Wang, Y., Gao, X., Collaborative learning for hyperspectral image classification. Neurocomputing 275 (2018), 2512–2524.
40. Passalis, N., Tefas, A., Dimensionality reduction using similarity-induced embeddings. IEEE Transactions on Neural Networks and Learning Systems 29:8 (2018), 3429–3441.
41. Peng, H., Long, F., Ding, C., Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:8 (2005), 1226–1238.
42. Renard, N., Bourennane, S., Dimensionality reduction based on tensor modeling for classification methods. IEEE Transactions on Geoscience and Remote Sensing 47:4 (2009), 1123–1131.
43. Scherer, D., Müller, A., Behnke, S., Evaluation of pooling operations in convolutional architectures for object recognition. International conference on artificial neural networks, 2010, Springer, 92–101.
44. Sellami, A., Farah, I.R., High-level hyperspectral image classification based on spectro-spatial dimensionality reduction. Spatial Statistics 16 (2016), 103–117.
45. Sellami, A., Farah, M., Farah, I.R., Solaiman, B., Hyperspectral imagery semantic interpretation based on adaptive constrained band selection and knowledge extraction techniques. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11:4 (2018), 1337–1347.
46. Shi, C., Pun, C.-M., Superpixel-based 3d deep neural networks for hyperspectral image classification. Pattern Recognition 74 (2018), 600–616.
47. Simonyan, K., Zisserman, A., Very deep convolutional networks for large-scale image recognition. 3rd International Conference on Learning Representations, ICLR, 2015, San Diego, CA, USA arXiv: 1409.1556.
48. Sosna, M., Trevinyo-Rodríguez, R.N., Velamuri, S.R., Business model innovation through trial-and-error learning: The naturhouse case. Long range planning 43:2-3 (2010), 383–407.
49. Sotoca, J.M., Pla, F., Supervised feature selection by clustering using conditional mutual information-based distances. Pattern Recognition 43:6 (2010), 2068–2081.
50. Su, H., Yang, H., Du, Q., Sheng, Y., Semisupervised band clustering for dimensionality reduction of hyperspectral imagery. IEEE Geoscience and Remote Sensing Letters 8:6 (2011), 1135–1139.
51. Verrelst, J., Rivera, J.P., Gitelson, A., Delegido, J., Moreno, J., Camps-Valls, G., Spectral band selection for vegetation properties retrieval using gaussian processes regression. International Journal of Applied Earth Observation and Geoinformation 52 (2016), 554–567.
52. Wang, J., Zhang, K., Wang, P., Madani, K., Sabourin, C., Unsupervised band selection using block-diagonal sparsity for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters 14:11 (2017), 2062–2066.
53. Wen, J., Fowler, J.E., He, M., Zhao, Y.-Q., Deng, C., Menon, V., Orthogonal nonnegative matrix factorization combining multiple features for spectral–spatial dimensionality reduction of hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing 54:7 (2016), 4272–4286.
54. Wu, B., Zhu, Y., Huang, X., Li, J., Generalization of spectral fidelity with flexible measures for the sparse representation classification of hyperspectral images. International Journal of Applied Earth Observation and Geoinformation 52 (2016), 275–283.
55. Xia, J., Dalla Mura, M., Chanussot, J., Du, P., He, X., Random subspace ensembles for hyperspectral image classification with extended morphological attribute profiles. IEEE Transactions on Geoscience and Remote Sensing 53:9 (2015), 4768–4786.
56. Xu, X., Li, J., Wu, C., Plaza, A., Regional clustering-based spatial preprocessing for hyperspectral unmixing. Remote Sensing of Environment 204 (2018), 333–346.
57. Xu, X., Shi, Z., Multi-objective based spectral unmixing for hyperspectral images. ISPRS Journal of Photogrammetry and Remote Sensing 124 (2017), 54–69.
58. Yan, C., Bai, X., Ren, P., Bai, L., Tang, W., Zhou, J., Band weighting via maximizing interclass distance for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters 13:7 (2016), 922–925.
59. Yan, S., Xu, D., Zhang, B., Zhang, H.-J., Yang, Q., Lin, S., Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(1), 2007.
60. Yousefi, B., Castanedo, C.I., Bédard, É., Beaudoin, G., Maldague, X.P., Mineral identification in lwir hyperspectral imagery applying sparse-based clustering. Quantitative InfraRed Thermography Journal, 2018, 1–16.
61. Yousefi, B., Sojasi, S., Castanedo, C.I., Maldague, X.P., Beaudoin, G., Chamberland, M., Comparison assessment of low rank sparse-pca based-clustering/classification for automatic mineral identification in long wave infrared hyperspectral imagery. Infrared Physics & Technology 93 (2018), 103–111.
62. Zhao, W., Du, S., Spectral–spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach. IEEE Transactions on Geoscience and Remote Sensing 54:8 (2016), 4544–4554.
63. Zhong, P., Gong, Z., Li, S., Schönlieb, C.-B., Learning to diversify deep belief networks for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing 55:6 (2017), 3516–3530.
64. Zhong, Y., Lin, X., Zhang, L., A support vector conditional random fields classifier with a mahalanobis distance boundary constraint for high spatial resolution remote sensing imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7:4 (2014), 1314–1330.
65. Zhou, X., Li, S., Tang, F., Qin, K., Hu, S., Liu, S., Deep learning with grouped features for spatial spectral classification of hyperspectral images. IEEE Geoscience and Remote Sensing Letters 14:1 (2017), 97–101.
66. Zhou, Y., Peng, J., Chen, C.P., Dimension reduction using spatial and spectral regularized local discriminant embedding for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing 53:2 (2015), 1082–1095.