A new deep convolutional neural network for fast hyperspectral image classification

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 145, Issue , 2018, Pages 120-147

  Paoletti, M E ^a   Haut, J M ^a   Plaza, J ^a   Plaza, A ^a  

^a UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Classification; Convolutional neural networks (CNNs); Deep learning; Graphics processing units (GPUs); Hyperspectral imaging

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER GRAPHICS; CONVOLUTION; DEEP LEARNING; DEEP NEURAL NETWORKS; GRAPHICS PROCESSING UNIT; HYPERSPECTRAL IMAGING; IMAGE RECOGNITION; INDEPENDENT COMPONENT ANALYSIS; NEURAL NETWORKS; PROGRAM PROCESSORS; SPECTROSCOPY;

COMPUTATION TIME; CONVOLUTIONAL NEURAL NETWORK; DEEP CONVOLUTIONAL NEURAL NETWORKS; HIGH-DIMENSIONAL; MULTIDIMENSIONAL DATA; REMOTELY SENSED IMAGERY; SPATIAL INFORMATIONS; TWO DIMENSIONAL IMAGES;

IMAGE CLASSIFICATION;

ACCURACY ASSESSMENT; ARTIFICIAL NEURAL NETWORK; DATA SET; DETECTION METHOD; EXPERIMENTAL STUDY; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGING METHOD; MULTISPECTRAL IMAGE; SATELLITE IMAGERY; SPATIAL ANALYSIS; TWO-DIMENSIONAL MODELING;

EID: 85036494607     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2017.11.021     Document Type: Article

References (85)

1. Atkinson, P.M., Tatnall, A.R.L., Introduction neural networks in remote sensing. Int. J. Remote Sens. 18:4 (1997), 699–709, 10.1080/014311697218700.
2. Benediktsson, J.A., Swain, P.H., 1990. Statistical Methods and Neural Network Approaches for Classification of Data from Multiple Sources (Ph.D. thesis). Purdue Univ., School of Elect. Eng. West Lafayette, IN.
3. Benediktsson, J.A., Swain, P.H., Ersoy, O.K., Conjugate gradient neural networks in classification of very high dimensional remote sensing data. Int. J. Remote Sens. 14:15 (1993), 2883–2903.
4. Bengio, Y., Learning deep architectures for AI. Mach. Learn. 2:1 (2009), 1–127.
5. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H., Greedy layer-wise training of deep networks. Schölkopf, B., Platt, J., Hoffman, T., (eds.) Advances in Neural Information Processing Systems 19 (NIPS’06), 2007, MIT Press, 153–160.
6. Bishop, C.M., Neural Networks for Pattern Recognition. 1995, Clarendon Press .
7. Böhning, D., Multinomial logistic regression algorithm. Ann. Inst. Stat. Math. 44:1 (1992), 197–200.
8. Camps-Valls, G., Bruzzone, L., Kernel-based methods for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 43:6 (2005), 1351–1362.
9. Chang, C.-I., Hyperspectral Imaging: Techniques for Spectral Detection and Classification. 2003, Springer, US.
10. Chen, Y., Jiang, H., Li, C., Jia, X., Ghamisi, P., Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 54:10 (2016), 6232–6251 .
11. Chen, Y., Lin, Z., Zhao, X., Wang, G., Gu, Y., Deep learning-based classification of hyperspectral data. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 7:6 (2014), 2094–2107.
12. Cheng, G., Han, J., Lu, X., Remote sensing image scene classification: benchmark and state of the art. Proc. IEEE(99), 2017, 1–19.
13. Chien, Y., Pattern classification and scene analysis. IEEE Trans. Autom. Control 19:4 (1974), 462–463.
14. Cho, K., 2014. Foundations and Advances in Deep Learning (Ph.D. thesis). Aalto University.
15. Deng, L., Yu, D., Deep learning: methods and applications. Found. Trends® Signal Process. 7:3–4 (2014), 197–387.
16. Dosovitskiy, A., Springenberg, J.T., Riedmiller, M., Brox, T., Discriminative unsupervised feature learning with convolutional neural networks. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q., (eds.) Advances in Neural Information Processing Systems, vol. 27, 2014, Curran Associates, Inc., 766–774.
17. Duchi, J., Edu, J.B., Hazan, E., Singer, Y., Adaptive subgradient methods for online learning and stochastic optimization∗. J. Mach. Learn. Res. 12 (2011), 2121–2159.
18. Fauvel, M., Benediktsson, J.A., Chanussot, J., Sveinsson, J.R., Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Trans. Geosci. Remote Sens. 46:11 (2008), 3804–3814.
19. Fisher, P., The pixel: a snare and a delusion. Int. J. Remote Sens. 18:3 (1997), 679–685.
20. García, V., Sánchez, J.S., Mollineda, R.A., Classification of high dimensional and imbalanced hyperspectral imagery data. Proceedings Pattern Recognition and Image Analysis: 5th Iberian Conference, IbPRIA 2011, Las Palmas de Gran Canaria, Spain, June 8–10, 2011, 2011, Springer, Berlin, Heidelberg, 644–651.
21. Ghamisi, P., Plaza, J., Chen, Y., Li, J., Plaza, A., Advanced supervised spectral classifiers for hyperspectral images: a review. IEEE Geosci. Remote Sens. Mag. 5:1 (2017), 8–32.
22. Glorot, X., Bengio, Y., 2010. Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS10). Society for Artificial Intelligence and Statistics. pp. 249–256.
23. Glorot, X., Bordes, A., Bengio, Y., 2011. Deep sparse rectifier neural networks. In: Gordon, Geoffrey J., Dunson, David B. (Ed.), Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11). Journal of Machine Learning Research – Workshop and Conference Proceedings, pp. 315–323.
24. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y., Generative adversarial nets. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q., (eds.) Advances in Neural Information Processing Systems, vol. 27, 2014, Curran Associates, Inc., 2672–2680.
25. Green, R.O., Eastwood, M.L., Sarture, C.M., Chrien, T.G., Aronsson, M., Chippendale, B.J., Faust, J.A., Pavri, B.E., Chovit, C.J., Solis, M., Olah, M.R., Williams, O., Imaging spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). Remote Sens. Environ. 65:3 (1998), 227–248.
26. Haut, J.M., Paoletti, M., Plaza, J., Plaza, A., Cloud implementation of the k-means algorithm for hyperspectral image analysis. J. Supercomput. 73:1 (2017), 514–529, 10.1007/s11227-016-1896-3.
27. Haut, J.M., Paoletti, M.E., Paz-Gallardo, A., Plaza, J., Plaza, A., 2017b. Cloud implementation of logistic regression for hyperspectral image classification. In: Vigo-Aguiar, J. (Ed.), Proceedings of the 17th International Conference on Computational and Mathematical Methods in Science and Engineering, CMMSE 2017. pp. 1063–2321.
28. He, H., Garcia, E.A., Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21:9 (2009), 1263–1284.
29. He, M., Li, X., Zhang, Y., Zhang, J., Wang, W., 2016. Hyperspectral image classification based on deep stacking network. In: 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). pp. 3286–3289.
30. Hinton, G., Salakhutdinov, R., Reducing the dimensionality of data with neural networks. Science 313 (2006), 504–507.
31. Hinton, G.E., Osindero, S., Teh, Y.-W., A fast learning algorithm for deep belief nets. Neural Comput. 18:7 (2006), 1527–1554.
32. Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R., 2012. Improving neural networks by preventing co-adaptation of feature detectors. CoRR. Available from: 1207.0580.
33. Hochreiter, S., Schmidhuber, J., Long short-term memory. Neural Comput. 9:8 (1997), 1735–1780.
34. Hu, F., Xia, G.-S., Hu, J., Zhang, L., Foody, G.M., Wang, L., Thenkabail, P.S., Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery in surveying, mapping and remote sensing. Remote Sens. 7:11 (2015), 14680–14707 .
35. Hu, W., Huang, Y., Wei, L., Zhang, F., Li, H., Deep convolutional neural networks for hyperspectral image classification. J. Sensors, 2015.
36. Jarrett, K., Kavukcuoglu, K., Ranzato, M.A., Lecun, Y., What is the best multi-stage architecture for object recognition?. ICCV, 2009, IEEE, 2146–2153.
37. Karhunen, J., Raiko, T., Cho, K., 2015. Unsupervised Deep Learning: A Short Review.
38. Khodadadzadeh, M., Li, J., Plaza, A., Ghassemian, H., Bioucas-Dias, J.M., Li, X., Spectral-spatial classification of hyperspectral data using local and global probabilities for mixed pixel characterization. IEEE Trans. Geosci. Remote Sens. 52:10 (2014), 6298–6314.
39. Kingma, D.P., Ba, J.L., 2014. ADAM: {A} method for stochastic optimization. CoRR. Available from: 1412.6980.
40. Kunkel, B., Blechinger, F., Lutz, R., Doerffer, R., van der Piepen, H., 1988. ROSIS (Reflective Optics System Imaging Spectrometer) – A candidate instrument for polar platform missions. In: Seeley, J., Bowyer, S. (Eds.), Optoelectronic technologies for remote sensing from space. pp. 134–141.
41. Larochelle, H., Bengio, Y., 2008. Classification using discriminative restricted boltzmann machines. In: Proceedings of the 25th International Conference on Machine learning – ICML ’08, pp. 536.
42. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
43. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., 1998a. Gradient-based learning applied to document recognition. Proc. IEEE.
44. LeCun, Y.A., Bottou, L., Orr, G.B., Müller, K.R., Efficient backprop. Neural Networks: Tricks of the Trade, This Book is an Outgrowth of a 1996 NIPS Workshop, 1998, Springer-Verlag, 9–50.
45. Li, J., Bioucas-Dias, J.M., Plaza, A., Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning. IEEE Trans. Geosci. Remote Sens. 48:11 (2010), 4085–4098.
46. Li, J., Bioucas-Dias, J.M., Plaza, A., Hyperspectral image segmentation using a new Bayesian approach with active learning. IEEE Trans. Geosci. Remote Sens. 49:10 (2011), 3947–3960.
47. Li, M., Zang, S., Zhang, B., Li, S., Wu, C., A review of remote sensing image classification techniques: the role of spatio-contextual information. Eur. J. Remote Sens. 47 (2014), 389–411.
48. Li, T., Zhang, J., Zhang, Y., 2014b. Classification of hyperspectral image based on deep belief networks. In: Image Processing (ICIP), 2014 IEEE International Conference on. pp. 5132–5136.
49. Li, Y., Zhang, H., Shen, Q., Spectral-spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens., 9(1), 2017, 67.
50. Licciardi, G.A., Del Frate, F., Pixel unmixing in hyperspectral data by means of neural networks. IEEE Trans. Geosci. Remote Sens. 49:11 (2011), 4163–4172.
51. Liu, B., Yu, X., Zhang, P., Tan, X., Yu, A., Xue, Z., A semi-supervised convolutional neural network for hyperspectral image classification. Remote Sens. Lett. 8:9 (2017), 839–848, 10.1080/2150704X.2017.1331053.
52. Liu, Q., Hang, R., Song, H., Zhu, F., Plaza, J., Plaza, A., 2016. Adaptive Deep Pyramid Matching for Remote Sensing Scene Classification. CoRR. Available from: 1611.03589.
53. Lu, X., Zheng, X., Yuan, Y., Remote sensing scene classification by unsupervised representation learning. IEEE Trans. Geosci. Remote Sens.(99), 2017, 1–10.
54. Ma, X., Wang, H., Wang, J., Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning. ISPRS J. Photogramm. Remote Sens. 120 (2016), 99–107.
55. Melgani, F., Bruzzone, L., Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans. Geosci. Remote Sens., 42(8), 2004.
56. Midhun, E.M., Nair, S.R., Prabhakar, N., Kumar, S., Deep model for classification of hyperspectral image using restricted Boltzmann machine. Proceedings of the 2014 International Conference on Interdisciplinary Advances in Applied Computing, 2014, ACM, New York, NY, USA, 35:1–35:7.
57. Nair, V., Hinton, G.E., Rectified linear units improve restricted Boltzmann machines. Fürnkranz, Johannes, Joachims, Thorsten, (eds.) Proceedings of the 27th International Conference on Machine Learning (ICML-10), 2010, Omnipress, 807–814.
58. Paoletti, M.E., Haut, J.M., Plaza, J., Plaza, A., 2017. Yinyang K-means clustering for hyperspectral image analysis. In: Vigo-Aguiar, J. (Ed.), Proceedings of the 17th International Conference on Computational and Mathematical Methods in Science and Engineering. Rota, pp. 1625–1636.
59. Plaza, A., Benediktsson, J.A., Boardman, J.W., Brazile, J., Bruzzone, L., Camps-Valls, G., Chanussot, J., Fauvel, M., Gamba, P., Gualtieri, A., Marconcini, M., Tilton, J.C., Trianni, G., Recent advances in techniques for hyperspectral image processing. Remote Sens. Environ. 113:1 (2009), S110–S122.
60. Qian, N., On the momentum term in gradient descent learning algorithms. Neural Netw. 12:1 (1999), 145–151.
61. Rajan, S., Ghosh, J., Crawford, M.M., An active learning approach to hyperspectral data classification. IEEE Trans. Geosci. Remote Sens. 46:4 (2008), 1231–1242.
62. Ranzato, M.A., Poultney, C., Chopra, S., Lecun, Y., Efficient learning of sparse representations with an energy-based model. Schölkopf, B., Platt, J., Hoffman, T., (eds.) Advances in Neural Information Processing Systems, vol. 19, 2006, MIT Press, 1137–1144.
63. Romero, A., Gatta, C., Camps-Valls, G., Unsupervised deep feature extraction for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 54:3 (2016), 1349–1362.
64. Salakhutdinov, R., Hinton, G., 2009. Deep boltzmann machines. In: 12th International Conference on Artificial Intelligence and Statistics, pp. 3.
65. Scholkopf, B., Smola, A.J., Learning with Kernels:Support Vector Machines, Regularization, Optimization, and Beyond. 2001, MIT Press, Cambridge, MA, USA.
66. Smolensky, P., Information processing in dynamical systems: foundations of harmony theory. Rumelhart, David E., McLelland, J.L., (eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Foundations, vol. 1, 1986, MIT Press, 194–281 (Chapter 6).
67. Starck, J.-L., Elad, M., Donoho, D.L., Image decomposition via the combination of sparse representations and a variational approach. IEEE Trans. Image Process. 14:10 (2005), 1570–1582.
68. Tarabalka, Y., Benediktsson, J.A., Chanussot, J., Spectral-spatial classification of hyperspectral imagery based on partitional clustering techniques. IEEE Trans. Geosci. Remote Sens. 47:8 (2009), 2973–2987.
69. Vetrivel, A., Gerke, M., Kerle, N., Nex, F., Vosselman, G., Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning. ISPRS J. Photogramm. Remote Sens. 140 (2018), 45–59.
70. Wu, Q., Diao, W., Dou, F., Sun, X., Zheng, X., Fu, K., Zhao, F., Shape-based object extraction in high-resolution remote-sensing images using deep Boltzmann machine. Int. J. Remote Sens. 37:24 (2016), 6012–6022.
71. Wu, Z., Wang, Q., Plaza, A., Li, J., Wei, Z., Real-time implementation of the sparse multinomial logistic regression for hyperspectral image classification on GPUs. IEEE Geosci. Remote Sens. Lett. 12:7 (2015), 1456–1460.
72. Xu, X., Li, J., Huang, X., Dalla Mura, M., Plaza, A., Multiple morphological component analysis based decomposition for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 54:5 (2016), 3083–3102.
73. Xu, X., Lil, f., Plaza, A., 2016b. Fusion of hyperspectral and LiDAR data using morphological component analysis. In: 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 3575–3578.
74. Yang, H., A back-propagation neural network for mineralogical mapping from AVIRIS data. Int. J. Remote Sens. 20:1 (1999), 97–110, 10.1080/014311699213622.
75. Yang, J., Zhao, Y., Chan, J.C.W., Yi, C., 2016. Hyperspectral image classification using two-channel deep convolutional neural network. In: 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 5079–5082.
76. Yu, S., Jia, S., Xu, C., 1, Convolutional neural networks for hyperspectral image classification. Neurocomputing 219 (2017), 88–98.
77. Yuan, Y., Mou, L., Lu, X., Scene recognition by manifold regularized deep learning architecture. IEEE Trans. Neural Netw. Learn. Syst. 26:10 (2015), 2222–2233.
78. Zeiler, M.D., 2012. ADADELTA: An Adaptive Learning Rate Method. CoRR. Available from: < 1212.5701>.
79. Zeiler, M.D., Krishnan, D., Taylor, G.W., Fergus, R., June 2010. Deconvolutional networks. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2528–2535.
80. Zhang, H., Li, Y., Zhang, Y., Shen, Q., Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network. Remote Sens. Lett. 8:5 (2017), 438–447.
81. Zhang, L., Zhang, L., Du, B., Deep learning for remote sensing data advances in machine learning for remote sensing and geosciences. IEEE Geosci. Remote Sens. Mag. 4:2 (2016), 22–40 .
82. Zhang, P., Gong, M., Su, L., Liu, J., Li, Z., Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images. ISPRS J. Photogramm. Remote Sens. 116 (2016), 24–41.
83. Zhao, W., Du, S., Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J. Photogramm. Remote Sens. 128 (2016), 223–239.
84. Zhao, W., Du, S., Spectral-spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54:8 (2016), 4544–4554.
85. Zhou, X., Prasad, S., Active and semisupervised learning with morphological component analysis for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 14:8 (2017), 1348–1352.