Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images via Convolutional Neural Networks

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 8, 2017, Pages 4520-4533

  Mei, Shaohui ^a   Ji, Jingyu ^a   Hou, Junhui ^b   Li, Xu ^a   Du, Qian ^c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^c MISSISSIPPI STATE UNIVERSITY   (United States)

Author keywords

Classification; convolutional neural network (CNN); feature learning; hyperspectral; spatial spectral

Indexed keywords

BENCHMARKING; CLASSIFICATION (OF INFORMATION); CONVOLUTION; NEURAL NETWORKS; SPECTROMETERS; SPECTROSCOPY; TARGET TRACKING;

ACTIVATION FUNCTIONS; AIRBORNE VISIBLE/INFRARED IMAGING SPECTROMETERS; CLASSIFICATION METHODS; CONVOLUTIONAL NEURAL NETWORK; HYPERSPECTRAL SENSORS; IMAGING SPECTROMETERS; REFLECTIVE OPTICS; SPECTRAL INFORMATION;

HYPERSPECTRAL IMAGING;

ARTIFICIAL NEURAL NETWORK; AVIRIS; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGING METHOD; MACHINE LEARNING; MULTISPECTRAL IMAGE; PARAMETERIZATION; SENSOR; SPATIAL ANALYSIS; SPECTROMETER; SPECTRUM; SUPERVISED LEARNING; UNSUPERVISED CLASSIFICATION;

EID: 85018902434     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2693346     Document Type: Article

References (43)

1. A. Zare and K. Ho, "Endmember variability in hyperspectral analysis: Addressing spectral variability during spectral unmixing," IEEE Signal Process. Mag., vol. 31, no. 1, pp. 95-104, Jan. 2014.
2. C. Rodarmel and J. Shan, "Principal component analysis for hyperspectral image classification," Surv. Land Inf. Sci., vol. 62, no. 2, p. 115, 2002.
3. M. D. Farrell and R. M. Mersereau, "On the impact of PCA dimension reduction for hyperspectral detection of difficult targets," IEEE Geosci. Remote Sens. Lett., vol. 2, no. 2, pp. 192-195, Apr. 2005.
4. Q. Du and J. E. Fowler, "Hyperspectral image compression using JPEG2000 and principal component analysis," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 2, pp. 201-205, Apr. 2007.
5. A. A. Green, M. Berman, P. Switzer, and M. D. Craig, "A transformation for ordering multispectral data in terms of image quality with implications for noise removal," IEEE Trans. Geosci. Remote Sens., vol. 26, no. 1, pp. 65-74, Jan. 1988.
6. X. Jia and J. A. Richards, "Segmented principal components transformation for efficient hyperspectral remote-sensing image display and classification," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 1, pp. 538-542, Jan. 1999.
7. Z. Yang, L. Guo, X. Luo, and X. Hu, "Research on segmented PCA based on band selection algorithm of hyperspectral image," Eng. Surv. Mapping, vol. 15, no. 3, pp. 15-18, 2006.
8. Q. Du and C.-I. Chang, "Segmented PCA-based compression for hyperspectral image analysis," Proc. SPIE, vol. 5268, pp. 274-281, Feb. 2004.
9. Q. Du, W. Zhu, H. Yang, and J. E. Fowler, "Segmented principal component analysis for parallel compression of hyperspectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 6, no. 4, pp. 713-717, Oct. 2009.
10. J. Zabalza et al., "Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing," ISPRS J. Photogramm. Remote Sens., vol. 93, pp. 112-122, Jul. 2014.
11. M. Fauvel, J. Chanussot, and J. A. Benediktsson, "Kernel principal component analysis for the classification of hyperspectral remote sensing data over urban areas," EURASIP J. Adv. Signal Process., vol. 2009, p. 11, Jan. 2009.
12. G. Licciardi, P. R. Marpu, J. Chanussot, and J. A. Benediktsson, "Linear versus nonlinear PCA for the classification of hyperspectral data based on the extended morphological profiles," IEEE Geosci. Remote Sens. Lett., vol. 9, no. 3, pp. 447-451, May 2012.
13. M. Lennon, G. Mercier, M. Mouchot, and L. Hubert-Moy, "Independent component analysis as a tool for the dimensionality reduction and the representation of hyperspectral images," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), vol. 6. Jul. 2001, pp. 2893-2895.
14. D. Lunga, S. Prasad, M. M. Crawford, and O. Ersoy, "Manifold-learningbased feature extraction for classification of hyperspectral data: A review of advances in manifold learning," IEEE Signal Process. Mag., vol. 31, no. 1, pp. 55-66, Jan. 2014.
15. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
16. B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, 1998.
17. C. M. Bachmann, T. L. Ainsworth, and R. A. Fusina, "Exploiting manifold geometry in hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 441-454, Mar. 2005.
18. W. Li, S. Prasad, J. E. Fowler, and L. M. Bruce, "Locality-preserving discriminant analysis in kernel-induced feature spaces for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 5, pp. 894-898, Sep. 2011.
19. W. Li, S. Prasad, J. E. Fowler, and L. M. Bruce, "Localitypreserving dimensionality reduction and classification for hyperspectral image analysis," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 4, pp. 1185-1198, Apr. 2012.
20. L. Zhang, L. Zhang, D. Tao, and X. Huang, "Sparse transfer manifold embedding for hyperspectral target detection," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 2, pp. 1030-1043, Feb. 2014.
21. Q. Du and C.-I. Chang, "A linear constrained distance-based discriminant analysis for hyperspectral image classification," Pattern Recognit., vol. 34, no. 2, pp. 361-373, 2001.
22. Q. Du, "Modified Fisher's linear discriminant analysis for hyperspectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 4, pp. 503-507, Oct. 2007.
23. X. Huang and L. Zhang, "A comparative study of spatial approaches for urban mapping using hyperspectral ROSIS images over Pavia City, northern Italy," Int. J. Remote Sens., vol. 30, no. 12, pp. 3205-3221, 2009.
24. J. Wen, Z. Tian, X. Liu, and W. Lin, "Neighborhood preserving orthogonal PNMF feature extraction for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 2, pp. 759-768, Apr. 2013.
25. M. Fauvel, Y. Tarabalka, J. A. Benediktsson, J. Chanussot, and J. C. Tilton, "Advances in spectral-spatial classification of hyperspectral images," Proc. IEEE, vol. 101, no. 3, pp. 652-675, Mar. 2013.
26. A. Plaza, P. Martinez, J. Plaza, and R. Perez, "Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 466-479, Mar. 2005.
27. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Adv. Neural Inf. Process. Syst., vol. 25, no. 2, pp. 1097-1105, 2012.
28. Y. Chen, Z. Lin, X. Zhao, G. Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.
29. W. Hu, Y. Huang, W. Li, F. Zhang, and H. Li, "Deep convolutional neural networks for hyperspectral image classification," J. Sens., vol. 2015, Jul. 2015, Art. no. 258619.
30. K. Makantasis, K. Karantzalos, A. Doulamis, and N. Doulamis, "Deep supervised learning for hyperspectral data classification through convolutional neural networks," in Proc. IEEE Geosci. Remote Sens. Symp., Jul. 2015, pp. 4959-4962.
31. W. Zhao and S. Du, "Spectral-spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4544-4554, Aug. 2016.
32. W. Li, G. Wu, F. Zhang, and Q. Du, "Hyperspectral image classification using deep pixel-pair features," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 2, pp. 844-853, Feb. 2017.
33. S. Ioffe and C. Szegedy. (Feb. 2015). "Batch normalization: Accelerating deep network training by reducing internal covariate shift." [Online]. Available: https://arxiv.org/abs/1502.03167
34. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, 2014.
35. K. He, X. Zhang, S. Ren, and J. Sun. (Feb. 2015). "Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification." [Online]. Available: https://arxiv.org/abs/1502.01852
36. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 580-587.
37. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
38. Y. L. Boureau, J. Ponce, and Y. LeCun, "A theoretical analysis of feature pooling in visual recognition," in Proc. Int. Conf. Mach. Learn., 2010, pp. 111-118.
39. G. Camps-Valls, L. Gomez-Chova, J. Munoz-Mari, J. Vila-Frances, and J. Calpe-Maravilla, "Composite kernels for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 3, no. 1, pp. 93-97, Jan. 2006.
40. W. Li and Q. Du, "Joint within-class collaborative representation for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2200-2208, Jun. 2014.
41. Y. Chen, N. M. Nasrabadi, and T. D. Tran, "Hyperspectral image classification using dictionary-based sparse representation," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 10, pp. 3973-3985, Oct. 2011.
42. Y. Jia et al. (Jun. 2014). "Caffe: Convolutional architecture for fast feature embedding." [Online]. Available: https://arxiv.org/abs/1408.5093
43. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011.