Going Deeper with Contextual CNN for Hyperspectral Image Classification

IEEE Transactions on Image Processing

Volumn 26, Issue 10, 2017, Pages 4843-4855

  Lee, Hyungtae ^a,b   Kwon, Heesung ^b  

^a BOOZ ALLEN HAMILTON   (United States)

^b U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

Convolutional neural network (CNN); fully convolutional network (FCN); hyperspectral image classification; multi scale filter bank; residual learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; DEEP NEURAL NETWORKS; FILTER BANKS; HYPERSPECTRAL IMAGING; NEURAL NETWORKS; PIXELS; SPECTROSCOPY;

CLASSIFICATION PERFORMANCE; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORKS (CNN); DEEP CONVOLUTIONAL NEURAL NETWORKS; MULTI-SCALE; PERFORMANCE COMPARISON; RESIDUAL LEARNING; STATE-OF-THE-ART APPROACH;

IMAGE CLASSIFICATION;

EID: 85023605626     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2017.2725580     Document Type: Article

References (44)

1. Y. Chen, Z. Lin, X. Zhao, G. Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.
2. W. Hu, Y. Huang, L. Wei, F. Zhang, and H. Li, "Deep convolutional neural networks for hyperspectral image classification," J. Sensors, vol. 2015, Jan. 2015, Art. no. 258619.
3. W. Zhao and S. Du, "Spectral-spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4544-4554, Aug. 2016.
4. Y. Chen, H. Jiang, C. Li, X. Jia, and P. Ghamisi, "Deep feature extraction and classification of hyperspectral images based on convolutional neural networks," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 6232-6251, Oct. 2016.
5. P. Liu, H. Zhang, and K. B. Eom, "Active deep learning for classification of hyperspectral images," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 2, pp. 712-724, Feb. 2017.
6. P. Zhong, Z. Gong, S. Li, and C.-B. Schönlieb, "Learning to diversify deep belief networks for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 55, no. 6, pp. 3516-3530, Jun. 2017.
7. Y. Chen, X. Zhao, and X. Jia, "Spectral-spatial classification of hyperspectral data based on deep belief network," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 6, pp. 2381-2392, Jun. 2015.
8. T. Li, J. Zhang, and Y. Zhang, "Classification of hyperspectral image based on deep belief networks," in Proc. IEEE Conf. Image Process. (ICIP), Oct. 2014, pp. 5132-5136.
9. K. Pearson, "On lines and planes of closest fit to systems of points in space," Philos. Mag., vol. 2, no. 6, pp. 559-572, 1901.
10. X. Wang, Y. Kong, Y. Gao, and Y. Cheng, "Dimensionality reduction for hyperspectral data based on pairwise constraint discriminative analysis and nonnegative sparse divergence," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 4, pp. 1552-1562, Apr. 2017.
11. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016, pp. 770-778.
12. C. Szegedy et al., "Going deeper with convolutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 1-9.
13. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 3431-3440.
14. H. Lee and H. Kwon, "Contextual deep CNN based hyperspectral classification," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Jul. 2016, pp. 3322-3325.
15. Y. LeCun et al., "Backpropagation applied to handwritten zip code recognition," Neural Comput., vol. 1, no. 4, pp. 541-551, 1989.
16. A. Krizhevsky, I. Sutskever, and G. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Conf. Adv. Neural Inf. Process. Syst. (NIPS), 2012, pp. 1097-1105.
17. J. Deng, W. Dong, R. Socher, L. J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 248-255.
18. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learn. Represent. (ICLR), 2015, pp. 1-32.
19. P. Gurram and H. Kwon, "Sparse kernel-based ensemble learning with fully optimized kernel parameters for hyperspectral classification problems," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 787-802, Feb. 2013.
20. Y. Gu, T. Liu, X. Jia, J. A. Benediktsson, and J. Chanussot, "Nonlinear multiple kernel learning with multiple-structure-element extended morphological profiles for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3235-3247, Jun. 2016.
21. F. de Morsier, M. Borgeaud, V. Gass, J.-P. Thiran, and D. Tuia, "Kernel low-rank and sparse graph for unsupervised and semi-supervised classification of hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3410-3420, Jun. 2016.
22. J. Liu, Z. Wu, J. Li, A. Plaza, and Y. Yuan, "Probabilistic-kernel collaborative representation for spatial-spectral hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 4, pp. 2371-2384, Apr. 2016.
23. Q. Wang, Y. Gu, and D. Tuia, "Discriminative multiple kernel learning for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 7, pp. 3912-3927, Jul. 2016.
24. B. Guo, S. R. Gunn, R. I. Demper, and J. D. B. Nelson, "Customizing kernel functions for SVM-based hyperspectral image classification," IEEE Trans. Image Process., vol. 17, no. 4, pp. 622-629, Apr. 2008.
25. L. Yang, M. Wang, S. Yang, R. Zhang, and P. Zhang, "Sparse spatiospectral LapSVM with semisupervised kernel propagation for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 5, pp. 2046-2054, May 2017.
26. R. Roscher and B. Waske, "Shapelet-based sparse representation for landcover classification of hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1623-1634, Mar. 2016.
27. J. Liu and W. Lu, "A probabilistic framework for spectral-spatial classification of hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 9, pp. 5375-5384, Sep. 2016.
28. A. Zehtabian and H. Ghassemian, "Automatic object-based hyperspectral image classification using complex diffusions and a new distance metric," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 7, pp. 4106-4114, Jul. 2016.
29. S. Jia, J. Hu, Y. Xie, L. Shen, X. Jia, and Q. Li, "Gabor cube selection based multitask joint sparse representation for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3174-3187, Jun. 2016.
30. J. Xia, J. Chanussot, P. Du, and X. He, "Rotation-based support vector machine ensemble in classification of hyperspectral data with limited training samples," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1519-1531, Mar. 2016.
31. Z. Zhong, B. Fan, K. Ding, H. Li, S. Xiang, and C. Pan, "Efficient multiple feature fusion with hashing for hyperspectral imagery classification: A comparative study," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4461-4478, Aug. 2016.
32. J. Xia, L. Bombrun, T. Adali, Y. Berthoumieu, and C. Germain, "Spectral-spatial classification of hyperspectral images using ICA and edge-preserving filter via an ensemble strategy," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4971-4982, Aug. 2016.
33. H. L. Yang and M. M. Crawford, "Spectral and spatial proximity-based manifold alignment for multitemporal hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 1, pp. 51-64, Jan. 2016.
34. M. A. Toksöz and I. Ulusoy, "Hyperspectral image classification via basic thresholding classifier," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 7, pp. 4039-4051, Jul. 2016.
35. P. Zhong and R. Wang, "Learning conditional random fields for classification of hyperspectral images," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1890-1907, Jul. 2010.
36. K. Bernard, Y. Tarabaika, J. Angulo, J. Chanussot, and J. A. Benediktsson, "Spectral-spatial classification of hyperspectral data based on a stochastic minimum spanning forest approach," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2008-2021, Apr. 2012.
37. Y. Gao, R. Ji, P. Cui, Q. Dai, and G. Hua, "Hyperspectral image classification through bilayer graph-based learning," IEEE Trans. Image Process., vol. 23, no. 7, pp. 2769-2778, Jul. 2014.
38. M. Brell, K. Segl, L. Guanter, and B. Bookhagen, "Hyperspectral and lidar intensity data fusion: A framework for the rigorous correction of illumination, anisotropic effects, and cross calibration," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 5, pp. 2799-2810, May 2017.
39. S. Jia, J. Hu, J. Zhu, X. Jia, and Q. Li, "Three-dimensional local binary patterns for hyperspectral imagery classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 4, pp. 2399-2413, Apr. 2017.
40. S. Jia, B. Deng, J. Zhu, X. Jia, and Q. Li, "Superpixel-based multitask learning framework for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 5, pp. 2575-2588, May 2017.
41. S. Mei, Q. Bi, J. Ji, J. Hou, and Q. Du, "Hyperspectral image classification by exploring low-rank property in spectral or/and spatial domain," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., to be published. [Online.] Available: https://doi.org/10.1109/JSTARS.2017.2650939, doi: 10.1109/JSTARS.2017.2650939.
42. H. Su, Y. Cai, and Q. Du, "Firefly-algorithm-inspired framework with band selection and extreme learning machine for hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 1, pp. 309-320, Jan. 2017.
43. E. V. Strobl and S. Visweswaran, "Deep multiple kernel learning," in Proc. IEEE Int. Conf. Mach. Learn. Appl. (ICMLA), Dec. 2013, pp. 414-417.
44. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Multimedia (ACMMM), 2014, pp. 675-678.