Multiple 3-D feature fusion framework for hyperspectral image classification

IEEE Transactions on Geoscience and Remote Sensing

Volumn 56, Issue 4, 2018, Pages 1873-1886

  Zhu, Jiasong ^a   Hu, Jie ^a   Jia, Sen ^a   Jia, Xiuping ^b   Li, Qingquan ^a  

^a SHENZHEN UNIVERSITY   (China)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Feature fusion; Hyperspectral image classification; Sparse representation

Indexed keywords

EXTRACTION; FEATURE EXTRACTION; HYPERSPECTRAL IMAGING; IMAGE CLASSIFICATION; IMAGE FUSION; IMAGE PROCESSING; INDEPENDENT COMPONENT ANALYSIS; SPECTROSCOPY; SURFACE MORPHOLOGY; WAVELET TRANSFORMS;

3-D FEATURE EXTRACTION; CURSE OF DIMENSIONALITY; FEATURE FUSION; HYPERSPECTRAL IMAGE DATAS; LOCAL BINARY PATTERNS; MORPHOLOGICAL PROFILE; SHAPE; SPARSE REPRESENTATION;

CLASSIFICATION (OF INFORMATION);

EXTRACTION METHOD; IMAGE ANALYSIS; IMAGE CLASSIFICATION; SATELLITE DATA; SPATIAL ANALYSIS; THREE-DIMENSIONAL MODELING;

HOUSTON; ITALY; LOMBARDY; PAVIA; TEXAS; UNITED STATES;

EID: 85040080279     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2769113     Document Type: Article

References (67)

1. A. Plaza et al., "Recent advances in techniques for hyperspectral image processing," Remote Sens. Environ., vol. 113, pp. S110-S122, Sep. 2009.
2. Q. Tong, Y. Xue, and L. Zhang, "Progress in hyperspectral remote sensing science and technology in China over the past three decades," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 1, pp. 70-91, Jan. 2014.
3. J. M. Bioucas-Dias, A. Plaza, G. Camps-Valls, P. Scheunders, N. M. Nasrabadi, and J. Chanussot, "Hyperspectral remote sensing data analysis and future challenges," IEEE Geosci. Remote Sens. Mag., vol. 1, no. 2, pp. 6-36, Jun. 2013.
4. L. M. Dale et al., "Hyperspectral imaging applications in agriculture and agro-food product quality and safety control: A review," Appl. Spectrosc. Rev., vol. 48, no. 2, pp. 142-159, 2013.
5. W. Li and F. Gan, "Progress in hyperspectral research and monitoring in mine environment," Remote Sens. Land Resour., vol. 28, no. 2, pp. 1-7, Apr. 2016.
6. S. Khan, "Hyperspectral remote sensing for detection of natural hydrocarbon seeps," Asian J. Multidiscipl. Stud., vol. 4, no. 2, pp. 1516-1530, 2016.
7. B. Chen, K. Chehdi, E. De Oliveria, C. Cariou, and B. Charbonnier, "Unsupervised hierarchical partitioning of hyperspectral images: Application to marine algae identification," Proc. SPIE, vol. 9643, p. 96430M, Oct. 2015.
8. J. N. Pelton, Future of Military Satellite Systems. Berlin, Germany: Springer, 2017, pp. 705-719.
9. D. Lu and Q. Weng, "A survey of image classification methods and techniques for improving classification performance," Int. J. Remote Sens., vol. 28, no. 5, pp. 823-870, Jan. 2007.
10. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Hoboken, NJ, USA: Wiley, 2012.
11. S. Kumar, J. Ghosh, and M. M. Crawford, "Best-bases feature extraction algorithms for classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 7, pp. 1368-1379, Jul. 2001.
12. W. Sun, L. Zhang, L. Zhang, and Y. M. Lai, "A dissimilarity-weighted sparse self-representation method for band selection in hyperspectral imagery classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 9, no. 9, pp. 4374-4388, Sep. 2016.
13. S. Jia, G. Tang, J. Zhu, and Q. Li, "A novel ranking-based clustering approach for hyperspectral band selection," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 1, pp. 88-102, Jan. 2016.
14. P. Ghamisi, J. Plaza, Y. Chen, J. Li, and A. J. Plaza, "Advanced spectral classifiers for hyperspectral images: A review," IEEE Geosci. Remote Sens. Mag., vol. 5, no. 1, pp. 8-32, Mar. 2017.
15. G. A. Shaw and H.-H. K. Burke, "Spectral imaging for remote sensing," Lincoln Lab. J., vol. 14, no. 1, pp. 3-28, 2003.
16. M. A. Lee et al., "Sensitivity of hyperspectral classification algorithms to training sample size," in Proc. 1st Workshop Hyperspectral Image Signal Process., Evol. Remote Sens. (WHISPERS), 2009, pp. 1-4.
17. M. Imani and H. Ghassemian, "Feature extraction using attraction points for classification of hyperspectral images in a small sample size situation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 11, pp. 1986-1990, Nov. 2014.
18. M. Fauvel, Y. Tarabalka, J. A. Benediktsson, J. Chanussot, and J. C. Tilton, "Advances in spectral-spatial classification of hyperspectral images," Proc. IEEE, vol. 101, no. 3, pp. 652-675, Mar. 2013.
19. G. Camps-Valls, L. Gómez-Chova, J. Muñoz-Marí, J. Vila-Francés, and J. Calpe-Maravilla, "Composite kernels for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 3, no. 1, pp. 93-97, Jan. 2006.
20. R. M. Haralick, K. Shanmugam, and I. Dinstein, "Textural features for image classification," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 6, pp. 610-621, Nov. 1973.
21. X. Huang, X. Liu, and L. Zhang, "A multichannel gray level cooccurrence matrix for multi/hyperspectral image texture representation," Remote Sens., vol. 6, no. 9, pp. 8424-8445, 2014.
22. A. Plaza, P. Martinez, R. Perez, and J. Plaza, "Spatial/spectral endmember extraction by multidimensional morphological operations," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 9, pp. 2025-2041, Sep. 2002.
23. J. A. Benediktsson, M. Pesaresi, and K. Amason, "Classification and feature extraction for remote sensing images from urban areas based on morphological transformations," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 9, pp. 1940-1949, Sep. 2003.
24. P. Ghamisi, R. Souza, J. A. Benediktsson, X. X. Zhu, L. Rittner, and R. A. Lotufo, "Extinction profiles for the classification of remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 5631-5645, Oct. 2016.
25. M. Dalla Mura, J. A. Benediktsson, B. Waske, and L. Bruzzone, "Morphological attribute profiles for the analysis of very high resolution images," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 10, pp. 3747-3762, Oct. 2010.
26. P. Ghamisi, M. Dalla Mura, and J. A. Benediktsson, "A survey on spectral-spatial classification techniques based on attribute profiles," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2335-2353, May 2015.
27. Y. Gu, T. Liu, X. Jia, J. A. Benediktsson, and J. Chanussot, "Nonlinear multiple kernel learning with multiple-structure-element extended morphological profiles for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 6, pp. 3235-3247, Jun. 2016.
28. B. Demir and S. Erturk, "Empirical mode decomposition of hyperspectral images for support vector machine classification," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4071-4084, Nov. 2010.
29. A. Erturk, M. K. Gullu, and S. Erturk, "Hyperspectral image classification using empirical mode decomposition with spectral gradient enhancement," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2787-2798, May 2013.
30. B. Zhang, S. Li, X. Jia, L. Gao, and M. Peng, "Adaptive Markov random field approach for classification of hyperspectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 5, pp. 973-977, Sep. 2011.
31. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Hyperspectral image segmentation using a new Bayesian approach with active learning," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 10, pp. 3947-3960, Oct. 2011.
32. J. Lin, Q. Wang, and Y. Yuan, "In defense of iterated conditional mode for hyperspectral image classification," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Jul. 2014, pp. 1-6.
33. J. Zhao, Y. Zhong, H. Shu, and L. Zhang, "High-resolution image classification integrating spectral-spatial-location cues by conditional random fields," IEEE Trans. Image Process., vol. 25, no. 9, pp. 4033-4045, Sep. 2016.
34. L. Fang, S. Li, X. Kang, and J. A. Benediktsson, "Spectral-spatial classification of hyperspectral images with a superpixel-based discriminative sparse model," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 8, pp. 4186-4201, Aug. 2015.
35. J. Li, H. Zhang, and L. Zhang, "Efficient superpixel-level multitask joint sparse representation for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 10, pp. 5338-5351, Oct. 2015.
36. S. Jia, X. Zhang, and Q. Li, "Spectral-spatial hyperspectral image classification using 1/2 regularized low-rank representation and sparse representation-based graph cuts," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 6, pp. 2473-2484, Jun. 2015.
37. S. Jia, B. Deng, J. Zhu, X. Jia, and Q. Li, "Superpixel-based multitask learning framework for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 5, pp. 2575-2588, May 2017.
38. R. Ji, Y. Gao, R. Hong, Q. Liu, D. Tao, and X. Li, "Spectral-spatial constraint hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 3, pp. 1811-1824, Mar. 2014.
39. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
40. K. Masood and N. Rajpoot, "Texture based classification of hyperspectral colon biopsy samples using CLBP," in Proc. IEEE Int. Symp. Biomed. Imag., Jun./Jul. 2009, pp. 1011-1014.
41. Y. M. Ren, Y. N. Zhang, and W.Wei, "Hyperspectral image classification via discriminative sparse representation with extended LBP texture," Adv. Mater. Res., vols. 989-994, pp. 3885-3888, Jul. 2014.
42. W. Li, C. Chen, H. Su, and Q. Du, "Local binary patterns and extreme learning machine for hyperspectral imagery classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 7, pp. 3681-3693, Jul. 2015.
43. D. Gabor, "Theory of communication. Part 1: The analysis of information," J. Inst. Elect. Eng. III, Radio Commun. Eng., vol. 93, no. 26, pp. 429-457, 1946.
44. L. M. Bruce, C. H. Koger, and J. Li, "Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2331-2338, Oct. 2002.
45. M. Shi and G. Healey, "Hyperspectral texture recognition using a multiscale opponent representation," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 5, pp. 1090-1095, May 2003.
46. L. Liu, M. O. Ngadi, S. O. Prasher, and C. Gariépy, "Categorization of pork quality using Gabor filter-based hyperspectral imaging technology," J. Food Eng., vol. 99, no. 3, pp. 284-293, 2010.
47. O. Rajadell, P. García-Sevilla, and F. Pla, "Spectral-spatial pixel characterization using Gabor filters for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 860-864, Jul. 2013.
48. F. Tsai and J. S. Lai, "Feature extraction of hyperspectral image cubes using three-dimensional gray-level cooccurrence," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 6, pp. 3504-3513, Jun. 2013.
49. B. Hou, T. Huang, and L. Jiao, "Spectral-spatial classification of hyperspectral data using 3-D morphological profile," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 12, pp. 2364-2368, Dec. 2015.
50. Y. Qian, M. Ye, and J. Zhou, "Hyperspectral image classification based on structured sparse logistic regression and three-dimensional wavelet texture features," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 4, pp. 2276-2291, Apr. 2013.
51. S. Jia, L. Shen, J. Zhu, and Q. Li, "A 3-D Gabor phase-based coding and matching framework for hyperspectral imagery classification," IEEE Trans. Cybern., to be published.
52. S. Jia, J. Hu, J. Zhu, X. Jia, and Q. Li, "Three-dimensional local binary patterns for hyperspectral imagery classification," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 4, pp. 2399-2413, Apr. 2017.
53. J. Bruna and S. Mallat, "Invariant scattering convolution networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1872-1886, Aug. 2013.
54. L. He, Y. Li, X. Li, and W. Wu, "Spectral-spatial classification of hyperspectral images via spatial translation-invariant wavelet-based sparse representation," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2696-2712, May 2015.
55. Y. Y. Tang, Y. Lu, and H. Yuan, "Hyperspectral image classification based on three-dimensional scattering wavelet transform," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2467-2480, May 2015.
56. K. Yan, Y. Chen, and D. Zhang, "Gabor surface feature for face recognition," in Proc. 1st Asian Conf. Pattern Recognit. (ACPR), 2011, pp. 288-292.
57. L. Shen and L. Bai, "A review on Gabor wavelets for face recognition," Pattern Anal. Appl., vol. 9, no. 2, pp. 273-292, 2006.
58. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
59. E. J. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
60. D. L. Donoho and Y. Tsaig, "Fast solution of 1-norm minimization problems when the solution may be sparse," IEEE Trans. Inf. Theory, vol. 54, no. 11, pp. 4789-4812, Nov. 2008.
61. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, 2001.
62. C. Debes et al., "Hyperspectral and LiDAR data fusion: Outcome of the 2013 GRSS data fusion contest," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2405-2418, Jun. 2014.
63. M. S. Asif, "Dynamic compressive sensing: Sparse recovery algorithms for streaming signals and video," Ph.D. dissertation, School Elect. Comput. Eng., Georgia Inst. Technol., Atlanta, GA, USA, 2013.
64. J. A. Richards, Remote Sensing Digital Image Analysis: Introduction. Berlin, Germany: Springer, 2013.
65. D. Tuia, M. Volpi, L. Copa, M. Kanevski, and J. Muñoz-Marí, "A survey of active learning algorithms for supervised remote sensing image classification," IEEE J. Sel. Topics Signal Process., vol. 5, no. 3, pp. 606-617, Jun. 2011.
66. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Spectral-spatial classification of hyperspectral data using loopy belief propagation and active learning," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 844-856, Feb. 2013.
67. L. Sun, Z. Wu, Z. Wei, J. Liu, and X. Li, "Supervised hyperspectral image classification combining sparse unmixing and spatial constraint," in Proc. Int. Conf. Comput. Vis. Remote Sens. (CVRS), 2012, pp. 110-115.