Mutual-information-based semi-supervised hyperspectral band selection with high discrimination, high information, and low redundancy

IEEE Transactions on Geoscience and Remote Sensing

Volumn 53, Issue 5, 2015, Pages 2956-2969

  Feng, Jie ^a   Jiao, Licheng ^a   Liu, Fang ^a   Sun, Tao ^a   Zhang, Xiangrong ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Clonal selection algorithm (CSA); hyperspectral band selection; multivariable mutual information (MMI); semisupervised learning

Indexed keywords

COMPUTATION THEORY; INFORMATION THEORY; REDUNDANCY; SPECTROSCOPY;

BAND SELECTION; CLONAL SELECTION ALGORITHMS; COMPUTATIONAL BURDEN; HYPER-SPECTRAL IMAGES; LOW ORDER APPROXIMATION; MUTUAL INFORMATIONS; RELAXED APPROXIMATION; SEMI- SUPERVISED LEARNING;

MULTIVARIABLE SYSTEMS;

ALGORITHM; IMAGE CLASSIFICATION; LAND COVER; LEARNING; SPECTRAL ANALYSIS;

EID: 84921030733     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2014.2367022     Document Type: Article

References (54)

1. C. I. Chang, Hyperspectral Data Exploitation: Theory and Applications. Hoboken, NJ, USA: Wiley, 2007.
2. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. IT-14, no. 1, pp. 55-63, Jan. 1968.
3. X. Jia, B.-C. Kuo, and M. Crawford, "Feature mining for hyperspectral image classification," Proc. IEEE, vol. 101, no. 3, pp. 676-697, Mar. 2013.
4. A. Agarwal, T. El-Ghazawi, H. El-Askary, and J. Le-Moigne, "Efficient hierarchical-PCA dimension reduction for hyperspectral imagery," in Proc. IEEE Int. Symp. Signal Process. Inf. Technol., Giza, Egypt, 2007, pp. 353-356.
5. L. Lei, S. Prasad, J. E. Fowler, and L. Mann Bruce, "Localitypreserving dimensionality reduction and classification for hyperspectral image analysis," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 4, pp. 1185-1198, Apr. 2012.
6. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 22, pp. 2323-2326, Dec. 2000.
7. X. Zhang, Q. Song, R. Liu, W.Wang, and L. Jiao, "Modified co-training with spectral and spatial views for semisupervised hyperspectral image classification," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2044-2055, Jun. 2014.
8. X. Zhang, Y. He, L. Jiao, R. Liu, and J. Feng, "Scaling cut criterionbased discriminant analysis for supervised dimension reduction," Knowl. Inf. Syst., to be published.
9. Z. Xu, I. King, M. R. Lyu, and R. Jin, "Discriminative semi-supervised feature selection via manifold regulation," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
10. A. J. Brown, M. R. Walter, and T. J. Cudahy, "Hyperspectral imaging spectroscopy of a Mars analogue environment at the North Pole Dome, Pilbara Craton, Western Australia," Austral. J. Earth Sci., vol. 52, no. 3, pp. 353-364, Jun. 2005.
11. A. J. Brown, "Spectral curve fitting for automatic hyperspectral data analysis," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1601-1608, Jun. 2006.
12. A. J. Brown, " Hyperspectral mapping of ancient hydrothermal systems," Ph.D. dissertation, Macquarie Univ., Sydney, N.S.W., Australia, 2006.
13. L. Zhang, Y. Zhong, B. Huang, J. Gong, and P. Li, "Dimensionality reduction based on clonal selection for hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 4172-4186, Dec. 2007.
14. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information: Criteria of max-dependency, max-relevance and minredundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005.
15. P. A. Estevez, M. Tesmer, C. A. Perez, and J. M. Zurada, "Normalized mutual information feature selection," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 189-201, Feb. 2009.
16. L. Shen, Z. Zhu, S. Jia, J. Zhu, and Y. Sun, "Discriminative Gabor feature selection for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 1, pp. 29-33, Jan. 2013.
17. M. Pal and G. M. Foody, "Feature selection for classification of hyperspectral data by SVM," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2297-2307, May 2010.
18. X. He, D. Cai, and P. Niyogi, "Laplacian score for feature selection," in Proc. Adv. Neural Inf. Process. Syst., 2006, vol. 18, pp. 507-514.
19. S. B. Kim and P. Rattakorn, "Unsupervised feature selection using weighted principal components," Expert Syst. Appl., vol. 38, no. 5, pp. 5704-5710, May 2011.
20. A. Martínez-Usó, F. Pla, J. M. Sotoca, and P. García-Sevilla, "Clusteringbased hyperspectral band selection using information measures," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 4158-4171, Dec. 2007.
21. P. Mitra, C. A. Murthy, and S. K. Pal, "Unsupervised feature selection using feature similarity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 301-312, Mar. 2002.
22. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ.Wisconsin-Madison, Madison, WI, USA, Tech. Rep. 1530, 2006.
23. G. Camps-Valls, T. V. B. Marsheva, and D. Zhou, "Semi-supervised graph-based hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3044-3054, Oct. 2007.
24. X. Zhang, Y. He, N.Zhou, and Y.Zheng, "Semisupervised dimensionality reduction of hyperspectral images via local scaling cut criterion," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 6, pp. 1547-1551, Nov. 2013.
25. Z. Zhao and H. Liu, "Semi-supervised feature selection via spectral analysis," in Proc. 7th SDM Conf., 2007, pp. 641-646.
26. I. Quinzán, J. M. Sotoca, and F. Pla, "Clustering-based feature selection in semi-supervised problems," in Proc. 7th Int. Conf. Intell. Syst. Des. Appl., 2009, pp. 536-540.
27. J. Zhao, K. Lu, and X. He, "Locality sensitive semi-supervised feature selection," Neurocomputing, vol. 71, no. 10-12, pp. 1842-1849, Jun. 2008.
28. M. Kalakech, P. Biela, L. Macaire, and D. Hamad, "Constraint scores for semi-supervised feature selection: A comparative study," Pattern Recognit. Lett., vol. 32, no. 5, pp. 656-665, Apr. 2011.
29. L. Chen, R. Huang, and W. Huang, "Graph-based semi-supervised weighted band selection for classification of hyperspectral data," in Proc. Int. Conf. Audio Lang. Image Process., 2010, pp. 1123-1126.
30. R. Huang, L. Yang, and Z. Lv, "Unlabeled sample reduction in semisupervised graph-based band selection for hyperspectral image classification," in Proc. 7th Int. Conf. Image Graphics, 2013, pp. 414-417.
31. J. Feng, L. Jiao, X. Zhang, and T. Sun, "Hyperspectral band selection based on trivariate mutual information and clonal selection," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 7, pp. 4092-4105, Jul. 2014.
32. L. N. de Castro and F. J. Von Zuben, "Learning and optimization using the clonal selection principle," IEEE Trans. Evol. Comput., vol. 6, no. 3, pp. 239-251, Jun. 2002.
33. L. N. de Castro and J.Timmis, Artificial Immune Systems: A New Computational Intelligence Approach. London, U.K.: Springer-Verlag, 2002.
34. K. M.Woldemariam and G. G. Yen, "Vaccine-enhanced artificial immune system for multimodal function optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 218-228, Feb. 2010.
35. J. Feng, L. Jiao, X. R. Zhang, and D. D. Yang, "Bag-of-visual-words based on clonal selection algorithm for SAR image classification," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 691-695, Jul. 2011.
36. S. Suri and P. Reinartz, "Mutual-information-based registration of TerraSAR-X and Ikonos imagery in urban areas," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 2, pp. 939-949, Feb. 2010.
37. J. Liang et al., "Automatic registration of multisensor images using an integrated spatial and mutual information metric," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 603-615, Jan. 2014.
38. J. P. Kern and M. S. Pattichis, "Robust multispectral image registration using mutual-information models," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 5, pp. 1494-1505, May 2007.
39. R. Bramon et al., "Multimodal data fusion based on mutual information," IEEE Trans. Vis. Comput. Graphics, vol. 18, no. 9, pp. 1574-1587, Sep. 2012.
40. J. B. Yeh and C. H. Wu, "Extraction of query term-related visual phrases for news video retrieval using mutual information," in Proc. IEEE Int. Symp. Circuits Syst., 2009, pp. 730-733.
41. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley-Interscience, 1991.
42. H. Matsuda, "Physical nature of higher-order mutual information: Intrinsic correlations and frustration," Phys. Rev. E, Stat. Nonlin. Soft Matter Phys., vol. 62, no. 3, pp. 3096-3102, Sep. 2000.
43. L. Zhang, C. Chen, J. Bu, and X. He, "A unified feature and instance selection framework using optimum experimental design," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2379-2388, May 2011.
44. C. I. Chang and S. Wang, "Constrained band selection for hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1575-1585, Jun. 2006.
45. A. Singer, "Maximum entropy formulation of the Kirkwood superposition approximation," J. Chem. Phys., vol. 121, no. 8, pp. 3657-3666, Aug. 2004.
46. L. Jiao, Y. Li, M. Gong, and X. Zhang, "Quantum-inspired immune clonal algorithm for global optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 5, pp. 1234-1253, Oct. 2008.
47. Y. Zhong and L. Zhang, "An adaptive artificial immune network for supervised classification of multi-/hyperspectral remote sensing imagery," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 3, pp. 894-909, Mar. 2012.
48. Y. Zhong, L. Zhang, J. Gong, and P. Li, "A supervised artificial immune classifier for remote-sensing imagery," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 3957-3966, Dec. 2007.
49. Y. Zhong and L. Zhang, "Sub-pixel mapping based on artificial immune systems for remote sensing imagery," Pattern Recognit., vol. 46, no. 11, pp. 2902-2926, Nov. 2013.
50. M. A. Hossain, X. Jia, and M. Pickering, "Subspace detection using a mutual information measure for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 2, pp 424-428, Feb. 2014.
51. D. Cai, X. He, J. Han, and T. S. Huang, "Graph regularization nonnegative matrix factorization for data representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.
52. N. Kwak and C. H. Choi, "Input feature selection by mutual information based on Parzen window," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1667-1671, Dec. 2002.
53. Y. Bazi and F. Melgani, "Toward an optimal SVM classification system for hyperspectral remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 11, pp. 3374-3385, Nov. 2006.
54. R. O. Green et al., "Imaging spectroscopy and the Airborne Visible/ Infrared Imaging Spectrometer (AVIRIS)," Remote Sens. Environ., vol. 65, no. 3, pp. 227-248, Sep. 1998.