Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection

IEEE Transactions on Knowledge and Data Engineering

Volumn 30, Issue 3, 2018, Pages 517-529

  Zhu, Xiaofeng ^a   Zhang, Shichao ^a   Hu, Rongyao ^a   Zhu, Yonghua ^b   Song, Jingkuan ^c  

^a GUANGXI NORMAL UNIVERSITY   (China)

^b GUANGXI UNIVERSITY   (China)

^c UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

dimensionality reduction; Feature selection; graph matrix; subspace learning

Indexed keywords

BENCHMARKING; CLASSIFICATION (OF INFORMATION); CORRELATION METHODS; DATA MINING; ITERATIVE METHODS; MATRIX ALGEBRA; PERSONNEL TRAINING; REDUNDANCY; ROBUSTNESS (CONTROL SYSTEMS);

BENCHMARK DATASETS; CLASSIFICATION PERFORMANCE; DATA MINING PROCESS; DIMENSIONALITY REDUCTION; EXPERIMENTAL ANALYSIS; FEATURE SELECTION METHODS; KERNEL; SUBSPACE LEARNING;

FEATURE EXTRACTION;

EID: 85032440732     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2017.2763618     Document Type: Article

References (55)

1. Z. Zhao, L. Wang, H. Liu, J. Ye, "On similarity preserving feature selection, " IEEE Trans. Knowl. Data Eng., vol. 25, no. 3, pp. 619-632, Mar. 2013.
2. R. Hu, et al., "Graph self-representation method for unsupervised feature selection, " Neurocomput., vol. 220, pp. 130-137, 2017.
3. X. Zhu, S. Zhang, Z. Jin, Z. Zhang, Z. Xu, "Missing value estimation for mixed-attribute data sets, " IEEE Trans. Knowl. Data Eng., vol. 23, no. 1, pp. 110-121, Jan. 2011.
4. Y. Zhang, G. Zhou, J. Jin, Q. Zhao, X. Wang, A. Cichocki, "Sparse Bayesian classification of EEG for brain-computer interface, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 11, pp. 2256-2267, Nov. 2016.
5. S. Zhang, X. Li, M. Zong, X. Zhu, R. Wang, "Efficient kNN classification with different numbers of nearest neighbors, " IEEE Trans. Neural Netw. Learn. Syst., to be published, doi: 10.1109/TNNLS.2017.2673241.
6. X. Zhu, X. Li, S. Zhang, "Block-row sparse multiview multilabel learning for image classification, " IEEE Trans. Cybern., vol. 46, no. 2, pp. 450-461, Feb. 2016.
7. X. He and P. Niyogi, "Locality preserving projections, " in Proc. Int. Conf. Neural Inf. Process. Syst., 2003, pp. 153-160.
8. P. Zhu, W. Zuo, L. Zhang, Q. Hu, S. C. K. Shiu, "Unsupervised feature selection by regularized self-representation, " Pattern Recognit., vol. 48, no. 2, pp. 438-446, 2015.
9. Y. Zhang, Y. Wang, J. Jin, X. Wang, "Sparse Bayesian learning for obtaining sparsity of eeg frequency bands based feature vectors in motor imagery classification, " Int. J. Neural Syst., vol. 27, no. 02, 2017, Art. no. 1650032.
10. X. Zhu, Z. Huang, Y. Yang, H. T. Shen, C. Xu, J. Luo, "Selftaught dimensionality reduction on the high-dimensional smallsized data, " Pattern Recognit., vol. 46, no. 1, pp. 215-229, 2013.
11. S. Zhang, X. Li, M. Zong, X. Zhu, D. Cheng, "Learning k for kNN classification, " ACM Trans. Intell. Syst. Technol., vol. 8, no. 3, 2017, Art. no. 43.
12. L. Du and Y.-D. Shen, "Unsupervised feature selection with adaptive structure learning, " in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2015, pp. 209-218.
13. X. Zhu, L. Zhang, Z. Huang, "A sparse embedding and least variance encoding approach to hashing, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 3737-3750, Sep. 2014.
14. Y. Zhang, G. Zhou, J. Jin, X. Wang, A. Cichocki, "Frequency recognition in SSVEP-based BCI using multiset canonical correlation analysis, " Int. J. Neural Syst., vol. 24, no. 04, 2014, Art. no. 1450013.
15. Z. Zhang, L. Bai, Y. Liang, E. Hancock, "Joint hypergraph learning and sparse regression for feature selection, " Pattern Recognit., vol. 63, pp. 291-309, 2017.
16. D. Cai, C. Zhang, X. He, "Unsupervised feature selection for multi-cluster data, " in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 333-342.
17. L. Shi, L. Du, Y.-D. Shen, "Robust spectral learning for unsupervised feature selection, " in Proc. IEEE Int. Conf. Data Mining, 2014, pp. 977-982.
18. C. Hou, F. Nie, X. Li, D. Yi, "Joint embedding learning and sparse regression: A framework for unsupervised feature selection, " IEEE Trans. Cybern., vol. 44, no. 6, pp. 793-804, Jun. 2014.
19. L. K. Saul and S. T. Roweis, "Think globally, fit locally: Unsupervised learning of low dimensional manifolds, " J. Mach. Learn. Res., vol. 4, pp. 119-155, 2003.
20. X. Zhu, X. Li, S. Zhang, Z. Xu, L. Yu, C. Wang, "Graph PCA hashing for similarity search, " IEEE Trans. Multimedia, vol. 19, no. 9, pp. 2033-2044, Sep. 2017.
21. X. Zhu, H. Suk, L. Wang, S. Lee, D. Shen, "A novel relational regularization feature selection method for joint regression and classification in AD diagnosis, " Med. Image Anal., vol. 38, pp. 205-214, 2017.
22. F. Nie, W. Zhu, X. Li, "Unsupervised feature selection with structured graph optimization, " in Proc. AAAI Conf. Artif. Intell., 2016, pp. 1302-1308.
23. D. Wang, F. Nie, H. Huang, "Unsupervised feature selection via unified trace ratio formulation and K-means clustering (TRACK), " in Proc. Joint Eur. Conf. Mach. Learn. Knowl. Discovery Databases, 2014, pp. 306-321.
24. X. Zhu, H.-I. Suk, S.-W. Lee, D. Shen, "Subspace regularized sparse multitask learning for multiclass neurodegenerative disease identification, " IEEE Trans. Biomed. Eng., vol. 63, no. 3, pp. 607-618, Mar. 2016.
25. J. Song, L. Gao, L. Liu, X. Zhu, N. Sebe, "Quantization-based hashing: A general framework for scalable image and video retrieval, " Pattern Recognit., 2017. [Online]. Available: Https://doi. org/10.1016/j.patcog.2017.03.021
26. X. Zhu, H.-I. Suk, H. Huang, D. Shen, "Low-rank graphregularized structured sparse regression for identifying genetic biomarkers, " IEEE Trans. Big Data, vol. 3, no. 4, pp. 405-414, Oct.-Dec. 2017.
27. X. Zhu, X. Li, S. Zhang, C. Ju, X. Wu, "Robust joint graph sparse coding for unsupervised spectral feature selection, " IEEE Trans. Neural Netw. Learn. Syst., vol. 28, no. 6, pp. 1263-1275, Jun. 2017.
28. I. Jolliffe, Principal Component Analysis. Hoboken, NJ, USA: Wiley, 2002.
29. B. Scholkopft and K.-R. Mullert, "Fisher discriminant analysis with kernels, " Neural Netw. Signal Process. IX, vol. 1, no. 1, 1999, Art. no. 1.
30. X. Zhu, Z. Huang, H. T. Shen, J. Cheng, C. Xu, "Dimensionality reduction by mixed kernel canonical correlation analysis, " Pattern Recognit., vol. 45, no. 8, pp. 3003-3016, 2012.
31. B. Scholkopf, A. Smola, K.-R. Muller, "Kernel principal component analysis, " in Proc. Int. Conf. Artif. Neural Netw., 1997, pp. 583-588.
32. J. Yang, A. F. Frangi, J.-Y. Yang, D. Zhang, Z. Jin, "KPCA plus LDA: A complete kernel fisher discriminant framework for feature extraction and recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005.
33. L. Gao, Z. Guo, H. Zhang, X. Xu, H. T. Shen, "Video captioning with attention-based LSTM and semantic consistency, " IEEE Trans. Multimedia, vol. 19, no. 9, pp. 2045-2055, Sep. 2017.
34. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection, " J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2003.
35. R. Kohavi and G. H. John, "Wrappers for feature subset selection, " Artif. Intell., vol. 97, no. 1, pp. 273-324, 1997.
36. Z. Li, Y. Yang, J. Liu, X. Zhou, H. Lu, "Unsupervised feature selection using nonnegative spectral analysis, " in Proc. AAAI Conf. Artif. Intell., 2012, pp. 1026-1032.
37. C. Hou, F. Nie, X. Li, D. Yi, Y. Wu, "Joint embedding learning and sparse regression: A framework for unsupervised feature selection, " IEEE Trans. Cybern., vol. 44, no. 6, pp. 793-804, Jun. 2014.
38. H. Liu and L. Yu, "Toward integrating feature selection algorithms for classification and clustering, " IEEE Trans. Knowl. Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005.
39. P. Smialowski, D. Frishman, S. Kramer, "Pitfalls of supervised feature selection, " Bioinf., vol. 26, no. 3, pp. 440-443, 2010.
40. K. Benabdeslem and M. Hindawi, "Efficient semi-supervised feature selection: Constraint, relevance, redundancy, " IEEE Trans. Knowl. Data Eng., vol. 26, no. 5, pp. 1131-1143, May 2014.
41. X. Kong and P. S. Yu, "Semi-supervised feature selection for graph classification, " in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2010, pp. 793-802.
42. Z. Xu, I. King, M. R.-T. Lyu, R. Jin, "Discriminative semisupervised feature selection via manifold regularization, " IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
43. R. Sheikhpour, M. A. Sarram, S. Gharaghani, M. A. Z. Chahooki, "A survey on semi-supervised feature selection methods, " Pattern Recognit., vol. 64, pp. 141-158, 2017.
44. Q. Gu, Z. Li, J. Han, "Joint feature selection and subspace learning, " in Proc. Int. Joint Conf. Artif. Intell., vol. 22, no. 1, 2011, Art. no. 1294.
45. Z. Zhao, L. Wang, H. Liu, J. Ye, "On similarity preserving feature selection, " IEEE Trans. Knowl. Data Eng., vol. 25, no. 3, pp. 619-632, Mar. 2013.
46. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, Y. Ma, "Robust recovery of subspace structures by low-rank representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
47. L. Chen and J. Z. Huang, "Sparse reduced-rank regression for simultaneous dimension reduction and variable selection, " J. Amer. Statistical Assoc., vol. 107, no. 500, pp. 1533-1545, 2012.
48. R. H. Keshavan, A. Montanari, S. Oh, "Matrix completion from noisy entries, " J. Mach. Learn. Res., vol. 11, pp. 2057-2078, 2010.
49. V. D. Silva and J. B. Tenenbaum, "Global versus local methods in nonlinear dimensionality reduction, " in Proc. Int. Conf. Neural Inf. Process. Syst., 2002, pp. 705-712.
50. H. Wang, F. Nie, H. Huang, "Globally and locally consistent unsupervised projection, " in Proc. AAAI Conf. Artif. Intell., 2014, pp. 1328-1333.
51. J. Yang, D. Zhang, J.-Y. Yang, B. Niu, "Globally maximizing, locally minimizing: Unsupervised discriminant projection with applications to face and palm biometrics, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 650-664, Apr. 2007.
52. I. Daubechies, R. DeVore, M. Fornasier, C. S. Gunturk, "Iteratively reweighted least squares minimization for sparse recovery, " Commun. Pure Appl. Math., vol. 63, no. 1, pp. 1-38, 2010.
53. R. A. Fisher, "The use of multiple measurements in taxonomic problems, " Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
54. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
55. D. Singh, et al., "Gene expression correlates of clinical prostate cancer behavior, " Cancer Cell, vol. 1, no. 2, pp. 203-209, 2002.