Subspace learning for unsupervised feature selection via matrix factorization

Pattern Recognition

Volumn 48, Issue 1, 2015, Pages 10-19

  Wang, Shiping ^a,b   Pedrycz, Witold ^b,c   Zhu, Qingxin ^a   Zhu, William ^d  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b UNIVERSITY OF ALBERTA   (Canada)

^c SYSTEMS RESEARCH INSTITUTE   (Poland)

^d MINNAN NORMAL UNIVERSITY   (China)

Author keywords

Feature selection; Kernel method; Machine learning; Matrix factorization; Subspace distance; Unsupervised learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; DATA MINING; EXTRACTION; FACTORIZATION; ITERATIVE METHODS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATRIX ALGEBRA; UNSUPERVISED LEARNING;

DIMENSIONALITY REDUCTION; DISCRETIZATION PROCESS; FEATURE SELECTION METHODS; HIGH DIMENSIONAL DATA; KERNEL METHODS; MATRIX FACTORIZATIONS; SUBSPACE DISTANCE; UNSUPERVISED FEATURE SELECTION;

FEATURE EXTRACTION;

EID: 85027928396     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.08.004     Document Type: Article

References (44)

1. H. Liu, and H. Motoda Feature Selection for Knowledge Discovery and Data Mining 1998 Springer
2. I. Guyon, A. Elisseeff (Eds.), Feature Extraction: Foundations and Applications, vol. 207, Springer, 2006.
3. L. Elden, Matrix Methods in Data Mining and Pattern Recognition, The Society for Industrial and Applied Mathematics, Philadelphia, 2007.
4. N. Halko, P.-G. Martinsson, and J.A. Tropp Finding structure with randomness probabilistic algorithms for constructing approximate matrix decompositions SIAM Rev. 53 2 2011 217 288
5. D.D. Lee, H. Seung, Algorithms for non-negative matrix factorization, in: Advances in Neural Information Processing Systems, 2001, pp. 556-562.
6. I. Jolliffe (Ed.), Principal Component Analysis, Springer, 1986.
7. S. Lipovetsky PCA and SVD with nonnegative loadings Pattern Recognit. 42 1 2009 68 76
8. G. Golub, and C. Reinsch Singular value decomposition and least squares solutions Numer. Math. 14 5 1970 403 420
9. S. Lipovetsky, and W.M. Conklin Singular value decomposition in additive, multiplicative, and logistic forms Pattern Recognit. 38 7 2005 1099 1110
10. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif. Intell. 97 1-2 1997 273 324
11. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Inf. Sci. 179 13 2009 2208 2217
12. M. Dash, K. Choi, P. Scheuermann, H. Liu, Feature selection for clustering - a filter solution, in: IEEE International Conference on Data Mining, 2002, pp. 115-122.
13. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation-based filter solution, in: Proceedings of the Twentieth International Conference on Machine Learning, 2003, pp. 856-863.
14. R. Duin, and R. Haeb-Umbach Multiclass linear dimension reduction by weighted pairwise fisher criteria IEEE Trans. Pattern Anal. Mach. Intell. 23 7 2001 762 766
15. W. Malina On an extended Fisher criterion for feature selection IEEE Trans. Pattern Anal. Mach. Intell. 5 1981 611 614
16. J. Yang, Z. Jin, J. Yang, D. Zhang, and A.F. Frangi Essence of kernel Fisher discriminant KPCA plus LDA Pattern Recognit. 37 10 2004 2097 2100
17. R. Gilad-Bachrach, A. Navot, N. Tishby, Margin based feature selection - theory and algorithms, in: Proceedings of the Twenty-First International Conference on Machine Learning, 2004, pp. 43-50.
18. H. Li, T. Jiang, and K. Zhang Efficient and robust feature extraction by maximum margin criterion IEEE Trans. Neural Netw. 17 1 2006 157 165
19. B. Liu, B. Fang, X. Liu, J. Chen, Z. Huang, and X. He Large margin subspace learning for feature selection Pattern Recognit. 46 10 2013 2798 2806
20. M. Dash, and H. Liu Consistency-based search in feature selection Artif. Intell. 151 2003 155 176
21. T. Zhang On the consistency of feature selection using greedy least squares regression J. Mach. Learn. Res. 10 2009 555 568
22. L. Song, A. Smola, A. Gretton, J. Bedo, and K. Borgwardt Feature selection via dependence maximization J. Mach. Learn. Res. 13 2012 1393 1434
23. L. Song, A. Smola, Supervised feature selection via dependence estimation, in: Proceedings of the 24th International Conference on Machine Learning, 2007, pp. 823-830.
24. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artif. Intell. 97 1997 245 271
25. L. Yu, and H. Liu Efficient feature selection via analysis of relevance and redundancy J. Mach. Learn. Res. 5 2004 1205 1224
26. R. Battiti Using mutual information for selecting features in supervised neural net learning IEEE Trans. Neural Netw. 5 4 1994 537 550
27. N. Kwak, and C.-H. Choi Input feature selection by mutual information based on Parzen window IEEE Trans. Pattern Anal. Mach. Intell. 24 12 2002 1667 1671
28. N. Kwak, and C.-H. Choi Input feature selection for classification problems IEEE Trans. Neural Netw. 13 1 2002 143 159
29. P. Mitra, C. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans. Pattern Anal. Mach. Intell. 24 4 2002 1 13
30. A.K. Farahat, A. Ghodsi, and M.S. Kamel Efficient greedy feature selection for unsupervised learning Knowl. Inf. Syst. 35 2013 285 310
31. Z. Zhao, H. Liu, Spectral feature selection for supervised and unsupervised learning, in: Proceedings of the 24th International Conference on Machine Learning, 2007, pp. 1151-1157.
32. Z. Zhao, H. Liu, Semi-supervised feature selection via spectral analysis, in: Proceedings of the SIAM International Conference on Data Mining, 2007, pp. 1-12.
33. V. Nikulin, T.-H. Huang, Unsupervised dimensionality reduction via gradient-based matrix factorization with two adaptive learning rates, in: Workshop on Unsupervised and Transfer Learning, 2012, pp. 181-195.
34. H. Felix, Set Theory: Translated from the German by John R. Aumann, AMS, 1957.
35. L. Wang, X. Wang, and J. Feng Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition Pattern Recognit. 39 2006 456 464
36. L. Wolf, and A. Shashua Learning over sets using kernel principal angles J. Mach. Learn. Res. 4 2003 913 931
37. D.D. Lee, and H.S. Seung Learning the parts of objects by non-negative matrix factorization Nature 401 1999 788 791
38. C. Ding, X. He, H.D. Simon, On the equivalence of nonnegative matrix factorization and spectral clustering, in: SIAM International Conference on Data Mining, 2005, pp. 606-610.
39. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the em algorithm J. R. Stat. Soc. Ser. B (Methodol.) 39 1 1977 1 38
40. X. He, D. Cai, P. Niyogi, Laplacian score for feature selection, in: Advances in Neural Information Processing Systems, 2005, pp. 507-514.
41. D. Cai, C. Zhang, X. He, Unsupervised feature selection for multi-cluster data, in: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2010, pp. 333-342.
42. 2, 1 norm regularized discriminative feature selection for unsupervised learning, in: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, 2011, pp. 1589-1594.
43. L. Lovasz, and M.D. Plummer Matching Theory 2009 American Mathematical Society Providence
44. R.M. Gray Entropy and Information Theory 2011 Springer New York