Global and local structure preservation for feature selection

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 6, 2014, Pages 1083-1095

  Liu, Xinwang ^a   Wang, Lei ^b   Zhang, Jian ^c   Yin, Jianping ^a   Liu, Huan ^d  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b UNIVERSITY OF WOLLONGONG   (Australia)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Feature selection; global similarity preservation; local geometric structure; similarity preservation.

Indexed keywords

ALGORITHMS; DATA STRUCTURES; FEATURE EXTRACTION; OPTIMIZATION; SUPERVISED LEARNING;

FEATURE SELECTION ALGORITHM; FEATURE SELECTION PROBLEM; GEOMETRIC DATA STRUCTURES; GLOBAL AND LOCAL STRUCTURES; GLOBAL SIMILARITY; LOCAL GEOMETRIC STRUCTURES; OPTIMIZATION ALGORITHMS; SEMI- SUPERVISED LEARNING;

GEOMETRY;

EID: 84901431072     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2287275     Document Type: Article

References (57)

1. A. Jain and D. Zongker, "Feature selection: Evaluation, application, and small sample performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 2, pp. 153-158, Feb. 1997. (Pubitemid 127828334)
2. F. Nie, H. Huang, X. Cai, and C. Ding, "Efficient and robust feature selection via joint 2,1-norms minimization," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2010, pp. 1813-1821.
3. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and minredundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005. (Pubitemid 41245053)
4. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2001.
5. H. Liu and H. Motoda, Computational Methods of Feature Selection. London, U.K.: Chapman & Hall, 2008.
6. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley, 1991.
7. Z. Zhao, L. Wang, and H. Liu, "Efficient spectral feature selection with minimum redundancy," in Proc. 24th AAAI Conf. Artif. Intell., 2010, pp. 673-678.
8. X. He, D. Cai, and P. Niyogi, "Laplacian score for feature selection," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2005.
9. L. Wang, "Feature selection with kernel class separability," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1534-1546, Sep. 2008.
10. J. G. Dy and C. E. Brodley, "Feature selection for unsupervised learning," J. Mach. Learn. Res., vol. 5, pp. 845-889, Jan. 2004.
11. Q. Gu, Z. Li, and J. Han, "Joint feature selection and subspace learning," in Proc. 22nd IJCAI, 2011, pp. 1294-1299.
12. C. Hou, F. Nie, D. Yi, and Y. Wu, "Feature selection via joint embedding learning and sparse regression," in Proc. 22nd IJCAI, 2011, pp. 1324-1229.
13. Y. Yang, H. T. Shen, Z. Ma, Z. Huang, and X. Zhou, "2,1-norm regularized discriminative feature selection for unsupervised learning," in Proc. 22nd IJCAI, 2011, pp. 1589-1594.
14. Z. Zhao and H. Liu, "Semi-supervised feature selection via spectral analysis," in Proc. ICDM, 2007, pp. 1-6.
15. J. Zhao, K. Lu, and X. He, "Locality sensitive semi-supervised feature selection," Neurocomputing, vol. 71, nos. 10-12, pp. 1842-1849, 2008.
16. Z. Xu, I. King, M.-T. Lyu, and R. Jin, "Discriminative semi-supervised feature selection via manifold regularization," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
17. Z. Zhao, L. Wang, H. Liu, and J. Ye, "On similarity preserving feature selection," IEEE Trans. Knowl. Data Eng., vol. 25, no. 3, pp. 619-632, Mar. 2013.
18. Y. Sun, S. Todorovic, and S. Goodison, "Local-learning-based feature selection for high-dimensional data analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1610-1626, Sep. 2010.
19. S. Xiang, F. Nie, G. Meng, C. Pan, and C. Zhang, "Discriminative least squares regression for multiclass classification and feature selection," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1738-1754, Nov. 2012.
20. L. Zhou, L. Wang, and C. Shen, "Feature selection with redundancyconstrained class separability," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 853-858, May 2010.
21. M. Ramona, G. Richard, and B. David, "Multiclass feature selection with kernel gram-matrix-based criteria," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 10, pp. 1611-1623, Oct. 2012.
22. J.-B. Yang and C. J. Ong, "Feature selection using probabilistic prediction of support vector regression," IEEE Trans. Neural Netw., vol. 22, no. 6, pp. 954-962, Jun. 2011.
23. S. Kim and E. P. Xing, "Feature selection via block-regularized regression," in Proc. 24th Conf. UAI, 2008, pp. 325-332.
24. Y. Kim and J. Kim, "Gradient LASSO for feature selection," in Proc. 21st ICML, 2004.
25. R. Jenatton, J.-Y. Audibert, and F. Bach, "Structured variable selection with sparsity-inducing norms," J. Mach. Learn. Res., vol. 12, pp. 2777-2824, Oct. 2011.
26. Y. Zhai, M. Tan, I. W. Tsang, and Y.-S. Ong, "Discovering support and affiliated features from very high dimensions," in Proc. 29th ICML, 2012, pp. 1455-1462.
27. Y. Jiang and J. Ren, "Eigenvalue sensitive feature selection," in Proc. 28th ICML, 2011, pp. 89-96.
28. F. Nie, S. Xiang, Y. Jia, C. Zhang, and S. Yan, "Trace ratio criterion for feature selection," in Proc. 23rd AAAI Conf. Artif. Intell., 2008, pp. 671-676.
29. Z. Zhao and H. Liu, "Spectral feature selection for supervised and unsupervised learning," in Proc. 24th ICML, 2007, pp. 1151-1157. (Pubitemid 47275183)
30. P. Padungweang, C. Lursinsap, and K. Sunat, "A discrimination analysis for unsupervised feature selection via optic diffraction principle," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 10, pp. 1587-1600, Oct. 2012.
31. M. Robnik-Šikonja and I. Kononenko, "Theoretical and empirical analysis of ReliefF and RreliefF," Mach. Learn., vol. 53, nos. 1-2, pp. 23-69, 2003.
32. L. Song, A. Smola, A. Gretton, J. Bedo, and K. Borgwardt, "Feature selection via dependence maximization," J. Mach. Learn. Res., vol. 13, no. 1, pp. 1393-1434, 2011.
33. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
34. L. K. Saul and S. T. Roweis, "Think globally, fit locally: Unsupervised learning of low dimensional manifolds," J. Mach. Learn. Res., vol. 4, pp. 119-155, 2003.
35. X. He and P. Niyogi, "Locality preserving projections," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2003.
36. X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005. (Pubitemid 40377326)
37. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006. (Pubitemid 44708005)
38. Z. Zhang and H. Zha, "Nonlinear dimension reduction via local tangent space alignment," in Proc. 4th IDEAL, 2003, pp. 477-481. (Pubitemid 36996128)
39. J. Chen, Z. Ma, and Y. Liu, "Local coordinates alignment with global preservation for dimensionality reduction," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 1, pp. 106-117, Jan. 2013.
40. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis," J. Mach. Learn. Res., vol. 8, pp. 1027-1061, Jan. 2007. (Pubitemid 46798409)
41. C. C. Aggarwal, "A framework for local supervised dimensionality reduction of high dimensional data," in Proc. 6th SIAM Int. Conf. Data Mining, 2006, pp. 360-371. (Pubitemid 43955551)
42. J. Yang, D. Zhang, J. Y. Yang, and B. Niu, "Globally maximizing, locally minimizing: Unsupervised discriminant projection with applications to face and palm biometrics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 650-664, Apr. 2007. (Pubitemid 46464405)
43. H. Wang, S. Chen, Z. Hu, and W. Zheng, "Locality-preserved maximum information projection," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 571-585, Apr. 2008. (Pubitemid 351583575)
44. J. Chen, J. Ye, and Q. Li, "Integrating global and local structures: A least squares framework for dimensionality reduction," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
45. T. Zhang, J. Yang, D. Zhao, and X. Ge, "Linear local tangent space alignment and application to face recognition," Neurocomputing, vol. 70, nos. 7-9, pp. 1547-1553, 2007. (Pubitemid 46336768)
46. Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course. Norwell, MA, USA: Kluwer, 2004.
47. X. Shu, Y. Gao, and H. Lu, "Efficient linear discriminant analysis with locality preserving for face recognition," Pattern Recognit., vol. 45, no. 5, pp. 1892-1898, 2012.
48. X. He, D. Cai, S. Yan, and H.-J. Zhang, "Neighborhood preserving embedding," in Proc. 10th IEEE ICCV, Oct. 2005, pp. 1208-1213. (Pubitemid 44042318)
49. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003. (Pubitemid 37049796)
50. K. Q. Weinberger and L. K. Saul, "An introduction to nonlinear dimensionality reduction by maximum variance unfolding," in Proc. 21st AAAI Conf. Artif. Intell., 2006, pp. 1683-1686. (Pubitemid 44705525)
51. (Accessed: Sep. 2012). L21RFS [Online]. Available: http://sites.google. com/site/feipingnie/publications/
52. (Accessed: Sep. 2012). mRMR [Online]. Available: http://penglab.janelia. org/proj/mRMR/
53. (Accessed: Sep. 2012). LLFS [Online]. Available: http://plaza.ufl.edu/ sunyijun/PAMI2.htm/
54. J. Zhu, S. Rosset, T. Hastie, and R. Tibshirani, "1-norm support vector machines," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2003.
55. A. Y. Ng, "Feature selection, -1 vs. -2 regularization, and rotational invariance," in Proc. 21st ICML, 2004, pp. 78-85.
56. (Accessed: Sep. 2012). LapScore [Online]. Available: http:// featureselection.asu.edu/
57. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. New York, NY, USA: Cambridge Univ. Press, 2004.