From transformation-based dimensionality reduction to feature selection

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 751-758

  Masaeli, Mahdokht ^a   Fung, Glenn ^b   Dy, Jennifer G ^a  

^a Northeastern University   (United States)

^b SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS OPTIMIZATION PROBLEMS; DIMENSIONALITY REDUCTION; DISCRETE OPTIMIZATION; FEATURE RELEVANCE; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; FEATURE SELECTION METHODS; FEATURE TRANSFORMATIONS; GENERAL APPROACH; HIGH DIMENSIONS; HILBERT; LINEAR DISCRIMINANT ANALYSIS; OPTIMIZATION CRITERIA;

DISCRIMINANT ANALYSIS; EVOLUTIONARY ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION;

FEATURE EXTRACTION;

EID: 77956531771     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Blake, C.L. and Merz, C.J. UCI repository of machine learning databases. In http://www.ics.uci.edu/∼mlearn/MLRepository.html, 1998.
2. Donoho, D. For most large underdetermined systems of linear equations the minimal 1-nonn solution is also the sparsest solution. Technical report, Statistics Department, Stanford University, 2004.
3. Fukumizu, K., Bach, F., and Jordan, M. Dimensionality reduction for supervised learning with reproducing kernel hilbert spaces. Journal of Machine Learning Research, 5:73-99, 2004.
4. Fukunaga, K. Statistical Pattern Recognition (second edition). Academic Press. San Diego, CA. 1990.
5. Gretton, A., Bousquet, O., Smola, A., and Scholkopf, B. Measuring statistical dependence with hilbert-schrnidt norms. In Int'l Conf. on Algorithmic Lemming Theory, pp. 63-77, 2005.
6. Guyon, I. and Elisseeff, A. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
7. Guyon, I., Weston, J., Banihill, S., and Vapnik, V. Gene selection for cancer classification using support vector machines. Machine Learning, 46(1-3):389-422, 2002.
8. He, X., Cai, D., and Niyogi, P. Laplaeian score for feature selection. In Advances in Neural Information Processing Systems, pp. 507-514, 2006.
9. Kira, K. and Rendell, L. A. A practical approach to feature selection. In Int'l Conf. in Machine Learning, pp. 249-256, 1992.
10. Kittler, J. Feature set search algorithms. In Pattern Recognition and Signal Processing, pp. 41-60, 1978.
11. Kohavi, R. and John, G. H. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2):273-324, 1997.
12. Masaeli, M., Yan, Y., Cui, Y., Fung, G., and Dy, J. G. Convex principal feature selection. In SIAM Int'l Conf. on Data Mining, pp. 619-628, 2010.
13. Mika, S., Ratsch, G., Western, J., Scholkoph, B., and Muller, K.R. Fisher discriminant analysis with kernels. In Neural Networks for Signal Processing IX, pp. 41-48, 1999.
14. Moghaddam, B., Weiss, Y., and Avidan, S. Generalized spectral bounds for sparse LDA. In Int'l Conf. on Machine Learning, pp. 641-648, 2006.
15. Nocedal, J. and Wright, S. Numerical Optimization (2nd ed.). Springer-Verlag, Berlin, New York, 2003.
16. Peng, H., Long, F. and Ding, C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. In IEEE Trans, on Pattern Analysis and Machine Intelligence, pp. 1226-1238, 2005.
17. Song, L., Smola, A. J., Gretton, A., Borgwardt, K. M., and Bedo, J. Supervised feature selection via dependence estimation. In Int'l Conf. on Machine Learning, pp. 823-830, 2007.
18. Tibshirani, R. Regression shrinkage and selection via the lasso. J. Royal Stat Soc. B, 58(1):267-288, 1996.
19. Vapnik, V. Statistical Learning Theory. Wiley. New York, 1998.
20. Yu, L. and Liu, H. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 5:1205-1224. 2004.
21. Yuan, M. and Lin, Y. Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. B, 1 (68) 49-67, 2006.
22. Zhao, Z. and Liu, H. Spectral feature selection for supervised and unsupervised learning. In Int'l Conf. on Machine Learning, pp. 1151-1157, 2007. (Pubitemid 47275183)
23. Zhu, Ji, Rosset, Sanaron, Hastie, Trevor, and Tibshirani, Robert. 1-norm support vector machines. In Advances in Neural Info. Proc. Systems, 2003.
24. Zou, H., Hastie, T., and Tibshirani, R. Sparse principal component analysis. Journal of Computational and Graphical Statistics, 15(2):262-286. 2006.