Simultaneous feature selection and classification using kernel-penalized support vector machines

Information Sciences

Volumn 181, Issue 1, 2011, Pages 115-128

  Maldonado, Sebastián ^a,b   Weber, Richard ^a,b   Basak, Jayanta ^a,b  

^a UNIVERSITY OF CHILE   (Chile)

^b IBM INDIA RESEARCH LAB   (India)

Author keywords

Embedded methods; Feature selection; Mathematical programming; Support vector machines

Indexed keywords

ALTERNATIVE APPROACH; ANISOTROPIC RBF; BENCH-MARK PROBLEMS; DUAL FORMULATIONS; EMBEDDED METHODS; FEATURE SELECTION; FEATURE SELECTION AND CLASSIFICATION; REAL-WORLD; SUPPORT VECTOR;

CLASSIFIERS; MATHEMATICAL PROGRAMMING; SUPPORT VECTOR MACHINES; VECTORS;

FEATURE EXTRACTION;

EID: 77958106713     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2010.08.047     Document Type: Article

References (24)

1. A.P. Blum, and P. Langley Selection of relevant features and examples in machine learning Artificial Intelligence 97 1997 245 271
2. P. Bradley, and O. Mangasarian Feature selection vía concave minimization and SVMs Machine Learning Proceedings of the Fifteenth International Conference 1998 Morgan Kaufmann San Francisco 82 90
3. S. Canu, and Y. Grandvalet Adaptive scaling for feature selection in SVMs Advances in Neural Information Processing Systems vol. 15 2002 MIT Press Cambridge, MA, USA pp. 553-560
4. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee Choosing multiple parameters for support vector machines Machine Learning 46 1 2002 131 159 (Pubitemid 34129966)
5. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
6. I. Guyon, S. Gunn, M. Nikravesh, and L.A. Zadeh Feature Extraction, Foundations and Applications 2006 Springer Berlin
7. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Machine Learning 46 1-3 2002 389 422
8. S. Hettich, and S.D. Bay The UCI KDD Archive 1999 University of California, Department of Information and Computer Science Irvine, CA
9. Y. Liu, and Y.F. Zheng FS-SFS: A novel feature selection method for support vector machines Pattern Recognition 39 2006 1333 1345
10. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Information Sciences 179 13 2009 2208 2217
11. S. Maldonado, R. Weber, Feature selection for support vector regression via kernel penalization, in: Proceedings of the 2010 International Joint Conference on Neural Networks, Barcelona, Spain, 2010, pp. 1973-1979.
12. J. Miranda, R. Montoya, and R. Weber Linear penalization support vector machines for feature selection S.K. Pal, PReMI 2005 LNCS vol. 3776 2005 Springer-Verlag Berlin, Heidelberg 188 192
13. J. Neumann, C. Schnörr, and G. Steidl Combined SVM-based feature selection and classification Machine Learning 61 1-3 2005 129 150
14. A. Rakotomamonjy Variable selection using SVM-based criteria Journal of Machine Learning Research 3 2003 1357 1370
15. G. Rätsch, T. Onoda, and K-R Müller Soft margins for AdaBoost Machine Learning 42 3 2001 287 320
16. J. Reunanen, I. Guyon, and A. Elisseeff Overfitting in making comparisons between variable selection methods Journal of Machine Learning Research 3 2003 1371 1382
17. B. Schölkopf, and A.J. Smola Learning with Kernels 2002 MIT Press Cambridge, MA, USA
18. M.-D. Shieh, and C.-C. Yang Multiclass SVM-RFE for product form feature selection Expert Systems with Applications 35 1-2 2008 531 541
19. Ö. Uncu, and I.B. Türksen A novel feature selection approach: combining feature wrappers and filters Information Sciences 177 2007 449 466
20. 2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification, Information Sciences, in press, doi:10.1016/j.ins.2010.05.037.
21. V. Vapnik Statistical Learning Theory 1998 John Wiley and Sons New York
22. J. Weston, S. Mukherjee, O. Chapelle, M. Ponntil, T. Poggio, and V. Vapnik Feature selection for SVMs Advances in Neural Information Processing Systems vol. 13 2001 MIT Press Cambridge, MA
23. J. Weston, A. Elisseeff, B. Schölkopf, and M. Tipping The use of zero-norm with linear models and kernel methods Journal of Machine Learning Research 3 2003 1439 1461
24. M.L. Zhang, J.M. Pena, and V. Robles Feature selection for multi-label naive Bayes classification Information Sciences 179 19 2009 3218 3229