Optimal feature selection for support vector machines

Pattern Recognition

Volumn 43, Issue 3, 2010, Pages 584-591

  Nguyen, Minh Hoai ^a   de la Torre, Fernando ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Feature extraction; Feature selection; Support vector machine

Indexed keywords

CLASSIFICATION PERFORMANCE; CLASSIFICATION PROCESS; ENERGY-BASED FRAMEWORK; FEATURE SELECTION; GENERALIZATION PERFORMANCE; INTERPRETABILITY; NON-LINEAR; PARAMETER LEARNING;

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL EFFICIENCY; GEARS; IMAGE RETRIEVAL; MULTILAYER NEURAL NETWORKS; SUPPORT VECTOR MACHINES; VECTORS;

FEATURE EXTRACTION;

EID: 70449708973     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.09.003     Document Type: Article

References (33)

1. B. Moghaddam, Y. Weiss, S. Avidan, Fast pixel/part selection with sparse eigenvectors, in: Proceedings of the IEEE International Conference on Computer Vision, 2007.
2. F. de la Torre, O. Vinyals, Learning kernel expansions for image classification, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
3. A.B. Chan, N. Vasconcelos, G.R.G. Lanckriet, Direct convex relaxations of sparse SVM, in: Proceedings of International Conference on Machine Learning, 2007.
4. B. Cao, D. Shen, J.-T. Sun, Q. Yang, Z. Chen, Feature selection in a kernel space, in: Proceedings of International Conference on Machine Learning, 2007.
5. Y. Sun, J. Li, Iterative RELIEF for feature weighting, in: Proceedings of International Conference on Machine Learning, 2006.
6. I. Kononenko, Estimating attributes: analysis and extensions of RELIEF, in: Proceedings of European Conference on Computer Vision, 1994.
7. P.S. Bradley, O.L. Mangasarian, Feature selection via concave minimization and support vector machines, in: Proceedings of International Conference on Machine Learning, 1998.
8. L. Hermes, J. Buhmann, Feature selection for support vector machines, in: Proceedings of International Conference on Pattern Recognition, 2000.
9. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, V. Vapnik, Feature selection for SVMs, in: Advances in Neural Information Processing Systems, 2001.
10. S. Avidan, Subset selection for efficient SVM tracking, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2003.
11. S. Avidan, Joint feature-basis subset selection, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2004.
12. O.L. Mangasarian, E.W. Wild, Feature selection for nonlinear kernel support vector machines, in: Workshop on Optimization-based Data Mining Techniques with Applications, IEEE International Conference on Data Mining, 2007.
13. Schölkopf B., and Smola A. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (2002), MIT Press, Cambridge, MA
14. K. Kira, L. Rendell, The feature selection problem: traditional methods and new algorithm, in: Proceedings of AAAI Conference on Artificial Intelligence, 1992.
15. K. Kira, L. Rendell, A practical approach to feature selection, in: Proceedings of International Workshop on Machine Learning, 1992.
16. S.C.H. Hoi, M.R. Lyu, E.Y. Chang, Learning the unified kernel machines for classification, in: Proceedings of International Conference on Knowledge Discovery and Data Mining, 2006.
17. N. Cristianini, J. Shawe-Taylor, A. Elisseeff, J. Kandola, On kernel-target alignment, in: Advances in Neural Information Processing Systems, 2001.
18. Lanckriet G.R., Cristianini N., Bartlett P., Ghaoui L.E., and Jordan M.I. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research 5 (2004) 27-72
19. Chapelle O., Vapnik V., Bousquet O., and Mukherjee S. Choosing multiple parameters for support vector machines. Machine Learning 46 1-3 (2002) 131-159
20. J. Stoeckel, G. Fung, SVM feature selection for classification of SPECT images of Alzheimer's disease using spatial information, in: IEEE International Conference on Data Mining, 2005.
21. M. Dundar, J. Theiler, S. Perkins, Incorporating spatial contiguity into the design of a support vector machine classifier, in: IEEE International Conference on Geoscience and Remote Sensing Symposium, 2006.
22. M. Grant, S. Boyd, CVX: Matlab software for disciplined convex programming (web page & software), October 2008 〈http://stanford.edu/∼boyd/cvx〉.
23. M. Grant, S. Boyd, Graph implementations for nonsmooth convex programs, in: V. Blondel, S. Boyd, H. Kimura (Eds.), Recent Advances in Learning and Control (a tribute to M. Vidyasagar) Lecture Notes in Control and Information Sciences, Springer, Berlin, 2008, pp. 95-110.
24. A. Asuncion, D. Newman, UCI machine learning repository, 2007 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
25. LeCun Y., Bottou L., Bengio Y., and Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86 11 (1998) 2278-2324
26. Sun Y. Iterative relief for feature weighting: algorithms, theories, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 6 (2007) 1035-1051
27. M. Everingham, A. Zisserman, Regression and classification approaches to eye localization in face images, in: Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition, 2006.
28. Philips P., Moon H., Rizvi S., and Rauss P. The FERET evaluation methodology for face-recognition. Pattern Analysis and Machine Intelligence 22 10 (2000) 1090-1104
29. T. Cootes, C. Taylor, Statistical models of appearance for computer vision, Technical Report, University of Manchester, 2001.
30. Viola P., and Jones M. Robust real-time face detection. International Journal of Computer Vision 57 2 (2004) 137-154
31. S. Munder, D. Gavrila, An experimental study on pedestrian classification, IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (11) (2006) 1863-1868.
32. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufmann, San Francisco
33. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, 2001, software available at 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉.