Feature selection based on loss-margin of nearest neighbor classification

Pattern Recognition

Volumn 42, Issue 9, 2009, Pages 1914-1921

  Li, Yun ^a   Lu, Bao Liang ^b  

^a NANJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Energy based model; Feature selection; Loss function; Margin

Indexed keywords

ENERGY-BASED MODEL; ENERGY-BASED MODELS; FACIAL DATA; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; FEATURE SELECTION METHODS; GENDER CLASSIFICATION; LOSS FUNCTION; LOSS FUNCTIONS; LOW LOSS; MARGIN; NEAREST NEIGHBOR CLASSIFICATION; REAL WORLD DATA;

SET THEORY;

FEATURE EXTRACTION;

EID: 67349250195     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.10.011     Document Type: Article

References (25)

1. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowl. Data Eng. 17 (2005) 494-502
2. Kohavi R., and John G. Wrapper for feature subset selection. Artif. Intell. 97 (1997) 234-273
3. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 3 (2003) 1157-1182
4. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic, Boston
5. Cover T., and Hart P. Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13 (1967) 21-27
6. Wu X.D., Kumar V., et al. Top 10 algorithms in data ming. Knowl. Inf. Syst. 14 1 (2008) 1-37
7. Cortes C., and Vapnik V. Support-vector networks. Mach. Learn. 20 (1995) 273-297
8. Schapire R.E., Freund Y., Bartlett P., and Lee W.S. Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Statist. 26 (1998) 1651-1686
9. K.Q. Weinberger, J. Blitzer, L.K. Saul, Distance metric learning for large margin nearest neighbor classification, in: Proceedings of Advances in Neural Information Processing Systems, vol. 18, Cambridge, MA, 2006.
10. K. Crammer, R.G. Bachrach, A. Navot, N. Tishby, Margin analysis of the lvq algorithm, in: Proceedings of Advances in Neural Information Processing Systems, La Jolla, CA, 2002.
11. Devijver P.A., and Kittler J. Pattern Recognition: A Statistical Approach (1982), Prentice-Hall, Englewood Cliffs
12. Y. LeCun, F.J. Huang, Loss functions for discriminative training of energy-based models, in: Proceedings of International Workshop on Artificial Intelligence and Statistics, 2005.
13. LeCun Y., Chopra S., Hadsell R., Huang F.J., and Ranzato M.A. A tutorial on energy-based learning. In: Bakir, et al. (Ed). Predicting Structured Outputs (2006), MIT Press
14. Chopra S., Hadsell R., and LeCun Y. Learning a similarity metric discriminatively, with application to face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2005), San Diego, CA 539-546
15. R.G. Bachrach, A. Navot, N. Tishby, Margin based feature selection-theory and algorithm, in: Proceedings of International Conference on Machine Learning, Banff, Canada, 2004.
16. L.L. Xu, K. Crammer, D. Schuurmans, Robust support vector machine training via convex outlier ablation, in: National Conference on Artificial Intelligence (AAAI), 2006, pp. 536-546.
17. Guyon I., Gunn S., Nikravesh M., and Zadeh L. Feature Extraction, Foundations and Applications (2006), Springer, Physica-Verlag, New York
18. Mitra P., Murthy C.A., and Pal S.K. Unsupervised feature selection using feature similarity. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 301-312
19. Kira K., and Rendell L. A practical approach to feature selection. Proceedings of International Conference on Machine Learning (1992) 249-256
20. Kononerko I. Estimating attributes: analysis and extension of RELIEF. Proceedings of European Conference on Machine Learning (1994) 171-182
21. Sikonja M.K., and Kononenko L. An adaptation of relief for attribute estimation in regression. Proceedings of International Conference on Machine Learning (1997) 296-304
22. C.J. Merz, P.M. Murphy, UCI repository of machine learning database 〈http://www.ics.uci.edu/mlearn/MLRepository.html〉, 1996.
23. Lian H.C., and Lu B.L. Gender recognition using a min-max modular SVM. Lecture Notes in Computer Science vol. 3611 (2005), Springer, Berlin 433-436
24. Li Y., and Lu B.L. Feature selection for identifying critical variables of principal components based on k-nearest neighbor rule. Lecture Notes in Computer Science vol. 4781 (2007), Springer, Berlin 196-207
25. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines 〈http://www.csie.ntu.edu.tw/∼cjlin/papers/libsvm.ps.gz〉, 2002.