Large-margin nearest neighbor classifiers via sample weight learning

Neurocomputing

Volumn 74, Issue 4, 2011, Pages 656-660

  Hu, Qinghua ^a   Zhu, Pengfei ^a   Yang, Yongbin ^a   Yu, Daren ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Large margin; Loss function; Nearest neighbor; Sample weighting

Indexed keywords

DATA SETS; DISTANCE FUNCTIONS; EXPERIMENTAL ANALYSIS; GRADIENT DESCENT ALGORITHMS; LARGE MARGIN; LEARNING SAMPLES; LOSS FUNCTION; NEAREST NEIGHBOR CLASSIFICATION; NEAREST NEIGHBOR CLASSIFIER; NEAREST NEIGHBORS; SAMPLE WEIGHTING; STATE-OF-THE-ART METHODS;

PATTERN RECOGNITION;

ACCURACY; ARTICLE; CLASSIFICATION; CONTROLLED STUDY; INTERMETHOD COMPARISON; K NEAREST NEIGHBOR; LEARNING ALGORITHM; MATHEMATICAL ANALYSIS; PATTERN RECOGNITION; PRIORITY JOURNAL;

EID: 78650231105     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.09.006     Document Type: Article

References (23)

1. Hart P., Cover T. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 1967, 13:21-27.
2. C. Stanfill, D. Waltz, Toward memory-based reasoning, Communications of the ACM 29 (1986) 1213-1228.
3. I. Kononenko, Estimating attributes: analysis and extensions of RELIEF, Technical Report, Faculty of Electrical Engineering and Computer Science, University of Ljubjana, 1993.
4. Kohavi R., Langley P., Yung Y. The utility of feature weighting in nearest-neighbor algorithms. Proceedings of the Ninth European Conference on Machine Learning 1997.
5. Paredes R., Vidal E., Keysers D. An evaluation of the WPE algorithm using tangent distance. Proceedings of the International Conference on Pattern Recognition 2002, 48-51.
6. Paredes R., Vidal E. Weighting prototypes a new editing approach. Proceedings of the 15th International Conference on Pattern Recognition 2000, vol. 2:25-28.
7. Crammer K., Gilad-Bachrach R., Navot A., Tishby A. Margin analysis of the LVQ algorithm. Advances in Neural Information Processing Systems 2003, 15:462-469.
8. R. Gilad-Bachrach, A. Navot, N. Tishby, Margin based feature selection-theory and algorithms, in: ICML, 2004.
9. Brown M., Grundy W., Lin D., Cristianini N., Sugnet C., Furey T., Ares M., Haussle D. Knowledge-based analysis of microarray gene expressions data by using support vector machines. Proceedings of the National Academy of Sciences 2000, 97(1):262-267.
10. Goldberger J., Roweis S., Hinton G., Salakhutdinov R. Neighborhood component analysis. Neural Information Processing Systems (NIPS) 2004, 17:513-520.
11. Wang J., Neskovic P., Cooper L.N. Improving nearest neighbor rule with a simple adaptive distance measure. Pattern Recognition Letters 2007, 28:207-213.
12. Weinberger K., Blitzer J., Saul L. Distance metric learning for large margin nearest neighbor classification. Advances in Neural Information Processing Systems (NIPS) 2006, 18:1473-1480.
13. Breiman L. Prediction games and arcing algorithms. Neural Computation 1999, 11:1493-1517.
14. Mason L., Baxter J., Bartlett P., Frean M.R. Boosting algorithms as gradient descent in function space. Neural Information Processing Systems 2000, 12:512-518.
15. Domeniconi C., Gunopulos D., Peng J. Large margin nearest neighbor classifiers. IEEE Transactions on Neural Networks 2005, 16:899-909.
16. Weinberger K.Q., Saul L.K. Distance metric learning for large margin nearest neighbor classification. Journal of Machine Learning Research 2009, 10:207-244.
17. Vapnik V. The Nature of Statistical Learning Theory 1995, Springer-Verlag.
18. Freund Y., Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 1997, 55:119-139.
19. A. Asuncion, D. Newman, UCI machine learning repository, University of California, Irvine, School of Information and Computer Sciences, URL 〈〉, 2007. http://www.ics.uci.edu/mlearn/MLRepository.html.
20. Paredes R., Vidal E. Learning weighted metrics to minimize nearest-neighbor classification error. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006, 28:1100.
21. X. Nguyen, M.J. Wainwright, M.I. Jordan, Divergences, surrogate loss functions and experimental design, in: Proceedings of NIPS 2005.
22. Sun Y.J. Iterative RELIEF for feature weighting: algorithms, theories, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 2007, 29:1035-1051.
23. Cristianini N., Shawe-Taylor J. An Introduction to Support Vector Methods 2000, Cambridge University Press, Cambridge.