Dimensionality reduction by minimizing nearest-neighbor classification error

Pattern Recognition Letters

Volumn 32, Issue 4, 2011, Pages 633-639

  Villegas, Mauricio ^a   Paredes, Roberto ^a  

^a INSTITUTO TECNOLÓGICO DE INFORMÁTICA   (Spain)

Author keywords

Dimensionality reduction; Nearest neighbor classifier; Pattern recognition

Indexed keywords

CLASS BOUNDARY; CLASSIFICATION ERRORS; COMPUTATIONALLY EFFICIENT; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION TECHNIQUES; ERROR PROBABILITIES; HIGH-DIMENSIONAL; LINEAR DIMENSION REDUCTION; LINEAR PROJECTIONS; NEAREST NEIGHBOR CLASSIFIER; NEAREST NEIGHBOR CLASSIFIERS; NEAREST-NEIGHBORS; OPTIMIZATION PROCEDURES; PATTERN CLASSIFICATION; RECOGNITION ACCURACY;

OPTIMIZATION; PATTERN RECOGNITION; PROBABILITY;

CLASSIFIERS;

EID: 78650639733     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2010.12.002     Document Type: Article

References (35)

1. Asuncion, A., Newman, D., 2007. UCI machine learning repository. Available from: .
2. Bailly-Bailliére, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Mariéthoz, J., Matas, J., Messer, K., Popovici, V., Porée, F., Ruíz, B., Thiran, J.P., 2003. The BANCA database and evaluation protocol. In: AVBPA, pp. 625-638.
3. C.M. Bishop Neural Networks for Pattern Recognition 1995 Oxford University Press
4. M. Bressan, and J. Vitri Nonparametric discriminant analysis and nearest neighbor classification Pattern Recognition Lett. 24 2003 2743 2749
5. J.M. Buenaposada, E. Muñoz, and L. Baumela Recognising facial expressions in video sequences Pattern Anal. Appl. 11 2008 101 116
6. Cai, D., He, X., Zhou, K., Han, J., Bao, H., 2007. Locality sensitive discriminant analysis. In: IJCAI, pp. 708-713.
7. Chang, C.C., Lin, C.J., 2001. LIBSVM: A library for support vector machines. Available from: .
8. de Ridder, D., Kouropteva, O., Okun, O., Pietikäinen, M., Duin, R.P.W., 2003. Supervised locally linear embedding. In: ICANN, pp. 333-341.
9. G. Donato, M. Bartlett, J. Hager, P. Ekman, and T. Sejnowski Classifying facial actions Trans. Pattern Anal. Machine Intell. 21 October 1999 974 989
10. C.C. Fowlkes, D.R. Martin, and J. Malik Local figure-ground cues are valid for natural images J. Vision 7 2007 http://www.journalofvision.org/ content/7/8/2.full.pdf+html
11. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1990 Academic Press
12. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov Neighbourhood components analysis L.K. Saul, Y. Weiss, L. Bottou, Advances in Neural Information Processing Systems vol. 17 2005 MIT Press Cambridge, MA 513 520
13. X. He, and P. Niyogi Locality preserving projections S. Thrun, L. Saul, B. Schölkopf, Advances in Neural Information Processing Systems vol. 16 2004 MIT Press Cambridge, MA
14. T. Kanade, Y. Tian, and J.F. Cohn Comprehensive database for facial expression analysis FG'00: Proc. Fourth IEEE Internat. Conf. on Automatic Face and Gesture Recognition 2000 2000 IEEE Computer Society Washington, DC, USA 46
15. T. Kohonen Self-organized formation of topologically correct feature maps Biological Cybernet. 43 1982 59 69
16. Martinez, A., Benavente, R., 1998. The AR Face Database. CVC Technical Report #24.
17. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre XM2VTSDB: The extended M2VTS database R. Chellapa, Second Internat. Conf. on Audio and Video-Based Biometric Person Authentication 1999 University of Maryland Washington, USA 72 77
18. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, and K.R. Müller Fisher discriminant analysis with kernels Y.H. Hu, J. Larsen, E. Wilson, S. Douglas, Neural Networks for Signal Process. IX 1999 IEEE 41 48
19. Nefian, A.V. Georgia tech face database. Available from: .
20. R. Paredes, and E. Vidal Learning weighted metrics to minimize nearest-neighbor classification error IEEE Trans. Pattern Anal. Machine Intell. 28 2006 1100 1110
21. P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss The FERET evaluation methodology for face-recognition algorithms IEEE Trans. Pattern Anal. Machine Intell. 22 2000 1090 1104
22. P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek Overview of the face recognition grand challenge CVPR'05: Proc. 2005 IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'05) vol. 1 2005 IEEE Computer Society Washington, DC, USA 947 954
23. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326
24. Rumelhart, D.E., Hinton, G.E., Williams, R.J., 1986. Learning internal representations by error propagation. In: Rumelhart, D.E., McClelland, J.L. (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318-362.
25. B. Schölkopf, A.J. Smola, and K.R. Müller Kernel principal component analysis Adv. Kernel Methods: Support Vector Learn. 1999 327 352
26. Spacek, L., Essex collection of facial images. Available from: .
27. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323
28. van der Maaten, L.J.P., 2007. An Introduction to Dimensionality Reduction Using Matlab. Technical Report MICC 07-07, Maastricht University.
29. Villegas, M., Paredes, R., 2008. Simultaneous learning of a discriminative projection and prototypes for nearest-neighbor classification. In: IEEE Conference on Computer Vision and Pattern Recognition, 2008, CVPR 2008, pp. 1-8.
30. M. Villegas, and R. Paredes Score fusion by maximizing the area under the ROC curve 4th Iberian Conf. on Pattern Recognition and Image Analysis LNCS vol. 5524 2009 Springer Póvoa de Varzim, Portugal 473 480
31. Weber, M., Caltech frontal face database. Available from: .
32. Weinberger, K.Q., Blitzer, J., Saul, L.K., 2006. Distance metric learning for large margin nearest neighbor classification. In: NIPS, pp. 1473-1480.
33. S. Yan, D. Xu, B. Zhang, H.J. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: A general framework for dimensionality reduction IEEE Trans. Pattern Anal. Machine Intell. 29 2007 40 51
34. Zhao, D., Lin, Z., Xiao, R., Tang, X., 2007. Linear Laplacian discrimination for feature extraction. In: CVPR07, pp. 1-7.
35. Z. Zheng, F. Yang, W. Tan, J. Jia, and J. Yang Gabor feature-based face recognition using supervised locality preserving projection Signal Process. 87 2007 2473 2483 Special Section: Total Least Squares and Errors-in-Variables Modeling