From classifiers to discriminators: A nearest neighbor rule induced discriminant analysis

Pattern Recognition

Volumn 44, Issue 7, 2011, Pages 1387-1402

  Yang, Jian ^a   Zhang, Lei ^b   Yang, Jing Yu ^a   Zhang, David ^b  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Classification; Classifier; Dimensionality reduction; Discriminant analysis; Feature extraction; Pattern recognition

Indexed keywords

CLASSIFICATION; DECISION RULES; DIMENSIONALITY REDUCTION; FACE IMAGE DATABASE; FEATURE EXTRACTION METHODS; FISHER LINEAR DISCRIMINANT ANALYSIS; HANDWRITTEN CHINESE CHARACTER; HANDWRITTEN NUMERAL; LOCAL MEAN; MINIMUM DISTANCE CLASSIFIERS; NEAREST NEIGHBOR RULE; NEAREST NEIGHBORS; OBJECT CATEGORIES;

CHARACTER RECOGNITION; DATABASE SYSTEMS; DESIGN; DISCRIMINANT ANALYSIS; DISCRIMINATORS; FACE RECOGNITION; FEATURE EXTRACTION; IMAGE RETRIEVAL; LAGRANGE MULTIPLIERS;

CLASSIFIERS;

EID: 79952187090     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.01.009     Document Type: Article

References (45)

1. T.M. Cover, and P.E. Hart Nearest neighbor pattern classification IEEE Transactions on Information Theory 13 1 1967 21 27
2. K. Fukunaga Introduction to Statistical Pattern Recognition second edition 1990 Academic Press
3. S.Z. Li, and Juwei Lu Face recognition using the nearest feature line method IEEE Transactions on Neural Networks 10 2 1999 439 443
4. J.-T. Chien, and C.-C. Wu Discriminant waveletfaces and nearest feature classifiers for face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 24 12 2002 1644 1649
5. W. Zheng, L. Zhao, and C. Zou Locally nearest neighbour classifiers for pattern classification Pattern Recognition 37 6 2004 1307 1309 (Pubitemid 38549829)
6. Z. Lou, Z. Jin, Novel adaptive nearest neighbor classifiers based on hit-distance, in: Proceedings of the 18th International Conference on Pattern Recognition (ICPR 2006), vol. 3, August 2024, 2006, pp. 8790.
7. H. Du, and Y.Q. Chen Rectified nearest feature line segment for pattern classification Pattern Recognition 40 2007 1486 1497 (Pubitemid 46123390)
8. Y. Mitani, and Y. Hamamoto A local mean-based nonparametric classifier Pattern Recognition Letters 27 10 2006 1151 1159
9. Daniel L. Swets, and John Weng Using discriminant eigenfeatures for image retrieval IEEE Transactions on Pattern Analysis and Machine Intelligence 18 8 1996 831 836 (Pubitemid 126772824)
10. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriengman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720 (Pubitemid 127762263)
11. C.J. Liu, and H. Wechsler Robust coding schemes for indexing and retrieval from large face databases IEEE Transactions on Image Processing 9 1 2000 132 137 (Pubitemid 30562090)
12. H. Yu, and J. Yang A direct LDA algorithm for high-dimensional datawith application to face recognition Pattern Recognition 34 10 2001 2067 2070
13. J. Yang, and J.Y. Yang Why can LDA be performed in PCA transformed space? Pattern Recognition 36 2 2003 563 566 (Pubitemid 35212848)
14. W. Zhao, R. Chellappa, J. Phillips, Subspace linear discriminant analysis for face recognition, Technical Report, CS-TR4009, University of Maryland, 1999.
15. J. Ye, R. Janardan, C. Park, and H. Park An optimization criterion for generalized discriminant analysis on undersampled problems IEEE Transactions on Pattern Analysis and Machine Intelligence 26 8 2004 982 994
16. H. Cevikalp, M. Neamtu, M. Wilkes, and A. Barkana Discriminative common vectors for face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 27 1 2005 4 13 (Pubitemid 40195893)
17. S. Mika, G. Rtsch, J. Weston, B. Schlkopf, K.-R. Mller Fisher discriminant analysis with kernels, in: IEEE International Workshop on Neural Networks for Signal Processing, vol. IX, Madison, USA, August 1999, pp. 4148.
18. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Computation 12 10 2000 2385 2404
19. J. Lu, K.N. Plataniotis, and A.N. Venetsanopoulos Face recognition using kernel direct discriminant analysis algorithms IEEE Transactions on Neural Networks 14 1 2003 117 126
20. J. Yang, A.F. Frangi, J.-Y. Yang, D. Zhang, and Z. Jin KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition IEEE Transactions on Pattern Analysis Machine Intelligence 27 2 2005 230 244 (Pubitemid 40377316)
21. T.-K. Kim, and J. Kittler Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 2005 318 327 (Pubitemid 40377325)
22. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang Face recognition using Laplacian faces IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 2005 328 340 (Pubitemid 40377326)
23. H.-T. Chen, H.-W. Chang, T.-L. Liu, Local discriminant embedding and its variants, in: IEEE Conference on Computer Vision and Pattern Recognition 2005 (CVPR 2005), pp. 846853.
24. S. Yan, D. Xu, B. Zhang, H. Zhang, Q. Yang, and S. Lin Graph embedding and extension: a general framework for dimensionality reduction IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 2007 40 51 (Pubitemid 46415944)
25. P. Vincent, Y. Bengio, K-local hyperplane and convex distance nearest neighbor algorithms, in: Advances in Neural Information Processing Systems (NIPS2002), 2002.
26. G.H. Golub, and C.F. Van Loan Matrix Computations Third edition 1996 The Johns Hopkins University Press Baltimore, London
27. X.P. Qiu, L.D. Wu, Face recognition by stepwise nonparametric margin maximum criterion, in: Proceedings of the IEEE Conference on Computer Vision, Beijing, China, October 2005.
28. S.X. Liao, and M. Pawlak On image analysis by moments IEEE Transactions on Pattern Analysis and Machine Intelligence 18 3 1996 254 266 (Pubitemid 126773883)
29. Y.H. Tseng, C.C. Kuo, and H.J. Lee Speeding up Chinese character recognition in an automatic document reading system Pattern Recognition 31 11 1998 1601 1612
30. B. Leibe, B. Schiele, Analyzing appearance and contour based methods for object categorization, in: International Conference on Computer Vision and Pattern Recognition (CVPR03), Madison, Wisconsin, June 2003.
31. B. Leibe, The ETH-80 Image Set. Available from: 〈 http://www.mis.informatik.tu-darmstadt.de/Research/Projects/categorization/ eth80-db.html 〉.
32. P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss The FERET evaluation methodology for face-recognition algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 22 10 2000 1090 1104
33. P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss The FERET database and evaluation procedure for face recognition algorithms Image and Vision Computing 16 5 1998 295 306 (Pubitemid 128393579)
34. S. Petridis, and S.T. Perantonis On the relation between discriminant analysis and mutual information for supervised linear feature extraction Pattern Recognition 37 5 2004 857 874 (Pubitemid 38473832)
35. Onur C. Hamsici, and Aleix M. Martinez Bayes optimality in linear discriminant analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 30 4 2008 647 657 (Pubitemid 351559718)
36. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2nd Edition 2000 John Wiley & Sons, Inc.
37. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326 (Pubitemid 32041578)
38. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Computation 15 6 2003 1373 1396 (Pubitemid 37049796)
39. H.S. Seung, and D.D. Lee The manifold ways of perception Science 290 2000 2268 2269 (Pubitemid 32041555)
40. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323 (Pubitemid 32041577)
41. Nearest neighbor search. Available from: 〈 http://en.wikipedia.org/ wiki/Nearest-neighbor-search 〉.
42. T. Hastie, and R. Tibshirani Discriminant Adaptive Nearest Neighbor Classification IEEE Transactions on Pattern Analysis on Machine Intelligence 18 6 1996 607 615
43. C. Domeniconi, J. Peng, and D. Gunopulos Locally adaptive metric nearest-neighbor classification IEEE Transactions on Pattern Analysis and Machine Intelligence 24 9 2002 1281 1285 (Pubitemid 35242588)
44. M. Bressan, and J. Vitria Nonparametric discriminant analysis and nearest neighbor classification Pattern Recognition Letters 24 2003 2743 2749 (Pubitemid 37030451)
45. H. Zhang, A.C. Berg, M. Maire, and J. Malik SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition 2006 CVPR