Unified formulation of linear discriminant analysis methods and optimal parameter selection

Pattern Recognition

Volumn 44, Issue 2, 2011, Pages 307-319

  An, Senjian ^a   Liu, Wanquan ^a   Venkatesh, Svetha ^a   Yan, Hong ^b,c  

^a CURTIN UNIVERSITY   (Australia)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^c UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Constrained ridge regression; Face recognition; Linear discriminant analysis; Model selection; Principal component analysis; Under sampled problem

Indexed keywords

LINEAR DISCRIMINANT ANALYSIS; MODEL SELECTION; PRINCIPAL COMPONENTS; RIDGE REGRESSION; UNDER-SAMPLED PROBLEM;

DISCRIMINANT ANALYSIS; EIGENVALUES AND EIGENFUNCTIONS; ERRORS; FACE RECOGNITION; MATHEMATICAL TRANSFORMATIONS; PROBLEM SOLVING; REGRESSION ANALYSIS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 77957979412     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.08.026     Document Type: Article

References (43)

1. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2001 Springer-Verlag New York
2. P. Belhumeur, J. Hespanha, and D. Kriegman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 711 720
3. R. Huang, Q. Liu, H. Lu, and S. Ma Solving the small sample size problem of LDA Proceedings of IEEE International Conference on Pattern Recognition, ICPR 2002
4. J. Ye, and Q. Li A two-stage linear discriminant analysis via QR-decomposition IEEE Trans. Pattern Anal. Mach. Intell. 27 6 2005 929 941
5. P. Howland, and H. Park Generalizing discriminant analysis using generalized singular value decomposition IEEE Trans. Pattern Anal. Mach. Intell. 26 8 2004 995 1006
6. S. Zhang, and T. Sim Discriminant subspace analysis: a FukunagaKoontz approach IEEE Trans. Pattern Anal. Mach. Intell. 29 10 2007 1732 1745
7. H. Yu, and J. Yang A direct LDA algorithm for high-dimensional data with application to face recognition Pattern Recognition 34 11 2001 2067 2070
8. J. Yang, and J.Y. Yang Why can LDA be performed in PCA transformed space Pattern Recognition 36 2 2000 563 566
9. L.F. Chen, H.Y.M. Liao, M.T. Ko, J.C. Lin, and G.J. Yu A new LDA-based face recognition system which can solve the small sample size problem Pattern Recognition 33 10 2000 1713 1726
10. H. Cevikalp, M. Neamtu, M. Wilkes, and A. Barkana Discriminant common vectors for face recognition IEEE Trans. Pattern Anal. Mach. Intell. 27 1 2005 4 13 (Pubitemid 40195893)
11. S. Mika, G. Rtsch, J. Weston, B. Schlkopf, and K.-R. Mller Fisher discriminant analysis with kernels Y.-H. Hu, J. Larsen, E. Wilson, S. Douglas, Neural Networks for Signal Processing IX 1999 IEEE 41 48
12. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Computation 12 10 2000 2385 2404
13. M.-H. Yang Kernel eigenfaces vs. Kernel Fisherfaces: face recognition using kernel methods FGR '02: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition 2002 IEEE Computer Society Washington, DC, USA 215
14. G. Dai, Y.T. Qian, Kernel generalized nonlinear discriminant analysis algorithm for pattern recognition, in: Proceedings of IEEE International Conference on Image Processing, 2004.
15. Q.S. Liu, H.Q. Lu, and S.D. Ma Improving kernel Fisher discriminant analysis for face recognition IEEE Trans. Circuits Syst. Video Tech. 14 1 2004 42 49
16. J.W. Lu, K.N. Plataniotis, and A.N. Venetsanopoulos Face recognition using kernel direct discriminant analysis algorithms IEEE Trans. Neural Networks 14 1 2003 117 126
17. J.W. Lu, K.N. Plataniotis, A.N. Venetsanopoulos, and J. Wang An efficient kernel discriminant analysis method Pattern Recognition 38 10 2005 1788 1790
18. J. Yang, A.F. Frangi, J.Y. Yang, D. Zhang, and Z. Jin KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition IEEE Trans. Pattern Anal. Mach. Intell. 27 2 2005 230 244
19. X. Wang, and X. Tang A unified framework for subspace face recognition IEEE Trans. Pattern Anal. Mach. Intell. 26 9 2004 1222 1228
20. M. Turk, and A.P. Pentland Face recognition using eigenfaces IEEE Conference on Computer Vision and Pattern Recognition, CVPR 1991
21. B. Moghaddam, T. Jebara, and A. Pentland Bayesian face recognition Pattern Recognition 33 2000 1771 1782
22. B. Moghaddam Principal manifolds and probabilistic subspace for visual recognition IEEE Trans. Pattern Anal. Mach. Intell. 24 6 2002 780 788
23. X. Jiang, B. Mandal, and A. Kot Eigenfeature regularization and extraction in face recognition IEEE Trans. Pattern Anal. Mach. Intell. 30 3 2008 383 394
24. O.C. Hamsici, and A.M. Martinez Bayes optimality in linear discriminant analysis IEEE Trans. Pattern Anal. Mach. Intell. 30 4 2008 647 657
25. M. Plutowski, Survey: cross-validation in theory and in practice, Research Report. Department of Computational Science Research, David Sarnoff Research Center, Princeton, New Jersey, 1996.
26. S. Ji, and J. Ye Generalized linear discriminant analysis: a unified framework and efficient model selection IEEE Trans. Neural Networks 19 10 2008 1768 1782
27. S. An, W. Liu, and S. Venkatesh Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression Pattern Recognition 40 8 2007 2154 2162
28. J. Ye Least squares linear discriminant analysis Proceedings of International Conference on Machine Learning, ICML 2007
29. L. Sun, S. Ji, and J. Ye A least squares formulation for canonical correlation analysis Proceedings of International Conference on Machine Learning, ICML 2008
30. P. Howland, M. Jeon, and H. Park Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition SIAM J. Matrix Anal. Appl. 25 1 2003 165 179
31. X. Jiang Asymmetric principal component and discriminant analysis for pattern classification IEEE Trans. Pattern Anal. Mach.Intell. 31 5 2009 931 937
32. A. Georghiades, P. Belhumeur, and D. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2005 643 660
33. K. Lee, J. Ho, and D. Kriegman Acquiring linear subspaces for face recognition under variable lighting IEEE Trans. Pattern Anal. Mach. Intell. 27 5 2005 684 698
34. T. Sim, S. Baker, and M. Bsat The CMU pose, illumination, and expression (PIE) database Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition 2002 IEEE Computer Society Washington, DC, USA 215
35. T. Sim, S. Baker, and M. Bsat The CMU pose illumination and expression (PIE) database IEEE Trans. Pattern Anal. Mach. Intell. 25 12 2003 1615 1618
36. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang Face recognition using laplacianfaces IEEE Trans. Pattern Anal. Mach. Intell. 27 3 2005 328 340
37. D. Cai, X. He, J. Han, and H.-J. Zhang Orthogonal Laplacianfaces for face recognition IEEE Trans. Image Process. 15 11 2006 3608 3614
38. B. Jahne Digital Image Processing 2005 Springer Berlin
39. B. Frey, and D. Dueck Clustering by passing messages between data points Science 315 2007 972 976
40. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: a general framework for dimensionality reduction IEEE Trans. Pattern Anal. Mach. Intell. 29 1 2007 40 51
41. Y. Sheng, K. Kucharski, A. Sadka, and W. Skarbek Automatic face synthesis and analysis: a quick survey Computer Vision and Graphics 2006 Springer Netherlands
42. H. Xu, C. Caramanis, and S. Mannor Robustness and regularization of support vector machines J. Mach. Learn. Res. 10 2009 1485 1510
43. H. Xue, S.C. Chen, and Q. Yang Discriminatively regularized least-squares classification Pattern Recognition 42 1 2009 93 104