Perturbation LDA: Learning the difference between the class empirical mean and its expectation

Pattern Recognition

Volumn 42, Issue 5, 2009, Pages 764-779

  Zheng, Wei Shi ^a,b   Lai, J H ^a,b   Yuen, Pong C ^c   Li, Stan Z ^d  

^a SUN YAT SEN UNIVERSITY   (China)

^b Guangdong Province Key Laboratory of Information Security   (China)

^c HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^d INSTITUTE OF AUTOMATION   (China)

Author keywords

Face recognition; Fisher criterion; Perturbation analysis

Indexed keywords

BIOMETRICS; COVARIANCE MATRIX; DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; LEARNING ALGORITHMS; PATTERN RECOGNITION; VECTORS;

DIMENSION REDUCTIONS; FACE IMAGES; FISHER CRITERION; FISHER'S LINEAR DISCRIMINANT ANALYSES; NEW ALGORITHMS; NEW FORMS; PERTURBATION ANALYSIS; PERTURBATION LEARNINGS; PRACTICAL IMPLEMENTATIONS; RANDOM VECTORS; SYNTHETIC DATA SETS;

FACE RECOGNITION;

EID: 58249083151     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.09.012     Document Type: Article

References (39)

1. Fisher R.A. The statistical utilization of multiple measurements. Ann. Eugen. 8 (1938) 376-386
2. Swets D.L., and Weng J. Using discriminant eigenfeatures for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18 8 (1996) 831-836
3. Webb A.R. Statistical Pattern Recognition. second ed. (2002), Wiley, UK
4. Zhao W., Chellappa R., Phillips J., and Rosenfeld A. Face recognition: a literature survey. ACM Comput. Surv. (2003) 399-458
5. Belhumeur P.N., Hespanha J.P., and Kriegman D.J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 711-720
6. Chen L., Liao H., Ko M., Lin J., and Yu G. A new LDA-based face recognition system, which can solve the small sample size problem. Pattern Recognition 33 10 (2000) 1713-1726
7. Cevikalp H., Neamtu M., Wilkes M., and Barkana A. Discriminative common vectors for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 27 1 (2005) 4-13
8. R. Huang, Q. Liu, H. Lu, S. Ma, Solving the small sample size problem in LDA, ICPR 2002.
9. Dai D.Q., and Yuen P.C. Regularized discriminant analysis and its application to face recognition. Pattern Recognition 36 (2003) 845-847
10. Hong Z.-Q., and Yang J.-Y. Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recognition 24 (1991) 317-324
11. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Lett. 26 2 (2005) 181-191
12. P. Zhang, J. Peng, N. Riedel, Discriminant analysis: a least squares approximation view, CVPR 2005.
13. W. Zhao, R. Chellappa, P.J. Phillips, Subspace linear discriminant analysis for face recognition, Technical Report CAR-TR-914, CS-TR-4009, University of Maryland at College Park, USA, 1999.
14. Yu H., and Yang J. A direct LDA algorithm for high-dimensional data-with application to face recognition. Pattern Recognition 34 (2001) 2067-2070
15. Ye J.P., and Li Q. LDA/QR: an efficient and effective dimension reduction algorithm and its theoretical foundation. Pattern Recognition 37 4 (2004) 851-854
16. Duchene J., and Leclercq S. An optimal transformation for discriminant and principal component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 10 6 (1988) 978-983
17. Jin Z., Yang J.Y., Hu Z.S., and Lou Z. Face recognition based on the uncorrelated discriminant transformation. Pattern Recognition 34 (2001) 1405-1416
18. Xiong H., Swamy M.N.S., and Ahmad M.O. Two-dimensional FLD for face recognition. Pattern Recognition 38 (2005) 1121-1124
19. Yang J., Zhang D., Yong X., and Yang J.-y. Two-dimensional discriminant transform for face recognition. Pattern Recognition 38 (2005) 1125-1129
20. J. Ye, R. Janardan, Q. Li, Two-dimensional linear discriminant analysis, NIPS 2004.
21. Zheng W.-S., Lai J.H., and Li S.Z. 1D-LDA versus 2D-LDA: when is vector-based linear discriminant analysis better than matrix-based?. Pattern Recognition 41 7 (2008) 2156-2172
22. Price J.R., and Gee T.F. Face recognition using direct, weighted linear discriminant analysis and modular subspaces. Pattern Recognition 38 (2005) 209-219
23. Friedman J.H. Regularized discriminant analysis. J. Am. Stat. Assoc. 84 405 (1989)
24. Hoffbeck J.P., and Landgrebe D.A. Covariance matrix estimation and classification with limited training data. IEEE Trans. Pattern Anal. Mach. Intell. 18 (1996) 763-767
25. Bensmail H., and Celeux G. Regularized Gaussian discriminant analysis through eigenvalue decomposition. J. Am. Stat. Assoc. 91 (1996) 1743-1748
26. Zhu M., and Martinez A.M. Subclass discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 28 8 (2006) 1274-1286
27. Lin S.P., and Perlman M.D. A Monte Carlo comparison of four estimators of a covariance matrix. In: Krishnaiah P.R. (Ed). Multivariate Analysis-VI: Proceedings of the Sixth International Symposium on Multivariate Analysis (1985), Elsevier, Amsterdam, the Netherlands 411-429
28. Tadjudin S., and Landgrebe D.A. Covariance estimation with limited training samples. IEEE Trans. Geosci. Remote Sensing 37 4 (1999) 2113-2118
29. Thomaz C.E., Gillies D.F., and Feitosa R.Q. A new covariance estimate for Bayesian classifiers in biometric recognition. IEEE Trans. Circuits Syst. Video Technol. 14 2 (2004) 214-223
30. Wahl P.W., and Kronmall R.A. Discriminant functions when covariances are equal and sample sizes are moderate. Biometrics 33 (1977) 479-484
31. Kirby M., and Sirovich L. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. Pattern Anal. Mach. Intell. 12 1 (1990) 103-108
32. Martinez A.M., and Kak A.C. PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 23 2 (2001) 228-233
33. Yang J., and Yang J.Y. Why can LDA be performed in PCA transformed space?. Pattern Recognition 36 2 (2003) 563-566
34. Phillips P.J., Moon H., Rizvi S.A., and Rauss P.J. The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22 10 (2000) 1090-1103
35. Sim T., Baker S., and Bsat M. The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25 12 (2003) 1615-1619
36. J. Yang, D. Zhang, J.-y. Yang, Median LDA: A robust feature extraction method for face recognition, in: IEEE International Conference on Systems, Man, and Cybernetics (SMC2006), Taiwan.
37. Herbrich R. Learning Kernel Classifiers Theory and Algorithms (2002), MIT Press, Cambridge, Massachusetts, London, England
38. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press, Cambridge
39. Loog M., and Duin R.P.W. Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion. IEEE Trans. Pattern Anal. Mach. Intell. 26 6 (2004) 732-739