1D-LDA vs. 2D-LDA: When is vector-based linear discriminant analysis better than matrix-based?

Pattern Recognition

Volumn 41, Issue 7, 2008, Pages 2156-2172

  Zheng, Wei Shi ^a,b   Lai, J H ^a,b   Li, Stan Z ^c  

^a SUN YAT SEN UNIVERSITY   (China)

^b Guangdong Province Key Laboratory of Information Security   (China)

^c INSTITUTE OF AUTOMATION   (China)

Author keywords

Fisher's linear discriminant analysis (LDA); Matrix based representation; Pattern recognition; Vector based representation

Indexed keywords

ALGORITHMS; PROBLEM SOLVING; VECTORS;

FISHER'S LINEAR DISCRIMINANT ANALYSIS (LDA); MATRIX-BASED REPRESENTATION; VECTOR-BASED REPRESENTATION;

FEATURE EXTRACTION;

EID: 41549158225     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.11.025     Document Type: Article

References (58)

1. Kirby M., and Sirovich L. Application of the KL procedure for the characterization of human faces. IEEE Trans. Pattern Anal. Mach. Intell. 12 1 (1990) 103-108
2. Turk M., and Pentland A. Eigenfaces for recognition. J. Cognitive Neurosci. 3 1 (1991) 71-86
3. Martinez A.M., and Kak A.C. PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 23 2 (2001) 228-233
4. Fukunnaga K. Introduction to Statistical Pattern Recognition. second ed. (1991), Academic Press, New York
5. Webb A.R. Statistical Pattern Recognition. second ed. (2002), Wiley, New York
6. Fisher R.A. The use of multiple measures in taxonomic problems. Ann. Eugenics 7 (1936) 179-188
7. Swets D.L., and Weng J. Using discriminant eigenfeatures for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18 8 (1996) 831-836
8. Belhumeur P.N., Hespanha J., and Kriegman D.J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19 7 (1997) 711-720
9. Comon P. Independent component analysis, a new concept?. Signal Processing 36 (1994) 287-314
10. Hyvärinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), Wiley, New York
11. Yuen P.C., and Lai J.H. Face representation using independent component analysis. Pattern Recognition 35 6 (2002) 1247-1257
12. Bartlett M.S., Movellan J.R., and Sejnowski T.J. Face recognition by independent component analysis. IEEE Trans. Neural Networks 13 6 (2002) 1450-1464
13. Lee D.D., and Seung H.S. Learning the parts of objects by non-negative matrix factorization. Nature 401 6755 (1999) 788-791
14. S.Z. Li, X.W. Hou, H.J. Zhang, Learning spatially localized, parts-based representation, in: CVPR, 2001.
15. Pascual-Montano A., Carazo J.M., Kochi K., Lehmann D., and Pascual-Marqui R.D. Nonsmooth nonnegative matrix factorization (nsNMF). IEEE Trans. Pattern Anal. Mach. Intell. 28 3 (2006) 403-415
16. He X., Yan S., Hu Y., Niyogi P., and Zhang H.-J. Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27 3 (2005) 328-340
17. Moghaddam B. Principle manifolds and probabilistic subspace for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 24 6 (2002) 780-788
18. Moghaddam B., Jebara T., and Pentland A. Bayesian face recognition. Pattern Recognition 33 (2000) 1771-1782
19. Yang J., Zhang D., Frangi A.F., and Yang J. Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26 1 (2004) 131-137
20. Yang J., and Yang J.Y. From image vector to matrix: a straightforward image projection technique-IMPCA vs. PCA. Pattern Recognition 35 9 (2002) 1997-1999
21. Li M., and Yuan B. 2D-LDA: a novel statistical linear discriminant analysis for image matrix. Pattern Recognition Lett. 26 5 (2005) 527-532
22. Xiong H., Swamy M.N.S., and Ahmad M.O. Two-dimensional FLD for face recognition. Pattern Recognition 38 (2005) 1121-1124
23. J. Ye, R. Janardan, Q. Li, Two-dimensional linear discriminant analysis, in: NIPS, 2004.
24. H. Kong, L. Wang, E.K. Teoh, J.G. Wang, V. Ronda, Generalized 2D principal component analysis, in: IEEE Conference on IJCNN, Canada, 2005.
25. Ye J. Generalized low rank approximations of matrices. Mach. Learn. 61 (2005) 167-191
26. Zhang D., Zhou Z.-H., and Chen S. Diagonal principal component analysis for face recognition. Pattern Recognition 39 (2006) 140-142
27. Yang J., Zhang D., Yong X., and Yang J.-Y. Two-dimensional discriminant transform for face recognition. Pattern Recognition 38 (2005) 1125-1129
28. H. Kong, L. Wang, E.K. Teoh, A framework of 2D Fisher discriminant analysis: application to face recognition with small number of training samples, in: CVPR, 2005.
29. 2 LDA: an efficient approach for face recognition. Pattern Recognition 39 (2006) 1396-1400
30. X.-Y. Jing, H.-S. Wong, D. Zhang, Face recognition based on 2D Fisherface approach, Pattern Recognition, 39 (2006) 707-710.
31. N.V. Chawla, K. Bowyer, Random subspaces and subsampling for 2-D face recognition, in: CVPR, 2005.
32. Liu K., Cheng Y.-Q., and Yang J.-Y. Algebraic feature extraction for image recognition based on an optimal discriminant criterion. Pattern Recognition 26 6 (1993) 903-911
33. Wang L., Wang X., and Feng J. On image matrix based feature extraction algorithms. IEEE Trans. Syst Man Cybern.-Part B: Cybern. 36 1 (2006) 194-197
34. D. Xu, S. Yan, L. Zhang, M. Li, W. Ma, Z. Liu, H. Zhang, Parallel image matrix compression for face recognition, in: Proceedings of the 11th International Multimedia Modelling Conference, 2005.
35. Chen L., Liao H., Ko M., Lin J., and Yu G. A new LDA based face recognition system which can solve the small sample size problem. Pattern Recognition 33 10 (2000) 1713-1726
36. R. Huang, Q.S. Liu, H.Q. Lu, S.D. Ma, Solving the small sample size problem of LDA, in: ICPR, 2002.
37. Cevikalp H., Neamtu M., Wilkes M., and Barkana A. Discriminative common vectors for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 27 1 (2005) 4-13
38. Ye J., Janardan R., Park C.H., and Park H. An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Trans. Pattern Anal. Mach. Intell. 26 8 (2004) 982-994
39. Loog M., and Duin R.P.W. Linear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion. IEEE Trans. Pattern Anal. Mach. Intell. 26 6 (2004) 732-739
40. Zheng W.-S., Lai J.-H., and Yuen P.C. GA-fisher: a new LDA-based face recognition algorithm with selection of principal components. IEEE Trans. Syst. Man Cybern. Part B 35 5 (2005) 1065-1078
41. C. Liu, H. Wechsler, Enhanced Fisher linear discriminant models for face recognition, in: ICPR, 1998.
42. Yu H., and Yang J. A direct LDA algorithm for high dimensional data with application to face recognition. Pattern Recognition 34 10 (2001) 2067-2070
43. Ye J., and Li Q. LDA/QR: an efficient and effective dimension reduction algorithm and its theoretical foundation. Pattern Recognition 37 (2004) 851-854
44. W. Zhao, R. Chellappa, P.J. Phillips, Subspace linear discriminant analysis for face recognition, Technical Report CAR-TR-914, CS-TR-4009, University of Maryland, College Park, MD.
45. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Letters 26 (2005) 181-191
46. Dai D.-Q., and Yuen P.C. Regularized discriminant analysis and its application to face recognition. Pattern Recognition 36 (2003) 845-847
47. P. Zhang, J. Peng, N. Riedel, Discriminant analysis: a least squares approximation view, in: CVPR, 2005.
48. Jin Z., Yang J.Y., Hu Z.S., and Lou Z. Face recognition based on the uncorrelated discriminant transformation. Pattern Recognition 34 (2001) 1405-1416
49. Duchene J., and Leclercq S. An optimal transformation for discriminant and principal component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 10 6 (1988) 978-983
50. Price J.R., and Gee T.F. Face recognition using direct, weighted linear discriminant analysis and modular subspaces. Pattern Recognition 38 (2005) 209-219
51. Kim H.-C., Kim D., and Bang S.Y. Face recognition using LDA mixture model. Pattern Recognition Lett. 24 (2003) 2815-2821
52. Kim T.-K., and Kittler J. Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image. IEEE Trans. Pattern Anal. Mach. Intell. 27 3 (2005) 318-327
53. F. De la Torre Frade, T. Kanade, Multimodal oriented discriminant analysis, in: International Conference on Machine Learning (ICML), August, 2005.
54. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, H.-J. Zhang, Discriminant analysis with tensor representation, in: CVPR, 2005.
55. Phillips P.J., Moon H., Rizvi S.A., and Rauss P.J. The feret evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22 10 (2000) 1090-1104
56. Sim T., Baker S., and Bsat M. The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25 12 (2003) 1615-1618
57. Martínez A.M., and Zhu M. Where are linear feature extraction methods applicable?. IEEE Trans. Pattern Anal. Mach. Intell. 27 12 (2005) 1934-1944
58. Yang J., and Yang J.Y. Why can LDA be performed in PCA transformed space?. Pattern Recognition 36 2 (2003) 563-566