Uncorrelated multilinear discriminant analysis with regularization and aggregation for tensor object recognition

IEEE Transactions on Neural Networks

Volumn 20, Issue 1, 2009, Pages 103-123

  Lu, Haiping ^a   Plataniotis, Konstantinos N ^a,b   Venetsanopoulos, Anastasios N ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b RYERSON UNIVERSITY   (Canada)

Author keywords

Dimensionality reduction; Face recognition; Feature extraction; Fusion; Gait recognition; Multilinear discriminant analysis; Regularization; Tensor objects

Indexed keywords

DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; GAIT ANALYSIS; OBJECT RECOGNITION; TENSORS;

DIMENSIONALITY REDUCTION; FUSION; GAIT RECOGNITION; MULTILINEAR DISCRIMINANT ANALYSIS; REGULARIZATION; TENSOR OBJECTS;

FACE RECOGNITION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPARATIVE STUDY; DISCRIMINANT ANALYSIS; EVALUATION; FACE; FACTUAL DATABASE; GAIT; HUMAN; STATISTICAL MODEL;

ALGORITHMS; BAYES THEOREM; DATABASES, FACTUAL; DISCRIMINANT ANALYSIS; FACE; GAIT; HUMANS; LINEAR MODELS; PATTERN RECOGNITION, AUTOMATED;

EID: 58649095928     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2004625     Document Type: Article

References (58)

1. N) (approximation of higher-order tensors," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1324-1342, 2000.
2. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H. Zhang, "Multilinear discriminant analysis for face recognition," IEEE Trans. Image Process., vol. 16, no. 1, pp. 212-220, Jan. 2007.
3. Z. Lei, R. Chu, R. He, S. Liao, and S. Z. Li, "Face recognition by discriminant analysis with Gabor tensor representation," in Proc. Int. Conf. Biometrics, Aug. 2007, pp. 87-95.
4. Y.-D. Kim and S. Choi, "Color face tensor factorization and slicing for illumination-robust recognition," in Proc. Int. Conf. Biometrics, Aug. 2007, pp. 19-28.
5. C. M. Cyr and B. B. Kimia, "3D object recognition using shape similarity-based aspect graph," in Proc. IEEE Conf. Comput. Vis., Jul. 2001, vol. 1, pp. 254-261.
6. K. W. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition," Comput. Vis. Image Understand., vol. 101, no. 1, pp. 1-15, Jan. 2006.
7. S. Z. Li, C. Zhao, M. Ao, and Z. Lei, "Learning to fuse 3D + 2D based face recognition at both feature and decision levels," in Proc. IEEE Int. Workshop Anal. Model. Faces Gestures, Oct. 2005, pp. 43-53.
8. C. Liu and H. Wechsler, "Independent component analysis of Gabor features for face recognition," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 919-928, Jul. 2003.
9. R. Chellappa, A. Roy-Chowdhury, and S. Zhou, Recognition of Humans and Their Activities Using Video. San Rafael, CA: Morgan & Claypool, 2005.
10. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008.
11. G. Shakhnarovich and B. Moghaddam, "Face recognition in subspaces," in Handbook of Face Recognition, S. Z. Li and A. K. Jain, Eds. New York: Springer-Verlag, 2004, pp. 141-168.
12. J. Zhang, S. Z. Li, and J. Wang, "Manifold learning and applications in recognition," in Intelligent Multimedia Processing With Soft Computing, Y. P. Tan, K. H. Yap, and L.Wang, Eds. New York: Springer-Verlag, 2004, pp. 281-300.
13. M. H. C. Law and A. K. Jain, "Incremental nonlinear dimensionality reduction by manifold learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 3, pp. 377-391, Mar. 2006.
14. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Gait recognition through MPCA plus LDA," in Proc. Biometrics Symp., Sep. 2006, pp. 1-6.
15. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
16. J. Ye, R. Janardan, and Q. Li, "Two-dimensional linear discriminant analysis," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2004, pp. 1569-1576.
17. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "A taxonomy of emerging multilinear discriminant analysis solutions for biometric signal recognition," in Biometrics: Theory, Methods, and Applications, N. V. Boulgouris, K. Plataniotis, and E. Micheli-Tzanakou, Eds. New York: Wiley/IEEE, 2008.
18. Y. Wang and S. Gong, "Tensor discriminant analysis for view-based object recognition," in Proc. Int. Conf. Pattern Recognit., Aug. 2006, vol. 3, pp. 33-36.
19. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Elapsed time in human gait recognition: A new approach," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Apr. 2006, vol. 2, pp. 177-180.
20. T. G. Kolda, "Orthogonal tensor decompositions," SIAM J. Matrix Anal. Appl., vol. 23, no. 1, pp. 243-255, 2001.
21. X. He, D. Cai, and P. Niyogi, "Tensor subspace analysis," in Advances in Neural Information Processing Systems 18 (NIPS). Cambridge, MA: MIT Press, 2005.
22. G. Dai and D. Y. Yeung, "Tensor embedding methods," in Proc. 21st Nat. Conf. Artif. Intell., Jul. 2006, pp. 330-335.
23. S. Yan, D. Xu, B. Zhang, H. J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
24. D. Xu, S. Lin, S. Yan, and X. Tang, "Rank-one projections with adaptive margins for face recognition," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 37, no. 5, pp. 1226-1236, Oct. 2007.
25. G. Hua, P. A. Viola, and S. M. Drucker, "Face recognition using discriminatively trained orthogonal rank one tensor projections," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
26. Z. Jin, J. Y. Yang, Z. M. Tang, and Z. S. Hu, "A theorem on the uncorrelated optimal discriminant vectors," Pattern Recognit., vol. 34, no. 10, pp. 2041-2047, Oct. 2001.
27. J. Ye, R. Janardan, Q. Li, and H. Park, "Feature reduction via generalized uncorrelated linear discriminant analysis," IEEE Trans. Knowl. Data Eng., vol. 18, no. 10, pp. 1312-1322, Oct. 2006.
28. Z. Jin, J. Y. Yang, Z. S. Hu, and Z. Lou, "Face recognition based on the uncorrelated discriminant transformation," Pattern Recognit., vol. 34, pp. 1405-1416, 2001.
29. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Uncorrelated multilinear principal component analysis through successive variance maximization," in Proc. Int. Conf. Mach. Learn., Jul. 2008, pp. 616-623.
30. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition," Pattern Recognit. Lett., vol. 26, no. 2, pp. 181-191, 2005.
31. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Uncorrelated multilinear discriminant analysis with regularization for gait recognition," in Proc. Biometrics Symp., Sep. 2007, pp. 1-6.
32. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
33. J. Ye, "Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems," J. Mach. Learn. Res., vol. 6, pp. 483-502, Apr. 2005.
34. T. K. Moon and W. C. Stirling, Mathematical Methods and Algorithms for Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 2000.
35. J. L. Rodgers, W. A. Nicewander, and L. Toothaker, "Linearly independent, orthogonal and uncorrelated variables," Amer. Statist. vol. 38, no. 2, pp. 133-134, May 1984.
36. Y. Koren and L. Carmel, "Robust linear dimensionality reduction," IEEE Trans. Vis. Comput. Graphics, vol. 10, no. 4, pp. 459-470, Jul. 2004.
37. J. D. Carroll and J. J. Chang, "Analysis of individual differences in multidimensional scaling via an n-way generalization of "Eckart-Young" decomposition," Psychometrika, vol. 35, pp. 283-319, 1970.
38. R. A. Harshman, "Foundations of the Parafac procedure: Models and conditions for an "explanatory" multi-modal factor analysis," UCLA Working Papers in Phonetics, vol. 16, pp. 1-84, 1970.
39. P. Kroonenberg and J. Leeuw, "Principal component analysis of three-mode data by means of alternating least squares algorithms," Psychometrika, vol. 45, no. 1, pp. 69-97, 1980.
40. J. H. Friedman, "Regularized discriminant analysis," J. Amer. Statist. Assoc., vol. 84, no. 405, pp. 165-175, Mar. 1989.
41. C. Liu, "Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 725-737, May 2006.
42. M. A. O. Vasilescu and D. Terzopoulos, "Multilinear analysis of image ensembles: Tensorfaces," in Proc. 7th Eur. Conf. Comput. Vis., May 2002, pp. 447-460.
43. S. W. Park and M. Savvides, "Individual kernel tensor-subspaces for robust face recognition: A computationally efficient tensor framework without requiring mode factorization," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 37, no. 5, pp. 1156-1166, Oct. 2007.
44. K. Jia and S. Gong, "Multi-modal tensor face for simultaneous super-resolution and recognition," in Proc. Int. Conf. Comput. Vis. Oct. 2005, vol. 2, pp. 1683-1690.
45. T. K. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 832-844, Aug. 1998.
46. R. E. Schapire, "The boosting approach to machine learning: An overview," in Nonlinear Estimation and Classification, D. D. Denison, M. H. Hansen, C. Holmes, B. Mallick, and B. Yu, Eds. New York: Springer, 2003.
47. R. P. W. D. M. Skurichina, "Bagging, boosting and the random subspace method for linear classifiers," Pattern Anal. Appl., vol. 5, no. 2, pp. 121-135, 2002.
48. L. Breiman, "Arcing classifiers," Ann. Statist., vol. 26, no. 3, pp. 801-849, 1998.
49. A. Ross and R. Govindarajan, "Feature level fusion of hand and face biometrics," in Proc. SPIE Conf. Biometric Technol. Human Identification II, Mar. 2005, pp. 196-204.
50. A. K. J. A. Ross and J. Z. Qian, "Information fusion in biometrics," Pattern Recognit. Lett., vol. 24, pp. 2115-2125, 2003.
51. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
52. J. Lu, K. N. Plataniotis, A. N. Venetsanopoulos, and S. Z. Li, "Ensemble-based discriminant learning with boosting for face recognition," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 166-178, Jan. 2006.
53. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Boosting LDA with regularization on MPCA features for gait recognition," in Proc. Biometrics Symp., Sep. 2007, pp. 1-6.
54. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
55. P. J. Phillips, H. Moon, S. A. Rizvi, and P. Rauss, "The FERET evaluation method for face recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
56. B. Moghaddam, T. Jebara, and A. Pentland, "Bayesian face recognition," Pattern Recognit., vol. 33, no. 11, pp. 1771-1782, 2000.
57. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA based algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
58. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.