A novel incremental principal component analysis and its application for face recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 4, 2006, Pages 873-886

  Zhao, Haitao ^a,b   Yuen, Pong Chi ^b   Kwok, James T ^c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Error analysis; Face recognition; Incremental principal component analysis (PCA); Singular value decomposition (SVD)

Indexed keywords

ERROR ANALYSIS; IMAGE ANALYSIS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

INCREMENTAL PRINCIPAL COMPONENT ANALYSIS; SINGULAR VALUE DECOMPOSITION ALGORITHM;

FACE RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; COMPUTER SIMULATION; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PRINCIPAL COMPONENT ANALYSIS;

EID: 33746803683     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.870645     Document Type: Article

References (35)

1. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
2. P. J. Phillips, H. Moo, S. A. Rizvi, and P. J. Rauss, "The FERET evaluation methodology for face recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
3. R. Chellappa, C. L. Wilson, and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. IEEE, vol. 83, no. 5, pp. 705-740, May 1995.
4. J. Daugman, "Face and gesture recognition: Overview," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 675-676, Jul. 1997.
5. R. Brunelli and T. Poggio, "Face recognition: Features versus templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 10, pp. 1042-1053, Oct. 1993.
6. A. Samal and P. A. Iyengar, "Automatic recognition and analysis of human faces and facial expression: A survey," Pattern Recognit., vol. 25, no. 1, pp. 65-77, Jan. 1992.
7. M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 103-108, Jan. 1990.
8. H. Zha and H. D. Simon, "On updating problems in latent semantic indexing," SIAM J. Sci. Comput., vol. 21, no. 2, pp. 782-791, 1999.
9. B. Schölkopf and A. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
10. B. Schölkopf, A. Smola, and K. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998.
11. M. Yang, "Kernel eigenfaces versus kernel fisherfaces: Face recognition using kernel methods," in Proc. 5th IEEE Int. Conf. Automatic Face and Gesture Recognition (RGR), Washington, DC, 2002, pp. 215-220.
12. P. M. Hall, A. D. Marshall, and R. R. Martin, "Merging and splitting eigenspace models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 1042-1049, Sep. 2000.
13. J. Weng, Y. Zhang, and W. S. Hwang, "Candid covariance-free incremental principal component analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 8, pp. 1034-1040, Aug. 2003.
14. D. Skocaj and A. Leonardis, "Weighted and robust incremental method for subspace learning," in Proc. 9th IEEE Int. Conf. Computer Vision, Nice, France, 2003, vol. 2, pp. 1494-1500.
15. J. T. Kwok and H. Zhao, "Incremental eigendecomposition," in Proc. ICANN, Istanbul, Turkey, Jun. 2003, pp. 270-273.
16. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Netw., vol. 2, pp. 459-473, 1989.
17. E. Oja and J. Karhunen, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix," J. Math. Anal. Appl., vol. 106, no. 1, pp. 69-84, 1985.
18. Y. Li, "On incremental and robust subspace learning," Pattern Recognit., vol. 37, no. 7, pp. 1509-1518, Jul. 2004.
19. M. Artač, M. Jogan, and A. Leonardis, "Incremental PCA for on-line visual learning and recognition," in Proc. Int. Conf. Pattern Recognition, Quebec City, QC, Canada, 2002, vol. 3, pp. 781-784.
20. A. Levy and M. Lindenbaum, "Sequential Karhunen-Loeve basis extraction and its application to images," IEEE Trans. Image Process., vol. 9, no. 8, pp. 1371-1374, Oct. 2000.
21. J. Bunch and C. Nielsen, "Updating the singular value decomposition," Numer. Math., vol. 32, no. 2, pp. 131-152, 1978.
22. M. Brand, "Incremental singular value decomposition of uncertain data with missing values," in Proc. Eur. Conf. Computer Vision, Copenhagen, Denmark, May 2002, vol. 2350, pp. 707-720.
23. B. N. Parlett, The Symmetric Eigenvalue Problem. Englewood Cliffs, NJ: Prentice-Hall, 1980.
24. P. Drineas, A. Frieze, R. Kannan, S. Vempala, and V. Vinay, "Clustering in large graphs and matrices," in Proc. ACM SODA Conf., Baltimore, MD, 1999, pp. 291-299.
25. A. Frieze, R. Kannan, and S. Vempala, "Fast Monte-Carlo algorithms for finding low rank approximations," in Proc. ACM FOCS Conf., Palo Alto, CA, 1998, pp. 370-378.
26. D. Ross, J. Lim, and M. H. Yang, "Adaptive probabilistic visual tracking with incremental subspace update," in Proc. 8th ECCV, Prague, Czechoslovakia, May 2004, pp. 470-482.
27. D. Achlioptas, F. Mcsherry, and B. Schölkopf, "Sampling techniques for kernel methods," in Advances in Neural Information Processing Systems, vol. 14. Cambridge, MA: MIT Press, 2002.
28. A. J. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17th Int. Conf. Machine Learning, Stanford, CA, 2000, pp. 911-918.
29. G. H. Golub, Lectures on Matrix Computations 2004, 2004. [Online]. Available: http://www.mat.uniromal.it/~bertaccini/seminars/
30. I. T. Jolliffe, Principal Component Analysis, 2nd ed. New York: Springer-Verlag, 2002.
31. K. Fukunaga, Introduction to Statistical Pattern Recognition. New York: Academic, 1990.
32. Z. Jin, J. Y. Yang, Z. S. Hu, and Z. Lou, "Face recognition based on the uncorrelated discriminant transform," Pattern Recognit., vol. 34, no. 7, pp. 1405-1416, 2001.
33. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces versus Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
34. A. M. Martinez and R. Benavente, "The AR face database," Purdue Univ., West Lafayette, IN, CVC Tech. Rep. 24, Jun. 1998.
35. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.