A fast incremental multilinear Principal Component analysis algorithm

International Journal of Innovative Computing, Information and Control

Volumn 7, Issue 10, 2011, Pages 6019-6040

  Wang, Jin ^a   Barreto, Armando ^a   Rishe, Naphtali ^b   Andrian, Jean ^a   Adjouadi, Malek ^a  

^a Florida International University   (United States)

^b FLORIDA INTERNATIONAL UNIVERSITY   (United States)

Author keywords

Fast principal component analysis; Incremental subspace learning; Mean update; Multilinear principal component analysis; Sequential Karhunen Loeve algorithm

Indexed keywords

INCREMENTAL FACE RECOGNITION SYSTEM; KARHUNEN-LOEVE; MATHEMATICAL FOUNDATIONS; MEAN UPDATE; PRINCIPAL COMPONENTS; REAL-WORLD APPLICATION; SUBSPACE LEARNING; THEORETICAL FOUNDATIONS;

ALGORITHMS; COMPUTATIONAL EFFICIENCY; DATA STRUCTURES; FACE RECOGNITION; NANOELECTRONICS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 80053535064     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. G. H. Golub and C. Reinsch, Singular value decomposition and least squares solutions, Numer. Math., vol.14, no.5, pp.403-420, 1970.
2. A. Levy and M. Lindenbaum, Sequential Karhunen-Loeve basis extraction and its application to images, IEEE Trans. Image Process., vol.9, no.8, 2002.
3. D. Ross, J. Lim, R. Lin and M. Yang, Sequential Karhunen-Loeve basis extraction and its application to images, Int. J. of Comput. Vision, 2007.
4. H. Zhao, P. C. Yuen and J. T. Kwok, A novel incremental principal component analysis and its application for face recognition, IEEE Trans. Syst. Man Cybern. B, Cybern., vol.36, no.4, 2006.
5. T. Chin and D. Suter, Incremental kernel principal component analysis, IEEE Trans. Image Process., vol.16, no.6, 2006.
6. L. Hoegaertsa, L. de Lathauwerb, I. Goethalsa, J. A. K. Suykensa, J. Vandewallea and B. de Moora, Efficiently updating and tracking the dominant kernel principal components, Neural Netw., vol.20, no.2, pp.220-229, 2007.
7. S. Bartelmaos and K. Abed-Meraim, Fast principal component extraction using givens rotations, IEEE Signal Processing Letters, vol.15, pp.369-372, 2008.
8. J. Wang, A. Barreto, L. Wang, Y. Chen, N. Rishe, J. Andrian and M. Adjouadi, Multilinear principal component analysis for face recognition with fewer features, Neurocomputing, vol.73, no.10-12, pp.1550-1555, 2010.
9. H. Wang and N. Ahuja, A tensor approximation approach to dimensionality reduction, Int. J. of Comput. Vision, vol.76, no.3, pp.217-229, 2008.
10. H. Lu, K. N. Plataniotis and A. N. Venetsanopoulos, MPCA: Multilinear principal component analysis for tensor objects, IEEE Trans. Neural Netw. vol.19, no.1, pp.18-39, 2008.
11. X. Li, W. Hu, Z. Zhang, X. Zhang and G. Luo, Robust visual tracking based on incremental tensor subspace learning, IEEE the 11th Int. Conf. on Comput. Vision, 2007.
12. J. Sun, C. E. Tsourakakis, E. Hoke, C. Faloutsos and T. Eliassi-Rad, Two heads better than one: Pattern discovery in time-evolving multi-aspect data, Data Mining and Knowledge Discovery, vol.17, no.1, pp.111-128, 2008.
13. S. Ozawa, S. Pang and N. Kasabov, Incremental learning of chunk data for online pattern classification systems, IEEE Trans. Neural Netw., vol.19, no.6, pp.1061-1074, 2008.
14. P. Hall, D. Marshall and R. Martin, Adding and subtracting eigenspaces with eigenvale decomposition and singular value decomposition, Image and Vision Computing, vol.20, no.13-14, pp.1009-1016, 2002.
15. G. H. Golub and C. F. van Loan, Matrix Computation, Johns Hopkins University Press, 1996.
16. K. M. Reddy and T. J. Herron, Computing the eigen decomposition of a symmetric matrix in fixed-point algorithms, IEEE Bangalore Section, The 10th Annual Symposium on Multimedia Communications and Signal Processing, pp.23-24, 2001.
17. R. J. Schilling and S. L. Harris, Applied Numerical Methods for Engineers Using Matlab and C, Brooks/Cole Publishing Company, 2000.
18. A. Sharma and K. K. Paliwal, Fast principal component analysis using fixed-point algorithm, Pattern Recognition Letters, vol.28, pp.1151-1155, 2007.
19. A. Hyv̈ainen and E. Oja, A fast fixed-point algorithm for independent component analysis, Neural Comput., vol.9, no.7, pp.1483-1492, 1997.
20. G. H. Bakir, B. Scholkopf and J. Weston, On the pre-image problem in kernel methods, Kernel Methods in Bioengineering, Signal and Image Processing, pp.284-302, 2007.
21. V. Berinde, Iterative Approximation of Fixed Points, Springer, 2007.
22. L. de Lathauwer, B. de Moor and J. Vandewalle, A multilinear singular value decomposition, SIAM J. Matrix and Application, vol.12, no.4, pp.1253-1278, 2000.
23. AT&T, The Database of Faces, http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html.
24. MNIST Database of Handwritten Digits, http://yann.lecun.com/exdb/mnist.
25. M. Turk and A. Pentland, Eigenfaces for recognition, J. Cognitive Neuroscience, vol.3, no.1, pp.71-86, 1991.
26. A. V. Knyazev and M. E. Argentati, Principal angles between subspaces in an a-based scalar product: Algorithms and perturbation estimates, SIAM J. Sci. Comput., vol.23, no.6, pp.2009-2041, 2002.
27. Face Recognition Data, University of Essex, UK, http://cswww.essex.ac.uk/mv/allfaces/index.html.
28. Georgia Tech Face Database, http://www.anefian.com/face reco.htm.
29. M. Adjouadi, C. Reyes, P. Vidal and A. Barreto, An analytical approach to signal reconstruction using gaussian approximations applied to randomly generated and flow cytometric data, IEEE Transactions on Signal Processing, vol.48, no.10, pp.2839-2849, 2000.
30. F. Candocia and M. Adjouadi, A similarity measure for stereo feature matching, IEEE Transactions on Image Processing, vol.6, no.10, pp.1460-1464, 1997.
31. M. Adjouadi and F. Candocia, A stereo matching paradigm-based on the walsh transformation, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.16, no.12, pp.1212-1218, 1994.
32. M. Adjouadi, A man-machine vision interface for sensing the environment, Journal of Rehabilitation Research and Development, vol.29, no.2, pp.57-76, 1992.
33. S. D. Lin, J. Lin and C. Chiang, Combining scale invaraint feature transform with principal component analysis in face recognition, ICIC Express Letters, vol.3, no.4(A), pp.927-932, 2009.
34. C. Chang and H. Hse, Application of principal component analysis to radial-basis function committee machine for face recognition, International Journal of Innovative Computing, Information and Control, vol.5, no.11(B), pp.4145-4154, 2009.
35. J. Li, J. Pan and Z. Lu, Kernel optimization-based discriminant analysis for face recognition, Neural Computing and Applications, vol.18, no.6, pp.603-612, 2009.