Low-rank incremental methods for computing dominant singular subspaces

Linear Algebra and Its Applications

Volumn 436, Issue 8, 2012, Pages 2866-2888

  Baker, C G ^a   Gallivan, K A ^b   Van Dooren, P ^c  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

^c UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Convergence analysis; Incremental SVD; Iterative methods; Pass efficient linear algebra; Singular value decomposition

Indexed keywords

BENCHMARK DATA; COMPUTATIONALLY EFFICIENT; CONVERGENCE ANALYSIS; EIGENSOLVERS; INCREMENTAL METHOD; ITERATIVE PROCEDURES; MULTIPLE PASS; SINGLE PASS; SINGULAR SUBSPACES; SINGULAR VALUE DECOMPOSITION (SVD); SINGULAR VALUES;

INDUSTRIAL APPLICATIONS; ITERATIVE METHODS; VECTORS;

SINGULAR VALUE DECOMPOSITION;

EID: 84858079690     PISSN: 00243795     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.laa.2011.07.018     Document Type: Article

References (34)

1. G. Golub, and C. Van Loan Matrix Computations third ed. 1996 The Johns Hopkins University Press Baltimore
2. G.W. Stewart Matrix Algorithms, Volume II: Eigensystems 2001 Society for Industrial and Applied Mathematics Philadelphia
3. J.L. Barlow, N. Bosner, and Z. Drmac A new stable bidiagonal reduction algorithm Linear Algebra Appl. 397 2005 35 84 (Pubitemid 40146312)
4. G.W. Stewart, and J. Sun Matrix Perturbation Theory 1990 Academic Press Boston
5. L. Sirovich, and M. Kirby Low-dimensional procedure for the characterization of human faces J. Opt. Soc. Amer. A 4 3 1987 519 524
6. M. Turk, and A. Pentland Eigenfaces for recognition J. Cogn. Neurosci. 3 1 1991 71 86
7. L. Eldén Matrix Methods in Data Mining and Pattern Recognition 2007 Society for Industrial and Applied Mathematics Philadelphia, PA, USA
8. L. Sirovich Empirical eigenfunctions and low dimensional systems L. Sirovich, New Perspectives in Turbulence 1991 Springer New York 139 163
9. L. Sirovich Turbulence and the dynamics of coherent structures. Part I: coherent structures Q. Appl. Math. 45 3 1987 561 571
10. H.T. Banks, R.C.H. del Rosario, and H.T. Tran Proper orthogonal decomposition-based control of transverse beam vibrations: experimental implementation IEEE Trans. Control Systems Technol. 10 5 2002 717 726 (Pubitemid 35032726)
11. G. Berkooz, P. Holmes, and J.L. Lumley The proper orthogonal decomposition in the analysis of turbulent flows Ann. Rev. Fluid Mech. 25 1993 539 575
12. R.B. Lehoucq, D.C. Sorensen, and C. Yang ARPACK Users' Guide: Solution of Large-Scale Eigenvalue Problems with Implicitly Restarted Arnoldi Methods 1998 Society for Industrial and Applied Mathematics Philadelphia
13. M. Brand, Fast online SVD revisions for lightweight recommender systems, in: In SIAM International Conference on Data Mining, 2003.
14. B.S. Manjunath, S. Chandrasekaran, Y.F. Wang, An eigenspace update algorithm for image analysis, in: IEEE Symposium on Computer Vision, Object Recognition III, 1995, pp. 10B.
15. S. Chandrasekaran, B.S. Manjunath, Y.F. Wang, J. Winkeler, and H. Zhang An eigenspace update algorithm for image analysis Graphical Models and Image Processing 59 5 1997 321 332 (Pubitemid 127435627)
16. A. Levy, and M. Lindenbaum Sequential Karhunen-Loeve basis extraction and its application to images IEEE Trans. Image Process. 9 8 2000 1371 1374
17. Y. Chahlaoui, K. Gallivan, and P. Van Dooren An incremental method for computing dominant singular spaces Proceedings of the Computational Information Retrieval Conference 2001 SIAM 53 62
18. M. Brand Incremental singular value decomposition of uncertain data with missing values Proceedings of the 2002 European Conference on Computer Vision 2002 Springer
19. C.G. Baker, A block incremental algorithm for computing dominant singular subspaces, Masters Thesis TR-041112, Department of Computer Science, Florida State University, 2004.
20. M. Brand Fast low-rank modifications of the thin singular value decomposition Linear Algebra Appl. 415 1 2006 20 30 Special Issue on Large Scale Linear and Nonlinear Eigenvalue Problems
21. M. Gu, S.C. Eisenstat, A stable and fast algorithm for updating the singular value decomposition, Technical Report YALEU/DCS/RR-966, Yale University, New Haven, CT, 1993.
22. Y. Chahlaoui, K. Gallivan, and P. Van Dooren Recursive calculation of dominant singular subspaces SIAM J. Matrix Anal. Appl. 25 2 2003 445 463
23. J.L. Barlow, and H. Erbay Modifiable low-rank approximation to a matrix Numer. Linear Algebra Appl. 16 2009 833 860
24. P.-A. Absil, R. Mahony, and R. Sepulchre Optimization Algorithms on Matrix Manifolds 2007 Princeton University Press Princeton
25. P.-A. Absil, C.G. Baker, and K.A. Gallivan Trust-region methods on Riemannian manifolds Found. Comput. Math. 7 3 2007 303 330
26. C. Bischof, and C. Van Loan The WY representation for products of Householder matrices SIAM J. Sci. Stat. Comput. 8 1987 s2 s13
27. R. Schreiber, and C. Van Loan A storage-efficient WY representation for products of Householder transformations SIAM J. Sci. Stat. Comput. 10 1 1989 53 57
28. A. Goldstein Constructive Real Analysis 1967 Harper & Row New York
29. J. Dennis, and R. Schnabel Numerical Methods for Unconstrained Optimization and Nonlinear Equations 1996 Society for Industrial and Applied Mathematics Philadelphia
30. F.S. Samaria, A.C. Harter, Parameterisation of a stochastic model for human face identification, in: Applications of Computer Vision, Proceedings of the Second IEEE Workshop, December 1994, pp. 138-142.
31. M.I. Shah, and D.C. Sorensen A symmetry preserving singular value decomposition SIAM J. Matrix Anal. Appl. 28 3 2006 746 769
32. P. Drineas, R. Kannan, and M.W. Mahoney Fast Monte Carlo algorithms for matrices III: computing a compressed approximate matrix decomposition SIAM J. Comput. 36 1 2006 184 206 (Pubitemid 46374023)
33. M.J. O'Hara On low-rank updates to the singular value and tucker decompositions Proceedings of the SIAM International Conference on Data Mining 2010
34. M.E. Hochstenbach A Jacobi-Davidson type SVD method SIAM J. Sci. Comput. 23 2 2001 606 628 (Pubitemid 34325611)