GMRES methods for least squares problems

NII Technical Reports

Volumn 2007, Issue 9, 2007, Pages 1-28

  Hayami, Ken ^a,b   Yin, Jun Feng ^a   Ito, Tokushi ^c  

^a NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^b GRADUATE UNIVERSITY FOR ADVANCED STUDIES   (Japan)

^c Business Design Laboratory Co Ltd   (Japan)

Author keywords

CGLS; GMRES; Iterative method; Krylov subspace method; Least squares problems; LSQR; Robust incomplete factorization

Indexed keywords

FACTORIZATION; GRADIENT METHODS; ITERATIVE METHODS; MATRIX ALGEBRA;

GENERALIZED MINIMAL RESIDUAL (GMRES) METHOD; KRYLOV SUBSPACE; ROBUST INCOMPLETE FACTORIZATION (RIF);

LEAST SQUARES APPROXIMATIONS;

EID: 34547403304     PISSN: 13465597     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. Z. -Z. BAI, I. S. DUFF, AND A. J. WATHEN, A class of incomplete orthogonal factorization methods. I: Methods and theories, BIT, 41 (2001), pp. 53-70.
2. M. BENZI AND M. TUMA, A robust incomplete factorization preconditioner for positive definite matrices, Numer. Linear Algebra Appl., 10 (2003), pp. 385-400.
3. M. BENZI AND M. TUMA, A robust preconditioner with low memory requirements for large sparse least squares problems, SIAM J. Sci. Comput., 25 (2003), pp. 499-512.
4. A. BJÖRCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
5. A. BJÖRCK, T. ELFVING, AND Z. STRAKOŠ, Stability of conjugate gradient and Lanczos methods for linear least squares problems, SIAM J. Matrix Anal. Appl., 19 (1998), pp. 720-736.
6. P. N. BROWN AND H. F. WALKER, GMRES on (nearly) singular systems, SIAM J. Matrix Anal. Appl., 18 (1997), pp. 37-51.
7. D. CALVETTI, B. LEWIS, AND L. REICHEL, GMRES-type methods for inconsistent systems, Linear Algebra Appl., 316 (2000), pp. 157-169.
8. K. HAYAMI AND T. ITO, Application of the GMRES method to singular systems and least squares problems, in Proceedings of the Seventh China-Japan Seminar on Numerical Mathematics and Scientific Computing, Z. -C. Shi and H. Okamoto, eds., Zhangjiajie, 2004, Science Press, Beijing, 2006, pp. 31-44.
9. K. HAYAMI AND T. ITO, Solution of least squares problems using GMRES methods, Proc. Inst. Statist. Math., 53 (2005), pp. 331-348 (in Japanese).
10. M. R. HESTENES AND E. STIEFEL, Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Standards, B49 (1952), pp. 409-436.
11. T. ITO AND K. HAYAMI, Preconditioned GMRES methods for least squares problems, NII Technical Report, NII-2004-006E, National Institute of Informatics, Tokyo, Japan, May, 2004, pp. 1-29.
12. T Ax = b, SIAM J. Sci. Statist. Comput., 5 (1984), pp. 978-987.
13. J. A. MEIJERINK AND H. VAN DER VORST, An iterative method for linear systems of which the coefficient matrix is a symmetric M-matriz, Math. Comp., 31 (1977), pp. 148-162.
14. C. C. PAIGE AND M. A. SAUNDERS, A robust incomplete factorization preconditioner for positive definite matrices, ACM Trans. Math. Software, 8 (1982), pp. 43-71.
15. A. PAPADOPOULOS, I. S. DUFF, AND A. J. WATHEN, A class of incomplete orthogonal factorization methods II: implementation and results, BIT, 45 (2005), pp. 159-179.
16. L. REICHEL AND Q. YE, Breakdown-free GMRES for singular systems, SIAM J. Matrix Anal. Appl., 26 (2005), pp. 1001-1021.
17. Y. SAAD, Preconditioning techniques for nonsymmetric and indefinite linear systems, J. Comput. Appl. Math., 24 (1988), pp. 89-105.
18. Y. SAAD, Iterative Methods for Sparse Linear Systems, Second ed., SIAM, Philadelphia, 2003.
19. Y. SAAD AND M. H. SCHULTZ, GMRES: A generalized minimal residual method for solving nonsymmetric linear systems, SIAM J. Sci. Statist. Comput., 7 (1986), pp. 856-869.
20. K. TANABE, Characterization of linear stationary iterative processes for solving a singular system of linear equations, Numer. Math., 22 (1974), pp. 349-359.
21. K. VUIK, A. G. J. SEVINK, AND G. C. HERMAN, A preconditioned Krylov subspace method for the solution of least squares problems in inverse scattering, J. Comput. Phys., 123 (1996), pp. 330-340.
22. X. WANG, K. A. GALLIVAN, AND R. BRAMLEY, CIMGS: An incomplete orthogonal factorization preconditioner, SIAM J. Sci. Comput., 18 (1997), pp. 516-536.
23. S. L. ZHANG AND Y. OYANAGI, Orthomin(k) method for linear least squares problem, J. Inf. Process., 14 (1991), pp. 121-125.