By how much can residual minimization accelerate the convergence of orthogonal residual methods?

Numerical Algorithms

Volumn 27, Issue 2, 2001, Pages 189-213

  Gutknecht, Martin H ^a   Rozložník, Miroslav ^a,b  

^a ETH ZURICH   (Switzerland)

^b INSTITUTE OF COMPUTER SCIENCE   (Czech Republic)

Author keywords

Biconjugate gradient method; CG; CGNE; CGNR; CGS; Conjugate gradient method; FOM; GMRES; Iterative method; Krylov space method; MR smoothing; QMR; QMR smoothing; Residual smoothing; System of linear algebraic equations; TFQMR

Indexed keywords

EID: 0035602327     PISSN: 10171398     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1011889705659     Document Type: Article

References (29)

1. P.N. Brown, A theoretical comparison of the Arnoldi and GMRES algorithms, SIAM J. Sci. Statist. Comput. 12 (1991) 58-78.
2. T.F. Chan, E. Gallopoulos, V. Simoncini, T. Szeto and C.H. Tong, A quasi-minimal residual variant of the Bi-CGSTAB algorithm for nonsymmetric systems, SIAM J. Sci. Comput. 15 (1994) 338-347.
3. J. Cullum, Peaks, plateaus, numerical instabilities in a Galerkin/minimal residual pair of methods for solving Ax = b, Appl. Numer. Math. 19 (1995) 255-278.
4. J. Cullum and A. Greenbaum, Relations between Galerkin and norm-minimizing iterative methods for solving linear systems, SIAM J. Matrix Anal. Appl. 17 (1996) 223-247.
5. M. Eiermann and O. Ernst, Geometric aspects in the theory of Krylov space methods, Acta Numerica 10 (2001) 251-312.
6. R. Fletcher, Conjugate gradient methods for indefinite systems, in: Numerical Analysis, ed. G.A. Watson, Dundee, 1975, Lecture Notes in Mathematics, Vol. 506 (Springer, Berlin, 1976) pp. 73-89.
7. R.W. Freund, A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems, SIAM J. Sci. Comput. 14 (1993) 470-482.
8. R.W. Freund, G.H. Golub and N.M. Nachtigal, Iterative solution of linear systems, Acta Numerica (1992) 57-100.
9. R.W. Freund, M.H. Gutknecht and N.M. Nachtigal, An implementation of the look-ahead Lanczos algorithm for non-Hermitian matrices, SIAM J. Sci. Comput. 14 (1993) 137-158.
10. R.W. Freund and N.M. Nachtigal, QMR: A quasi-minimal residual method for non-Hermitian linear systems, Numer. Math. 60 (1991) 315-339.
11. A. Greenbaum, Estimating the attainable accuracy of recursively computed residual methods, SIAM J. Matrix Anal. Appl. 18 (1997) 535-551.
12. M.H. Gutknecht, A completed theory of the unsymmetric Lanczos process and related algorithms, Part I, SIAM J. Matrix Anal. Appl. 13 (1992) 594-639.
13. M.H. Gutknecht, Changing the norm in conjugate gradient type algorithms, SIAM J. Numer. Anal. 30 (1993) 40-56.
14. M.H. Gutknecht, A completed theory of the unsymmetric Lanczos process and related algorithms, Part II, SIAM J. Matrix Anal. Appl. 15 (1994) 15-58.
15. M.R. Hestenes and E. Stiefel, Methods of conjugate gradients for solving linear systems, J. Res. National. Bureau Standards 49 (1952) 409-435.
16. C. Lanczos, Solution of systems of linear equations by minimized iterations, J. Res. Nat. Bureau Standards 49 (1952) 33-53.
17. C.C. Paige and M.A. Saunders, Solution of sparse indefinite systems of linear equations, SIAM J. Numer. Anal. 12 (1975) 617-629.
18. Y. Saad, Iterative Methods for Sparse Linear Systems (PWS, Boston, 1996).
19. Y. Saad and M.H. Schultz, Conjugate gradient-like algorithms for solving nonsymmetric linear systems, Math. Comp. 44 (1985) 417-424.
20. H. Sadok, Analysis of the convergence of the minimal and the orthogonal residual methods, Preprint (1997).
21. W. Schönauer, Scientific Computing on Vector Computers (Elsevier, Amsterdam, 1987).
22. P. Sonneveld, CGS, a fast Lanczos-type solver for nonsymmetric linear systems, SIAM J. Sci. Statist. Comput. 10 (1989) 36-52.
23. E. Stiefel, Relaxationsmethoden bester Strategie zur Lösung linearer Gleichungssysteme, Comm. Math. Helv. 29 (1955) 157-179.
24. H.A. van der Vorst, Bi-CGSTAB: A fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems, SIAM J. Sci. Statist. Comput. 13 (1992) 631-644.
25. H.F. Walker, Residual smoothing and peak/plateau behavior in Krylov subspace methods, Appl. Numer. Math. 19 (1995) 279-286.
26. R. Weiss, Convergence behavior of generalized conjugate gradient methods, PhD thesis, University of Karlsruhe (1990).
27. R. Weiss, Properties of generalized conjugate gradient methods, J. Numer. Linear Algebra Appl. 1 (1994) 45-63.
28. R. Weiss, Parameter-Free Iterative Linear Solvers, Mathematical Research, Vol. 97 (Akademie Verlag, Berlin, 1996).
29. L. Zhou and H.F. Walker, Residual smoothing techniques for iterative methods, SIAM J. Sci. Comput. 15 (1994) 297-312.