Convergence analysis of Krylov subspace iterations with methods from potential theory

SIAM Review

Volumn 48, Issue 1, 2006, Pages 3-40

  Kuijlaars, Arno B J ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Constrained equilibrium; Eigenvalue distribution; Equilibrium measure; Krylov subspace iterations; Potential theory; Ritz values

Indexed keywords

APPROXIMATION THEORY; CALCULATIONS; CONVERGENCE OF NUMERICAL METHODS; EIGENVALUES AND EIGENFUNCTIONS; LINEAR SYSTEMS; MATRIX ALGEBRA; POLYNOMIALS;

CONSTRAINED EQUILIBRIUM; EIGENVALUE DISTRIBUTION; EQUILIBRIUM MEASURE; KRYLOV SUBSPACE ITERATIONS; POTENTIAL THEORY; RITZ VALUES;

ITERATIVE METHODS;

EID: 33644583290     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0036144504445376     Document Type: Article

References (81)

1. A.I. Aptekarev and W. Van Assche, Asymptotics of discrete orthogonal polynomials and the continuum limit of the Toda lattice, J. Phys. A, 34 (2001), pp. 10627-10637.
2. D.H. Armitage and S.J. Gardiner, Classical Potential Theory, Springer-Verlag, London, 2001.
3. O. Axelsson, Iterative Solution Methods, Cambridge University Press, Cambridge, UK, 1994.
4. Z. Bai, J. Demmel, J. Dongarra, A. Ruhe, and H. van der Vorst, eds., Templates for the Solution of Algebraic Eigenvalue Problems: A Practical Guide, SIAM, Philadelphia, 2000.
5. J. Baik, T. Kriecherbauer, K.D.T.-R. McLaughlin, and P.D. Miller, Uniform Asymptotics for Polynomials Orthogonal with Respect to a General Class of Discrete Weights and Universality Results for Associated Ensembles, preprint math. CA/0310278; Announcement of results, Internet. Math. Res. Notices, 2003 (2003), pp. 821-858.
6. R. Barrett, M.W. Berry, T.F. Chan, J. Demmel, J. Donato, J. Dongarra, V. Eijkhout, R. Pozo, C. Romine, and H. van der Vorst, Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, SIAM, Philadelphia, 1994.
7. C. Beattie, M. Embree, and J. Rossi, Convergence of restarted Krylov subspaces to invariant subspaces, SIAM J. Matrix Anal. Appl., 25 (2004), pp. 1074-1109.
8. B. Beckermann, On a conjecture of E.A. Rakhmanov, Constr. Approx., 16 (2000), pp. 427-448.
9. B. Beckermann, A Note on the Convergence of Ritz Values for Sequences of Matrices, Publication ANO 408, Université de Lille, 2000.
10. B. Beckermann and A.B.J. Kuijlaars, Superlinear convergence of conjugate gradients, SIAM J. Numer. Anal., 39 (2001), pp. 300-329.
11. B. Beckermann and A.B.J. Kuijlaars, On the sharpness of an asymptotic error estimate for conjugate gradients, BIT, 41 (2001), pp. 856-867.
12. B. Beckermann and A.B.J. Kuijlaars, Superlinear CG convergence for special right-hand sides, Electron. Trans. Numer. Anal., 14 (2002), pp. 1-19.
13. P. Billingsley, Convergence of Probability Measures, 2nd ed., Wiley, New York, 1999.
14. H.P. Blatt, E.B. Saff, and M. Simkani, Jentzsch-Szego type theorems for the zeros of best approximants, J. London Math. Soc., 38 (1988), pp. 307-316.
15. V.S. Buyarov and E.A. Rakhmanov, Families of equilibrium measures with external field on the real axis, Sb. Math., 190 (1999), pp. 791-802.
16. D. Calvetti, L. Reichel, and D.C. Sorensen, An implicitly restarted Lanczos method for large symmetric eigenvalue problems, Electron. Trans. Numer. Anal., 2 (1994), pp. 1-21.
17. S.B. Damelin and A.B.J. Kuijlaars, The support of the equilibrium measure in the presence of a monomial external field on [-1, 1], Trans. Amer. Math. Soc., 351 (1999), pp. 4561-4584.
18. P.A. Deift, Orthogonal Polynomials and Random Matrices: A Riemann-Hilbert Approach, AMS, Providence, RI, 1999.
19. P. Deift, Four lectures on random matrix theory, in Asymptotic Combinatorics with Applications to Mathematical Physics, A.M. Vershik, ed., Lecture Notes in Math. 1815, Springer-Verlag, Berlin, 2003, pp. 21-52.
20. P.A. Deift and K.T.-R. McLaughlin, A continuum limit of the Toda lattice, Mem. Amer. Math. Soc., 131 (624) (1998).
21. J. Doob, Classical Potential Theory and Its Probabilistic Counterpart, Springer-Verlag, New York, 1984.
22. P.D. Dragnev and E.B. Saff, Constrained energy problems with applications to orthogonal polynomials of a discrete variable, J. Anal. Math., 72 (1997), pp. 223-259.
23. P.D. Dragnev and E.B. Saff, A problem in potential theory and zero asymptotics of Krawtchouk polynomials, J. Approx. Theory, 102 (2000), pp. 120-140.
24. T.A. Driscoll, K.-C. Toh, and L.N. Trefethen, From potential theory to matrix iterations in six steps, SIAM Rev., 40 (1998), pp. 547-578.
25. V. Faber, W. Joubert, E. Knill, and T. Manteuffel, Minimal residual method stronger than polynomial preconditioning, SIAM J. Matrix Anal. Appl., 17 (1996), pp. 707-729.
26. B. Fischer, Polynomial Based Iteration Methods for Symmetric Linear Systems, Wiley-Teubner, Chichester, UK, 1996.
27. P.J. Forrester, N.C. Snaith, and J.J.M. Verbaarschot, Developments in random matrix theory, J. Phys. A, 36 (12) (2003), pp. R1-R10.
28. O. Frostman, Potential d'équilibre et capacité des ensembles, Ph.D. thesis, Lund University, Sweden, 1935.
29. I.Ya. Goldsheid and B.A. Khoruzhenko, Eigenvalue curves of asymmetric tridiagonal random matrices, Electron. J. Probab., 5 (16) (2000), pp. 1-28.
30. I.Ya. Goldsheid and B.A. Khoruzhenko, Regular spacings of complex eigenvalues in the one-dimensional non-Hermitian Anderson model, Comm. Math. Phys., 238 (2003), pp. 505-524.
31. G.H. Golub and C.F. Van Loan, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
32. G.H. Golub and H. van der Vorst, Eigenvalue computation in the 20th century, J. Comput. Appl. Math., 123 (2000), pp. 35-65.
33. A.A. Gonchar and E.A. Rakhmanov, Equilibrium measure and the distribution of zeros of extremal polynomials, Mat. Sb., 125 (1984), pp. 117-127.
34. A. Greenbaum, Iterative Methods for Solving Linear Systems, SIAM, Philadelphia, 1997.
35. A. Greenbaum and L. Gurvits, Max-min properties of matrix factor norms, SIAM J. Sci. Comput., 15 (1994), pp. 348-358.
36. A. Greenbaum and L.N. Trefethen, GMRES/CR and Arnoldi/Lanczos as matrix approximation problems, SIAM J. Sci. Comput., 15 (1994), pp. 359-368.
37. T. Guhr, A. Müller-Groeling, and H.A. Weidenmüller, Random-matrix theories in quantum physics: Common concepts, Phys. Rep., 299 (1998), pp. 189-425.
38. S. Helsen, A.B.J. Kuijlaars, and M. Van Barel, Convergence of the isometric Arnoldi process, SIAM J. Matrix Anal. Appl., 26 (2005), pp. 782-809.
39. S. Helsen and M. Van Barel, A numerical solution of the constrained energy problem, J. Comput. Appl. Math., to appear.
40. F. Hiai and D. Petz, The Semicircle Law, Free Random Variables and Entropy, AMS, Providence, RI, 2000.
41. K. Johansson, Discrete orthogonal polynomial ensembles and the Plancherel measure, Ann. of Math. (2), 153 (2001), pp. 259-296.
42. K. Johansson, Non-intersecting paths, random tilings and random matrices, Probab. Theory Related Fields, 123 (2002), pp. 225-280.
43. S. Kaniel, Estimates for some computational techniques in linear algebra, Math. Comp., 20 (1966), pp. 369-378.
44. A.B.J. Kuijlaars, Which eigenvalues are found by the Lanczos method?, SIAM J. Matrix Anal. Appl., 22 (2000), pp. 306-321.
45. A.B.J. Kuijlaars, On the finite-gap ansatz in the continuum limit of the Toda lattice, Duke Math. J., 104 (2000), pp. 433-462.
46. A.B.J. Kuijlaars and E.A. Rakhmanov, Zero distributions for discrete orthogonal polynomials, J. Comp. Appl. Math., 99 (1998), pp. 255-274.
47. A.B.J. Kuijlaars and W. Van Assche, Extremal polynomials on discrete sets, Proc. London Math. Soc., 79 (1999), pp. 191-221.
48. N.S. Landkof, Foundations of Modern Potential Theory, Springer-Verlag, New York, 1972.
49. J. Liesen and P. Tichý, The worst-case GMRES for normal matrices, BIT, 44 (2004), pp. 79-98.
50. M.L. Mehta, Random Matrices, 2nd ed., Academic Press, Boston, 1991.
51. H.N. Mhaskar and E.B. Saff, Extremal problems for polynomials with exponential weights, Trans. Amer. Math. Soc., 285 (1984), pp. 204-234.
52. H.N. Mhaskar and E.B. Saff, Where does the sup norm of a weighted polynomial live? (A generalization of incomplete polynomials), Constr. Approx., 1 (1985), pp. 71-91.
53. H.N. Mhaskar and E.B. Saff, Weighted analogues of capacity, transfinite diameter, and Chebyshev constant, Constr. Approx., 8 (1992), pp. 105-124.
54. O. Nevanlinna, Convergence of Iterations for Linear Equations, Birkhäuser, Basel, 1993.
55. B.N. Parlett, The Symmetric Eigenvalue Problem, Classics Appl. Math. 20, SIAM, Philadelphia, 1998.
56. G. Pölya and G. Szegö, Über den transfiniten Durchmesser (Kapazitätskonstante) von ebenen und räumlichen Punktmengen, J. Reine Angew. Math., 165, (1931), pp. 4-49.
57. E.A. Rakhmanov, On asymptotic properties of polynomials orthogonal on the real axis, Mat. Sb., 119 (1982), pp. 163-203. English transl. Math. USSR-Sb., 47 (1984), pp. 155-193.
58. E.A. Rakhmanov, Equilibrium measure and the distribution of zeros of the extremal polynomials of a discrete variable, Sb. Math., 187 (1996), pp. 1213-1228.
59. T. Ransford, Potential Theory in the Complex Plane, Cambridge University Press, Cambridge, UK, 1995.
60. Y. Saad, On the rates of convergence of the Lanczos and the block-Lanczos methods, SIAM J. Numer. Anal., 17 (1980), pp. 687-706.
61. Y. Saad, Numerical Methods for Large Eigenvalue Problems, Manchester University Press, Manchester, UK, 1992.
62. Y. Saad, Iterative Methods for Sparse Linear Systems, 2nd ed., SIAM, Philadelphia, 2003.
63. E.B. Saff and V. Totik, Logarithmic Potentials with External Fields, Springer-Verlag, Berlin, 1997.
64. S. Serra Capizzano, Locally X matrices, spectral distributions, preconditioning, and applications, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1354-1388.
65. S. Serra Capizzano, Spectral behavior of matrix sequences and discretized boundary value problems, Linear Algebra Appl., 337 (2001), pp. 37-78.
66. S. Serra Capizzano, Generalized locally Toeplitz sequences: Spectral analysis and applications to discretized partial differential equations, Linear Algebra Appl., 366 (2003), pp. 371-402.
67. G.L.G. Sleijpen and A. van der Sluis, Further results on the convergence behavior of conjugate gradients and Ritz values, Linear Algebra Appl., 246 (1996), pp. 233-278.
68. A. van der Sluis and H.A. van der Vorst, The rate of convergence of conjugate gradients, Numer. Math., 48 (1986), pp. 543-560.
69. A. van der Sluis and H.A. van der Vorst, The convergence behavior of Ritz values in the presence of close eigenvalues, Linear Algebra Appl., 88/89 (1987), pp. 651-694.
70. H. Stahl and V. Totik, General Orthogonal Polynomials, Cambridge University Press, Cambridge, UK, 1992.
71. K.C. Toh, GMRES vs. ideal GMRES, SIAM J. Matrix Anal. Appl., 18 (1997), pp. 30-36.
72. V. Totik, Weighted Approximation with Varying Weight, Lecture Notes in Math. 1569, Springer-Verlag, Berlin, 1994.
73. C. Tracy and H. Widom, Introduction to random matrices, in Geometric and Quantum Aspects of Integrable Systems, G.F. Helminck, ed., Springer-Verlag, Berlin, 1993, pp. 103-130.
74. C. Tracy and H. Widom, Universality of the distribution functions of random Matrix theory, in Integrable Systems: From Classical to Quantum, J. Harnad, G. Sabidussi, and P. Winternitz, eds., CRM Proc. Lecture Notes 26, AMS, Providence, RI, 2000, pp. 251-264.
75. L.N. Trefethen and D. Bau III, Numerical Linear Algebra, SIAM, Philadelphia, 1997.
76. L.N. Trefethen, M. Contedini, and M. Embree, Spectra, pseudospectra, and localization for random bidiagonal matrices, Comm. Pure Appl. Math., 54 (2001), pp. 595-623.
77. A.M. Tulino and S. Verdú, Random Matrix Theory and Wireless Communications, Now Publishers, Delft, The Netherlands, 2004.
78. H. van der Vorst, Iterative Krylov Methods for Large Linear Systems, Cambridge University Press, Cambridge, UK, 2003.
79. J.L. Walsh, Interpolation and Approximation by Rational Functions in the Complex Domain, 5th ed., AMS, Providence, RI, 1969.
80. D.S. Watkins, Some perspectives on the eigenvalue problem, SIAM Rev., 35 (1993), pp. 430-471.
81. J.H. Wilkinson, The Algebraic Eigenvalue Problem, Clarendon Press, Oxford, UK, 1965.