Extrapolation algorithms and Padé approximations: A historical survey

Applied Numerical Mathematics

Volumn 20, Issue 3, 1996, Pages 299-318

  Brezinski, C ^a  

^a UNIV LILLE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; NUMERICAL ANALYSIS; PERTURBATION TECHNIQUES; POLYNOMIALS;

DISCRETIZATION; EXTRAPOLATION ALGORITHMS; PADE APPROXIMANTS; POWER SERIES EXPANSION;

ALGORITHMS;

EID: 0030103537     PISSN: 01689274     EISSN: None     Source Type: Journal    
DOI: 10.1016/0168-9274(95)00110-7     Document Type: Article

References (138)

1. M. Abramowitz and I.A. Stegun, eds., Handbook of Mathematical Functions (Dover, New York, 1965).
2. A.C. Aitken, On Bernoulli's numerical solution of algebraic equations, Proc. R. Soc. Edinb. 46 (1926) 289-305.
3. H. Andoyer, Interpolation, in: J. Molk, ed., Encyclopédie des Sciences Mathématiques Pures et Appliquées, Tome I, vol. 4, Fasc. 1, 1-21 (Gauthier-Villars, Paris, 1904-1912) 127-160; reprinted by (Editions Gabay, Paris, 1993).
4. G.A. Baker Jr, Application of the Padé method to the investigation of some magnetic properties of the Ising model, Phys. Rev. 124 (1961) 768-774.
5. G.A. Baker Jr and P.R. Graves-Morris, Padé Approximates, 2 vols. (Addison-Wesley, Reading, MA, 1981); also: (Cambridge University Press, Cambridge, 2nd ed., 1996).
6. F.L. Bauer, La méthode d'intégration numérique de Romberg, in: Colloque sur l'Analyse Numérique (Librairie Universitaire, Louvain, 1961) 119-129.
7. B. Beckermann, A connection between the E-algorithm and the epsilon-algorithm, in: C. Brezinski, ed., Numerical and Applied Mathematics (Baltzer, Basel, 1989) 443-446.
8. 2 d'Aitken et Comparaison de Procédés d'Accélération de la Convergence, Thèse 3ème cycle, Université de Lille I (1987).
9. A. Berlinet, Sequence transformations as statistical tools, Appl. Numer. Math. 1 (1985) 531-544.
10. N. Bogolyubov, N. Krylov, On Rayleigh's principle in the theory of differential equations of mathematical physics and upon Euler's method in the calculus of variation, Acad. Sci. Ukraine (Phys. Math.) 3 (1926) 3-22 (in Russian).
11. H.C. Bolton, H.I. Scoins, Eigenvalues of differential equations by finite-difference methods, Proc. Cambridge Phil. Soc. 52 (1956) 215-229.
12. C. Brezinski, Application de l'ε-algorithme à la résolution des systèmes non linéaires, C. R. Acad. Sci. Paris 271 A (1970) 1174-1177.
13. C. Brezinski, Accélération de suites à convergence logarithmique, C. R. Acad. Sci. Paris 273 A (1971) 727-730.
14. C. Brezinski, Généralisation de la transformation de Shanks, de la table de Padé et de l'ε-algorithme, Calcolo 12 (1975) 317-360.
15. C. Brezinski, A general extrapolation algorithm, Numer. Math. 35 (1980) 175-187.
16. C. Brezinski, Padé-Type Approximation and General Orthogonal Polynomials, ISNM 50 (Birkhäuser, Basel, 1980).
17. C. Brezinski, Error control in convergence acceleration processes, IMA J. Numer. Anal. 3 (1983) 65-80.
18. C. Brezinski, Composite sequence transformations, Numer. Math. 46 (1985) 311-321.
19. C. Brezinski, A new approach to convergence acceleration methods, in: A. Cuyt, ed., Nonlinear Numerical Methods and Rational Approximation (Reidel, Dordrecht, 1988) 373-405.
20. C. Brezinski, Quasi-linear extrapolation processes, in: R.P. Agarwal et al., eds., Numerical Mathematics. Singapore 1988, ISNM 86 (Birkhäuser, Basel, 1988) 61-78.
21. C. Brezinski, A survey of iterative extrapolation by the E-algorithm, Det Kong. Norske Vid. Selsk. Skr. 2 (1989) 1-26.
22. C. Brezinski, History of Continued Fractions and Padé Approximants (Springer, Berlin, 1990).
23. C. Brezinski, A Bibliography on Continued Fractions, Padé Approximation, Extrapolation and Related Subjects (Prensas Universitarias de Zaragoza, Zaragoza, 1991).
24. C. Brezinski, Biorthogonality and its Applications to Numerical Analysis (Marcel Dekker, New York, 1991).
25. C. Brezinski, The generalizations of Newton's interpolation formula due to Mühlbach and Andoyer, Elect. Trans. Numer. Anal. 2 (1994) 130-137.
26. C. Brezinski, J.P. Delahaye and B. Germain-Bonne, Convergence acceleration by extraction of linear subsequences, SIAM J. Numer. Anal. 20 (1983) 1099-1105.
27. C. Brezinski and A.C. Matos, A derivation of extrapolation algorithms based on error estimates, J. Comput. Appl. Math., to appear.
28. C. Brezinski and M. Redivo Zaglia, Construction of extrapolation processes, Appl. Numer. Math. 8 (1991) 11-23.
29. C. Brezinski and M. Redivo Zaglia, Extrapolation Methods. Theory and Practice (North-Holland, Amsterdam, 1991).
30. C. Brezinski and M. Redivo Zaglia, Treatment of near-breakdown in the CGS algorithm, Numerical Algor. 7 (1994) 33-73.
31. C. Brezinski and M. Redivo Zaglia, A general extrapolation procedure revisited, Adv. Comput. Math. 2 (1994) 461-477.
32. C. Brezinski, M. Redivo Zaglia and H. Sadok, Avoiding breakdown and near-breakdown in Lanczos type algorithms, Numerical Algor. 1 (1991) 261-274.
33. C. Brezinski, M. Redivo Zaglia and H. Sadok, A breakdown-free Lanczos type algorithm for solving linear systems, Numer. Math. 63 (1992) 29-38.
34. C. Brezinski and A.C. Rieu, The solution of systems of equations using the vector ε-algorithm, and an application to boundary value problems, Math. Comp. 28 (1974) 731-741.
35. C. Brezinski and J. van Iseghem, Padé approximations, in: P.G. Ciarlet and J.L. Lions, eds., Handbook of Numerical Analysis, Vol. III (North-Holland, Amsterdam, 1994) 47-222.
36. C. Brezinski and G. Walz, Sequences of transformations and triangular recursion schemes with applications in numerical analysis, J. Comput. Appl. Math. 34 (1991) 361-383.
37. R. Bulirsch and J. Stoer, Numerical treatment of ordinary differential equations by extrapolation methods, Numer. Math. 8 (1966) 1-13.
38. A. Bultheel, Laurent Series and their Padé Approximations (Birkhäuser, Basel, 1987).
39. G. Cantor, Ein Beitrag zur Mannigfaltigkeitslehre, J. Reine Angew. Math. 84 (1878) 242-258.
40. C. Carstensen, On a general epsilon algorithm, in: C. Brezinski, ed., Numerical and Applied Mathematics (Baltzer, Basel, 1989) 437-441.
41. J.L. Chabert et al., Histoire d'Algorithmes (Belin, Paris, 1994).
42. L. Collatz, Numerische Behandlung von Differentialgleichungen (Springer, Berlin, 1951).
43. F. Cordellier, Démonstration algébrique de l'extension de l'identité de Wynn aux tables de Padé non normales, in: L. Wuytack, ed., Padé Approximation and its Applications, Lecture Notes in Mathematics 765 (Springer, Berlin, 1979) 36-60.
44. A. Cuyt and L. Wuytack, Nonlinear Methods in Numerical Analysis (North-Holland, Amsterdam, 1987).
45. J.P. Delahaye, Automatic selection of sequence transformations, Math. Comp. 37 (1981) 197-204.
46. J.P. Delahaye, Sequence Transformations (Springer, Berlin, 1988).
47. J.P. Delahaye and B. Germain-Bonne, Résultats négatifs en accélération de la convergence, Numer. Math. 35 (1980) 443-457.
48. A. Draux, Polynômes Orthogonaux Formels. Applications, Lecture Notes in Mathematics 974 (Springer, Berlin, 1983).
49. A. Draux and P. van Ingelandt, Polynômes Orthogonaux et Approximants de Padé, Logiciels (Editions Technip, Paris, 1987).
50. J. Dutka, Richardson-extrapolation and Romberg-integration, Historia Math. 11 (1984) 3-21.
51. A. Edrei, E.B. Saff and R.S. Varga, Zeros of Sections of Power Series, Lecture Notes in Mathematics 1002 (Springer, Berlin, 1983).
52. W.F. Ford and A. Sidi, An algorithm for a generalization of the Richardson extrapolation process, SIAM J. Numer. Anal. 24 (1987) 1212-1232.
53. E. Gekeler, On the solution of systems of equations by the epsilon algorithm of Wynn, Math. Comp. 26 (1972) 427-436.
54. B. Germain-Bonne, Transformations de suites, RAIRO, R1 (1973) 84-90.
55. B. Germain-Bonne, Estimation de la Limite de Suites et Formalisation de Procédés d'Accélération de la Convergence, Thèse d'Etat, Université de Lille I (1978).
56. W.B. Gragg, On extrapolation algorithms for initial-value problems, SIAM J. Numer. Anal. 2 (1965) 384-403.
57. P.R. Graves-Morris, Vector valued rational interpolants I, Numer. Math. 42 (1983) 331-348.
58. H.L. Gray, T.A. Atchison and G.V. McWilliams, Higher order G-transformations, SIAM J. Numer. Anal. 8 (1971) 365-381.
59. M.H. Gutknecht, The unsymmetric Lanczos algorithms and their relations to Padé approximation, continued fractions, and the qd algorithm, in: Proceedings of the Copper Mountain Conference on Iterative Methods (1990).
60. T. Håvie, Generalized Neville type extrapolation schemes, BIT 19 (1979) 204-213.
61. E. Hairer and G. Wanner, Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems (Springer, Berlin, 1991).
62. H. Hankel, Ueber eine besondere Classe der symmetrischen Determinanten, Inaugural Diss., Universität Göttingen (1861).
63. P. Henrici, The quotient-difference algorithm, Nat. Bur. Stand. Appl. Math. Ser. 49 (1958) 23-46.
64. C. Hermite, Sur la fonction exponentielle, C. R. Acad. Sci. Paris 77 (1873) 18-24, 74-79, 226-233, 285-293.
65. C. Huygens, De circuli magnitudine inventa, in: Œuvres, t. XII (1654).
66. C.G.J. Jacobi, Über die Darstellung einer Reihe gegebener Werthe durch eine gebrochen rationale Funktion, J. Reine Angew. Math. 30 (1845) 127-156.
67. K. Jbilou and H. Sadok, Some results about vector extrapolation methods and related fixed-point iterations, J. Comput. Appl. Math. 36 (1991) 385-398.
68. W.B. Jones and W.J. Thron, Continued Fractions, Analytic Theory and Applications (Addison-Wesley, Reading, 1980).
69. D.C. Joyce, Survey of extrapolation processes in numerical analysis, SIAM Rev. 13 (1971) 435-490.
70. K. Kommerell, Das Grenzgebiet der Elementaren und Höheren Mathematik (Verlag Köhler, Leipzig, 1936).
71. J.L. Lagrange, Sur l'usage des fractions continues dans le calcul intégral, Nouveaux Mém. Acad. Sci. Berlin 7 (1776) 236-264; Oeuvres 4 (1869) 301-322.
72. J.L. Lagrange, Sur l'usage des fractions continues dans le calcul intégral, Nouveaux Mém. Acad. Sci. Berlin 7 (1776) 236-264; Oeuvres 4 (1869) 301-322.
73. J.H. Lambert, Observationes variae in mathesin puram, Acta Helvetica 3 (1758) 128-168.
74. P.J. Laurent, Un théorème de convergence pour le procédé d'extrapolation de Richardson, C. R. Acad. Sci. Paris 256 (1963) 1435-1437.
75. H. Lavastre, On the stochastic acceleration of sequences of random variables, Appl. Numer. Math. 15 (1994) 77-98.
76. H. Le Ferrand, Convergence of the topological ε-algorithm for solving systems of nonlinear equations, Numerical Algor. 3 (1992) 273-284.
77. D. Levin, Development of nonlinear transformations for improving convergence of sequences, Int. J. Comput. Math. B3 (1973) 371-388.
78. F. Lindemann, Ueber die Zahl π, Math. Ann. 20 (1882) 213-225.
79. L. Lorentzen and H. Waadeland, Continued Fractions with Applications (North-Holland, Amsterdam, 1992).
80. D.S. Lubinsky, Strong Asymptotics for Extremal Errors and Polynomials Associated with Erdos-type Weights, Pitman Research Notes 202 (Longman House, Harlow, 1988).
81. D.S. Lubinsky and E.B. Saff, Strong Asymptotics for Extremal Polynomials Associated with Weights on ℝ, Lecture Notes in Mathematics 1305 (Springer, Berlin, 1988).
82. S. Lubkin, A method of summing infinite series, J. Res. Nat. Bur. Stand. 48 (1952) 228-254.
83. C. Maclaurin, Treatise of Fluxions, Edinburgh, 1742.
84. G.I. Marchuk and V.V. Shaidurov, Difference Methods and their Extrapolations (Springer, Berlin, 1983).
85. A.C. Matos, Acceleration methods based on convergence tests, Numer. Math. 58 (1990) 329-340.
86. A.C. Matos, Linear difference operators and acceleration methods, submitted.
87. A.C. Matos and M. Prévost, Acceleration property for the columns of the E-algorithm, Numerical Algor. 2 (1992) 393-408.
88. J.C. Maxwell, A Treatise on Electricity and Magnetism (Oxford University Press, Oxford, 1892).
89. J.B. McLeod, A note on the ε-algorithm, Computing 7 (1971) 17-24.
90. G. Meinardus and G.D. Taylor, Lower estimates for the error of the best uniform approximation, J. Approx. Theory 16 (1976) 150-161.
91. R.M. Milne, Extension of Huygens' approximation to a circular arc, Math. Gaz. 2 (1903) 309-311.
92. R. de Montessus de Ballore, Sur les fractions continues algébriques, Bull. Soc. Math. France 30 (1902) 28-36.
93. P. Moussa, Physique théorique: les approximants de Padé retrouvés, in: Approximants de Padé (IREM de Lille, Lille, 1994).
94. G. Mühlbach, Neville-Aitken algorithms for interpolating by functions of Čebyšev-systems in the sense of Newton and in a generalized sense of Hermite, in: A.G. Law and B.N. Sahney, eds., Theory of Approximation with Applications (Academic Press, New York, 1976) 200-212.
95. H. Naegelsbach, Studien zu Fürstenau's neuer Methode der Darstellung und Berechnung der Wurzeln algebraischer Gleichungen durch Determinanten der Coefficienten, Arch. Math. Phys. 59 (1876) 147-192; 61 (1877) 19-85.
96. H. Naegelsbach, Studien zu Fürstenau's neuer Methode der Darstellung und Berechnung der Wurzeln algebraischer Gleichungen durch Determinanten der Coefficienten, Arch. Math. Phys. 59 (1876) 147-192; 61 (1877) 19-85.
97. P. Nevai, ed., Orthogonal Polynomials: Theory and Practice (Kluwer, Dordrecht, 1990).
98. E.M. Nikishin and V.N. Sorokin, Rational Approximations and Orthogonality, Trans. Math. Monographs 92 (American Mathematical Society, Providence, RI, 1991).
99. T.H. O'Beirne, On linear iterative processes and on methods of improving the convergence of certain types of iterated sequences, Technical Report, Torpedo Experimental Establishment, Greenock (1947).
100. K.J. Overholt, Extended Aitken acceleration, BIT 5 (1965) 122-132.
101. H. Padé, Sur la représentation approchée d'une fonction par des fractions rationnelles, Ann. Sci. Ec. Norm. Sup. 9 (1892) 1-93; also in: C. Brezinski, ed., Oeuvres (Librairie Scientifique et Technique Albert Blanchard, Paris, 1984) 72-166.
102. H. Padé, Sur la représentation approchée d'une fonction par des fractions rationnelles, Ann. Sci. Ec. Norm. Sup. 9 (1892) 1-93; also in: C. Brezinski, ed., Oeuvres (Librairie Scientifique et Technique Albert Blanchard, Paris, 1984) 72-166.
103. R. Pennacchi, Le trasformazioni razionali di una successione, Calcolo 5 (1968) 37-50.
104. R. Powell and S.M. Shah, Summability Theory and its Applications (Nostrand Reinhold, London, 1972).
105. M. Prévost, Acceleration property for the E-algorithm and an application to the summation of series, Adv. Comput. Math. 2 (1994) 319-341.
106. J.D. Pryce, Numerical Solution of Sturm-Liouville Problems (Clarendon Press, Oxford, 1993).
107. L.F. Richardson, The approximate arithmetical solution by finite difference of physical problems involving differential equations, with an application to the stress in a masonry dam, Philos. Trans. Roy. Soc. London Ser. A 210 (1910) 307-357.
108. L.F. Richardson, The deferred approach to the limit, I: Single lattice, Philos. Trans. Roy. Soc. London Ser. A 226 (1927) 299-349.
109. W. Romberg, Vereinfachte numerische Integration, Kgl. Norske Vid. Selsk. Forsk. 28 (1955) 30-36.
110. H. Rutishauser, Der Quotienten-Differenzen-Algorithmus, Z. Angew. Math. Phys. 5 (1954) 233-251.
111. H. Rutishauser, Bestimmung der Eigenwerte und Eigenvektoren einer Matrix mit Hilfe des Quotienten-Differenzen-Algorithmus, Z. Angew. Math. Phys. 6 (1955) 387-401.
112. H. Rutishauser, Ausdehnung des Rombergschen Prinzips, Numer. Math. 5 (1963) 48-54.
113. H. Sadok, Quasilinear vector extrapolation methods, Linear Alg. Appl. 190 (1993) 71-85.
114. J.F. Saigey, Problèmes d'Arithmétique et Exercices de Calcul du Second Degré avec les Solutions Raisonnées (Hachette, Paris, 1859).
115. A. Salam, Non-commutative extrapolation algorithms, Numerical Algor. 7 (1994) 225-251.
116. J.R. Schmidt, On the numerical solution of linear simultaneous equations by an iterative method, Phil. Mag. 7 (1941) 369-383.
117. C. Schneider, Vereinfachte Rekursionen zur Richardson-Extrapolation in Spezialfällen, Numer. Math. 24 (1975) 177-184.
118. D. Shanks, An analogy between transient and mathematical sequences and some nonlinear sequence-to-sequence transforms suggested by it, Part I, Memorandum 9994, Naval Ordnance Laboratory, White Oak (1949).
119. D. Shanks, Non linear transformations of divergent and slowly convergent sequences, J. Math. Phys. 34 (1955) 1-42.
120. W.F. Sheppard, Some quadrature formulas, Proc. London Math. Soc. 32 (1900) 258-277.
121. A. Sidi, Extrapolation vs. projection methods for linear systems of equations, J. Comput. Appl. Math. 22 (1988) 71-88.
122. A. Sidi, On a generalization of the Richardson extrapolation process, Numer. Math. 57 (1990) 365-377.
123. H. Stahl and V. Totik, General Orthogonal Polynomials (Cambridge University Press, Cambridge, 1992).
124. E. Stiefel, Altes und neues über numerische Quadratur, Z. Angew. Math. Mech. 41 (1961) 408-413.
125. T.J. Stieltjes, Sur la réduction en fraction continue d'une série procédant suivant les puissances descendantes d'une variable, Ann. Fac. Sci. Toulouse 3 (1889) H. 1-17.
126. T.J. Stieltjes, Recherches sur les fractions continues, Ann. Fac. Sci. Toulouse 8 (1894) 1-122.
127. W. van Assche, Asymptotic s for Orthogonal Polynomials, Lecture Notes in Mathematics 1265 (Springer, Berlin, 1987).
128. J. van Iseghem, Vector Padé approximants, in: R. Vichnevetsky and J. Vignes, eds., Numerical Mathematics and Applications (North-Holland, Amsterdam, 1985) 73-77.
129. J. van Iseghem, Vector orthogonal relations. Vector QD algorithm, J. Comput. Appl. Math. 19 (1987) 141-150.
130. J. van Iseghem, Convergence of vectorial sequences. Applications, Numer. Math. 68 (1994) 549-562.
131. G. Walz, The history of extrapolation methods in numerical analysis, Report No. 130, Universität Mannheim, Fakultät für Mathematik und Informatik (1991).
132. G. Walz, Asymptotic Expansions in Numerical Analysis, to appear.
133. E.J. Weniger, Nonlinear sequence transformations for the acceleration of convergence and the summation of divergent series, Comput. Physics Reports 10 (1989) 189-371.
134. J. Wimp, Sequence Transformations and their Applications (Academic Press, New York, 1981).
135. n) transformation, MTAC 10 (1956) 91-96.
136. P. Wynn, On a procrustean technique for the numerical transformation of slowly convergent sequences and series, Proc. Cambridge Phil. Soc. 52 (1956) 663-671.
137. P. Wynn, Acceleration techniques for iterated vector and matrix problems, Math. Comp. 16 (1962) 301-322.
138. P. Wynn, Singular rules for certain nonlinear algorithms, BIT 3 (1963) 175-195.