The quasi-Newton least squares method: A new and fast secant method analyzed for linear systems

SIAM Journal on Numerical Analysis

Volumn 47, Issue 3, 2009, Pages 2347-2368

  Haelterman, Rob ^a   Degroote, Joris ^b   Van Heule, Dirk ^a   Vierendeels, Jan ^b  

^a ROYAL MILITARY ACADEMY   (Belgium)

^b GHENT UNIVERSITY   (Belgium)

Author keywords

GMRes; Iterative method; Least squares; Linear algebra; Quasi Newton method; Rank one update; Secant method

Indexed keywords

EID: 77049089518     PISSN: 00361429     EISSN: None     Source Type: Journal    
DOI: 10.1137/070710469     Document Type: Article

References (30)

1. C.G. BROYDEN, A class of methods for solving nonlinear simultaneous equations, Math. Comp., 19 (1965), pp. 577-593.
2. C.G. BROYDEN, Quasi-Newton methods and their applications to function minimization, Math. Comp., 21 (1967), pp. 368-381.
3. C.N. DAWSON, H. KLIE, M.F. WHEELER, AND C.S. WOODWARD, A parallel, implicit, cell-centered method for two-phase flow with a preconditioned Newton-Krylov solver, Comput. Geosci., 1 (1997), pp. 215-249.
4. J.E. DENNIS AND J.J. MORÉ, A characterization of superlinear convergence and its application to quasi-Newton methods, Math. Comp., 28 (1974), pp. 549-560.
5. J.E. DENNIS, JR., AND J.J. MORÉ, Quasi-Newton methods, motivation and theory, SIAM Rev., 19 (1977), pp. 46-89.
6. J.E. DENNIS, JR., AND R.B. SCHNABEL, Least change secant updates for quasi-Newton methods, SIAM Rev., 21 (1979), pp. 443-459.
7. J.E. DENNIS AND R.B. SCHNABEL, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, NJ, 1983.
8. P. DEUFLHARD, R. FREUND, AND A. WALTER, Fast secant methods for the iterative solution of large nonsymmetric linear systems, IMPACT Comp. Sci. Eng., 2 (1990), pp. 244-276.
9. P. DEUFLHARD, Newton Methods for Nonlinear Problems, Affine Invariance and Adaptive Algorithms, 2nd ed., Springer Ser. Comput. Math. 35, Springer, New York, 2006.
10. L.C.W. DIXON, Automatic Differentiation and Parallel Processing in Optimisation, Technical report 180, The Hatfield Polytechnique, Hatfield, UK, 1987.
11. T. EIROLA AND O. NEVANLINNA, Accelerating with rank-one updates, Linear Algebra Appl., 121 (1989), pp. 511-520.
12. W. GAI, J. XUE, AND Y. QU, A new implementation of the EN method, Appl. Math. Comput., 98 (1999), pp. 199-208.
13. D.M. GAY, Some convergence properties of Broyden's method, SIAM J. Numer. Anal., 16 (1979), pp. 623-630.
14. G. KEDEM, Automatic differentiation of computer programs, ACM Trans. Math. Software, 6 (1980), pp. 150-165.
15. C.T. KELLEY, Iterative Methods for Linear and Nonlinear Equations, Frontiers Appl. Math. 16, SIAM, Philadelphia, 1995.
16. V.L.R. LOPES AND J.M. MARTINEZ, Convergence properties of the Inverse Column-Updating method, Optim. Methods Softw., 6 (1995), pp. 127-144.
17. J.M. MARTINEZ, A quasi-Newton method with modification of one column per iteration, Computing, 33 (1984), pp. 353-362.
18. J.M. MARTINEZ AND M.C. ZAMBALDI, An inverse column-updating method for solving large-scale nonlinear systems of equations, Optim. Methods Softw., 1 (1992), pp. 129-140.
19. J.M. MARTINEZ, On the convergence of the column-updating method, Comput. Appl. Math., 12 (1993), pp. 83-94.
20. J.M. MARTINEZ, Practical quasi-Newton method for solving nonlinear systems, J. Comput. Appl. Math., 124 (2000), pp. 97-122.
21. Matrix Market Repository, http://math.nist.gov/MatrixMarket/.
22. J.M. ORTEGA AND W.C. RHEINBOLDT, Iterative Solution of Nonlinear Equations in Several Variables, Classics Appl. Math. 30, SIAM, Philadelphia, PA, 2000.
23. Y. SAAD, Iterative Methods for Sparse Linear Systems, 2nd ed., SIAM, Philadelphia, 2003.
24. A.H. SHERMAN AND W.J. MORRISON, Adjustment of an inverse matrix corresponding to changes in the elements of a given column or a given row of the original matrix, Ann. Math. Statist., 21 (1950), pp. 124-127.
25. E. SPEDICATO, Z. XIA, AND L. ZHANG, ABS algorithms for linear equations and optimization, J. Comput. Appl. Math., 124 (2000), pp. 155-170.
26. G. STRANG, Linear Algebra and its Applications, 3rd ed., Saunders, Orlando, 1988.
27. E.H. VAN BRUMMELEN, C. MICHLER, AND R. DE BORST, Interface-GMRES(R) Acceleration of Subiteration for Fluid-structure-interaction Problems, Report DACS-05-001, Delft Aerospace Computational Science, Delft, The Netherlands, 2005.
28. H.A. VAN DER VORST, Iterative Krylov Methods for Large Linear Systems, Cambridge Monogr. Appl. Comput. Math., Cambridge University Press, New York, 2003.
29. J. VIERENDEELS, L. LANOYE, J. DEGROOTE, AND P. VERDONCK, Implicit coupling of partitioned fluid-structure interaction problems with reduced order models, Comput. & Structures, 85 (2007), pp. 970-976.
30. J. VIERENDEELS, Implicit coupling of partitioned fluid-structure interaction solvers using reduced-order models, in Fluid-Structure Interaction, Modelling, Simulation, Optimization, H.-J. Bungartz and M. Schäfer, eds., Lect. Notes Comput. Sci. Eng. 53, Springer, Berlin, 2006, pp. 1-18.