Nonmonotone spectral methods for large-scale nonlinear systems

Optimization Methods and Software

Volumn 18, Issue 5, 2003, Pages 583-599

  La Cruz, William ^a   Raydan, Marcos ^b  

^a UNIVERSIDAD CENTRAL DE VENEZUELA   (Venezuela)

^b FACULTAD DE CIENCIAS   (Venezuela)

Author keywords

Krylov subspace methods; Nonmonotone line search; Spectral gradient method

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; MATRIX ALGEBRA; OPTIMIZATION;

KRYLOV SUBSPACE METHOD; SPECTRAL GRADIENT METHOD;

NONLINEAR SYSTEMS;

EID: 0242551553     PISSN: 10556788     EISSN: None     Source Type: Journal    
DOI: 10.1080/10556780310001610493     Document Type: Article

References (35)

1. J. Barzilai and J.M. Borwein (1988). Two point step size gradient methods. IMA J. Numer. Anal., 8, 141-148.
2. S. Bellavia and B. Morini (2001). A globally convergent Newton-GMRES subspace method for systems of nonlinear equations. SIAM J. Sci. Comput., 23, 940-960.
3. E.G. Birgin, R. Biloti, M. Tygel and L.T. Santos (1999). Restricted optimization: A clue to fast and accurate implmentation of the common reflection surface method. Journal of Applied Geophysics, 42, 143-155.
4. E.G. Birgin, I. Chambouleyron and J.M. Martínez (1999). Estimation of the optical constants and the thickness of thin films using unconstrained optimization. Journal of Computational Physics, 151, 862-880.
5. E.G. Birgin and Y.G. Evtushenko (1998). Automatic differentiation and spectral projected gradient methods for optimal control problems. Optimization Meth. & Soft., 10, 125-146.
6. P.N. Brown and Y. Saad (1990). Hybrid Krylov methods for nonlinear systems of equations. SIAM J. Sci. Comput., 11, 450-481.
7. P.N. Brown and Y. Saad (1994). Convergence theory of nonlinear Newton-Krylov algorithms. SIAM J. Opt., 4, 297-330.
8. C.G. Broyden (1965). A class of methods for solving nonlinear simultaneous equations. Math. Comp., 19, 577-593.
9. Z. Castillo, D. Cores and M. Raydan (2000). Low cost optimization techniques for solving the nonlinear seismic reflection tomography problem. Optimization and Engineering, 1, 155-169.
10. D. Cores, G. Fung and R. Michelena (2000). A fast and global two point low storage optimization technique for tracing rays in 2D and 3D Isotropic media. Journal of Applied Geophysics, 45, 273-287.
11. Y.H. Dai (2001). On nonmonotone line search. JOTA (to appear).
12. R.S. Dembo, S.C. Eisenstat and T. Steihaug (1982). Inexact Newton methods. SIAM J. Numer. Anal., 19,400-408.
13. J.E. Dennis, Jr., J.M. Martínez and X. Zhang (1994). Triangular decomposition methods for solving reducible nonlinear systems of equations. SIAM J. Opt., 4, 358-382.
14. J.E. Dennis, Jr. and H.F. Walker (1981). Convergence theorems for least-change secant update methods. SIAM J. Numer. Anal., 18, 949-987.
15. J.E. Dennis, Jr. and R.B. Schnabel (1983). Numerical Methods for unconstrained Optimization and Nonlinear Equations. Prentice-Hall, Englewood Cliffs, NJ.
16. S.C. Eisenstat and H.F. Walker (1994). Globally convergent inexact Newton methods. SIAM J. Opt., 4, 393-422.
17. M.C. Ferris and S. Lucidi (1994). Nonmonotone stabilization methods for nonlinear equations JOTA, 81, 53-71.
18. R. Fletcher (1990). Low storage methods for unconstrained optimization. Lectures in Applied Mathematics (AMS), 26, 165-179.
19. R. Fletcher (2001). On the Barzilai-Borwein method. Technical Report NA/207, Department of Mathematics, University of Dundee, Dundee, Scotland.
20. R.W. Freund (1993). A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems. SIAM J. Sci. Comp., 14, 470-482
21. M. Gasparo (2000). A nonmonotone hybrid method for nonlinear systems. Optimization Meth. & Soft., 13, 79-94.
22. M. Gomez-Ruggiero, J.M. Martínez and A. Moretti (1992). Comparing algorithms for solving sparse nonlinear systems of equations. SIAM J. Sci. Comp., 23, 459-483.
23. L. Grippo, F. Lampariello and S. Lucidi (1986). A nonmonotone line search technique for Newton's method. SIAM J. Numer. Anal., 23, 707-716.
24. C.T. Kelley (1995). Iterative Methods for Linear and Nonlinear Equations. SIAM, Philadelphia.
25. D.H. Li and M. Fukushima (2000). A derivative-free line search and global convergence of Broyden-like method for nonlinear equations. Optimization Meth. & Soft., 13, 181-201.
26. J.M. Martínez (1990). A family of quasi-Newton methods for nonlinear equations with direct secant updates of matrix factorizations. SIAM J. Numer. Anal., 27, 1034-1049.
27. J.M. Martínez (1990). Local convergence theory of inexact Newton methods based on structured least change secant updates. Math. Comp., 55, 143-167.
28. M. Mulato, I. Chambouleyron, E.G. Birgin and J.M. Martínez (2000). Determination of thickness and optical constants of a-Si:H films from transmittance data. Applied Physics Letters, 77, 2133-2135.
29. J.M. Ortega and W.C. Rheinboldt (1970). Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York.
30. M. Raydan (1993). On the Barzilai and Borwein choice of step length for the gradient method. IMA J. Numer. Anal., 13, 321-326.
31. M. Raydan (1997). The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAMJ. Opt., 7, 26-33.
32. Y. Saad and M.H. Schultz (1986). GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Stat. Comput., 7, 856-869.
33. L.K. Schubert (1970). Modification of a quasi-Newton method for nonlinear equations with a sparse Jacobian. Math. Comp., 24, 27-30.
34. A.H. Sherman (1978). On Newton-iterative methods for the solution of systems of nonlinear equations. SIAM J. Numer. Anal., 15, 755-771.
35. H.A. Van Der Vorst (1992). Bi-CGSTAB: A fast and smoothly convergent variant Bi-CG for the solution of non-symmetric linear systems. SIAM J. Sci. Stat. Comput., 13, 631-644.