A nonmonotone line search technique and its application to unconstrained optimization

SIAM Journal on Optimization

Volumn 14, Issue 4, 2004, Pages 1043-1056

  Zhang, Hongchao ^a   Hager, William W ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

L BFGS method; Nonmonotone line search; R linear convergence; Unconstrained optimization

Indexed keywords

GLOBAL CONVERGENCE; NONMONOTONE LINE SEARCH; R-LINEAR CONVERGENCE; UNCONSTRAINED OPTIMIZATION;

FUNCTIONS; INTEGER PROGRAMMING; ITERATIVE METHODS; OPTIMIZATION; PROBLEM SOLVING; SET THEORY;

ALGORITHMS;

EID: 9944262108     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/S1052623403428208     Document Type: Article

References (18)

1. J. BARZILAI AND J. M. BORWEIN, Two-point step size gradient methods, IMA J. Numer. Anal., 8 (1988), pp. 141-148.
2. E. G. BIRGIN, J. M. MARTINEZ, AND M. RAYDAN, Nonmonotone spectral projected gradient methods on convex sets, SIAM J. Optim., 10 (2000), pp. 1196-1211.
3. I. BONGARTZ, A. R. CONN, N. I. M. GOULD, AND P. L. TOINT, CUTE: Constrained and unconstrained testing environments, ACM Trans. Math. Software, 21 (1995), pp. 123-160.
4. Y. H. DAI, On the nonmonotone line search, J. Optim. Theory Appl., 112 (2002), pp. 315-330.
5. Y. H. DAI, R-linear convergence of the Barzilai and Borwein gradient method, IMA J. Numer. Anal., 22 (2002), pp. 1-10.
6. Y. H. DAI, A nonmonotone conjugate gradient algorithm for unconstrained optimization, J. Syst. Sci. Complex., 15 (2002), pp. 139-145.
7. L. GRIPPO, F. LAMPARIELLO, AND S. LUCIDI, A nonmonotone line search technique for Newton's method, SIAM J. Numer. Anal., 23 (1986), pp. 707-716.
8. L. GRIPPO, F. LAMPARIELLO, AND S. LUCIDI, A truncated Newton method with nonmonotone line search for unconstrained optimization, J. Optim. Theory Appl., 60 (1989), pp. 401-419.
9. L. GRIPPO, F. LAMPARIELLO, AND S. LUCIDI, A class of nonmonotone stabilization methods in unconstrained optimization, Numer. Math., 59 (1991), pp. 779-805.
10. D. C. LIU AND J. NOCEDAL, On the limited memory BFGS method for large scale optimization, Math. Prog., 45 (1989), pp. 503-528.
11. S. LUCIDI, F. ROCHETICH, AND M. ROMA, Curvilinear stabilization techniques for truncated Newton methods in large-scale unconstrained optimization, SIAM J. Optim., 8 (1998), pp. 916-939.
12. J. J. MORÉ, B. S. GARBOW, AND K. E. HILLSTROM, Testing unconstrained optimization software, ACM Trans. Math. Software, 7 (1981), pp. 17-41.
13. J. NOCEDAL, Updating quasi-Newton matrices with limited storage, Math. Comp., 35 (1980), pp. 773-782.
14. E. R. PANIER AND A. L. TITS, Avoiding the Maratos effect by means of a nonmonotone line-search, SIAM J. Numer. Anal., 28 (1991), pp. 1183-1195.
15. M. RAYDAN, The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem, SIAM J. Optim., 7 (1997), pp. 26-33.
16. P. L. TOINT, An assessment of non-monotone line search techniques for unconstrained optimization, SIAM J. Sci. Comput., 17 (1996), pp. 725-739.
17. H. ZHANG, A Few Nonmonotone Methods in Nonlinear Optimization, Master's Thesis, ICMSEC, Chinese Academy of Sciences, Beijing, China, 2001 (in Chinese).
18. J. L. ZHOU AND A. L. TITS, Nonmonotone line search for minimax problem, J. Optim. Theory Appl., 76 (1993), pp. 455-476.