R-linear convergence of the Barzilai and Borwein gradient method

IMA Journal of Numerical Analysis

Volumn 22, Issue 1, 2002, Pages 1-10

  Dai, Yu Hong ^a   Liao, Li Zhi ^b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

Gradient method; R linear convergence; Strictly convex; Unconstrained optimization

Indexed keywords

GRADIENT METHODS; OPTIMIZATION;

LINE SEARCHES; OBJECTIVE FUNCTIONS; R-LINEAR CONVERGENCES; STEP SIZE; STRICTLY CONVEXES; UNCONSTRAINED OPTIMIZATION; UNCONSTRAINED OPTIMIZATION PROBLEMS;

CONJUGATE GRADIENT METHOD;

EID: 0036102376     PISSN: 02724979     EISSN: None     Source Type: Journal    
DOI: 10.1093/imanum/22.1.1     Document Type: Article

References (14)

1. AKAIKE, H. 1959 On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method. Ann. Inst. Statist. Math. Tokyo, 11, 1-17.
2. BARZILAI, J. & BORWEIN, J. M. 1988 Two-point step size gradient methods. IMA J. Numer. Anal., 8, 141-148.
3. BIRGIN, E. G., CHAMBOULEYRON, I. & MARTÍNEZ, J. M. 1999 Estimation of the optical constants and the thickness of thin films using unconstrained optimization. J. Comput. Phys., 151, 862-880.
4. BIRGIN, E. G., MARTÍNEZ, J. M. & RAYDAN, M. 2000 Nonmonotone spectral projected gradient methods on convex sets. SIAM J. Optim., 10, 1196-1211.
5. CAUCHY, A. 1847 Méthode générale pour la résolution des syst̀ems d'équations simultanées. Comp. Rend. Sci. Paris, 25, 536-538.
6. DAI, Y. H. 2000 On nonmonotone line search. Research Report (accepted by J. Optim. Theor. Appl.).
7. FLETCHER, R. 1990 Low storage methods for unconstrained optimization. Lectures Appl. Math. (AMS), 26, 165-179.
8. FRIEDLANDER, A., MARTÍNEZ, J. M, MOLINA, B. & RAYDAN, M. 1999 Gradient method with retards and generalizations. SIAM J. Numer. Anal., 36, 275-289.
9. GLUNT, W., HAYDEN, T. L. & RAYDAN, M. 1993 Molecular conformations from distance matrices. J. Comput. Chem., 14, 114-120.
10. GRIPPO, L., LAMPARIELLO, F. & LUCIDI, S. 1986 A nonmonotone line search technique for Newton's method. SIAM J. Numer. Anal., 23, 707-716.
11. LIU, W. B. & DAI, Y. H. 1999 Minimization algorithms based on supervisor and searcher cooperation: I- faster and robust gradient algorithms for minimization problems with stronger noises. Research Report (to appear in J. Optim. Theor. Appl.).
12. MOLINA, B. & RAYDAN, M. 1996 Preconditioned Barzilai-Borwein method for the numerical solution of partial differential equations. Numer. Algorithms, 13, 45-60.
13. RAYDAN, M. 1993 On the Barzilai and Borwein choice of steplength for the gradient method. IMA J. Numer. Anal., 13, 321-326.
14. RAYDAN, M. 1997 The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAM J. Optim., 7, 26-33.