Alternate step gradient method

Optimization

Volumn 52, Issue 4-5, 2003, Pages 395-415

  Dai, Yu Hong ^a  

^a CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

Convergence rate; Gradient method; Linear system; Nonmonotone line search; Unconstrained optimization

Indexed keywords

EID: 0344550334     PISSN: 02331934     EISSN: None     Source Type: Journal    
DOI: 10.1080/02331930310001611547     Document Type: Article

References (22)

1. H. Akaike (1959). On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method. Ann. Inst. Statist. Math. Tokyo, 11, 1-17.
2. E.G. Birgin, I. Chambouleyron and J.M. Martínez, (1999). Estimation of the optical constants and the thickness of thin films using unconstrained optimization. J. Comput. Phys., 151, 862-880.
3. E.G. Birgin, J.M. Martínez and M. Raydan (2000). Nonmonotone spectral projected gradient methods on convex sets. SIAM J. Optim., 10, 1196-1211.
4. J. Barzilai and J.M. Borwein (1988). Two-point step size gradient methods. IMA J. Numer. Anal., 8, 141-148.
5. A. Cauchy (1847). Méthode générale pour la résolution des systéms d'équations simultanées. Comp. Rend. Sci. Paris, 25, 536-538.
6. Y.H. Dai (2002). On the nonmonotone line search. Journal of Optimization Theory and Applications, 112(2), 315-330.
7. Y.H. Dai and L.-Z. Liao (2002). R-linear convergence of the Barzilai and Borwein gradient method. IMA J. Numer. Anal., 22, 1-10.
8. Y.H. Dai and J.Y. Yuan (2001). On a class of gradient algorithms for unconstrained optimization (Preprint).
9. R. Fletcher (1999). Low storage methods for unconstrained optimization. Lectures in Applied Mathematics (AMS), 26, 165-179.
10. R. Fletcher (2001). The Barzilai Borwein Method - Steepest Descent Resurgent? Report in the International Workshop on "Optimization and Control with Applications", July 9-17. Erice, Italy.
11. R. Fletcher and C. Reeves, (1964). Function minimization by conjugate gradients. Comput. J., 7, 149-154.
12. A. Friedlander, J.M. Martínez, B. Molina and M. Raydan (1999). Gradient method with retards and generalizations. SIAM J. Numer. Anal., 36, 275-289.
13. W. Glunt, T.L. Hayden and M. Raydan (1993). Molecular conformations from distance matrices. J. Comput. Chem., 14, 114-120.
14. L. Grippo, F. Lampariello and S. Lucidi (1986). A nonmonotone line search technique for Newton's method. SIAM J. Numer. Anal., 23, 707-716.
15. M.R. Hestenes and E.L. Stiefel (1952). Methods of conjugate gradients for solving linear systems. J. Res. Nat. Bur. Standards Sect., 5(49), 409-436.
16. Y.L. Lai, (1981). Some properties of the steepest descent method. Acta Mathematicae Applicatae Sinica, 4(2), 106-116.
17. W.B. Liu and Y.H. Dai (2001). Minimization algorithms based on supervisor and searcher cooperation. Journal of Optimization Theory and Applications, 111(2), 359-379.
18. J.J. Moré, B.S. Garbow and K.E. Hillstrom (1981). Testing unconstrained optimization software. ACM Transactions on Mathematical Software, 7, 17-41.
19. J. Nocedal, A. Sartentaer C. Zhu (2002). On the behavior of the gradient norm in the steepest descent method. Computational Optimization and Applications, 22(1), 5-35.
20. M. Raydan (1993). On the Barzilai and Borwein choice of steplength for the gradient method. IMA J. Numer. Anal., 13, 321-326.
21. M. Raydan (1997). The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAM J. Optim., 7, 26-33.
22. M. Raydan (2001). Nonmonotone spectral methods for large-scale nonlinear systems. Report in the International Workshop on "Optimization and Control with Applications". July 9-17. Erice, Italy.