Alternate minimization gradient method

IMA Journal of Numerical Analysis

Volumn 23, Issue 3, 2003, Pages 377-393

  Dai, Yu Hong ^a   Yuan, Ya Xiang ^a  

^a CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

Convergence rate; Gradient method; Line search; Linear system; Monotonic and nonmonotonic; Unconstrained optimization

Indexed keywords

GRADIENT METHODS; LINEAR SYSTEMS; OPTIMIZATION;

CONVERGENCE RATES; LINE SEARCHES; NONMONOTONIC; NUMERICAL EXPERIMENTS; POSITIVE DEFINITE; SMOOTH FUNCTIONS; STRICTLY CONVEXES; UNCONSTRAINED OPTIMIZATION;

STEEPEST DESCENT METHOD;

EID: 0038504589     PISSN: 02724979     EISSN: None     Source Type: Journal    
DOI: 10.1093/imanum/23.3.377     Document Type: Article

References (16)

1. AKAIKE, H. (1959) On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method. Ann. Inst. Statist. Math. Tokyo, 11, 1-17.
2. BARZILAI, J. & BORWEIN, J. M. (1988) Two-point step size gradient methods. IMA J. Numer. Anal, 8, 141-148.
3. CAUCHY, A. (1847) Méthode générale pour la résolution des systèmes d'equations simultanées. Comp. Rend. Acad. Sci. Paris, 25, 536-538.
4. DAI, Y. H. (2001) Alternate stepsize gradient method. Research report AMSS-2001-041. Beijing: Academy of Mathematics and System Sciences, Chinese Academy of Sciences.
5. DAI, Y. H. & LIAO, L.-Z. (2002) R-linear convergence of the Barzilai and Borwein gradient method. IMA J. Numer. Anal, 22, 1-10.
6. FLETCHER, R. (1990) Low storage methods for unconstrained optimization Lectures in Applied Mathematics, 26. Providence, RI: American Mathematical Society, pp. 165-179.
7. FLETCHER, R. & REEVES, C. (1964) Function minimization by conjugate gradients. Comput. J., 7, 149-154.
8. FORSYTHE, G. E. (1968) On the asymptotic directions of the s-dimensional optimum gradient method. Numerische Mathematik, 11, 57-76.
9. FRIEDLANDER, A., MARTÍNEZ, J. M. & RAYDAN, (1995) A new method for large-scale box constrained convex quadratic minimization problems. Optimization Methods and Software, 5, 57-74.
10. FRIEDLANDER, A., MARTÍNEZ, J. M., MOLINA, B. & RAYDAN, M. (1999) Gradient method with retards and generalizations. SIAM J. Numer. Anal, 36, 275-289.
11. HICKERNELL, F. J. & YUAN, Y. (1997) A simple multistart algorithm for global optimization. OR Trans., 1, 1-11.
12. HESTENES, M. R. & STIEFEL, E. L. (1952) Methods of conjugate gradients for solving linear systems. J. Res. Natl Bur. Standards Sect., 5, 409-436.
13. HU, Q. & Zou, J. (2001) An iterative method with variable relaxation parameters for saddle-point problems. SIAM J. Matrix Anal. Appl., 23, 317-338.
14. MORÉ, J. J., GARBOW, B. S. & HILLSTROM, K. E. (1981) Testing unconstrained optimization software. ACM Transactions on Mathematical Software, 7, 17-41.
15. RAYDAN, M. (1993) On the Barzilai and Borwein choice of steplength for the gradient method. IMA J. Numer. Anal., 13, 321-326.
16. RAYDAN, M. (1997) The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAM J. Optim., 7, 26-33.