A new gradient method with an optimal stepsize property

Computational Optimization and Applications

Volumn 33, Issue 1, 2006, Pages 73-88

  Dai, Y H ^a   Yang, X Q ^b  

^a INSTITUTE OF COMPUTATIONAL MATHEMATICS AND SCIENTIFIC ENGINEERING COMPUTING   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

(Shifted) power method; Gradient method; Linear system; Steepest descent method

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; GRADIENT METHODS; OPTIMAL CONTROL SYSTEMS; VECTORS;

(SHIFTED) POWER METHOD; STEEPEST DESCENT METHOD; STEPSIZE FORMULA;

LINEAR SYSTEMS;

EID: 32544432828     PISSN: 09266003     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10589-005-5959-2     Document Type: Conference Paper

References (12)

1. H. Akaike, "On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method," Ann. Inst. Statist. Math. Tokyo Vol. II, pp. 1-17, 1959.
2. J. Barzilai and J.M. Borwein, "Two-point step size gradient methods," IMA J. Numer. Anal., vol. 8, pp. 141-148, 1988.
3. A. Cauchy, "Méthode générale pour la résolution des systèmes d'équations simultanées, " Comp. Rend. Acad. Sci. Paris, vol. 25, pp. 536-538, 1847.
4. Y.H. Dai and Y. Yuan, "Alternate minimization gradient method," IMA J. Numer. Anal., vol. 23, pp. 377-393, 2003.
5. H.C. Elman and G.H. Golub, "Inexact and preconditioned Uzawa algorithms for saddle point problems," SIAM J. Numer. Anal., vol. 31, pp. 1645-1661, 1994.
6. R. Fletcher, On the Barzilai-Borwein method, Research report NA207, Unversity of Dundee, 2001.
7. A. Friedlander, J.M. Martínez, B. Molina, and M. Raydan, "Gradient method with retards and generalizations," SIAM J. Numer. Anal., vol. 36, pp. 275-289, 1999.
8. G. Golub and R.S. Varga, "Chebyshev semi-iterative methods, successive overrelaxation iteration methods, and second order richardson iterative methods," Numerische Mathematik, vol. 3, pp. 147-156, 1961.
9. Q. Hu and J. Zou, "An iterative method with variable relaxation parameters for saddle-point problems," SIAM J. Matrix Anal. Appl., vol. 23, pp. 317-338, 2001.
10. J. Nocedal, A. Sartenaer, and C. Zhu, "On the behavior of the gradient norm in the steepest descent method," Computational Optimization and Applications, vol. 22, pp. 5-35, 2002.
11. M.N. Vrahatis, G.S. Androulakis, J.N. Lambrinos, and G.D. Magoulas, "A class of gradient unconstrained minimization algorithms with adaptive stepsize," Journal of Computational and Applied Mathematics, vol. 114, pp. 367-386, 2000.
12. J.H. Wilkinson, The Algebraic Eigenvalue Prolem, Oxford University Press, 1965.