Extended Barzilai-Borwein method for unconstrained minimization problems

Pacific Journal of Optimization

Volumn 6, Issue 3, 2010, Pages 591-613

  Narushima, Yasushi ^a   Wakamatsu, Takahiko ^b   Yabe, Hiroshi ^a  

^a TOKYO UNIVERSITY OF SCIENCE   (Japan)

^b Hitach Ltd

Author keywords

Barzilai Borwein method; Global convergence; Large scale unconstrained minimization problem; Q superlinear convergence

Indexed keywords

EID: 78049432839     PISSN: 13489151     EISSN: 13498169     Source Type: Journal    
DOI: None     Document Type: Article

References (21)

1. J. Barzilai and J.M. Borwein, Two-point step size gradient methods, IMA Journal of Numerical Analysis 8 (1988) 141-148.
2. Y.H. Dai, title typecontributorA nonmonotone conjugate gradient algorithm for unconstrained optimization/title, Journal of System Science and Complexity 15 (2002) 139-145.
3. Y.H. Dai, On the nonmonotone line search, Journal of Optimization Theory and Applications 112 (2002) 315-330.
4. Y.H. Dai, W.W. Hager, K. Schittkowski and H. Zhang, The cyclic Barzilai-Borwein method for unconstrained optimization, IMA Journal of Numerical Analysis 26 (2006) 604-627.
5. Y.H. Dai and L.Z. Liao, R-linear convergence of the Barzilai and Borwein gradient method, IMA Journal of Numerical Analysis 22 (2002) 1-10.
6. Y.H. Dai and Y. Yuan, Analysis of monotone gradient methods, Journal of Industrial and Management Optimization 1 (2005) 181-192.
7. J.E. Dennis and J.J. Moré, A characterization of superlinear convergence and its application to quasi-Newton methods, Mathematics of Computation 28 (1974) 549-560.
8. R. Fletcher, On the Barzilai-Borwein method, Numerical Analysis Report NA/207, Department of Mathematics, University of Dundee, 2001 (See also Optimization and Control with Applications, Springer series in Applied Optimization 96, Springer-Verlag, 2005, pp. 235-256.
9. A. Friedlander, J.M. Martinez, B. Molina and M. Raydan, Gradient method with retards and generalizations, SIAM Journal on Numerical Analysis 36 (1999) 275-289.
10. L. Grippo, F. Lampariello and S. Lucidi, A nonmonotone line search technique for Newton's method, SIAM Journal on Numerical Analysis 23 (1986) 707-716.
11. L. Grippo, F. Lampariello and S. Lucidi, A truncated Newton method with nonmonotone line search for unconstrained optimization, Journal of Optimization Theory and Applications 60 (1989) 401-419.
12. L. Grippo and M. Sciandrone, Nonmonotone globalization techniques for the Barzilai Borwein gradient method, Computational Optimization and Applications, 23 (2002) 143-169.
13. Matrix Market, http://math.nist.gov/MatrixMarket/
14. J.J. Moré, B.S. Garbow and K.E. Hillstrom, Testing unconstrained optimization software, ACM Transactions on Mathematical Software 7 (1981) 17-41.
15. J. Nocedal and S.J. Wright, Numerical Optimization, second edition, Springer Series in Operations Research, Springer Verlag, New York, 2006.
16. M. Raydan, On the Barzilai and Borwein choice of steplength for the gradient method, IMA Journal of Numerical Analysis 13 (1993) 321-326.
17. M. Raydan, The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem, SIAM Journal on Optimization 7 (1997) 26-33.
18. M. Raydan and B. Svaiter, Relaxed steepest descent and Cauchy-Barzilai-Borwein method, Computational Optimization and Applications 21 (2002) 155-167.
19. Y.X. Yuan, A new stepsize for the steepest descent method, Journal of Computational Mathematics 24 (2006) 149-156.
20. Y.X. Yuan, Gradient methods for large scale convex quadratic functions, Technical Report (see also Y.F. Wang, A. Yagola and C. Yang eds., Optimization and Regularization for Computational Inverse Problems and Applications, (Higher Education Press, 2009)).
21. B. Zhou, L. Gao and Y.H. Dai, Gradient methods with adaptive step-size, Computational Optimization and Applications 35 (2006) 69-86.