Conjugate gradient methods based on secant conditions that generate descent search directions for unconstrained optimization

Journal of Computational and Applied Mathematics

Volumn 236, Issue 17, 2012, Pages 4303-4317

  Narushima, Yasushi ^a   Yabe, Hiroshi ^b  

^a YOKOHAMA NATIONAL UNIVERSITY   (Japan)

^b TOKYO UNIVERSITY OF SCIENCE   (Japan)

Author keywords

Conjugate gradient method; Descent search direction; Global convergence; Secant condition; Unconstrained optimization

Indexed keywords

GLOBAL CONVERGENCE; NUMERICAL RESULTS; OBJECTIVE FUNCTIONS; SEARCH DIRECTION; SECANT CONDITION; SECOND ORDERS; UNCONSTRAINED OPTIMIZATION; UNCONSTRAINED OPTIMIZATION PROBLEMS;

OPTIMIZATION;

CONJUGATE GRADIENT METHOD;

EID: 84862841641     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2012.01.036     Document Type: Article

References (29)

1. M.R. Hestenes, and E. Stiefel Methods of conjugate gradients for solving linear systems Journal of Research of the National Bureau of Standards 49 1952 409 436
2. R. Fletcher, and C.M. Reeves Function minimization by conjugate gradients The Computer Journal 7 1964 149 154
3. J. Nocedal, and S.J. Wright Numerical Optimization second ed. Springer Series in Operations Research 2006 Springer-Verlag New York
4. J.C. Gilbert, and J. Nocedal Global convergence properties of conjugate gradient methods for optimization SIAM Journal on Optimization 2 1992 21 42
5. Y.H. Dai, and Y. Yuan A nonlinear conjugate gradient method with a strong global convergence property SIAM Journal on Optimization 10 1999 177 182
6. W.W. Hager, and H. Zhang A survey of nonlinear conjugate gradient methods Pacific Journal of Optimization 2 2006 35 58
7. Y.H. Dai, and L.Z. Liao New conjugacy conditions and related nonlinear conjugate gradient methods Applied Mathematics and Optimization 43 2001 87 101
8. H. Yabe, and M. Takano Global convergence properties of nonlinear conjugate gradient methods with modified secant condition Computational Optimization and Applications 28 2004 203 225
9. J.A. Ford, Y. Narushima, and H. Yabe Multi-step nonlinear conjugate gradient methods for unconstrained minimization Computational Optimization and Applications 40 2008 191 216
10. W. Zhou, and L. Zhang A nonlinear conjugate gradient method based on the MBFGS secant condition Optimization Methods and Software 21 2006 707 714
11. M. Kobayashi, Y. Narushima, and H. Yabe Nonlinear conjugate gradient methods with structured secant condition for nonlinear least squares problems Journal of Computational and Applied Mathematics 234 2010 375 397
12. K. Sugiki, Y. Narushima, H. Yabe, Globally convergent three-term conjugate gradient methods that use secant conditions and generate descent search directions for unconstrained optimization, Journal of Optimization Theory and Applications, in press (http://dx.doi.org/10.1007/s10957-011-9960-x).
13. Y. Narushima, H. Yabe, and J.A. Ford A three-term conjugate gradient method with sufficient descent property for unconstrained optimization SIAM Journal on Optimization 21 2011 212 230
14. W.W. Hager, and H. Zhang A new conjugate gradient method with guaranteed descent and an efficient line search SIAM Journal on Optimization 16 2005 170 192
15. G. Yu, L. Guan, and G. Li Global convergence of modified Polak-Ribiére-Polyak conjugate gradient methods with sufficient descent property Journal of Industrial and Management Optimization 4 2008 565 579
16. G. Yuan Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems Optimization Letters 3 2009 11 21
17. A. Perry A modified conjugate gradient algorithm Operations Research 26 1978 1073 1078
18. J.Z. Zhang, N.Y. Deng, and L.H. Chen New quasi-Newton equation and related methods for unconstrained optimization Journal of Optimization Theory and Applications 102 1999 147 167
19. J.Z. Zhang, and C.X. Xu Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations Journal of Computational and Applied Mathematics 137 2001 269 278
20. D.H. Li, and M. Fukushima A modified BFGS method and its global convergence in nonconvex minimization Journal of Computational and Applied Mathematics 129 2001 15 35
21. J.A. Ford, and I.A. Moghrabi Alternative parameter choices for multi-step quasi-Newton methods Optimization Methods and Software 2 1993 357 370
22. J.A. Ford, and I.A. Moghrabi Multi-step quasi-Newton methods for optimization Journal of Computational and Applied Mathematics 50 1994 305 323
23. L. Zhang New versions of the Hestenes-Stiefel nonlinear conjugate gradient method based on the secant condition for optimization Computational & Applied Mathematics 28 2009 111 133
24. G. Zoutendijk Nonlinear programming, computational methods J. Abadie, Integer and Nonlinear Programming 1970 North-Holland Amsterdam 37 86
25. I. Bongartz, A.R. Conn, N.I.M. Gould, and P.L. Toint CUTE: constrained and unconstrained testing environment ACM Transactions on Mathematical Software 21 1995 123 160
26. N.I.M. Gould, D. Orban, P.L. Toint, CUTEr web site. http://www.cuter.rl. ac.uk/.
27. W.W. Hager, and H. Zhang Algorithm 851: CGDESCENT, a conjugate gradient method with guaranteed descent ACM Transactions on Mathematical Software 32 2006 113 137
28. W.W. Hager, H. Zhang, CGDESCENT version 1.4 User's Guide, University of Florida, November 2005. http://www.math.ufl.edu/~hager/.
29. E.D. Dolan, and J.J. Moré Benchmarking optimization software with performance profiles Mathematical Programming 91 2002 201 213