Nonlinear conjugate gradient methods with sufficient descent properties for unconstrained optimization

Journal of Industrial and Management Optimization

Volumn 9, Issue 3, 2013, Pages 595-619

  Nakamura, Wataru ^a   Narushima, Yasushi ^b   Yabe, Hiroshi ^c  

^a CENTRAL JAPAN RAILWAY COMPANY   (Japan)

^b YOKOHAMA NATIONAL UNIVERSITY   (Japan)

^c TOKYO UNIVERSITY OF SCIENCE   (Japan)

Author keywords

Global convergence; Nonlinear conjugate gradient method; Scaled conjugate gradient method; Sufficient descent property; Unconstrained optimization

Indexed keywords

EID: 84890017726     PISSN: 15475816     EISSN: 1553166X     Source Type: Journal    
DOI: 10.3934/jimo.2013.9.595     Document Type: Article

References (31)

1. N. Andrei, A Dai-Yuan conjugate gradient algorithm with sufficient descent and conjugacy conditions for unconstrained optimization, Applied Mathematics Letters, 21 (2008), 165-171
2. N. Andrei, New accelerated conjugate gradient algorithms as a modification of Dai-Yuan's computational scheme for unconstrained optimization, Journal of Computational and Applied Mathematics, 234 (2010), 3397-3410
3. I. Bongartz, A. R. Conn, N. I. M. Gould and P. L. Toint, CUTE: Constrained and un-constrained testing environments, ACM Transactions on Mathematical Software, 21 (1995), 123-160
4. X. Chen and J. Sun, Global convergence of a two-parameter family of conjugate gradient methods without line search, Journal of Computational and Applied Mathematics, 146 (2002), 37-45
5. W. Cheng, A two-term PRP-based descent method, Numerical Functional Analysis and Op-timization, 28 (2007), 1217-1230
6. Y. H. Dai, Nonlinear conjugate gradient methods, in "Wiley Encyclopedia of Operations Research and Management Science" (eds. J. J. Cochran, L. A. Cox, Jr., P. Keskinocak, J. P. Kharoufeh and J. C. Smith), John Wiley & Sons, (2011)
7. Y. H. Dai and L. Z. Liao, New conjugacy conditions and related nonlinear conjugate gradient methods, Applied Mathematics and Optimization, 43 (2001), 87-101
8. Y. H. Dai and Y. Yuan, A nonlinear conjugate gradient method with a strong global conver-gence property, SIAM Journal on Optimization, 10 (1999), 177-182
9. Y. H. Dai and Y. Yuan, A three-parameter family of nonlinear conjugate gradient methods, Mathematics of Computation, 70 (2001), 1155-1167
10. Z. Dai and B. S. Tian, Global convergence of some modified PRP nonlinear conjugate gradient methods, Optimization Letters, 5 (2011), 615-630
11. Z. Dai and F. Wen, A modified CG-DESCENT method for unconstrained optimization, Jour-nal of Computational and Applied Mathematics, 235 (2011), 3332-3341
12. E. D. Dolan and J. J. Moré, Benchmarking optimization software with performance profiles, Mathematical Programming, 91 (2002), 201-213
13. R. Fletcher, "Practical Methods of Optimization," 2nd edition, John Wiley & Sons, 1987
14. R. Fletcher and C. M. Reeves, Function minimization by conjugate gradients, The Computer Journal, 7 (1964), 149-154
15. N. I. M. Gould, D. Orban and P. L. Toint, CUTEr and SifDec: A constrained and uncon-strained testing environment, revisited, ACM Transactions on Mathematical Software, 29 (2003), 373-394
16. W. W. Hager and H. Zhang, A new conjugate gradient method with guaranteed descent and an efficient line search, SIAM Journal on Optimization, 16 (2005), 170-192
17. W. W. Hager and H. Zhang, A survey of nonlinear conjugate gradient methods, Pacific Journal of Optimization, 2 (2006), 35-58
18. W. W. Hager and H. Zhang, "CG DESCENT Version 1.4, User's Guide," University of Florida, November 14, 2005, http://www.math.ufl.edu/~hager/papers/CG/
19. M. R. Hestenes and E. Stiefel, Methods of conjugate gradients for solving linear systems, Journal of Research of the National Bureau of Standards, 49 (1952), 409-436
20. M. Li and H. Feng, A sufficient descent LS conjugate gradient method for unconstrained optimization problems, Applied Mathematics and Computation, 218 (2011), 1577-1586
21. Y. Liu and C. Storey, Efficient generalized conjugate gradient algorithms, part 1: Theory, Journal of Optimization Theory and Applications, 69 (1991), 129-137
22. Y. Narushima and H. Yabe, Conjugate gradient methods based on secant conditions that generate descent search directions for unconstrained optimization, Journal of Computational and Applied Mathematics, 236 (2012), 4303-4317
23. Y. Narushima, H. Yabe and J. A. Ford, A three-term conjugate gradient method with sufficient descent property for unconstrained optimization, SIAM Journal on Optimization, 21 (2011), 212-230
24. J. Nocedal and S. J. Wright, "Numerical Optimization," 2nd edition, Springer Series in Op-erations Research and Financial Engineering, Springer, 2006
25. K. Sugiki, Y. Narushima and H. Yabe, Globally convergent three-term conjugate gradient methods that use secant conditions and generate descent search directions for unconstrained optimization, Journal of Optimization Theory and Applications, 153 (2012), 733-757
26. W. Sun and Y. Yuan, "Optimization Theory and Methods: Nonlinear Programming," Springer, 2006
27. G. Yu, L. Guan and W. Chen, Spectral conjugate gradient methods with sufficient descent property for large-scale unconstrained optimization, Optimization Methods and Software, 23 (2008), 275-293
28. G. Yu, L. Guan and G. Li, Global convergence of modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property, Journal of Industrial and Management Optimization, 4 (2008), 565-579
29. G. Yuan, Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems, Optimization Letters, 3 (2009), 11-21
30. L. Zhang and J. Li, A new globalization technique for nonlinear conjugate gradient methods for nonconvex minimization, Applied Mathematics and Computation, 217 (2011), 10295-10304
31. L. Zhang, W. Zhou and D. H. Li, Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search, Numerische Mathematik, 104 (2006), 561-572