A three-term conjugate gradient algorithm for large-scale unconstrained optimization problems

Applied Numerical Mathematics

Volumn 92, Issue , 2015, Pages 70-81

  Deng, Songhai ^a   Wan, Zhong ^a  

^a CENTRAL SOUTH UNIVERSITY   (China)

Author keywords

Algorithm; Global convergence; Inexact line search; Large scale problems; Three term conjugate gradient method

Indexed keywords

BENCHMARKING; CONJUGATE GRADIENT METHOD; GRADIENT METHODS; ITERATIVE METHODS; OPTIMIZATION;

BENCH-MARK-TEST PROBLEMS; CONJUGATE GRADIENT ALGORITHMS; GLOBAL CONVER-GENCE; INEXACT LINE SEARCHES; LARGE SCALE UNCONSTRAINED OPTIMIZATIONS; LARGE-SCALE PROBLEM; STATE-OF-THE-ART ALGORITHMS; THREE-TERM;

ALGORITHMS;

EID: 84923261681     PISSN: 01689274     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apnum.2015.01.008     Document Type: Article

References (36)

1. A.Y. Al-Bayati, and Hawraz N. Al-khayat A global convergent spectral conjugate gradient method Aust. J. Basic Appl. Sci. 7 2013 303 309
2. A.Y. Al-Bayati, and W.H. Sharif A new three-term conjugate gradient method for unconstrained optimization Can. J. Sci. Eng. Math. 1 2010 108 124
3. N. Andrei An unconstrained optimization test functions collection Adv. Model. Optim. 10 2008 147 161
4. N. Andrei Acceleration of conjugate gradient algorithm for unconstrained optimization Appl. Math. Comput. 213 2009 361 369
5. N. Andrei A modified Polak-Ribière-Polyak conjugate gradient algorithm for unconstrained optimization Optimization 60 2011 1457 1471
6. N. Andrei A simple three-term conjugate gradient algorithm for unconstrained optimization J. Comput. Appl. Math. 241 2013 19 29
7. N. Andrei On three-term conjugate gradient algorithms for unconstrained optimization Appl. Math. Comput. 219 2013 6316 6327
8. N. Andrei Another conjugate gradient algorithm with guaranteed descent and conjugacy conditions J. Optim. Theory Appl. 159 1 2013 159 182 10.1007/s10957-013-0285-9
9. E.M.L. Beale A derivation of conjugate gradients F.A. Lootsma, Numerical Methods for Nonlinear Optimization 1972 Academic Press London 39 43
10. I. Bongartz, and A.R. Conn CUTE: constrained and unconstrained testing environment ACM Trans. Math. Softw. 21 1 March 1995 124 160
11. W. Cheng A two-term PRP-based descent method Numer. Funct. Anal. Optim. 28 2007 1217 1230
12. H.P. Crowder, and P. Wolfe Linear convergence of the conjugate gradient method IBM J. Res. Dev. 16 1969 431 433
13. Y.H. Dai, and Y. Yuan Convergence properties of the Beale-Powell restart algorithm Sci. China Ser. A 41 1998 1142 1150
14. Y.H. Dai, and Y. Yuan A nonlinear conjugate gradient method with a strong global convergence property SIAM J. Optim. 10 1999 177 182
15. Y.H. Dai, and Y. Yuan A three-parameter family of nonlinear conjugate gradient methods Math. Comput. 70 2000 1155 1167
16. S.H. Deng, Z. Wan, and X.H. Chen An improved spectral conjugate gradient algorithm for nonconvex unconstrained optimization problems J. Optim. Theory Appl. 157 2013 820 842
17. E.D. Dolan, and J.J. Moré Benchmarking optimization software with performance profiles Math. Program. 91 2002 201 213
18. R. Fletcher, and C.M. Reeves Function minimization by conjugate gradients Comput. J. 7 1964 149 154
19. W.W. Hager, and H. Zhang A new conjugate gradient method with guaranteed descent and an efficient line search SIAM J. Control Optim. 16 2005 170 192
20. W.W. Hager, and H. Zhang Algorithm 851: CG-DESCENT, a conjugate gradient method with guaranteed descent ACM Trans. Math. Softw. 32 2006 113 137
21. M.R. Hestenes, and E.L. Stiefel Methods of conjugate gradients for solving linear systems J. Res. Natl. Bur. Stand. 49 6 1952 409 436
22. H.D. Huang, Y.J. Li, and Z.X. Wei Global convergence of a modified PRP conjugate gradient method J. Math. Res. Expo. 30 2010 141 148
23. S. Huang, Z. Wan, and S.H. Deng A modified projected conjugate gradient method for unconstrained optimization problems ANZIAM J. 54 03 2013 143 152
24. C. Li, L. Fang, and X.L. Cao Global convergence of a kind of conjugate gradient method TELKOMNIKA 11 2013 544 549
25. L. Nazareth A conjugate direction algorithm without line search J. Optim. Theory Appl. 23 1997 373 387
26. M.J.D. Powell Restart procedures of the conjugate gradient method Math. Program. 2 1977 241 254
27. Z. Wan, Y. Chen, S. Huang, and D. Feng A modified nonmonotone BFGS algorithm for solving smooth nonlinear equations Optim. Lett. 8 6 2014 1845 1860
28. Z. Wan, C.M. Hu, and Z.L. Yang A spectral PRP conjugate gradient methods for nonconvex optimization problem based on modified line search Discrete Contin. Dyn. Syst.; Ser. B 16 4 2011 1153 1169
29. Z. Wan, S. Huang, and X.D. Zheng New cautious BFGS algorithm based on modified Armijo-type line search J. Inequal. Appl. 2012 2012 241 10.1186/1029-242X-2012-241
30. Z. Wan, K.L. Teo, X.L. Shen, and C.M. Hu New BFGS method for unconstrained optimization problem based on modified Armijo line search Optimization 63 2 2014 285 304
31. Z. Wan, Z.L. Yang, and Y.L. Wang New spectral PRP conjugate gradient method for unconstrained optimization Appl. Math. Lett. 24 1 2011 16 22
32. P. Wolfe Convergence conditions for ascent methods SIAM Rev. 11 1968 226 235
33. P. Wolfe Convergence conditions for ascent methods (II): some corrections SIAM Rev. 13 1971 185 188
34. J. Zhang, Y. Xiao, and Z. Wei Nonlinear conjugate gradient methods with sufficient descent condition for large-scale unconstrained optimization Math. Probl. Eng. 2009 2009 10.1155/2009/234290 Article ID 243290
35. L. Zhang, W. Zhou, and D.H. Li A descent modified Polak-Ribière-Polyak conjugate gradient method and its global convergence IMA J. Numer. Anal. 26 2006 629 640
36. L. Zhang, W. Zhou, and D.H. Li Some descent three-term conjugate gradient methods and their global convergence Optim. Methods Softw. 22 2007 697 711