On three-term conjugate gradient algorithms for unconstrained optimization

Applied Mathematics and Computation

Volumn 219, Issue 11, 2013, Pages 6316-6327

  Andrei, Neculai ^a,b  

^a NATIONAL INSTITUTE FOR RESEARCH AND DEVELOPMENT IN INFORMATICS   (Romania)

^b ACADEMY OF ROMANIAN SCIENTISTS   (Romania)

Author keywords

Conjugacy condition; Descent condition; Numerical comparisons; Three term conjugate gradient; Unconstrained optimization

Indexed keywords

CONJUGACY; CONJUGATE GRADIENT; DESCENT CONDITION; NUMERICAL COMPARISON; UNCONSTRAINED OPTIMIZATION;

ALGORITHMS; NEWTON-RAPHSON METHOD; OPTIMIZATION;

CONJUGATE GRADIENT METHOD;

EID: 84872919695     PISSN: 00963003     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.amc.2012.11.097     Document Type: Article

References (40)

1. A.Y. Al-Bayati, and W.H. Sharif A new three-term conjugate gradient method for unconstrained optimization Can. J. Sci. Eng. Math. 1 5 2010 108 124
2. N. Andrei An acceleration of gradient descent algorithm with backtracking for unconstrained optimization Numer. Algorithms 42 2006 63 73 (Pubitemid 44014348)
3. N. Andrei Scaled conjugate gradient algorithms for unconstrained optimization Comput. Optim. Appl. 38 2007 401 416 (Pubitemid 350115179)
4. N. Andrei Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization Optim. Methods Software 22 2007 561 571 (Pubitemid 46580882)
5. N. Andrei An unconstrained optimization test functions collection Adv. Model. Opt. 10 2008 147 161
6. N. Andrei Acceleration of conjugate gradient algorithms for unconstrained optimization Appl. Math. Comput. 213 2009 361 369
7. N. Andrei A modified Polak-Ribière-Polyak conjugate gradient algorithm for unconstrained optimization Optimization 60 2011 1457 1471
8. R. Aris, The Mathematical Theory of Diffusion and Reaction in Permeable Catalysts, Oxford, 1975.
9. B.M. Averick, R.G. Carter, J.J. Moré, G.L. Xue, The MINPACK-2 test problem collection. Mathematics and Computer Science Division, Argonne National Laboratory, Preprint MCS-P153-0692, June 1992.
10. E.M.L. Beale A derivative of conjugate gradients F.A. Lootsma, Numerical Methods for Nonlinear Optimization 1972 Academic Press London 39 43
11. J. Bebernes, D. Eberly, Mahematical problems from combustion theory. in: Applied Mathematical Sciences 83, Springer-Verlag, 1989.
12. W. Cheng A two-term PRP-based descent method Numer. Funct. Anal. Optim. 28 2007 1217 1230
13. G. Cimatti On a problem of the theory of lubrication governed by a variational inequality Appl. Math. Optim. 3 1977 227 242 (Pubitemid 8548045)
14. Y.H. Dai, and L.Z. Liao New conjugate conditions and related nonlinear conjugate gradient methods Appl. Math. Optim. 43 2001 87 101
15. Y.H. Dai, and Y. Yuan A nonlinear conjugate gradient method with a strong global convergence property SIAM J. Optim. 10 1999 177 182
16. N.Y. Deng, and Z. Li Global convergence of three terms conjugate gradient methods Optim. Methods Software 4 1995 273 282
17. R. Fletcher, Practical Methods of Optimization, Volume 1: Unconstrained Optimization, John Wiley & Sons, New York, 1987.
18. R. Fletcher, and C.M. Reeves Function minimization by conjugate gradients Comput. J. 7 1964 149 154
19. R. Glowinski Numerical Methods for Nonlinear Variational Problems 1984 Springer-Verlag Berlin
20. J. Goodman, R. Kohn, and L. Reyna Numerical study of a relaxed variational problem from optimal design Comput. Methods Appl. Mech. Eng. 57 1986 107 127 (Pubitemid 16612536)
21. W.W. Hager, and H. Zhang A new conjugate gradient method with guaranteed descent and an efficient line search SIAM J. Optim. 16 2005 170 192
22. M.R. Hestenes, and E.L. Stiefel Methods of conjugate gradients for solving linear systems J. Res. Nat. Bur. Stand. 49 1952 409 436
23. Y. Liu, and C. Storey Efficient generalized conjugate gradient algorithms, Part 1: Theory JOTA 69 1991 129 137
24. M.F. McGuire, P. Wolfe, Evaluating a restart procedure for conjugate gradients. Report RC-4382, IBM Research Center, Yorktown Heights, 1973.
25. Y. Narushima, H. Yabe, and J.A. Ford A three-term conjugate gradient method with sufficient descent property for unconstrained optimization SIAM J. Optim. 21 1 2011 212 230
26. L. Nazareth A conjugate direction algorithm without line search J. Optim. Theor. Appl. 23 1977 373 387
27. J.C.C. Nitsche Lectures on Minimal Surfaces 1 1989 Cambridge University Press
28. J. Nocedal Conjugate gradient methods and nonlinear optimization L. Adams, J.L. Nazareth, Linear and nonlinear Conjugate Gradient related methods 1996 SIAM 9 23
29. E. Polak, G. Ribière, Note sur la convergence de directions conjuguée, Rev. Francaise Informat Recherche Operationelle, 3e Année 16 (1969) 35-43.
30. B.T. Polyak The conjugate gradient method in extreme problems USSR Comput. Math. Math. Phys. 9 1969 94 112
31. M.J.D. Powell, Nonconvex minimization calculations and the conjugate gradient method. in: Numerical Analysis (Dundee, 1983), Lecture Notes in Mathematics, vol. 1066, Springer, Berlin, 1984, pp.122-141.
32. D.F. Shanno On the convergence of a new conjugate gradient algorithm SIAM J. Numer. Anal. 15 1978 1247 1257
33. D.F. Shanno, and K.H. Phua Algorithm 500, minimization of unconstrained multivariate functions ACM Trans. Math. Software 2 1976 87 94
34. P. Wolfe Convergence conditions for ascent methods SIAM Rev. 11 1968 226 235
35. P. Wolfe Convergence conditions for ascent methods, (II): some corrections SIAM Rev. 13 1971 185 188
36. L. Zhang, W. Zhou, and D.H. Li A descent modified Polak-Ribière- Polyak conjugate gradient method and its global convergence IMA J. Numer. Anal. 26 2006 629 640 (Pubitemid 44546419)
37. L. Zhang, W. Zhou, and D.H. Li Some descent three-term conjugate gradient methods and their global convergence Optim. Methods Software 22 2007 697 711 (Pubitemid 46580890)
38. J. Zhang, Y. Xiao, Z. Wei, Nonlinear conjugate gradient methods with sufficient descent condition for large-scale unconstrained optimization. Mathematical Problems in Engineering, vol. 2009 (2009), Article ID 243290. http://dx.doi.org/10.1155/2009/243290.
39. L. Zhang, and Y. Zhou A note on the convergence properties of the original three-term Hestenes-Stiefel method AMO-Adv. Model. Optim. 14 2012 159 163
40. G. Zoutendijk Nonlinear programming, computational methods J. Abadie, Integer and Nonlinear Programming 1970 North-Holland Amsterdam 38 86