A simple three-term conjugate gradient algorithm for unconstrained optimization

Journal of Computational and Applied Mathematics

Volumn 241, Issue 1, 2013, Pages 19-29

  Andrei, Neculai ^a,b  

^a NATIONAL INSTITUTE FOR RESEARCH AND DEVELOPMENT IN INFORMATICS   (Romania)

^b ACADEMY OF ROMANIAN SCIENTISTS   (Romania)

Author keywords

Conjugacy condition; Descent condition; Numerical comparisons; Three term conjugate gradient; Unconstrained optimization

Indexed keywords

CONJUGACY; CONJUGATE GRADIENT; DESCENT CONDITION; NUMERICAL COMPARISON; UNCONSTRAINED OPTIMIZATION;

ALGORITHMS; NEWTON-RAPHSON METHOD; OPTIMIZATION;

CONJUGATE GRADIENT METHOD;

EID: 84867746781     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2012.10.002     Document Type: Article

References (39)

1. P. Wolfe Convergence conditions for ascent methods SIAM Review 11 1968 226 235
2. P. Wolfe Convergence conditions for ascent methods, (II): some corrections SIAM Review 13 1971 185 188
3. R. Fletcher, and C.M. Reeves Function minimization by conjugate gradients Computer Journal 7 1964 149 154
4. E. Polak, and G. Ribière Note sur la convergence de directions conjuguée Rev. Francaise Informat Recherche Operationelle, 3e Année 16 1969 35 43
5. B.T. Polyak The conjugate gradient method in extreme problems USSR Computational Mathematics and Mathematical Physics 9 1969 94 112
6. Y. Liu, and C. Storey Efficient generalized conjugate gradient algorithms, part 1: theory JOTA-Journal of Optimization Theory and Applications 69 1991 129 137
7. Y.H. Dai, and Y. Yuan A nonlinear conjugate gradient method with a strong global convergence property SIAM Journal on Optimization 10 1999 177 182
8. Y.H. Dai, and L.Z. Liao New conjugate conditions and related nonlinear conjugate gradient methods Applied Mathematics and Optimization 43 2001 87 101
9. R. Fletcher Practical methods of optimization Unconstrained Optimization, Vol. 1 1987 John Wiley & Sons New York
10. M.R. Hestenes, and E.L. Stiefel Methods of conjugate gradients for solving linear systems Journal of Research of the National Bureau of Standards 49 1952 409 436
11. E.M.L. Beale A derivative of conjugate gradients F.A. Lootsma, Numerical Methods for Nonlinear Optimization 1972 Academic Press London 39 43
12. M.F. McGuire, P. Wolfe, Evaluating a restart procedure for conjugate gradients, Report RC-4382, IBM Research Center, Yorktown Heights, 1973.
13. M.J.D. Powell Nonconvex minimization calculations and the conjugate gradient method Numerical Analysis (Dundee, 1983) Lecture Notes in Mathematics vol. 1066 1984 Springer Berlin 122 141
14. N.Y. Deng, and Z. Li Global convergence of three terms conjugate gradient methods Optimization Method and Software 4 1995 273 282
15. L. Nazareth A conjugate direction algorithm without line search Journal of Optimization Theory and Applications 23 1977 373 387
16. L. Zhang, W. Zhou, and D.H. Li A descent modified Polak-Ribière- Polyak conjugate gradient method and its global convergence IMA Journal of Numerical Analysis 26 2006 629 640
17. L. Zhang, W. Zhou, and D.H. Li Some descent three-term conjugate gradient methods and their global convergence Optimization Methods and Software 22 2007 697 711
18. L. Zhang, and Y. Zhou A note on the convergence properties of the original three-term Hestenes-Stiefel method AMO - Advanced Modeling and Optimization 14 2012 159 163
19. J. Zhang, Y. Xiao, and Z. Wei Nonlinear conjugate gradient methods with sufficient descent condition for large-scale unconstrained optimization Mathematical Problems in Engineering 2009 2009 10.1155/2009/243290 Article ID 243290
20. A.Y. Al-Bayati, and W.H. Sharif A new three-term conjugate gradient method for unconstrained optimization Canadian Journal on Science and Engineering Mathematics 1 5 2010 108 124
21. W. Cheng A two-term PRP-based descent method Numerical Functional Analysis and Optimization 28 2007 1217 1230
22. Y. Narushima, H. Yabe, and J.A. Ford A three-term conjugate gradient method with sufficient descent property for unconstrained optimization SIAM Journal on Optimization 21 1 2011 212 230
23. W.W. Hager, and H. Zhang A new conjugate gradient method with guaranteed descent and an efficient line search SIAM Journal on Optimization 16 2005 170 192
24. N. Andrei A modified Polak-Ribière-Polyak conjugate gradient algorithm for unconstrained optimization Optimization 60 2011 1457 1471
25. B.M. Averick, R.G. Carter, J.J. Moré, G.L. Xue, The MINPACK-2 test problem collection, Mathematics and Computer Science Division, Argonne National Laboratory, Preprint MCS-P153-0692, June 1992.
26. J. Nocedal Conjugate gradient methods and nonlinear optimization L. Adams, J.L. Nazareth, Linear and Nonlinear Conjugate Gradient Related Methods 1996 SIAM 9 23
27. N. Andrei Acceleration of conjugate gradient algorithms for unconstrained optimization Applied Mathematics and Computation 213 2009 361 369
28. N. Andrei An acceleration of gradient descent algorithm with backtracking for unconstrained optimization Numerical Algorithms 42 2006 63 73
29. N. Andrei Scaled conjugate gradient algorithms for unconstrained optimization Computational Optimization and Applications 38 2007 401 416
30. D.F. Shanno, and K.H. Phua Algorithm 500, minimization of unconstrained multivariate functions ACM Transactions on Mathematical Software 2 1976 87 94
31. N. Andrei Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization Optimization Methods and Software 22 2007 561 571
32. G. Zoutendijk Nonlinear programming, computational methods J. Abadie, Integer and Nonlinear Programming 1970 North-Holland Amsterdam 38 86
33. N. Andrei An unconstrained optimization test functions collection Advanced Modeling and Optimization 10 2008 147 161
34. R. Glowinski Numerical Methods for Nonlinear Variational Problems 1984 Springer-Verlag Berlin
35. G. Cimatti On a problem of the theory of lubrication governed by a variational inequality Applied Mathematics and Optimization 3 1977 227 242
36. J. Goodman, R. Kohn, and L. Reyna Numerical study of a relaxed variational problem from optimal design Computer Methods in Applied Mechanics and Engineering 57 1986 107 127
37. R. Aris, The Mathematical Theory of Diffusion and Reaction in Permeable Catalysts, Oxford, 1975.
38. J. Bebernes, and D. Eberly Mahematical Problems from Combustion Theory Applied Mathematical Sciences vol. 83 1989 Springer-Verlag
39. J.C.C. Nitsche Lectures On Minimal Surfaces, Vol. 1 1989 Cambridge University Press