Another Conjugate Gradient Algorithm with Guaranteed Descent and Conjugacy Conditions for Large-scale Unconstrained Optimization

Journal of Optimization Theory and Applications

Volumn 159, Issue 1, 2013, Pages 159-182

  Andrei, Neculai ^a,b  

^a NATIONAL INSTITUTE FOR RESEARCH AND DEVELOPMENT IN INFORMATICS   (Romania)

^b ACADEMY OF ROMANIAN SCIENTISTS   (Romania)

Author keywords

Conjugacy condition; Conjugate gradient; Descent condition; Unconstrained optimization; Wolfe line search

Indexed keywords

FUNCTIONS; OPTIMIZATION;

CONDITION; CONJUGACY CONDITIONS; CONJUGATE GRADIENT; CONJUGATE GRADIENT ALGORITHMS; DESCENT CONDITION; LARGE SCALE UNCONSTRAINED OPTIMIZATIONS; LINEAR COMBINATIONS; SEARCH DIRECTION; UNCONSTRAINED OPTIMIZATION; WOLFE LINE SEARCHES;

CONJUGATE GRADIENT METHOD;

EID: 84884514636     PISSN: 00223239     EISSN: 15732878     Source Type: Journal    
DOI: 10.1007/s10957-013-0285-9     Document Type: Article

References (29)

1. Golub, G. H., O'Leary, D. P.: Some history of the conjugate gradient and Lanczos algorithms: 1948-1976. SIAM Rev. 31, 50-102 (1989).
2. O'Leary, D. P.: Conjugate gradients and related KMP algorithms: the beginnings. In: Adams, L., Nazareth, J. L. (eds.) Linear and Nonlinear Conjugate Gradient-Related Methods, pp. 1-8. SIAM, Philadelphia (1996).
3. Hager, W. W., Zhang, H.: A survey of nonlinear conjugate gradient methods. Pac. J. Optim. 2, 35-58 (2006).
4. Dolan, E. D., Moré, J. J.: Benchmarking optimization software with performance profiles. Math. Program. 91, 201-213 (2002).
5. Andrei, N.: An unconstrained optimization test functions collection. Adv. Model. Optim. 10, 147-161 (2008).
6. Hestenes, M. R., Stiefel, E. L.: Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand. 49, 409-436 (1952).
7. Dai, Y. H., Yuan, Y.: An efficient hybrid conjugate gradient method for unconstrained optimization. Ann. Oper. Res. 103, 33-47 (2001).
8. Polak, E., Ribière, G.: Note sur la convergence de directions conjuguée. Rev. Fr. Inf. Rech. Oper. 16, 35-43 (1969).
9. Polyak, B. T.: The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9, 94-112 (1969).
10. Hager, W. W., Zhang, H.: A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM J. Optim. 16, 170-192 (2005).
11. Liu, D. C., Nocedal, J.: On the limited memory BFGS method for large scale optimization methods. Math. Program. 45, 503-528 (1989).
12. Averick, B. M., Carter, R. G., Moré, J. J., Xue, G. L.: The MINPACK-2 test problem collection. Mathematics and Computer Science Division, Argonne National Laboratory, Preprint MCS-P153-0692 (1992).
13. Wolfe, P.: Convergence conditions for ascent methods. SIAM Rev. 11, 226-235 (1969).
14. Perry, A.: A modified conjugate gradient algorithm. Oper. Res. 26, 1073-1078 (1978).
15. Shanno, D. F.: Conjugate gradient methods with inexact searches. Math. Oper. Res. 3, 244-256 (1978).
16. Dai, Y. H., Liao, L. Z.: New conjugacy conditions and related nonlinear conjugate gradient methods. Appl. Math. Optim. 43, 87-101 (2001).
17. Andrei, N.: Scaled conjugate gradient algorithms for unconstrained optimization. Comput. Optim. Appl. 38, 401-416 (2007).
18. Andrei, N.: Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization. Optim. Methods Softw. 22, 561-571 (2007).
19. Birgin, E., Martínez, J. M.: A spectral conjugate gradient method for unconstrained optimization. Appl. Math. Optim. 43, 117-128 (2001).
20. Yuan, Y., Stoer, J.: A subspace study on conjugate gradient algorithms. Z. Angew. Math. Mech. 75, 69-77 (1995).
21. Shanno, D. F., Phua, K. H.: Algorithm 500. Minimization of unconstrained multivariate functions. ACM Trans. Math. Softw. 2, 87-94 (1976).
22. Andrei, N.: Acceleration of conjugate gradient algorithms for unconstrained optimization. Appl. Math. Comput. 213, 361-369 (2009).
23. Moré, J. J., Thuente, D. J.: Line search algorithms with guaranteed sufficient decrease. ACM Trans. Math. Softw. 20, 286-307 (1994).
24. Glowinski, R.: Numerical Methods for Nonlinear Variational Problems. Springer, Berlin (1984).
25. Cimatti, G.: On a problem of the theory of lubrication governed by a variational inequality. Appl. Math. Optim. 3, 227-242 (1977).
26. Goodman, J., Kohn, R., Reyna, L.: Numerical study of a relaxed variational problem from optimal design. Comput. Methods Appl. Mech. Eng. 57, 107-127 (1986).
27. Aris, R.: The Mathematical Theory of Diffusion and Reaction in Permeable Catalysts. Oxford University Press, London (1975).
28. Bebernes, J., Eberly, D.: Mathematical Problems from Combustion Theory. Applied Mathematical Sciences, vol. 83. Springer, Berlin (1989).
29. Nitsche, J. C. C.: Lectures on Minimal Surfaces vol. 1. Cambridge University Press, Cambridge (1989).