Convergence conditions, line search algorithms and trust region implementations for the Polak-Ribière conjugate gradient method

Optimization Methods and Software

Volumn 20, Issue 1, 2005, Pages 71-98

  Grippo, L ^a   Lucidi, S ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Conjugate gradient method; Polak Ribi re method; Unconstrained optimization

Indexed keywords

ALGORITHMS; DIFFERENTIATION (CALCULUS); FUNCTIONS; OPTIMIZATION; QUADRATIC PROGRAMMING; SET THEORY;

CONJUGATE GRADIENT METHOD; DIFFERENTIABLE FUNCTIONS; POLAK-RIBIÈRE METHOD; UNCONSTRAINED OPTIMIZATION;

CONVERGENCE OF NUMERICAL METHODS;

EID: 12344285803     PISSN: 10556788     EISSN: None     Source Type: Journal    
DOI: 10.1080/1055678042000208570     Document Type: Article

References (26)

1. Hestenes, M.R. and Stiefel, E.L., 1952, Methods of conjugate gradients for solving linear systems. Journal of Reseach Natural Bureau of Standards Section 5, 49, 409-436.
2. Dixon, L.C.W., 1973, Nonlinear optimization: A survey of the state of the art. In: D.J. Evans (Ed) Software for Numerical Mathematics (New York: Academic Press), pp. 193-216.
3. Fletcher, R., 1987, Practical Methods of Optimization (New York: John Wiley and Sons).
4. Fletcher, R. and Reeves, C.M., 1964, Function minimization by conjugate gradients. Computer Journal, 7, 149-154.
5. Gilbert, J.C. and Nocedal, J., 1992, Global convergence of conjugate gradient methods for optimization. SIAM Journal on Optimization, 2, 21-42.
6. Hestenes, M.R., 1980, Conjugate Direction Methods in Optimization (New York: Springer Verlag).
7. Khoda, K.M., Liu, Y. and Storey, C., 1992, Generalized Polak-Ribiere algorithm. Journal on Optimization Theory and Applications, 75, 345-354.
8. Liu, Y. and Storey, C., 1991, Efficient generalized conjugate gradient algorithms, part 1: Theory. Journal on Optimization Theory and Applications, 69, 129-137.
9. Polak, E. and Ribière, G., 1969, Note sur la convergence de méthodes de directions conjuguées. Revue Francaise d'Informatique et de Recherche Opérationnelle, 16, 35-43.
10. Shanno, D.F., 1985, Globally convergent conjugate gradient algorithms. Mathematical Programming, 33, 61-67.
11. Shanno, D.F., 1978, Conjugate gradient methods with inexact searches. Mathematics of Operations Research, 3, 244-2567.
12. Shanno, D.F., 1978, On the convergence of a new conjugate gradient algorithm. SIAM Journal on Numerical Analysis, 15, 1247-1257.
13. Zoutendijk, G., 1970, Nonlinear programming computational methods. In: J. Abadie (Ed) Integer and Nonlinear Programming (Amsterdam: North-Holland), pp. 37-86.
14. Al-Baali, M., 1985, Descent property and global convergence of the Fletcher-Reeves method with inexact line search. IMA Journal on Numerical Analysis, 5, 121-124.
15. Powell, M.J.D., 1984, Nonconvex minimization calculations and the conjugate gradient method. In: Lecture Notes in Mathematics 1066 (Berlin: Spring-Verlag), pp. 122-141.
16. Powell, M.J.D., 1986, Convergence properties of algorithms for nonlinear optimization. SIAM Review, 28, 487-500.
17. Dai, Y.H., Han, J.Y., Liu, G.H., Sun, D.F., Yin, H.X. and Yuan, Y., 1999, Convergence properties of nonlinear conjugate gradient methods. SIAM Journal on Optimization, 10, 345-358.
18. Grippo, L. and Lucidi, S., 1997, A globally convergent version of the Polak-Ribiere conjugate gradient method. Mathematical Programming, 78, 375-391.
19. Dai, Y.H., 2002, Conjugate gradient methods with Armijo-type line searches. Acta Mathematicae Applicatae Sinica (English Series), 18(1), 123-130.
20. Onega, J.M. and Rheinboldt, W.C., 1970, Iterative Solution of Nonlinear Equations in Several Variables (New York: Academic Press).
21. Polijak, B.T., 1987, Introduction to Optimization. Optimization Software Inc.
22. Bazaraa, M.S., Sherali, H.D. and Shetty, C.M., 1993, Nonlinear Programming (New York: John Wiley and Sons).
23. Bertsekas, D.P., 1999, Nonlinear Programming, (2nd edn) (Athena Scientific).
24. De Leone, R., Gaudioso, M. and Grippo, L., 1984, Stopping criteria for linesearch methods without derivatives. Mathematical Programming, 30, 285-300.
25. Grippo, L., Lampariello, F. and Lucidi, S., 1988, Global convergence and stabilization of unconstrained minimization methods without derivatives. Journal of Optimization Theory and Applications, 56, 385-406.
26. Raydan, M., 1997, The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAM Journal on Optimization, 7, 26-33.