Convergence of the Polak-Ribiére-Polyak conjugate gradient method

Nonlinear Analysis, Theory, Methods and Applications

Volumn 66, Issue 6, 2007, Pages 1428-1441

  Shi, Zhen Jun ^a,b   Shen, Jie ^b  

^a QUFU NORMAL UNIVERSITY   (China)

^b UNIVERSITY OF MICHIGAN DEARBORN   (United States)

Author keywords

Global convergence; PRP conjugate gradient method; Unconstrained optimization

Indexed keywords

FUNCTION EVALUATION; NUMERICAL ANALYSIS; OPTIMIZATION; PROBLEM SOLVING;

CONJUGATE GRADIENT METHOD; GLOBAL CONVERGENCE;

CONVERGENCE OF NUMERICAL METHODS;

EID: 33845893334     PISSN: 0362546X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.na.2006.02.001     Document Type: Article

References (28)

1. Armijo L. Minimization of functions having Lipschits continuous partial derivatives. Pacific J. Math. 16 (1966) 1-3
2. Birgin E.G., and Martinez J.M. A spectral conjugate gradient method for unconstrained optimization. Appl. Math. Optim. 43 (2001) 117-128
3. Cohen A. Rate of convergence of several conjugate gradient algorithms. SIAM J. Numer. Anal. 9 (1972) 248-259
4. Dai Y.H. New properties of a nonlinear conjugate gradient method. Numer. Math. 89 (2001) 83-98
5. Dai Y.H., and Yuan Y. A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim. 10 1 (1999) 177-182
6. Dai Y.H., and Ni Q. Testing different conjugate gradient methods for large-scale unconstrained optimization. J. Comput. Math. 21 3 (2003) 311-320
7. Dai Y.H., and Fletcher R. On the asymptotic behaviour of some new gradient methods. Math. Prog. 103 (2005) 541-559
8. Fletcher R., and Reeves C. Function minimization by conjugate gradients. Comput. J. 7 (1964) 149-154
9. Grippo L., and Lucidi S. Convergence conditions, line search algorithms and trust region implementations for the Polak Ribiére conjugate gradient method. Optim. Methods Softw. 20 1 (2005) 71-98
10. Grippo L., and Lucidi S. A globally convergent version of the Polak-Ribiére conjugate gradient method. Math. Prog. 78 (1997) 375-391
11. Gilbert J.C., and Nocedal J. Global convergence properties of conjugate gradient methods for optimization. SIAM J. Optim. 2 1 (1992) 21-42
12. Goldstein A.A. On steepest descent. SIAM J. Control 3 (1965) 147-151
13. Hestenes M.R., and Stiefel E. Method of conjugate gradient for solving linear systems. J. Res. Nat. Bur. Stand. 49 (1952) 409-436
14. Khoda K.M., Liu Y., and Storey C. Generalized Polak-Ribiére algorithm. J. Optim. Theory Appl. 75 (1992) 345-354
15. Moré J.J., Garbow B.S., and Hillstrom K.E. Testing unconstrained optimization software. ACM Trans. Math. Softw. 7 (1981) 17-41
16. Nocedal J., and Wright J.S. Numerical Optimization (1999), Springer-Verlag, New York, Inc.
17. Nocedal J. Theory of algorithm for unconstrained optimization. Acta Numer. 1 (1992) 199-242
18. Polak E., and Ribiére G. Note sur la convergence de directions conjuguées. Rev. Francaise Infomat Recherche Operatonelle, 3e Année 16 (1969) 35-43
19. Polyak B.T. The conjugate gradient method in extreme problems. USSR Comput. Math. Math. Phys. 9 (1969) 94-112
20. Sun J., and Zhang J.P. Convergence of conjugate gradient methods without line search. Ann. Oper. Res. 103 (2001) 161-173
21. Sun J., Yang X.Q., and Chen X.D. Quadratic cost flow and the conjugate gradient method. European J. Oper. Res. 164 (2005) 104-114
22. Shanno D.F. Conjugate gradient methods with inexact line searches. Math. Oper. Res. 3 (1978) 244-256
23. Shanno D.F. On the convergence of a new conjugate gradient algorithm. SIAM J. Numer. Anal. 15 (1978) 1247-1257
24. Shi Z.J. Restricted PR conjugate gradient method and its global convergence. Adv. Math. 31 1 (2002) 47-55 (in Chinese)
25. Shi Z.J., and Shen J. Convergence of descent method without line search. Appl. Math. Comput. 167 (2005) 94-107
26. Shi Z.J., and Shen J. Step-size estimation for unconstrained optimization methods. Comput. Appl. Math. 24 3 (2005) 1-18
27. Wolfe P. Convergence conditions for ascent methods. SIAM Rev. 11 (1969) 226-235
28. Yuan Y. Numerical Methods for Nonlinear Programming (1993), Shanghai Scientific & Technical Publishers