New versions of the Hestenes-Stiefel nonlinear conjugate gradient method based on the secant condition for optimization

Computational and Applied Mathematics

Volumn 28, Issue 1, 2009, Pages 111-133

  Zhang, Li ^a  

^a CHANGSHA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Descent direction; Global convergence; HS method

Indexed keywords

NEWTON-RAPHSON METHOD;

CONDITION; DESCENT DIRECTIONS; DESCENT METHOD; GLOBAL CONVER-GENCE; HESTENES-STIEFEL METHOD; INEXACT LINE SEARCHES; NONLINEAR CONJUGATE GRADIENT METHOD; OPTIMISATIONS; QUASI-NEWTON METHODS; SEARCH DIRECTION;

CONJUGATE GRADIENT METHOD;

EID: 69049100288     PISSN: 22383603     EISSN: 18070302     Source Type: Journal    
DOI: 10.1590/s1807-03022009000100006     Document Type: Article

References (25)

1. N. Andrei, Scaled conjugate gradient algorithms for unconstrained optimization. Comput. Optim. Appl., 38 (2007), 401-416.
2. E. Birgin and J.M. Martínez, A spectral conjugate gradient method for unconstrained optimization. Appl. Math. Optim., 43 (2001), 117-128.
3. K.E. Bongartz, A.R. Conn, N.I.M. Gould and P.L. Toint, CUTE: constrained and unconstrained testing environments. ACM Trans. Math. Softw., 21 (1995), 123-160.
4. Y.H. Dai and L.Z. Liao, New conjugate conditions and related nonlinear conjugate gradient methods. Appl. Math. Optim., 43 (2001), 87-101.
5. Y.H. Dai and Y. Yuan, A nonlinear conjugate gradient method with a strong global convergence property. SIAM J. Optim., 10 (1999), 177-182.
6. Y.H. Dai and Y. Yuan, Nonlinear Conjugate Gradient Methods. Shanghai Science and Technology Publisher, Shanghai (2000).
7. E.D. Dolan and J.J. Moré, Benchmarking optimization software with performance profiles. Math. Program., 91 (2002), 201-213.
8. R. Fletcher and C. Reeves, Function minimization by conjugate gradients. Comput. J., 7 (1964), 149-154.
9. R. Fletcher, Practical Methods of Optimization, Vol I: Unconstrained Optimization. John Wiley & Sons, New York (1987).
10. J.C. Gilbert and J. Nocedal, Global convergence properties of conjugate gradient methods for optimization. SIAM. J. Optim., 2 (1992), 21-42.
11. W.W. Hager and H. Zhang, A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM J. Optim., 16 (2005), 170-192.
12. W.W. Hager and H. Zhang, A survey of nonlinear conjugate gradient methods. Pacific J. Optim., 2 (2006), 35-58.
13. M.R. Hestenes and E.L. Stiefel, Methods of conjugate gradients for solving linear systems. J. Research Nat. Bur. Standards Section B, 49 (1952), 409-432.
14. D. Li and M. Fukushima, A modified BFGS method and its global convergence in nonconvex minimization. J. Comput. Appl. Math., 129 (2001), 15-35.
15. Y.L. Liu and C.S. Storey, Efficient generalized conjugate gradient algorithms, Part 1: Theory. J. Optim. Theory Appl., 69 (1991), 129-137.
16. J.J. Moré and D.J. Thuente, Line search algorithms with guaranted sufficient decrease. ACM Trans. Math. Softw., 20 (1994), 286-307.
17. B. Polak and G. Ribiere, Note sur la convergence des méthodes de directions conjuguées. Rev. Française Informat Recherche Operationelle, 16 (1969), 35-43.
18. B.T. Polyak, The conjugate gradient method in extreme problems. USSR Comp. Math. Math. Phys., 9 (1969), 94-112.
19. D.F. Shanno, Conjugate gradient methods with inexact searches. Math. Oper. Res., 3 (1978), 244-256.
20. P. Wolfe, Convergence conditions for ascent methods. SIAM Rev., 11 (1969), 226-235.
21. Y. Yuan and J. Stoer, A subspace study on conjugate algorithms. ZAMM Z. Angew. Math. Mech., 75 (1995), 69-77.
22. L. Zhang, W. Zhou and D. Li, A descent modified Polak-Ribière-Polyak conjugate gradient method and its global convergence. IMA J. Numer. Anal., 26 (2006), 629-640.
23. L. Zhang, W. Zhou and D. Li, Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search. Numer. Math., 104 (2006), 561-572.
24. L. Zhang, W. Zhou and D. Li, Some descent three-term conjugate gradient methods and their global convergence. Optim. Methods Softw., 22 (2007), 697-711.
25. G. Zoutendijk, Nonlinear Programming, Computational methods, Integer and Nonlinear Programming. J. Abadie (ed.), North-Holland, Amsterdam (1970), 37-86.