The superlinear convergence of a modified BFGS-type method for unconstrained optimization

Computational Optimization and Applications

Volumn 29, Issue 3, 2004, Pages 315-332

  Wei, Zengxin ^a   Yu, Gaohang ^a   Yuan, Gonglin ^a   Lian, Zhigang ^a  

^a GUANGXI UNIVERSITY   (China)

Author keywords

Quasi newton method; Superlinear convergence; Unconstrained optimization

Indexed keywords

ALGORITHMS; GLOBAL OPTIMIZATION; ITERATIVE METHODS; MATRIX ALGEBRA; NUMERICAL ANALYSIS; PROBLEM SOLVING; THEOREM PROVING;

BFGS METHODS; QUASI-NEWTON METHOD; SUPERLINEAR CONVERGENCE; UNCONSTRAINED OPTIMIZATION;

CONVERGENCE OF NUMERICAL METHODS;

EID: 5544237802     PISSN: 09266003     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:COAP.0000044184.25410.39     Document Type: Article

References (18)

1. C.G. Broyden, J.E. Dennis, and J.J. Moré, "On the local and superlinear convergence of quasi-Newton methods," J. Inst. Math. Appl., vol. 12. pp. 223-246, 1973.
2. R. Byrd and J. Nocedal, "A tool for the analysis of quasi-Newton methods with application to unconstrained minimization," SIAM J. Numerical Anal., vol. 26, pp. 727-739, 1989.
3. R. Byrd, J. Nocedal, and Y. Yuan, "Global convergence of a class of quasi-Newton methods on convex problems," SIAM J. Numer. Anal., vol. 24, pp. 1171-1189, 1987.
4. Y. Dai, "Convergence properties of the BFGS algorithm," SIAM J. Optim., vol. 13, pp. 693-701, 2003.
5. W.C. Davidon, "Variable metric methods for minimization," Argonne National Laboratories Report, ANL-5990.
6. J.E. Dennis and J.J. Moré, "A characterization of superlinear convergence and its application to quasi-Newton methods," Math. Comp., vol. 28, pp. 549-560, 1974.
7. J.E. Dennis and J.J. Moré, "Quasi-Newton methods, motivation and theory," SIAM Rev., vol. 19, pp. 46-89, 1977.
8. A. Griewank and P.L. Toint, "Local convergence analysis for partitioned quasi-Newton updates," Numer. Math., vol. 39, pp. 429-448, 1982.
9. D. Li and M. Fukushima, "A modified BFGS method and its global convergence in nonconvex minimization," J. Comput. Appl. Math., vol. 129, pp. 15-35, 2001.
10. D. Li and M. Fukushima, "A global and superlinear convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations," SIAM J. Numer. Anal., vol. 37, pp. 152-172, 1999.
11. D. Li and M. Fukushima, "On the global convergence of the BFGS method for nonconvex unconstrained optimization problems," SIAM J. Optim., vol. 11, pp. 1054-1064, 2001.
12. J.M. Perry, "A class of conjugate algorithms with a two step variable metric memory," Discussion paper 269, Center for Mathematical Studies in Economics and Management Science, Northwestern University, 1977.
13. M.J.D. Powell, "A new algorithm for unconstrained optimation," in Nonlinear Programming, J.B. Rosen, O.L. Mangasarian, and K. Ritter (Eds.), Academic Press, New York, 1970.
14. D.F. Shanno, "On the convergence of a new conjugate gradient algorithm," SIAM J. Numer. Anal., vol. 15, pp. 1247-1257, 1978.
15. Z. Wei, L. Qi, and X. Chen, "An SQP-type method and its application in stochastic programming," J. Optim. Theory Appl., vol. 116, pp. 205-228, 2003.
16. Z. Wei, G. Li, and L. Qi, "New quasi-Newton methods for unconstrained optimization problems," to appear in Mathematical Programming.
17. Z. Wei, L. Qi, and S. Ito, "New step-size rules for optimization problems," Department of Mathematics and Information Science, Guangxi University, Nanning, Guangxi, People's Republic of China, October 2000.
18. Y. Yuan and W. Sun, Theory and Methods of Optimization, Science Press of China, 1999.