Recent progress in the global convergence of quasi-Newton methods for nonlinear equations

Hokkaido Mathematical Journal

Volumn 36, Issue 4, 2007, Pages 729-743

  Li, Dong Hui ^a   Cheng, Wanyou ^a  

^a HUNAN UNIVERSITY   (China)

Author keywords

Derivative Free line search; Global convergence; Nonlinear equation; Quasi Newton method

Indexed keywords

EID: 56749099032     PISSN: 03854035     EISSN: None     Source Type: Journal    
DOI: 10.14492/hokmj/1272848030     Document Type: Article

References (31)

1. Bellavia S., Gasparo M.G. And Macconi M., A switching-method for nonlinear systems. Journal of Computational and Applied Mathematics 71 (1996), 83–93.
2. Brigin E.G., Krejic N.K. And Martìnez J.M., Globally convergent inexact quasi- Newton methods for solving nonliear systems. Numerical Algorithms 32 (2003), 249–260.
3. Byrd R. And Nocedal J., A tool for the analysis of quasi-Newton methods with application to unconstrained minimization. SIAM Journal on Numerical Analysis 26 (1989), 727–739.
4. Byrd R., Nocedal J. And Yuan Y., Global convergence of a class of quasi-Newton methods on convex problems. SIAM Journal on Numerical Analysis 24 (1987), 1171–1190.
5. Cruz W., Martínez J. And Raydan M., Special residual method without gradient information for solving large scale nonlinear systems of equations. Mathematics of Computation 75 (2006), 1429–1448.
6. Dai Y., Convergence properties of the BFGS algorithm. SIAM Journal on Optimization 13 (2002), 693–701.
7. Dennis J.E. Jr. And Moré J.J., Quasi-Newton methods, motivation and theory SIAM Review 19 (1977), 46–89.
8. Griewank A., The’global’ convergence of Broyden-like methods with a suitable line search. Journal of Australia Mathematics Society Ser. B 28 (1986), 75–92.
9. Grippo L. And Sciandrone M., Nonmonotone derivative-free methods for nonlinear equations. To appear in Computational Optimization and Applications.
10. Grippo L., Lampariello F. And Lucidi S., A nonmonotone line search technique for Newton’s method. SIAM Journal on Numerical Analysis 23 (1986), 707–716.
11. Gu G.Z., Li D.H., Qi L. And Zhou S.Z., Descent directions of quasi-Newton methods for symmetric nonlinear equations. SIAM Journal on Numerical Analysis 40 (2003), 1763–1774.
12. Li D.H. And Fukushima M., A globally and superlinear convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations. SIAM Journal on Numerical Analysis 37 (1999), 152–172.
13. Li D.H. And Fukushima M., A derivative-free line search and DFP method for symmetric equations with global and superlinear convergence. Numerical Functional Analysys and Optimization 20 (1999), 59–77.
14. Li D.H. And Fukushima M., A derivative-free line search and global convergence of Broyden-like method for nonlinear equations. Optimizaiton Methods Software 13 (2000), 181–201.
15. Li D.H. And Fukushima M., Smoothing Newton and quasi-Newton methods for mixed complementarity problems. Computational Optimization and Applications 17 (2000), 203–230.
16. Li D.H. And Fukushima M., On the global convergence of BFGS method for nonconvex unconstrained optimization problems. SIAM Journal on Optimization 11 (2001), 1054–1064.
17. Li D.H. And Fukushima M., A modified BFGS method and its global convergence in nonconvex minimization. Journal of Computational and Applied Mathematics 129 (2001), 15–35.
18. Li D.H. And Fukushima M., Globally convergent Broyden-like methods for semismooth equations and applications to VIP, NCP and MCP. Annals of Operations Research 103 (2001), 71–79.
19. Li D.H., Yamashita N. And Fukushima M., A nonsmooth equation based BFGS method for solving KKT systems in mathematical programming. Journal of Optimization Theory and Applications 109 (2001), 123–167.
20. Martínez J.M., Practical quasi-Newton methods for solving nonlinear systems. Journal of Computational and Applied Mathematics 124 (2000), 97–121.
21. Moré J.J. And Trangenstein J.A., On the global convergence of Broyden’s method. Mathematics of Computation 30 (1976), 523–540.
22. Ortega J.M. And Rheinboldt W.C., Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, 1970.
23. Powell M.J.D., A hybrid method for nonlinear equations. In “Numerical Methods for Nonlinear Algebraic Equations” (P. Rabinowitz ed.), Gordon and Breach, London, 1970, pp. 87–114.
24. Powell M.J.D., A FORTRAN subroutine for solving systems of nonlinear algebraic equations. In “Numerical Methods for Nonlinear Algebraic Equations”, (P. Rabinowitz ed.), Gordon and Breach, London, 1970, pp. 115–161.
25. Powell M.J.D., Some global convergence properties of a variable metric algorithm for minimization without exact line searches. In “Nonlinear Programming, SIAMAMS Proceedings”, Vol. 9, (R.W. Cottle and C.E. Lemke eds.), Amer. Math. Soc. Providence. RI. (1976), 55–92.
26. Solodov M.V. And Svaiter B.F., A globally convergent inexact Newton method for systems of monotone equations. In “Reformulation: Nonsmooth, Piecewise smooth, Semismooth and Smoothing Methods”, (M. Fukushima and L. Qi eds.), Kluwer Academic Publishers, 1998, pp. 355–369.
27. Zhang J.W. And Li D.H., A norm descent BFGS method for solving the KKT system of symmetric variational inequality problems. Optimization Methods and Software 22 (2007), 237–252.
28. Zhou W.J. And Li D.H., Limited memory BFGS method for nonlinear monotone equations. Journal of Computational Mathematics 25 (2007), 89–96.
29. Zhou W.J. And Li D.H., A globally convergent BFGS method for nonlinear monotone equations without any merit functions. manuscrpts.
30. Zhou G. And Toh K.C., Superlinear convergence of a Newton-type algorithm for monotone equations. Journal of Optimization Theory and Applications 125 (2005), 205–221.
31. Zhu D.T., Nonmonotone backtracking inexact quasi-Newton algorithms for solving smooth nonlinear equations. Applied Mathematics and Computation 161 (2005), 875–895.