On the quadratic convergence of the levenberg-marquardt method without nonsingularity assumption

Computing (Vienna/New York)

Volumn 74, Issue 1, 2005, Pages 23-39

  Fan, Jin Yan ^a,b   Yuan, Ya Xiang ^a,b  

^a Chinese Academy of Sciences ^*

^b INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Levenberg Marquardt method; Nonlinear equations; Quadratic convergence

Indexed keywords

LEVENBERG-MARQUARDT METHOD; POSITIVE CONSTANTS; QUADRATIC CONVERGENCE; SINGULAR PROBLEMS;

ALGORITHMS; COMPUTATIONAL METHODS; ERROR ANALYSIS; NONLINEAR EQUATIONS; NUMERICAL ANALYSIS; PARAMETER ESTIMATION; PROBLEM SOLVING; SET THEORY;

CONVERGENCE OF NUMERICAL METHODS;

EID: 13744251115     PISSN: 0010485X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00607-004-0083-1     Document Type: Article

References (14)

1. Kelley, C. T: Iterative methods for optimization (Frontiers in Applied Mathematics 18). Philadelphia: SIAM 1999.
2. Levenberg, K.: A method for the solution of certain nonlinear problems in least squares. Quart. Appl. Math. 2, 164-166 (1944).
3. Marquardt, D. W.: An algorithm for least-squares estimation of nonlinear inequalities. SIAM J. Appl. Math. 11, 431-441 (1963).
4. Moré, J. J.: The Levenberg-Marquardt algorithm: implementation and theory. In: Lecture Notes in Mathematics 630: Numerical analysis (Watson, G. A., ed.), pp. 105-116. Berlin: Springer 1978.
5. Moré, J. J.: Recent developments in algorithms and software for trust region methods. In: Mathematical programming: The state of art. (Bachem, A., Grötschel, M., Korte, B., eds.), pp. 258-287. Berlin: Springer 1983.
6. Moré, J. J., Garbow, B. S., Hillstrom, K. H.: Testing unconstrained optimization software. ACM Trans. Math. Software 7, 17-41 (1981).
7. Nocedal, J., Yuan, Y.X.: Combining trust region and line search techniques. In: Advances in nonlinear programming (Yuan, Y., ed.), pp. 153-175. Kluwer 1998.
8. Powell, M. J. D.: An iterative method for finding stationary values of a function of several variables. Comput. J. 5, 147-151 (1962).
9. Schnabel, R. B., Frank, P.D.: Tensor methods for nonlinear equations. SIAM J. Numer. Anal. 21, 815-843 (1984).
10. Stewart, G. W., Sun, J. G.: Matrix perturbation theory. San Diego: Academic Press 1990.
11. Yamashita, N., Fukushima, M.: On the rate of convergence of the Levenberg-Marquardt method. Computing (Suppl. 15): 237-249 (2001).
12. Yuan, Y. X.: Trust region algorithms for nonlinear equations. Information 1, 7-20 (1998).
13. Yuan, Y. X.: Problems on convergence of unconstrained optimization algorithms. In: Numerical linear algebra and optimization (Yuan, Y. X., ed.), pp. 95-107. Beijing: Science Press 1999.
14. Yuan, Y. X.: A review of trust region algorithms for optimization. In: ICM99: Proc. 4th Int. Congress on Industrial and Applied Mathematics (Ball, J. M., Hunt, J. C. R., eds.), pp. 271-282. Oxford: Oxford University Press 2000.