Convergence properties of a self-adaptive levenberg-marquardt algorithm under local error bound condition

Computational Optimization and Applications

Volumn 34, Issue 1, 2006, Pages 47-62

  Fan, Jinyan ^a   Pan, Jianyu ^b,c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b SJTU ^*

^c EAST CHINA NORMAL UNIVERSITY   (China)

Author keywords

Levenberg marquardt method; Singular nonlinear equations; Trust region method

Indexed keywords

ACTUAL REDUCTION; LEVENBERG-MARQUARDT ALGORITHMS; PREDICTED REDUCTION; SINGULAR NONLINEAR EQUATIONS; TRUST REGION METHODS;

ALGORITHMS; ERRORS; FUNCTIONS; NONLINEAR EQUATIONS; NUMERICAL METHODS; QUADRATIC PROGRAMMING;

CONVERGENCE OF NUMERICAL METHODS;

EID: 33646596539     PISSN: 09266003     EISSN: 15732894     Source Type: Journal    
DOI: 10.1007/s10589-005-3074-z     Document Type: Article

References (17)

1. H. Dan, N. Yamashita, and M. Fukushima,"Convergence properties of the inexact Levenberg-Marquardt method under local error bound," Optimization Methods and Software, vol. 17, pp. 605-626, 2002.
2. J.Y. Fan and Y.X. Yuan,"On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption," Computing, vol. 74, no. 1, pp. 23-39, 2005.
3. J.Y. Fan,"A modified Levenberg-Marquardt algorithm for singular system of nonlinear equations," Journal of Computational Mathematics, vol. 21, no. 5, pp. 625-636, 2003.
4. L. Hei,"A self-adaptive trust region algorithm," Report, AMSS, Chinese Academy of Sciences, 2000.
5. K. Levenberg,"A method for the solution of certain nonlinear problems in least squares," Quart. Appl. Math., vol. 2, pp. 164-166, 1944.
6. D.W. Marquardt,"An algorithm for least-squares estimation of nonlinear inequalities," SIAM J. Appl. Math., vol. 11, pp. 431-441, 1963.
7. J.J. Moré,"The Levenberg-Marquardt algorithm: implementation and theory," in Lecture Notes in Mathematics 630: Numerical Analysis, G.A. Watson (Ed.), Springer-Verlag: Berlin, 1978, pp. 105-116.
8. J.J. Moré,"Recent developments in algorithms and software for trust region methods," in Mathematical Programming: The State of Art, A. Bachern, M. Grötschel and B. Korte (Eds.), Springer: Berlin, 1983, pp. 258-287.
9. J.J. Moré, B.S. Garbow, and K.H. Hillstrom,"Testing unconstrained optimization software," ACM Trans. Math. Software, vol. 7, pp. 17-41, 1981.
10. J. Nocedal and Y.X. Yuan,"Combining trust region and line search techniques," in Advances in Nonlinear Programming, Y. Yuan (Ed.), Kluwer, pp. 153-175, 1998.
11. M.J.D. Powell,"Convergence properties of a class of minimization algorithms," in Nonlinear Programming 2, O.L. Mangasarian, R.R. Meyer, and S.M. Robinson (Eds.), Academic Press: New York, 1975, pp. 1-27.
12. R.B. Schnabel and P.D. Frank,"Tensor methods for nonlinear equations," SIAM J. Numer. Anal., vol. 21, pp. 815-843, 1984.
13. G.W. Stewart and J.G. Sun, Matrix Perturbation Theory. Academic Press: San Diego, CA, 1990.
14. N. Yamashita and M. Fukushima,"On the rate of convergence of the Levenberg-Marquardt method," Computing (Suppl), vol. 15, pp. 239-249, 2001.
15. Y.X. Yuan,"Trust region algorithms for nonlinear programming," in Contemporary Mathematics, Z.C. Shi (Ed.) vol. 163, American Mathematics Society, 1994, pp. 205-225.
16. Y.X. Yuan,"Trust region algorithms for nonlinear equations," Information, vol. 1, pp. 7-20, 1998.
17. Y.X. Yuan,"A review of trust region algorithms for optimization," in ICM99: Proceedings of the Fourth International Congress on Industrial and Applied Mathematics, J.M. Ball and J.C.R. Hunt (Eds.), Oxford University Press, 2000 pp. 271-282.