Convergence of a regularized euclidean residual algorithm for nonlinear least-squares

SIAM Journal on Numerical Analysis

Volumn 48, Issue 1, 2010, Pages 1-29

  Bellavia, S ^a   Cartis, C ^b   Gould, N I M ^c   Morini, B ^a   Toint, Ph L ^d  

^a UNIVERSITY OF FLORENCE   (Italy)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c RUTHERFORD APPLETON LABORATORY   (United Kingdom)

^d UNIVERSITY OF NAMUR   (Belgium)

Author keywords

Global convergence; Nonlinear least squares; Numerical algorithms; Systems of nonlinear equations

Indexed keywords

CONVERGENCE PROPERTIES; CRITICAL POINTS; EUCLIDEAN; FIRST-ORDER; GLOBAL CONVERGENCE; GLOBALLY CONVERGENT; JACOBIANS; LIPSCHITZ CONTINUOUS; NONLINEAR LEAST SQUARES; NUMERICAL ALGORITHMS; OBJECTIVE FUNCTIONS; RATE OF CONVERGENCE; RESIDUAL METHOD; UNDERLYING SYSTEMS;

ALGORITHMS; APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; EQUATIONS OF STATE;

NONLINEAR EQUATIONS;

EID: 77951840062     PISSN: 00361429     EISSN: None     Source Type: Journal    
DOI: 10.1137/080732432     Document Type: Article

References (22)

1. S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, Cambridge, England, 2004.
2. R. H. Byrd, R. B. Schnabel, and G. A. Shultz, A trust region algorithm for nonlinearly constrained optimization, SIAM J. Numer. Anal., 24 (1987), pp. 1152-1170.
3. C. Cartis, N. I. M. Gould, and P. L. Toint, Adaptive cubic overestimation methods for unconstrained optimization. Part I: Motivation, convergence and numerical results, Math. Program. Ser. A, 2009, DOI: 10.1007/s10107-009-0286-5.
4. C. Cartis, N. I. M. Gould, and P. L. Toint, Trust-region and other regularisation of linear least-squares problems, BIT, 49 (2009), pp. 21-53.
5. M. R. Celis, A Trust Region Strategy for Nonlinear Equality Constrained Optimization, Technical report TR85-4, Department of Computational and Applied Mathematics, Rice University, Houston, TX, 1985.
6. A. R. Conn, N. I. M. Gould, and P. L. Toint, Trust-Region Methods, MPS SIAM Ser. Optimiz. 1, SIAM, Philadelphia, 2000.
7. J. Fan and Y. Yuan, On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption, Computing, 74 (2005), pp. 23-39.
8. N. I. M. Gould, D. Orban, and P. L. Toint, GALAHAD-a library of thread-safe Fortran 90 packages for large-scale nonlinear optimization, ACM Trans. Math. Software, 29 (2003), pp. 353-372.
9. A. Griewank, The Modification of Newton's Method for Unconstrained Optimization by Bounding Cubic Terms, Technical report NA/12, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, United Kingdom, 1981.
10. J. J. Moŕe, Recent developments in algorithms and software for trust region methods, in Mathematical Programming: The State of the Art, A. Bachem, M. Grötschel, and B. Korte, eds., Springer Verlag, Heidelberg, Berlin, New York, 1983, pp. 258-287.
11. J. J. Moŕe and D. C. Sorensen, Computing a trust region step, SIAM J. Sci. and Stat. Comput., 4 (1983), pp. 553-572.
12. Y. Nesterov, Modified Gauss-Newton scheme with worst-case guarantees for global performance, Optim. Methods Softw., 22 (2007), pp. 469-483.
13. Y. Nesterov and B. T. Polyak, Cubic regularization of Newton method and its global performance, Math. Program., 108 (2006), pp. 177-205.
14. J. Nocedal and S. J. Wright, Numerical Optimization, Springer Ser. Oper. Res., Springer Verlag, Heidelberg, Berlin, New York, 1999.
15. E. O. Omojokun, Trust Region Algorithms for Optimization with Nonlinear Equality and Inequality Constraints, Ph.D. thesis, University of Colorado, Boulder, CO, 1989.
16. M. J. D. Powell and Y. Yuan, A trust region algorithm for equality constrained optimization, Math. Program., 49 (1990), pp. 189-213.
17. R. T. Rockafellar, Augmented Lagrangians and applications of the proximal point algorithm in convex programming, Math. Oper. Res., 1 (1976), pp. 97-116.
18. T. Steihaug, The conjugate gradient method and trust regions in large scale optimization, SIAM J. Numer. Anal., 20 (1983), pp. 626-637.
19. S. Thomas, Sequential Estimation Techniques for Quasi-Newton Algorithms, Ph.D. thesis, Cornell University, Ithaca, NY, 1975.
20. P. L. Toint, Towards an efficient sparsity exploiting Newton method for minimization, in Sparse Matrices and Their Uses, I. S. Duff, ed., Academic Press, London, 1981, pp. 57-88.
21. A. Vardi, A trust region algorithm for equality constrained minimization: Convergence properties and implementation, SIAM J. Numer. Anal., 22 (1985), pp. 575-591.
22. M. Weiser, P. Deuflhard, and B. Erdmann, Affine conjugate adaptive Newton methods for nonlinear elastomechanics, Optim. Methods Softw., 22 (2007), pp. 413-431.