Quadratic and superlinear convergence of the huschens method for nonlinear least squares problems

Computational Optimization and Applications

Volumn 10, Issue 1, 1998, Pages 79-103

  Yabe, Hiroshi ^a   Ogasawara, Hideho ^a  

^a TOKYO UNIVERSITY OF SCIENCE   (Japan)

Author keywords

Broyden family; Huschens method; Nonlinear least squares problem; Quadratic and superlinear convergence; Structured quasi Newton method

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; FUNCTION EVALUATION; ITERATIVE METHODS; MATHEMATICAL MODELS; MATRIX ALGEBRA; NONLINEAR EQUATIONS; PROBLEM SOLVING; THEOREM PROVING; LEAST SQUARES APPROXIMATIONS;

BROYDEN FAMILY; HUSCHENS METHOD; NONLINEAR LEAST SQUARE PROBLEMS; QUADRATIC AND SUPERLINEAR CONVERGENCE; STRUCTURED QUASI-NEWTON METHOD; NONLINEAR LEAST SQUARES PROBLEMS; OBJECTIVE FUNCTION; STRUCTURED QUASI NEWTON METHODS;

LEAST SQUARES APPROXIMATIONS; CONVERGENCE OF NUMERICAL METHODS;

EID: 0032047409     PISSN: 09266003     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1018391917880     Document Type: Article

References (17)

1. M. Al-Baali and R. Fletcher, "Variational methods for non-linear least-squares," Journal of the Operational Research Society, vol. 36, pp. 405-421, 1985.
2. M. C. Bartholomew-Biggs, "The estimation of the Hessian matrix in nonlinear least squares problems with non-zero residuals," Mathematical Programming, vol. 12, pp. 67-80, 1977.
3. J. E. Dennis, Jr., D. M. Gay, and R. E. Welsch, "An adaptive nonlinear least-squares algorithm," ACM Transactions on Mathematical Software, vol. 7, pp. 348-368, 1981.
4. J. E. Dennis, Jr., H. J. Martinez, and R. A. Tapia, "Convergence theory for the structured BFGS secant method with an application to nonlinear least squares," Journal of Optimization Theory and Applications, vol. 61, pp. 161-178, 1989.
5. J. E. Dennis, Jr. and J. J. More, "A characterization of superlinear convergence and its application to quasi-Newton methods," Mathematics of Computation, vol. 28, pp. 549-560, 1974.
6. J. E. Dennis, Jr. and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall: New Jersey, 1983.
7. J. E. Dennis, Jr. and H. F. Walker, "Convergence theorems for least-change secant update methods," SIAM Journal on Numerical Analysis, vol. 18, pp. 949-987, 1981.
8. J. R. Engels and H. J. Martinez, "Local and superlinear convergence for partially known quasi-Newton methods," SIAM Journal on Optimization, vol. 1, pp. 42-56, 1991.
9. R. Fletcher and C. Xu, "Hybrid methods for nonlinear least squares," IMA Journal of Numerical Analysis, vol. 7, pp. 371-389, 1987.
10. J. Huschens, "Structured quasi-Newton methods for optimization problems in Hubert spaces," Technical report, Universität Trier, Trier, Germany, June 1991.
11. J. Huschens, " On the use of product structure in secant methods for nonlinear least squares problems," SIAM Journal on Optimization, vol. 4, pp. 108-129, 1994.
12. R. B. Schnabel, Analyzing and improving quasi-Newton methods for unconstrained optimization, Ph.D. thesis, Cornell University, Ithaca, NY, 1977.
13. A. Stachurski, "Superlinear convergence of Broyden's bounded θ-class of methods," Mathematical Programming, vol. 20, pp. 196-212, 1981.
14. H. Yabe, "On Huschens method for solving nonlinear least squares problems," in Studies in Liberal Arts and Sciences, vol. 26, pp. 217-231. Science University of Tokyo, 1993, in Japanese.
15. H. Yabe and T. Takahashi, "Factorized quasi-Newton methods for nonlinear least squares problems," Mathematical Programming, vol. 51, pp. 75-100, 1991.
16. H. Yabe and N. Yamaki, "Convergence of a faetorized Broyden-like family for nonlinear least squares problems," SIAM Journal on Optimization, vol. 5, pp. 770-791, 1995.
17. H. Yabe and N. Yamaki, "Local and superlinear convergence of structured quasi-Newton methods for nonlinear optimization," Journal of the Operations Research Society of Japan, vol. 39, pp. 541-557, 1996.