Rank-deficient nonlinear least squares problems and subset selection

SIAM Journal on Numerical Analysis

Volumn 49, Issue 3, 2011, Pages 1244-1266

  Ipsen, I C F ^a   Kelley, C T ^a   Pope, S R ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b SAS INSTITUTE INC   (United States)

Author keywords

Levenberg Marquardt algorithm; Nonlinear least squares; Singular value decomposition; Subset selection

Indexed keywords

JACOBIANS; LEVENBERG-MARQUARDT ALGORITHM; LEVENBERG-MARQUARDT METHOD; LOCAL CONVERGENCE; NONLINEAR LEAST SQUARES; NONLINEAR LEAST SQUARES PROBLEMS; NUMERICAL EXPERIMENTS; PERTURBATION ANALYSIS; SUBSET SELECTION; TRUNCATED SINGULAR VALUE DECOMPOSITION;

CONVERGENCE OF NUMERICAL METHODS; SINGULAR VALUE DECOMPOSITION;

LEAST SQUARES APPROXIMATIONS;

EID: 79960422161     PISSN: 00361429     EISSN: None     Source Type: Journal    
DOI: 10.1137/090780882     Document Type: Article

References (24)

1. A. Ben-Israel, A Newton-Raphson method for the solution of systems of equations, J. Math. Anal. Appl., 15 (1966), pp. 243-252.
2. P. T. Boggs, The convergence of the Ben-Israel iteration for nonlinear least squares problems, Math. Comp., 30 (1976), pp. 512-522.
3. S. L. Campbell and C. D. Meyer, Generalized Inverses of Linear Transformations, Dover Publications, New York, 1991.
4. A. R. Conn, N. I. M. Gould, and P. L. Toint, Trust Region Methods, MPS-SIAM Ser. Optim. 1, SIAM, Philadelphia, 2000.
5. J. E. Dennis, Jr., and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Classics Appl. Math. 16, SIAM, Philadelphia, 1996.
6. P. Deuflhard and G. Heindl, Affine invariant convergence theorems for Newton's method and extensions to related methods, SIAM J. Numer. Anal., 16 (1979), pp. 1-10.
7. L. M. Ellwein, S. R. Pope, A. Xie, J. Batzel, C. T. Kelley, and M. S. Olufsen, Modeling cardiovascular and respiratory dynamics in congestive heart failure, preprint.
8. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed., The Johns Hopkins University Press, Baltimore, MD, 1996.
9. M. Gu and S. C. Eisenstat, Efficient algorithms for computing a strong rank-revealing QR factorization, SIAM J. Sci. Comput., 17 (1996), pp. 848-869. (Pubitemid 126621180)
10. T. Heldt, Computational Models of Cardiovascular Response to Orthostatic Stress, Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA, 2004.
11. I. C. F. Ipsen, Numerical Matrix Analysis, SIAM, Philadelphia, 2009.
12. C. T. Kelley, Iterative Methods for Linear and Nonlinear Equations, Frontiers Appl. Math. 16, SIAM, Philadelphia, 1995.
13. C. T. Kelley, Iterative Methods for Optimization, Frontiers Appl. Math. 18, SIAM, Philadelphia, 1999.
14. K. Levenberg, A method for the solution of certain non-linear problems in least squares, Quart. Appl. Math., 4 (1944), pp. 164-168.
15. D. W. Marquardt, An algorithm for least squares estimation of nonlinear parameters, SIAM J. Appl. Math., 11 (1963), pp. 431-441.
16. J. M. Ortega and W. C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
17. S. Pope, Parameter Identification in Lumped Compartment Cardiorespiratory Models, Ph.D. thesis, North Carolina State University, Raleigh, NC, 2009.
18. S. R. Pope, L. M. Ellwein, C. L. Zapata, V. Novak, C. T. Kelley, and M. S. Olufsen, Estimation and identification of parameters in a lumped cerebrovascular model, Math. Biosci. Eng., 6 (2009), pp. 93-115.
19. R. Schaback, Convergence analysis of the general Gauss-Newton method, Numer. Math., 46 (1985), pp. 281-309.
20. L. F. Shampine and M. W. Reichelt, The MATLAB ODE suite, SIAM J. Sci. Comput., 18 (1997), pp. 1-22. (Pubitemid 127643992)
21. G. W. Stewart, Error and perturbation bounds for subspaces associated with certain eigenvalue problems, SIAM Rev., 15 (1973), pp. 727-764.
22. G. W. Stewart and J.-G. Sun, Matrix Perturbation Theory, Academic Press, Boston, 1990.
23. K. Tanabe, Continuous Newton-Raphson method for solving an underdetermined system of nonlinear equations, Nonlinear Analysis, TMA, 3 (1979), pp. 493-501.
24. K. Tanabe, Global analysis of continuous analogs of the Levenberg-Marquardt and Newton-Raphson methods for solving nonlinear equations, Ann. Inst. Statist. Math., 37 (1985), pp. 189-203.