Approximate Gauss-newton methods for nonlinear least squares problems

SIAM Journal on Optimization

Volumn 18, Issue 1, 2007, Pages 106-132

  Gratton, S ^a   Lawless, A S ^b   Nichols, N K ^b  

^a CERFACS   (France)

^b UNIVERSITY OF READING   (United Kingdom)

Author keywords

Approximate Gauss Newton methods; Nonlinear least squares problems; Variational data assimilation

Indexed keywords

DATA ACQUISITION; LEAST SQUARES APPROXIMATIONS; NEWTON-RAPHSON METHOD; NUMERICAL METHODS;

APPROXIMATE GAUSS-NEWTON METHODS; NONLINEAR LEAST SQUARES PROBLEMS; VARIATIONAL DATA ASSIMILATION;

PROBLEM SOLVING;

EID: 34548808885     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/050624935     Document Type: Article

References (23)

1. M. C. BARTHOLOMEW-BIGGS, S. BROWN, B. CHRISTIANSON, AND L. DIXON, Automatic differentiation of algorithms, J. Comput. Appl. Math., 124 (2000), pp. 171-190.
2. AKE BJÖRCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, PA, 1996.
3. E. CATINAS, Inexact perturbed Newton methods and applications to a class of Krylov solvers, J. Optim. Theory Appl., 108 (2001), pp. 543-571.
4. E. CATINAS, On the superlinear convergence of the successive approximations method, J. Optim. Theory Appl., 113 (2002), pp. 473-485.
5. J. CÔTÉ, S. GRAVEL, A. MÉTHOT, A. PATOINE, M. ROCH, AND A. STANIPORTH, The operational CMC-MRB global environmental multiscale (GEM) model. Part I: Design considerations and formulation, Monthly Weather Rev., 126 (1998), pp. 1373-1395.
6. P. COURTIER, J. N. THEPAUT, AND A. H OLLINGSWORTH, A strategy for operational implementation of 4D-Var, using an incremental approach, Quart. J. Roy. Meteor. Soc., 120 (1994), pp. 1367-1387.
7. M. J. P. CULLEN, T. DAVIES, M. H. MAWSON, J. A. JAMES, S. C. COULTER, AND A. MALCOLM, An Overview of Numerical Methods for the Next Generation U.K. NWP and Climate Model, Numer. Methods Atmos. Oceanic Model., The Andre Robert Memorial Volume, C. A. Lin, R. Laprise, and H. Ritchie, eds., Canadian Meteorological and Oceanographic Society, Ottawa, ON, Canada, 1997, pp. 425-444.
8. R. S. DEMBO, S. C. EISENSTAT, AND T. STEIHAUG, Inexact Newton methods, SIAM J. Numer. Anal., 19 (1982), pp. 400-408.
9. J. E. DENNIS AND R. B. SCHNABEL, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, NJ, 1983.
10. J. E. DENNIS AND T. STEIHAUG, On the successive projections approach to least squares problems, SIAM J. Numer. Anal., 23 (1986), pp. 717-733.
11. M. GHIL AND P. MALANOTTE-RIZZOLI, Data assimilation in meteorology and oceanography, Adv. Geophys., 33 (1991), pp. 141-266.
12. S. GRATTON, Outils Théoriques d'Analyse du Calcul à Précision Finie, Ph.D. thesis, TH/PA/98/30, Institut National Polytechnique de Toulouse, Toulouse, France, 1998.
13. A. S. LAWLESS, Development of linear models for data assimilation in numerical weather prediction, Ph.D. thesis, The University of Reading, Reading, UK, 2001.
14. A. S. LAWLESS. S. GRATTON, AND N. K. NICHOLS, An investigation of incremental AD-Var using non-tangent linear models, Quart. J. Roy. Meteor. Soc, 131 (2005), pp. 459-476.
15. A. S. LAWLESS, S. GRATTON, AND N. K. NICHOLS, Approximate iterative methods for variational data assimilation, Internat. J. Numer. Methods Fluids, 47 (2005), pp. 1129-1135.
16. A. S. LAWLESS, N. K. NICHOLS, AND S. P. BALLARD, A comparison of two methods for developing the linearization of a shallow-water model, Quart. J. Roy. Meteor. Soc., 129 (2003), pp. 1237-1254.
17. A. S. LAWLESS AND N. K. NICHOLS, Inner loop stopping criteria for incremental fourdimensional variational data assimilation, Monthly Weather Rev., 134 (2006), pp. 3425-3435.
18. A. C. LORENC, S. P. BALLARD, R. S. BELL, N. B. INGLEBY. P. L. F. ANDREWS, D. M. BARKER, J. R. BRAY, A. M. CLAYTON, T. DALBY, D. LI, T. J. PAYNE, AND F. W. SAUNDERS, The Met. Office global 3-dimensional variational data assimilation scheme, Quart. J. Roy. Meteor. Soc., 126 (2000), pp. 2991-3012.
19. N. K. NICHOLS, Data assimilation: Aims and basic concepts, in Data Assimilation for the Earth System, R. Swinbank, V. Shutyaev, and W. A. Lahoz, eds., Kluwer Academic Publishers, Norwell, MA, 2003, pp. 9-20.
20. J. M. ORTEGA AND W. C. RHEINBOLDT, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, 1970.
21. V. PEREYRA, Iterative methods for solving nonlinear least squares problems, SIAM J. Numer. Anal., 4 (1967), pp. 27-36.
22. J. S. STOER AND R. BULIRSCH, Introduction to Numerical Analysis, Springer, New York, 1980.
23. P-A. WEDIN, On the Gauss-Newton Method for the Nonlinear Least-Squares Problems, Working paper 24, Institute for Applied Mathematics, Stockolm, Sweden, 1974.