Forecasting with imperfect models, dynamically constrained inverse problems, and gradient descent algorithms

Physica D: Nonlinear Phenomena

Volumn 237, Issue 2, 2008, Pages 216-232

  Judd, Kevin ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Data assimilation; Dynamical systems; Inverse problems; State estimation; Weather and climate forecasting

Indexed keywords

CONSTRAINT THEORY; DYNAMICAL SYSTEMS; GRADIENT METHODS; MATHEMATICAL MODELS; STATE ESTIMATION; WEATHER FORECASTING;

CLIMATE FORECASTING; DATA ASSIMILATION; GRADIENT DESCENT ALGORITHMS;

INVERSE PROBLEMS;

EID: 38549091725     PISSN: 01672789     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physd.2007.08.017     Document Type: Article

References (27)

1. N.E. Baker, R. Daley, R. Gelaro, J. Goerss, T. Hogan, R. Langland, R. Pauley, M. Rennick, C. Reynolds, G. Rohaly, T. Rosmond, S. Swadley, The navy operational global atmospheric prediction system: A brief history of past, present, and future developments, Technical Report, Naval Research Laboratory, Monterey, California, 1998
2. Berliner L.M. Likelihood and bayesian prediction of chaotic systems. J. Amer. Statist. Assoc. 416 (1996) 96-121
3. Courtier P., Andersson E., Heckley W., Pailleux J., Vasiljevic D., Hamrud M., Hollingsworth A., Rabier F., and Fisher M. The ECMWF implementation of three-dimensional variational assimilation (3d-var) i: Formulation. Q. J. R. Meteorol. Soc. 124 (1998) 1783-1808
4. Daley R., and Barker E. NAVDAS: Formulation and diagnostics. Mon. Weather Rev. 129 4 (2001) 869-883
5. Do Y., Lai Y.C., Liu Z., and Kostelich E.J. Universal and nonuniversal features in shadowing dynamics of nonhyperbolic chaotic systems with unstable-dimension variability. Phys. Rev. E 67 035202(R) (2003) 1-4
6. Errico R.M., and Baumhefner D.P. Predictability experiments using a high-resolution limited-area model. Mon. Weather Rev. 115 (1987) 488-504
7. Hillier F.S., and Lieberman G.J. Introduction to Operations Research. 3rd ed. (1980), Holden-Day, San Francisco
8. Ikeda K. Multiple-valued stationary state and its instability of the transmitted light by a ring cavity system. Opt. Commun. 30 (1979) 257
9. Judd K. Nonlinear state estimation, indistinguishable states and the extended Kalman filter. Physica D 183 (2003) 273-281
10. K. Judd, Shadowing pseudo-orbits and gradient descent noise reduction, J. Nonlinear Sci. (2007) (in press)
11. Judd K. Failure of maximum likelihood methods for chaotic dynamical systems. Physical Rev. E 75 (2007) 036210
12. K. Judd, C.A. Reynolds, T. Rosmond, Toward shadowing in operational weather prediction, Technical Report NRL/MR/7530-04-18, Naval Research Laboratory, Monterey, CA, 93943-5502 USA, 2004
13. Judd K., and Smith L.A. Indistinguishable states I: Perfect model scenario. Physica D 151 (2001) 125-141
14. Judd K., and Smith L.A. Indistinguishable states II: Imperfect model scenarios. Physica D 196 (2004) 224-242
15. Judd K., Smith L.A., and Weisheimer A. Gradient free descent: Shadowing and state estimation with limited derivative information. Physica D 190 (2004) 153-166
16. Katok A., and Hasselblatt B. Introduction to the modern theory of dynamical systems. Encyclopedia of Mathematics and its Applications vol. 54 (1995), Cambridge University Press
17. Lorenz E.N. Deterministic nonperiodic flow. J. Atmospheric. Sci. 20 (1963) 130-141
18. Molteni F., Buizza R., Palmer T.N., and Petroliagis T. The ECMWF ensemble prediction system: Methodology and validation. Q. J. R. Meteorol. Soc. 122 (1996) 73-120
19. Nazareth J.L. Differentiable optimization and equation solving. Canadian Mathematical Society Books in Mathematics (2003), Springer
20. Palmer T. Predicting uncertainty in forecasts of weather and climate. Rep. Progr. Phys. 63 (2000) 71-116
21. Palmer T.N., Buizza R., Molteni F., Chen Y.-C., and Corti S. Singular vectors and the predictability of weather and climate. Phil. Trans. R. Soc. Lond. A 348 1688 (1994) 459-475
22. Press W.H., Flannery B.P., Teukolsky S.A., and Vetterling W.T. Numerical Recipes in C (1988), Cambridge University Press, Cambridge
23. Ridout D., and Judd K. Convergence properties of gradient descent noise reduction. Physica D 165 (2001) 27-48
24. L.A. Smith, Accountability and error in ensemble forecasting, in: Predictability, in: ECMWF Seminar Proceedings, vol. 1, Shinfield Park, Reading, Berkshire, 1995, pp. 351-369. RG29ax, September 95, 1995. ECMWF
25. Smith L.A. Disentangling uncertainty and error: On the predictability of nonlinear systems. In: Mees A.I. (Ed). Nonlinear Dynamics and Statistics (2000), Birkhauser, Boston 31-64
26. Toth Z., and Kalnay E. Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteorol. Soc. 74 12 (1993) 2317-2330
27. Toth Z., and Kalnay E. Ensemble forecasting at NCEP and the breeding vector method. Mon. Weather Rev. 125 (1997) 3297-3319