Controlling model error of underdamped forecast models in sparse observational networks using a variance-limiting Kalman filter

Quarterly Journal of the Royal Meteorological Society

Volumn 139, Issue 670, 2013, Pages 212-225

  Mitchell, Lewis ^a   Gottwald, Georg A ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Data assimilation; Ensemble Kalman filter; Lorenz 96; Model error

Indexed keywords

ANALYSIS SKILLS; CLIMATOLOGICAL INFORMATION; DATA ASSIMILATION; ENSEMBLE KALMAN FILTER; FORECAST MODEL; LORENZ-96; MODEL ERRORS; OBSERVATION INTERVAL; STATISTICAL PROPERTIES;

EXTRATERRESTRIAL ATMOSPHERES; METEOROLOGY;

KALMAN FILTERS;

CLIMATOLOGY; ENSEMBLE FORECASTING; ERROR ANALYSIS; KALMAN FILTER; MODELING; OBSERVATIONAL METHOD;

EID: 84873319845     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.1968     Document Type: Article

References (54)

1. Anderson JL. 1996. A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate 9: 1518-1530.
2. Anderson JL. 2001. An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 129: 2884-2903.
3. Anderson JL, Anderson SL. 1999. A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Mon. Weather Rev. 127: 2741-2758.
4. Bengtsson L, Arkin P, Berrisford P, Bougeault P, Folland CK, Gordon C, Haines K, Hodges KI, Jones P, Kållberg P, Rayner N, Simmons A, Stammer D, Thorne PW, Uppala S, Vose RS. 2007. The need for a dynamical climate reanalysis. Bull. Amer. Meteorol. Soc. 88: 495-501.
5. Bergemann K, Gottwald GA, Reich S. 2009. Ensemble propagation and continuous matrix factorization algorithms. Q. J. R. Meteorol. Soc. 135: 1560-1572.
6. Bishop CH, Etherton BJ, Majumdar SJ. 2001. Adaptive sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical aspects. Mon. Weather Rev. 129: 420-436.
7. Blumen W. 1990. A semi-geostrophic Eady-wave frontal model incorporating momentum diffusion. Part II: Kinetic energy and enstrophy dissipation. J. Atmos. Sci. 47: 2903-2908.
8. Buizza R, Houtekamer PL, Pellerin G, Toth Z, Zhu Y, Wei M. 2005. A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Weather Rev. 133: 1076-1097.
9. Burgers G, van Leeuwen PJ, Evensen G. 1998. Analysis scheme in the ensemble Kalman filter. Mon. Weather Rev. 126: 1719-1724.
10. Charron M, Pellerin G, Spacek L, Houtekamer PL, Gagnon N, Mitchell HL, Michelin L. 2010. Toward random sampling of model error in the Canadian ensemble prediction system. Mon. Weather Rev. 138: 1877-1901.
11. Compo GP, Whitaker JS, Sardeshmukh PD, Matsui N, Allan RJ, Yin X, Gleason Jr BE, Vose RS, Rutledge G, Bessemoulin P, Brönnimann S, Brunet M, Crouthamel RI, Grant AN, Groisman PY, Jones PD, Kruk MC, Kruger AC, Marshall GJ, Maugeri M, Mok HY, Nordli Ø, Ross TF, Trigo RM, Wang XL, Woodruff SD, Worley SJ. 2011. The Twentieth Century reanalysis project. Q. J. R. Meteorol. Soc. 137: 1-28.
12. Côté J, Staniforth A. 1988. A two-time-level semi-Lagrangian semi-implicit scheme for spectral models. Mon. Weather Rev. 116: 2003-2016.
13. Dee DP, Da Silva AM. 1998. Data assimilation in the presence of forecast bias. Q. J. R. Meteorol. Soc. 124: 269-295.
14. Dee DP, Todling R. 2000. Data assimilation in the presence of forecast bias: The GEOS moisture analysis. Mon. Weather Rev. 128: 3268-3282.
15. Dubinkina S, Frank J. 2007. Statistical mechanics of Arakawa's discretizations. J. Comput. Phys. 227: 1286-1305.
16. Dubinkina S, Frank J. 2010. Statistical relevance of vorticity conservation in the Hamiltonian particle-mesh method. J. Comput. Phys. 229: 2634-2648.
17. Durran DR. 1999. Numerical Methods for Wave Equations in Geophysical Fluid Dynamics. Springer: New York, NY.
18. Eckermann SD, Hoppel KW, Coy L, McCormack JP, Siskind DE, Nielsen K, Kochenash A, Stevens MH, Englert CR, Singer W, Hervig M. 2009. High-altitude data assimilation system experiments for the northern summer mesosphere season 2007. J. Atmos. Solar-Terrest. Phys. 71: 531-551.
19. Evensen G. 1994. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 99C5 10143-10162.
20. Evensen G. 2006. Data Assimilation: The Ensemble Kalman Filter. Springer: New York, NY.
21. Fisher M, Leutbecher M, Kelly GA. 2005. On the equivalence between Kalman smoothing and weak-constraint four-dimensional variational data assimilation. Q. J. R. Meteorol. Soc. 131: 3235-3246.
22. Frederiksen JS, Davies AG. 1997. Eddy viscosity and stochastic backscatter parameterizations on the sphere for atmospheric circulation models. J. Atmos. Sci. 54: 2475-2492.
23. Golub GH, Loan CFV. 1996. Matrix Computations. The Johns Hopkins University Press: Baltimore, MD.
24. Gottwald GA, Mitchell L, Reich S. 2011. Controlling overestimation of error covariance in ensemble Kalman filters with sparse observations: A variance limiting Kalman filter. Mon. Weather Rev. 139: 2650-2667.
25. Grote MJ, Majda AJ. 2006. Stable time filtering of strongly unstable spatially extended systems. Proc. Nat. Acad. Sci. 103: 7548-7553.
26. Hamill TM, Colucci SJ. 1997. Verification of Eta/RSM short-range ensemble forecasts. Mon. Weather Rev. 125: 1312-1327.
27. Hamill TM, Whitaker JS. 2011. What constrains spread growth in forecasts initialized from ensemble Kalman filters. Mon. Weather Rev. 139: 117-131.
28. Houtekamer PL, Mitchell HL. 1998. Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev. 126: 796-811.
29. Houtekamer PL, Mitchell HL, Pellerin G, Buehner M, Charron M, Spacek L, Hansen B. 2005. Atmospheric data assimilation with an ensemble Kalman filter: Results with real observations. Mon. Weather Rev. 133: 604-620.
30. Kalnay E. 2002. Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press: Cambridge, UK.
31. Leimkuhler B, Reich S. 2005. Simulating Hamiltonian Dynamics. Cambridge University Press: Cambridge, UK.
32. Liu J, Fertig EJ, Li H, Kalnay E, Hunt BR, Kostelich EJ, Szunyogh I, Todling R. 2008. Comparison between local ensemble transform Kalman filter and PSAS in the NASA finite volume GCM-perfect model experiments. Nonlinear Proc. Geophys. 15: 645-659.
33. Lorenz EN. 1996. Predictability-a problem partly solved. In: Proceedings of Seminar on Predictability, 4-8 September 1995. ECMWF: Reading, UK.
34. Majda AJ, Timofeyev I, Vanden Eijnden E. 1999. Models for stochastic climate prediction. Proc. Nat. Acad. Sci. 96: 14687-14691.
35. Mitchell L, Gottwald GA. 2012. Data assimilation in slow-fast systems using homogenized climate models. J. Atmos. Sci. 69: 1359-1377.
36. Molteni F, Palmer TN. 1993. Predictability and finite-time instability of the northern winter circulation. Q. J. R. Meteorol. Soc. 119: 269-298.
37. Ott E, Hunt B, Szunyogh I, Zimin A, Kostelich E, Corrazza M, Kalnay E, Yorke J. 2004. A local ensemble Kalman filter for atmospheric data assimilation. Tellus A 56: 415-428.
38. Palmer TN, Williams P (eds). 2010. Stochastic physics and climate modelling. Cambridge University Press: Cambridge, UK.
39. Palmer TN. 2001. A nonlinear dynamical perspective on model error: A proposal for non-local stochastic-dynamic parametrization in weather and climate prediction models. Q. J. R. Meteorol. Soc. 127: 279-304.
40. Polavarapu S, Shepherd TG, Rochon Y, Ren S. 2005. Some challenges of middle atmosphere data assimilation. Q. J. R. Meteorol. Soc. 131: 3513-3527.
41. Ritchie H. 1988. Application of the semi-Lagrangian method to a spectral model of the shallow-water equations. Mon. Weather Rev. 116: 1587-1598.
42. Salmon R. 1998. Lectures on Geophysical Fluid Dynamics. Oxford University Press: New York, NY.
43. Sankey D, Ren S, Polavarapu S, Rochon Y, Nezlin Y, Beagley S. 2007. Impact of data assimilation filtering methods on the mesosphere. J. Geophys. Res. 112D24 104-118.
44. Shutts GJ. 2005. A stochastic kinetic energy backscatter algorithm for use in ensemble prediction systems. Q. J. R. Meteorol. Soc. 131: 3079-3102.
45. Simon DJ. 2006. Optimal State Estimation. John Wiley & Sons: New York, NY.
46. Skamarock WC, Klemp JB. 1992. The stability of time-split numerical methods for the hydrostatic and the nonhydrostatic elastic equations. Mon. Weather Rev. 120: 2109-2127.
47. Takacs LL. 1996. 'A simple bias correction algorithm for use in data assimilation'. DAO Office Note 96-25. Goddard Space Flight Center: Greenbelt, MD.
48. Talagrand O, Vautard R, Strauss B. 1997. Evaluation of probabilistic prediction systems. In: Proceedings of the Workshop on Predictability. ECMWF: Reading, UK.
49. Thuburn J. 2008. Some conservation issues for the dynamical cores of NWP and climate models. J. Comput. Phys. 227 3715-3730.
50. Tippett MK, Anderson JL, Bishop CH, Hamill TM, Whitaker JS. 2003. Ensemble square root filters. Mon. Weather Rev. 131 1485-1490.
51. Toth Z, Kalnay E. 1993. Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteorol. Soc. 74: 2317-2330.
52. Wang X, Bishop CH, Julier SJ. 2004. Which is better, an ensemble of positive-negative pairs or a centered spherical simplex ensemble? Mon. Weather Rev. 132: 1590-1505.
53. Whitaker JS, Compo GP, Wei X, Hamill TM. 2004. Reanalysis without radiosondes using ensemble data assimilation. Mon. Weather Rev. 132: 1190-1200.
54. Whitaker JS, Compo GP, Thépaut J-N. 2009. A comparison of variational and ensemble-based data assimilation systems for reanalysis of sparse observations. Mon. Weather Rev. 137: 1991-1999.