A mechanism for catastrophic filter divergence in data assimilation for sparse observation networks

Nonlinear Processes in Geophysics

Volumn 20, Issue 5, 2013, Pages 705-712

  Gottwald, G A ^a   Majda, A J ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ASSIMILATION; FORECASTING METHOD; NUMERICAL MODEL;

EID: 84897437006     PISSN: 10235809     EISSN: 16077946     Source Type: Journal    
DOI: 10.5194/npg-20-705-2013     Document Type: Article

References (31)

1. Abramov, R. V. and Majda, A. J.: New Approximations and Tests of Linear Fluctuation-Response for Chaotic Nonlinear Forced-Dissipative Dynamical Systems. J. Nonlin. Sci., 18, 303-341, 2006.
2. Anderson, J. L.: An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev., 129, 2884-2903, 2001.
3. Anderson, J. L. and Anderson, S. L.: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts, Mon. Weather Rev., 127, 2741-2758, 1999.
4. Bergemann, K., Gottwald, G. A., and Reich, S.: Ensemble propagation and continuous matrix factorization algorithms. Q. J. Roy. Meteorol. Soc., 135, 1560-1572, 2009.
5. Ehrendorfer, M.: A review of issues in ensemble-based Kalman filtering, Meteorol. Z., 16, 795-818, 2007.
6. Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics, J. Geophys. Res., 99, 10143-10162, 1994.
7. Evensen, G.: Data Assimilation: The Ensemble Kalman Filter. Springer, New York, 2006.
8. Gaspari, G. and Cohn, S. E.: Construction of correlation functions in two and three dimensions. Q. J. Roy. Meteorol. Soc., 125, 723-757, 1999.
9. Gottwald, G. A., Mitchell, L., and Reich, S.: Controlling overes-timation of error covariance in ensemble Kalman filters with sparse observations: A variance limiting Kalman filter, Mon. Weather Rev., 139, 2650-2667, 2011.
10. Hamill, T. M., Whitaker, J. S., and Snyder, C.: Distance-dependent filtering of background covariance estimates in an ensemble Kalman filter, Mon. Weather Rev., 129, 2776-2790, 2001.
11. Harlim, J. and Majda, A. J.: Catastrophic filter divergence in filtering nonlinear dissipative systems, Communications in Mathematical Sciences, 8, 27-43, 2010.
12. Houtekamer, P. L. and Mitchell, H. L.: Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev., 126, 796-811, 1998.
13. Houtekamer, P. L. and Mitchell, H. L.: A sequential ensemble Kalman filter for atmospheric data assimilation, Mon. Weather Rev., 129, 123-136, 2001.
14. Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, Cambridge, 2001.
15. Keating, S. R., Majda, A. J., and Smith, K. S.: New methods for estimating ocean eddy heat transport using satellite altimetry, Mon. Weather Rev., 140, 1703-1722, 2012.
16. Liu, J., Fertig, E. J., Li, H., Kalnay, E., Hunt, B. R., Kostelich, E. J., Szunyogh, I., and Todling, R.: Comparison between Local Ensemble Transform Kalman Filter and PSAS in the NASA finite volume GCM - perfect model experiments, Nonlin. Processes Geophys., 15, 645-659, doi:10.5194/npg-15-645-2008, 2008.
17. Lorenz, E. N.: Predictability - a problem partly solved, edited by: Palmer, T., in: Predictability, European Centre for Medium-Range Weather Forecast, Shinfield Park, Reading, UK, 1996.
18. Majda, A. J. and Harlim, J.: Filtering Complex Turbulent Systems, Cambridge University Press, Cambridge, 2012.
19. Mitchell, L. and Gottwald, G. A.: Controlling model error of under-damped forecast models in sparse observational networks using a variance-limiting kalman filter, Q. J. Roy. Meteorol. Soc., 139, 212-225, 2012.
20. Ng, G.-H. C., McLaughlin, D., Entekhabi, D., and Ahanin, A.: The role of model dynamics in ensemble Kalman filter performance for chaotic systems, Tellus A, 63, 958-977, 2011.
21. Patil, D. J., Hunt, B., Kalnay, E., Yorke, J., and Ott, E.: Local low dimensionality of atmospheric dynamics. Phys. Rev. Lett., 86, 5878-5881, 2001.
22. Pazó, D., Rodriguez, M. A., and López, J. M.: Maximizing the statistical diversity of an ensemble of bred vectors by using the geometric norm, J. Atmos. Sci., 68, 1507-1512, 2011.
23. Sacher, W. and Bartello, P.: Sampling errors in ensemble Kalman filtering. Part I: Theory, Mon. Weather Rev., 136, 3035-3049, 2008.
24. Sakov, P. and Oke, P.: A deterministic formulation of the ensemble Kalman filter: An alternative to ensemble square root filters, Tellus A, 60, 415-428, 2008.
25. Schuster, H. G. and Just, W.: Deterministic Chaos: An Introduction. John Wiley & Sons, 4th edition, 2005.
26. Simon, D. J.: Optimal State Estimation, John Wiley & Sons, Inc., New York, 2006.
27. Stuart, A. M. and Humphries, A.: Dynamical Systems and Numerical Analysis, Cambridge University Press, Cambridge, 1996.
28. Tippett, M. K., Anderson, J. L., Bishop, C. H., Hamill, T. M., and Whitaker, J. S.: Ensemble square root filters, Mon. Weather Rev., 131, 1485-1490, 2003.
29. Wang, X., Bishop, C. H., and Julier, S. J.: Which is better, an ensemble of positive-negative pairs or a centered spherical simplex ensemble?, Mon. Weather Rev., 132, 1590-1505, 2004.
30. Whitaker, J. S., Compo, G. P., Wei, X., and Hamill, T. M.: Reanaly-sis without radiosondes using ensemble data assimilation. Mon. Weather Rev., 132, 1190-1200, 2004.
31. Whitaker, J. S., Compo, G. P., and Thépaut, J. N.: A comparison of variational and ensemble-based data assimilation systems for re-analysis of sparse observations. Mon. Weather Rev., 137, 1991-1999, 2009.