Mathematical strategies for filtering turbulent dynamical systems

Discrete and Continuous Dynamical Systems

Volumn 27, Issue 2, 2010, Pages 441-486

  Majda, Andrew J ^a   Harlim, John ^b   Gershgorin, Boris ^a  

^a NEW YORK UNIVERSITY   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Data assimilation; Filtering turbulent systems; Kalman filter; Model error; Stochastic parameter estimation

Indexed keywords

EID: 77953299631     PISSN: 10780947     EISSN: None     Source Type: Journal    
DOI: 10.3934/dcds.2010.27.441     Document Type: Article

References (70)

1. B. Anderson and J. Moore, "Optimal Filtering," Prentice-Hall Englewood Cliffs, NJ, 1979.
2. J. Anderson, An ensemble adjustment Kalman filter for data assimilation, Monthly Weather Review, 129 (2001), 2884-2903.
3. J. Anderson, A local least squares framework for ensemble filtering, Monthly Weather Review, 131 (2003), 634-642.
4. J. Anderson, An adaptive covariance inflation error correction algorithm for ensemble filters, Tellus A, 59 (2007), 210-224.
5. S.-J. Bask, B. Hunt, E. Kalnay, E. Ott and I. Szunyogh , Local ensemble Kalman filtering in the presence of model bias, Tellus A, 58 (2006), 293-306.
6. A. Bain and D. Crisan, "Fundamentals of Stochastic Filtering," Springer, New York, 2009.
7. T. Bengtsson, P. Bickel and B. Li, Curse of dimensionailty revisited: Collapse of the particle filter in very large scale systems, in "IMS Lecture Notes-Monograph Series in Probability and Statistics: Essays in Honor of David A. Freedman" (eds D. Nolan and T. Speed), 2, Institute of Mathematical Sciences, (2008), 316-334.
8. L. Berliner, R. Milliff and C. Wikie, Bayesian hierarchical modeling of air-sea interaction, Journal of Geophysical Research, 108 (2003), 3104-3120.
9. P. Bickel, B. Li and T. Bengtsson, Sharp failure rates for the bootstrap filter in high dimensions, in "IMS Lecture Notes-Monograph Series: Essays in Honor of J.K. Gosh," 3, Institute of Mathematical Sciences, (2008), 318-329.
10. C. Bishop, B. Etherton and S. Majumdar, Adaptive sampling with the ensemble transform Kalman filter part I: The theoretical aspects, Monthly Weather Review, 129 (2001), 420-436.
11. E. Castronovo, J. Harlim and A. Majda, Mathematical criteria for filtering complex systems: Plentiful observations, Journal of Computational Physics, 227 (2008), 3678-3714.
12. A. Charin and P. Krause, Dimensional reduction for a Bayesian filter, Proceedings of the National Academy of Sciences, 101 (2004), 15013-15017.
13. C. Chui and G. Chen, "Kalman Filtering," Springer, New York, 1999.
14. S. Cohn and D. Dee, Observability of discretized partial differential equations, SIAM Journal on Numerical Analysis, 25 (1988), 586-617.
15. S. Cohn and S. Parrish, The behavior of forecast error covariances for a Kalman filter in two dimensions, Monthly Weather Review, 119 (1991), 1757-1785.
16. R. Daley, "Atmospheric Data Analysis," Cambridge University Press, New York, 1991.
17. D. Dee and A. D. Silva, Data assimilation in the presence of forecast bias, Quarterly Journal of the Royal Meteorological Society, 124 (1998), 269-295.
18. D. Dee and R. Todling, Data assimilation in the presence of forecast bias: The GEOS moisture analysis, Monthly Weather Review, 128 (2000), 3268-3282.
19. T. Delsole, Stochastic model of quasigeostrophic turbulence, Surveys in Geophysics, 25 (2004), 107-149.
20. P. Embid and A. Majda, Low Froude number limiting dynamics for stably stratified flow with small or fixed Rossby number, Geophys. Astrophys. Fluid Dyn., 87 (1998), 1-50.
21. G. Evensen, The ensemble Kalman filter: Theoretical formulation and practical implementation, Ocean Dynamics, 53 (2003), 343-367.
22. B. Farrell and P. Ioannou, State estimation using a reduced-order Kalman filter, Journal of the Atmospheric Sciences, 58 (2001), 3666-3680.
23. B. Farrell and P. Ioannou, Distributed forcing of forecast and assimilation error systems, Journal of the Atmospheric Sciences, 62 (2005), 460-475.
24. B. Friedland, Treatment of bias in recursive filtering, IEEE Trans. Automat. Contr., AC-14 (1969), 359-367.
25. B. Friedland, Estimating sudden changes of biases in linear dynami systems, IEEE Trans. Automat. Contr., AC-2'T (1982), 237-240.
26. C. Gardiner, "Handbook of Stochastic Methods for Physics, Chemistry, and the Natural Sciences," Springer-Verlag, New York, 1997.
27. B. Gershgorin, J. Harlim and A. J. Majda, Improving filtering and prediction of sparsely observed spatially extended turbulent systems with model errors through stochastic parameter estimation, Journal of Computational Physics, 229 (2010), 31-57.
28. B. Gershgorin, J. Harlim and A. Majda, Test models for improving filtering with model errors through stochastic parameter estimation, Journal of Computational Physics, 229 (2010), 1-31.
29. B. Gershgorin and A. Majda, A nonlinear test model for filtering slow-fast systems, Comm. Math. Sci., 6 (2008), 611-649.
30. B. Gershgorin and A. Majda, Filtering a nonlinear slow-fast system with strong fast forcing, Comm. Math. Sci., 8 (2009), 67-92.
31. M. Ghil and P. Malanotte-Rizolli, Data assimilation in meteorology and oceanography, Advances in Geophysics, 33 (1991), 141-266.
32. M. Grote and A. Majda, Stable time filtering of strongly unstable spatially extended systems, Proceedings of the National Academy of Sciences, 103 (2006), 7548-7553.
33. J. Harlim and B. Hunt, Four-dimensional local ensemble transform Kalman filter: Numerical experiments with a global circulation model, Tellus A, 59 (2007), 731-748.
34. J. Harlim and A. Majda, Filtering nonlinear dynamical systems with linear stochastic models, Nonlinearity, 21 (2008), 1281-1306.
35. J. Harlim and A. Majda, Mathematical strategies for filtering complex systems: Regularly spaced sparse observations, Journal of Computational Physics, 227 (2008), 5304-5341.
36. J. Harlim and A. Majda, Catastrophic filter divergence in filtering nonlinear dissipative systems, Comm. Math. Sci., 8 (2010), 27-43.
37. J. Harlim and A. Majda, Filtering turbulent sparsely observed geophysical flows, Monthly Weather Review, doi: 10. 1175/2009MWR3113. 1, in press (2009).
38. K. Haven, A. Majda and R. Abramov, Quantifying predictability through information theory: Small sample estimation in a non-gaussian framework, Journal of Computational Physics, 206 (2005), 334-362.
39. B. Hunt, E. Kostelich and I. Szunyogh, Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica B, 230 (2007), 112-126.
40. A. Jazwinski, "Stochastic Processes and Filtering Theory," Academic, San Diego, California, 1970.
41. J. Kaipio and E. Somersalo, "Statistical and Computational Inverse Problems," Springer New York, 2005.
42. B. Khouider and A. Majda, A simple multicloud parametrization for convectiuely coupled tropical waves. Part II: Nonlinear simulations, Journal of the Atmospheric Sciences, 64 (2007), 381-400.
43. R. Kleeman and A. Majda, Predictability in a model of geophysical turbulence, Journal of the Atmospheric Sciences, 62 (2005), 2864-2879.
44. R. Klein and A. Majda, Systematic multiscale models for deep convection on mesoscales, Theo. Comp. Fluid Dyn., 20 (2006), 525-551.
45. E. Lorenz, Deterministic nonperiodic flow, Journal of the Atmospheric Sciences, 20 (1963), 130-141.
46. E. Lorenz, Predictability-a problem partly solved, in "Proceedings on Predictability, Held at ECMWF on 4-8 September 1995," (1996), 1-18.
47. E. Lorenz and K. Emanuel, Optimal sites for supplementary weather observations: Simulations with a small model, J. Atmos. Sci., 55 (1998), 399-414.
48. A. Majda, Real world turbulence and modern applied mathematics, in "Mathematics: Frontiers and Perspectives 2000," (2000), International Mathematical Union, 137-151.
49. A. Majda, "Introduction to PDEs and Waves for the Atmosphere and Ocean," vol. 9 of Courant Lecture Notes in Mathematics, American Mathematical Society, 2003.
50. A. Majda, R. Abramov and M. Grote, "Information Theory and Stochastics for Multiscale Nonlinear Systems," CRM Monograph Series v. 25, American Mathematical Society, Providence, Rhode Island, USA, 2005.
51. A. Majda, C. Franzke and B. Khouider, An applied mathematics perspective on stochastic modelling for climate, Philos Ttansact A Math Phys Eng Sci., 366 (2008), 2429-2455.
52. A. Majda, B. Gershgorin and Y. Yuan, Low frequency climate response and fluctuation-dissipation theorems: Theory and practice, Journal of the Atmospheric Sciences, doi: 10. 1175/2009JAS3264. 1, in press (2009).
53. A. Majda and M. Grote, Explicit off-line criteria for stable accurate time filtering of strongly unstable spatially extended systems, Proceedings of the National Academy of Sciences, 104 (2007), 1124-1129.
54. A. Majda and I. Timofeyev, Statistical mechanics for truncations of the Burgers-Hopf equation: A model for intrinsic behavior with scaling, Milan Journal of Mathematics, 70 (2002), 39-96.
55. A. Majda and I. Timofeyev, Low dimensional chaotic dynamics versus intrinsic stochastic chaos: A paradigm model, Physica D, 199 (2004), 339-368.
56. A. Majda, I. Timofeyev and E. Vanden-Eijnden, Models for stochastic climate prediction, Proc. Nat. Acad. Sci., 98 (1999), 15687-15691.
57. A. Majda, I. Timofeyev and E. Vanden-Eijnden, Systematic strategies for stochastic mode reduction in climate, Journal of the Atmospheric Sciences, 60 (2003), 1705-1722.
58. A. Majda and X. Wang, "Nonlinear Dynamics and Statistical Theories for Basic Geophysical Flows," Cambridge University Press, UK, 2006.
59. R. Miller, E. Carter and S. Blue, Data assimilation into nonlinear stochastic models, Tellus A, 51 (1999), 167-194.
60. P. D. Moral, Nonlinear filtering: Interacting particle solutions, Markov processes and related fields, 2 (1996), 555-580.
61. P. D. Moral and J. Jacod, Interacting particle filtering with discrete observation, in "Sequential Monte-Carlo Methods in Practice" (eds. A. Doucet, N. De Freitas and N. Gordon), vol. Statistics for engineering and information science, Springer, (2001), 43-75.
62. T. J. O'Kane and J. S. Frederiksen, Comparison of statistical dynamical, square root and ensemble Kalman filters, Entropy, 10 (2008), 684-721.
63. E. Ott, B. Hunt, I. Szunyogh, A. Zimin, E. Kostelich, M. Corrazza, E. Kalnay and J. Yorke, A local ensemble Kalman filter for atmospheric data assimilation, Tellus A, 56 (2004), 415-428.
64. E. Pitcher, Application of stochastic dynamic prediction to real data, Journal of the Atmospheric Sciences, 34 (1977), 3-21.
65. R. Richtmeyer and K. Morton, "Difference Methods for Initial Value Problems," Wiley, 1967.
66. V. Rossi and J. P. Vila, Nonlinear filtering in discrete time: A particle convolution approach, Ann. Inst. Stat. Univ. Paris, 3 (2006), 71-102.
67. R. Salmon, "Lectures on Geophysical Fluid Dynamics," vol. 378, Oxford University Press, 1998.
68. S. Smith, C. Boccaletti, C. Henning, I. Marinov, C. Tarn, I. Held and G. Vallis, Thrbulent diffusion in the geostropic inverse cascade, Journal of Fluid Mechanics, 469 (2002), 13-48.
69. I. Szunyogh, E. Kostelich, G. Gyarmati, D. Patil, B. Hunt, E. Kalnay, E. Ott and J. Yorke, Assessing a local ensemble Kalman filter: Perfect model experiments with the NCEP global model, Tellus A, 57 (2005), 528-545.
70. R. Todling and M. Ghil, Tacking atmospheric instabilities with the Kalman filter. Part I: Methodology and one-layer results, Monthly Weather Review, 122 (1994), 183-204.