Mathematical strategies for filtering complex systems: Regularly spaced sparse observations

Journal of Computational Physics

Volumn 227, Issue 10, 2008, Pages 5304-5341

  Harlim, J ^a   Majda, A J ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Data assimilation; Finite difference; Kalman filter; Turbulence

Indexed keywords

BANDPASS FILTERS; EQUIPMENT TESTING; FOURIER SERIES; KALMAN FILTERS; MESH GENERATION; REAL TIME SYSTEMS; STOCHASTIC SYSTEMS;

DATA ASSIMILATION; ENERGY SPECTRUM; FILTER PERFORMANCE; FILTERING PROBLEMS; FINITE DIFFERENCE; FOURIER-DOMAIN; OFFLINE TEST; REAL TIME FILTERING; TEST BED; TEST CRITERIA;

TURBULENCE;

EID: 41249100391     PISSN: 00219991     EISSN: 10902716     Source Type: Journal    
DOI: 10.1016/j.jcp.2008.01.049     Document Type: Article

References (33)

1. Anderson B., and Moore J. Optimal Filtering (1979), Prentice-Hall, Englewood Cliffs, NJ
2. Anderson J. An ensemble adjustment Kalman filter for data assimilation. Monthly Weather Review 129 (2001) 2884-2903
3. Anderson J. A local least squares framework for ensemble filtering. Monthly Weather Review 131 4 (2003) 634-642
4. Anderson J., and Anderson S. A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Monthly Weather Review 127 (1999) 2741-2758
5. Bishop C., Etherton B., and Majumdar S. Adaptive sampling with the ensemble transform Kalman filter part I: the theoretical aspects. Monthly Weather Review 129 (2001) 420-436
6. Castronovo E., Harlim J., and Majda A. Mathematical test criteria for filtering complex systems: plentiful observations. Journal of Computational Physics 227 7 (2008) 3678-3714
7. Chorin A., and Krause P. Dimensional reduction for a bayesian filter. Proceedings of the National Academy of Sciences 101 42 (2004) 15013-15017
8. Chui C., and Chen G. Kalman Filtering (1999), Springer, New York
9. Cohn S., and Dee D. Observability of discretized partial differential equations. SIAM Journal on Numerical Analysis 25 3 (1988) 586-617
10. Farrell B., and Ioannou P. State estimation using a reduced-order Kalman filter. Journal of the Atmospheric Sciences 58 23 (2001) 3666-3680
11. Farrell B., and Ioannou P. Distributed forcing of forecast and assimilation error systems. Journal of the Atmospheric Sciences 62 2 (2005) 460-475
12. Gardiner C. Handbook of Stochastic Methods for Physics, Chemistry, and the Natural Sciences (1997), Springer-Verlag, New York
13. Ghil M., and Malanotte-Rizolli P. Data assimilation in meteorology and oceanography. Advances in Geophysics 33 (1991) 141-266
14. Grote M., and Majda A. Stable time filtering of strongly unstable spatially extended systems. Proceedings of the National Academy of Sciences 103 (2006) 7548-7553
15. Harlim J., and Hunt B. A non-Gaussian ensemble filter for assimilating infrequent noisy observations. Tellus A 59 2 (2007) 225-237
16. Harlim J., and Hunt B. Four-dimensional local ensemble transform Kalman filter: numerical experiments with a global circulation model. Tellus A 59 5 (2007) 731-748
17. J. Harlim, A. Majda, Filtering nonlinear dynamical systems with linear stochastic models, Nonlinearity, submitted for publication.
18. Haven K., Majda A., and Abramov R. Quantifying predictability through information theory: small sample estimation in a non-gaussian framework. Journal of Computational Physics 206 (2005) 334-362
19. Hesthaven J., Gottlieb S., and Gottlieb D. Spectral Methods for Time-dependent Problems. Cambridge Monographs on Applied and Computational Mathematics vol. 21 (2007), Cambridge University Press, Cambridge, UK
20. Houtekamer P., and Mitchell H. Data assimilation using an ensemble Kalman filter technique. Monthly Weather Review 126 (1998) 796-811
21. Hunt B., Kostelich E., and Szunyogh I. Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter. Physica D 230 (2007) 112-126
22. Kaipio J., and Somersalo E. Statistical and Computational Inverse Problems (2005), Springer, New York
23. E. Lorenz, Predictability - a problem partly solved, in: Proceedings on predictability, held at ECMWF on 4-8 September 1995, 1996.
24. Majda A., Abramov R., and Grote M. Information Theory and Stochastics for Multiscale Nonlinear Systems. CRM Monograph Series vol. 25 (2005), American Mathematical Society, Providence, RI, USA
25. Majda A., and Grote M. Explicit off-line criteria for stable accurate time filtering of strongly unstable spatially extended systems. Proceedings of the National Academy of Sciences 104 (2007) 1124-1129
26. Majda A., McDonough J., and Osher S. The Fourier method for nonsmooth initial data. Mathematics of Computation 32 144 (1978) 1041-1081
27. Majda A., and Wang X. Nonlinear Dynamics and Statistical Theories for Basic Geophysical Flows (2006), Cambridge University Press, UK
28. Miller R., Carter E., and Blue S. Data assimilation into nonlinear stochastic models. Tellus A 51 2 (1999) 167-194
29. Ott E., Hunt B., Szunyogh I., Zimin A., Kostelich E., Corrazza M., Kalnay E., and Yorke J. A local ensemble Kalman filter for atmospheric data assimilation. Tellus A 56 (2004) 415-428
30. Richtmeyer R., and Morton K. Difference Methods for Initial Value Problems (1967), Wiley
31. Todling R., and Ghil M. Tracking atmospheric instabilities with the kalman filter. Part I: methodology and one-layer results. Monthly Weather Review 122 1 (1994) 183-204
32. Wang X., Bishop C., and Julier S. Which is better, an ensemble of positive-negative pairs or a centered spherical simplex ensemble?. Monthly Weather Review 132 7 (2004) 1590-1605
33. Whitaker J., and Hamill T. Ensemble data assimilation without perturbed observations. Monthly Weather Review 130 (2002) 1913-1924