An ensemble-based smoother with retrospectively updated weights for highly nonlinear systems

Monthly Weather Review

Volumn 135, Issue 1, 2007, Pages 186-202

  Chin, T Mike ^a   Turmon, M J ^a   Jewell, J B ^a   Ghil, M ^b,c,d  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; DATA PROCESSING; KALMAN FILTERING; MARKOV PROCESSES; MONTE CARLO METHODS; PROBABILITY DISTRIBUTIONS;

DOUBLE-WELL POTENTIAL; ENSEMBLE KALMAN FILTER; NON-GAUSSIAN DISTRIBUTIONS; RESAMPLED PARTICLE FILTER; TRIVARIATE LORENZ SYSTEMS;

NONLINEAR SYSTEMS;

ALGORITHM; DATA ASSIMILATION; ESTIMATION METHOD; KALMAN FILTER; MONTE CARLO ANALYSIS; NUMERICAL METHOD; NUMERICAL MODEL; PROBABILITY;

EID: 33846652430     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/MWR3353.1     Document Type: Article

References (50)

1. Alexander, F. J., G. L. Eyink, and J. M. Restrepo, 2005: Accelerated Monte Carlo for optimal estimation of time series. J. Stat. Phys., 119, 1331-1345.
2. Anderson, J. L., and S. L. Anderson, 1999: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Mon. Wea. Rev., 127, 2741-2758.
3. Balgovind, R., A. Dalcher, M. Ghil, and E. Kalnay, 1983: A stochastic-dynamic model for the spatial structure of forecast error statistics. Mon. Wea. Rev., 111, 701-722.
4. Bengtsson, T., C. Snyder, and D. Nychka, 2003: Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res., 108, 8775, doi:10.1029/2002JD002900.
5. Bennett, A. F., 1992: Inverse Methods in Physical Oceanography. Cambridge University Press, 346 pp.
6. Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719-1724.
7. Cohn, S. E., N. S. Sivakumaran, and R. Todling, 1994: A fixed-lag Kalman smoother for retrospective data assimilation. Mon. Wea. Rev., 122, 2838-2867.
8. Crisan, D., 2001: Particle filters - A theoretical perspective. Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds., Springer, 17-41.
9. Daley, R., 1991: Atmospheric Data Analysis. Cambridge University Press, 457 pp.
10. Doucet, A., S. J. Godsill, and C. Andrieu, 2000: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput., 10, 197-208.
11. Doucet, A., N. de Freitas, and N. Gordon, Eds., 2001: Sequential Monte Carlo Methods in Practice. Springer-Verlag, 581 pp.
12. Ehrendorfer, M., and J. J. Tribbia, 1997: Optimal prediction of forecast error covariances through singular vectors. J. Atmos. Sci., 54, 286-313.
13. Errico, R. M., 1997: What is an adjoint model? Bull. Amer. Meteor. Soc., 78, 2557-2591.
14. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res., 99, 10 143-10 162.
15. Evensen, G., 2003: The Ensemble Kalman Filter: Theoretical formulation and practical implementation. Ocean Dyn., 53, 343-367.
16. Evensen, G., and P. J. van Leeuwen, 2000: An ensemble Kalman smoother for nonlinear dynamics. Mon. Wea. Rev., 128, 1852-1867.
17. Eyink, G. L., and J. M. Restrepo, 2000: Most probable histories for nonlinear dynamics: Tracking climate transitions. J. Stat. Phys., 101, 459-472.
18. Gelb, A., 1974: Applied Optimal Estimation. MIT Press, 374 pp.
19. Ghil, M., 1997: Advances in sequential estimation for atmospheric and oceanic flows. J. Meteor. Soc. Japan, 75, 289-304.
20. Gilks, W. R., S. Richardson, and D. J. Spiegelhalter, 1996: Introducing Markov chain Monte Carlo. Markov Chain Monte Carlo in Practice, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds., Chapman and Hall, 1-19.
21. Godsill, S. J., and T. Clapp, 2001: Improvement strategies for Monte Carlo particle filters. Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds., Springer-Verlag, 139-158.
22. Godsill, S. J., A. Doucet, and M. West, 2004: Monte Carlo smoothing for nonlinear time series. J. Amer. Stat. Assoc., 99, 156-168.
23. Haario, H., M. Laine, M. Lehtinen, E. Saksman, and J. Tamminen, 2004: Markov chain Monte Carlo methods for high dimensional inversion in remote sensing. J. Roy. Stat. Soc., 66B, 591-607.
24. Hastings, W. K., 1970: Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
25. Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
26. Hürzeler, M., and H. R. Künsch, 1998: Monte Carlo approximations for general state space models. J. Comput. Graph. Stat., 7, 175-193.
27. Jazwinski, A. H., 1970: Stochastic Processes and Filtering Theory. Academic Press, 376 pp.
28. Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 341 pp.
29. Keppenne, C. L., and M. M. Rienecker, 2002: Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model. Mon. Wea. Rev., 130, 2951-2965.
30. Kim, S., G. L. Eyink, J. M. Restrepo, F. J. Alexander, and G. Johnson, 2003: Ensemble filtering for nonlinear dynamics. Mon. Wea. Rev., 131, 2586-2594.
31. Kitagawa, G., 1996: Monte Carlo filter and smoother for non-Gaussian nonlinear state space models. J. Comput. Graph. Stat., 5, 1-25.
32. Lawson, W. G., and J. A. Hansen, 2004: Implications of stochastic and deterministic filters as ensemble-based data assimilation methods in varying regimes of error growth. Mon. Wea. Rev., 132, 1966-1981.
33. Liu, J. S., and R. Chen, 1998: Sequential Monte Carlo methods for dynamic systems. J. Amer. Stat. Assoc., 93, 1032-1044.
34. Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130-141.
35. McLachlan, G., and D. Peel, 2000: Finite Mixture Models. Wiley, 419 pp.
36. Metropolis, N., A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, 1953: Equation of state calculations by fast computing machines. J. Chem. Phys., 21, 1087-1092.
37. Miller, R. N., and L. L. Ehret, 2002: Ensemble generation for models of multimodel systems. Mon. Wea. Rev., 130, 2313-2333.
38. Miller, R. N., M. Ghil, and F. Gauthiez, 1994: Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci., 51, 1037-1056.
39. Miller, R. N., E. F. Carter, and S. T. Blue, 1999: Data assimilation into nonlinear stochastic models. Tellus, 51A, 167-194.
40. Molteni, F., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The ECMWF ensemble prediction system: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73-119.
41. Ott, E., and Coauthors, 2004: A local ensemble Kalman filter for atmospheric data assimilation. Tellus, 56A, 415-428.
42. Pham, D. T., 2001: Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Wea. Rev., 129, 1194-1207.
43. Robert, C. P., and G. Casella, 2005: Monte Carlo Statistical Methods. 2d ed. Springer, 645 pp.
44. Tierney, L., 1996: Introduction to general state-space Markov chain theory. Markov Chain Monte Carlo in Practice, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds., Chapman and Hall, 59-74.
45. Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74, 2317-2330.
46. Turmon, M., J. Pap, and S. Mukhtar, 2002: Statistical pattern recognition for labeling solar active regions: Application to SoHO/MDI imagery. Astrophys. J., 568, 396-407.
47. van Leeuwen, P. J., 2003: A variance-minimizing filter for large-scale applications. Mon. Wea. Rev., 131, 2071-2084.
48. van Leeuwen, P. J., and G. Evensen, 1996: Data assimilation and inverse methods in terms of a probabilistic formulation. Mon. Wea. Rev., 124, 2898-2913.
49. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913-1924.
50. Wunsch, C., 1996: The Ocean Circulation Inverse Problem. Cambridge University Press, 437 pp.