Ensemble Kalman Filter: Application to meteorological data assimilation

IEEE Control Systems

Volumn 29, Issue 3, 2009, Pages 34-46

  Lakshmivarahan, S ^a   Stensrud, David J ^b  

^a UNIVERSITY OF MADRAS   (India)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION METHODS; ATMOSPHERIC MODELING; DATA ASSIMILATION; EQUATIONS; PREDICTIVE MODELS;

APPROXIMATION THEORY; COMPUTER SIMULATION; CONTROL THEORY; DATA PROCESSING; GAS EMISSIONS; GLOBAL WARMING; GREENHOUSE GASES; KALMAN FILTERS; LEAKAGE (FLUID); PREDICTIVE CONTROL SYSTEMS;

MATHEMATICAL MODELS;

EID: 66849104077     PISSN: 1066033X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCS.2009.932225     Document Type: Article

References (107)

1. E. Kalnay, Atmospheric Modeling, Data Assimilation, and Predictability. Cambridge, U.K.: Cambridge Univ. Press, 2003.
2. R. Daley, Atmospheric Data Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1991.
3. J. M. Lewis, S. Lakshmivarahan, and S. Dhall, Dynamic Data Assimilation: A Least Squares Approach. Cambridge, U.K.: Cambridge Univ. Press, 2006.
4. R. S. Bucy and P. D. Joseph, Filtering for Stochastic Processes with Applications to Guidance. Hoboken, NJ: Interscience, 1961.
5. A. H. Jazwinskii, Stochastic Processes and Filtering Theory. New York: Academic, 1970.
6. A. Gelb, Applied Optimal Estimation. Boston, MA: MIT Press, 1974.
7. B. D. O. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice Hall, 1979.
8. P. S. Maybeck, Stochastic Models: Estimation and Control. New York: Academic, vol. 1,1979 and vol. 2,1982.
9. R. S. Bucy, Lectures on Discrete Time Filtering. New York: Springer-Verlag, 1994.
10. D. E. Catlin, Estimation Control and Discrete Kalman Filter. New York: Springer-Verlag, 1989.
11. V. Krishnan, Nonlinear Filtering and Smoothing. Hoboken, NJ: Wiley, 1984.
12. G. Kallianpur, Stochastic Filtering Theory. New York: Springer-Verlag, 1980.
13. H. J. Kushner, “On the differential equations satisfied by the conditional probability densities of Markov processes with applications,” SIAM J. Control, vol. 2, pp. 106–119,1962.
14. M. Zakai, “On optimal filtering of diffusion processes,” Zietschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebiete, vol. 11, pp. 230–243,1969.
15. V. Benes, “Exact finite dimensional filter for certain diffusions with nonlinear drift,” Stochastics, vol. 5, pp. 65–92,1981.
16. F. E. Daum, “New exact nonlinear filters,” in Bayesian Analysis of Time Series and Dynamic Models, J. C. Spall, Ed. New York: Marcel Dekker, 1988, pp. 199–226.
17. J. F. Bennaton, “Discrete Galerkin approximations to nonlinear filtering solution,” J. Math. Anal. Appl., vol. 110, pp. 364–383,1985.
18. F. LeGland, “Time discretization of nonlinear filtering equations,” in Proc. 28th Decision and Control Conf., 1989, pp. 2601–2606.
19. J. E. Handschin and D. Q. Mayne, “Monte Carlo techniques to estimate the conditional expectation in multi-stage nonlinear filtering,” Int. J. Control, vol. 9, pp. 547–559,1969.
20. H. Tanizaki, Nonlinear Filters: Estimation and Applications. New York: Springer-Verlag, 1996.
21. G. Evensen, “Sequential data assimilation with nonlinear quasi-geo-strophic model using Monte Carlo methods for forecast error statistics,” J. Geophys. Res., vol. 99, pp. 10143–10162,1994.
22. G. Evensen, Data Assimilation: The Ensemble Kalman Filter. New York: Springer-Verlag, 2007.
23. G. Kitagawa, “Monte Carlo filter and smoother for non-Gaussian nonlinear state space models,” J. Comput. Graph. Stat., vol. 5, pp. 1–25,1996.
24. S. Julier, J. Uhlmann, and H. F. Durrant-Whyte “A new method for the nonlinear transformation of mean and covariances in filters and estimators,” IEEE Trans. Automat. Contr., vol. 45, pp. 477–482, 2002.
25. N. J. Gordon, D. J. Salmond, and A. F. M. Smith, “Novel approach to nonlinear/non-Gaussian Bayesian state estimation,” Proc. Inst. Elec. Eng., F, vol. 140, pp. 107–113,1993.
26. B. Ristic, S. Arulampalam, and N. Gordon, Beyond Kalman Filter: Particle Filters and Tracking Applications. Boston, MA: Artech House, 2004.
27. S. Haykim, Ed., Kalman Filtering and Neural Networks. Hoboken, NJ: Wiley, 2001.
28. A. Doucet, N. de Freitas, and N. Gordon, Eds., Sequential Monte Carlo Methods in Practice. New York: Springer-Verlag, 2001.
29. J. R. Holton, An Introduction to Dynamic Meteorology. New York: Academic, 2004.
30. E. Lorenz, “Deterministic nonperiodic flow,” J. Atmos. Sci., vol. 20, pp. 130–141,1963.
31. F. Atger, “The skill of ensemble prediction systems,” Month. Weather Rev., vol. 127, pp. 1941–1953,1999.
32. D. J. Stensrud, J.-W. Bao, and T. T. Warner, “Using initial condition and model physics perturbations in short-range ensemble simulations of mesoscale convective systems,” Month. Weather Rev., vol. 128, pp. 2077–2107,2000.
33. A. H. Murphy and R. L. Winkler, “Probabilistic temperature forecasts: The case for an operational program,” Bull. Amer. Meteorol. Soc., vol. 60, pp. 12–19,1979.
34. J. L. Anderson, “Selection of initial conditions for ensemble forecasts in a simple perfect model framework,” J. Atmos. Sci., vol. 53, pp. 22–36,1996.
35. M. Zupanski, S. J. Fletcher, I. M. Navon, B. Uzunoglu, R. P. Heikes, D. A. Randall, T. D. Ringler, and D. Daescu “Initiation of ensemble data assimilation,” Tellus A, vol. 58, pp. 159–170, 2006.
36. N. E. Bowler “Comparison of error breeding, singular vectors, random perturbations and ensemble Kalman filter perturbation strategies on a simple model,” Tellus A, vol. 58, pp. 538–548, 2006.
37. R. J. Doviak and D. S. Zrnic, Doppler Radar and Weather Observations. Mineola, NY: Dover, 1993.
38. L. Garand, D. S. Turner, C. Chouinard, and J. Halle, “A physical formulation of atmospheric transmittances for the massive assimilation of satellite infrared radiances,” J. Appl. Meteorol., vol. 38, pp. 541–554,1999.
39. R. E. Kalman, “A new approach to linear filtering and prediction problems,” Trans. ASME, J. Basic Eng. D, vol. 82, pp. 35–45,1960.
40. R. E. Kalman, and R. S. Bucy, “New results in linear filtering and prediction theory,” Trans. ASME, J. Basic Eng. D, vol. 83, pp. 95–108,1961.
41. T. Kailath, “A view of three decades of linear filtering theory,” IEEE Trans. Inform. Theory, vol. 20, pp. 146–181,1974.
42. C. Canuto, M. Y. Hussaini, A. Quarteroni, and T. A. Zang, Spectral Methods: Fundamentals in Single Domain. New York: Springer-Verlag, 2006.
43. P. Holmes, J. L. Lumley, and G. Berkooz, Turbulence, Coherent Structures, Dynamical Systems and Symmetry. Cambridge, U.K.: Cambridge Univ. Press, 1996.
44. K. Hasselmann, “PIPs and POPs: Reduction of complex dynamical systems using principal interaction and oscillation patterns,” J. Geophys. Res., vol. 93 (D9), pp. 11015–11021,1988.
45. T. DelSole “Optimally persistent patterns in time-varying fields,” J. Atmos. Sci., vol. 58, pp. 1341–1356, 2001.
46. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw Hill, 1984.
47. G. J. Bierman, Factorization Methods for Discrete Sequential Estimation. New York: Academic, 1977.
48. Q. Xu, “Generalized adjoint for physical processes with parameterized discontinuities—Part I: Basic issues and heuristic examples,” J. Atmos. Sci., vol. 53, pp. 1123–1142,1996.
49. Q. Xu and J. Gao, “Generalized adjoint for physical processes with parameterized discontinuities—Part VI: Minimization problems in multidimensional space,” J. Atmos. Sci., vol. 56, pp. 994–1002,1999.
50. S. E. Cohn, M. Ghil, and E. Isaacson, “Optimal interpolation and Kalman filter,” in Proc. 5th Conf. Numerical Weather Prediction, 1981, pp. 36–42.
51. S. E. Cohn and D. F. Parrish, “The behavior of the forecast error covariance for a Kalman filter in two dimensions,” Month. Weather Rev., vol. 119, pp. 1757–1785,1991.
52. S. E. Cohn, A. Da Silva, J. Guo, M. Sienkiewicz, and D. Lamich, “Assessing the effects of data selection with DAO physical-space statistical analysis system,” Month. Weather Rev., vol. 126, pp. 2913–2926,1998.
53. R. Todling and S. E. Cohn, “Suboptimal schemes for atmospheric data assimilation based on the Kalman filter,” Month. Weather Rev., vol. 122, pp. 2530–2557,1994.
54. D. P. Dee, “Simplification of the Kalman filter for meteorological data assimilation,” Q. J. R. Meteorol. Soc., vol. 117, pp. 365–384,1991.
55. S. E. Cohn, “An introduction to estimation theory,” J. Meteorol. Soc. Jpn., vol. 75, pp. 257–288,1997.
56. M. Ghil and P. Malanotte-Rizzoli, “Data assimilation in meteorology and oceanography,” Adv. Geophys., vol. 33, pp. 141–265,1991.
57. R. Dayley and R. Menard, “Spectral characteristics of Kalman filter systems for atmospheric data assimilation systems,” Month. Weather Rev., vol. 121, pp. 1554–1565,1993.
58. M. Verlaan and A. W. Heemink “Nonlinearity in data assimilation: A practical method for analysis,” Month. Weather Rev., vol. 129, pp. 1578–1589, 2001.
59. A. Segers, Data Assimilation in Atmospheric Chemistry Models using Kalman Filtering. Amersterdam, Netherlands: Delft Univ. Press, 2002.
60. W. Wang, C. H. Bishop, and S. J. Julier “Which is better, an ensemble of positive-negative pairs or a centered spherical ensemble?,” Month. Weather Rev., vol. 132, pp. 1590–1605, 2004.
61. P. Sakov and P. R. Oke “Implications of the form of the ensemble transformation in the ensemble square root filters,” Month. Weather Rev., vol. 136, pp. 1042–1053, 2008.
62. G. Burgers, J. van Leeuwen, and G. Evensen, “Analysis scheme in ensemble Kalman filter,” Month. Weather Rev., vol. 126, pp. 1719–1724,1998.
63. P. L. Houtekamer and H. L. Mitchell “Data assimilation using an ensemble Kalman filter technique,” Month. Weather Rev., vol. 126, pp. 796–811, 1998.
64. D. T. Pham “Stochastic methods for sequential data assimilation in strongly nonlinear systems,” Month. Weather Rev., vol. 129, pp. 1194–1207, 2001.
65. I. Hoteit, D. T. Pham, and J. Blum, “A simplified reduced order Kalman filtering and application to altimetric data assimilation in tropical Pacific,” J. Mar. Syst., vol. 36, pp. 101–127,2002.
66. C. H. Bishop, B. J. Etherton, and S. J. Majumdar “Adaptive sampling with the ensemble transform Kalman filter—Part I: Theoretical aspects,” Month. Weather Rev., vol. 129, pp. 420–436, 2001.
67. J. L. Anderson “An ensemble adjustment filter for data assimilation,” Month. Weather Rev., vol. 129, pp. 2884–2903, 2001.
68. M. K. Tippett, J. L. Anderson, T. M. Hamill, and J. S. Whitaker “Ensemble square root filters,” Month. Weather Rev., vol. 131, pp. 1485–1490, 2003.
69. J. S. Whitaker and T. M. Hamill, “Ensemble data assimilation without perturbed observations,” Month. Weather Rev., vol. 130, pp. 1913–1924,2002.
70. J. F. Bellatoni and K. W. Dodge, “A square root formulation of Kalman-Schmidt filter,” AIAA J., vol. 5, pp. 1309–1314,1967.
71. A. Andrews “A square root formulation of Kalman covariance equations,” AIAA J., vol. 6, pp. 1165–1166, 1968.
72. D. T. Pham, J. Verron, and M. C. Roubau, “A singular evolutive extended Kalman filter for data assimilation in oceanography,” J. Mar. Syst., vol. 16, pp. 323–340,1998.
73. P. Lermusiaux and A. Robinson “Data assimilation via error subspace statistical estimation—Part I: Theory and schemes,” Month. Weather Rev., vol. 127, pp. 1385–1407, 1999.
74. P. Lermusiaux and A. Robinson “Data assimilation via error subspace statistical estimation—Part II: Middle Atlantic bight shelfbreak front simulations and ESSE validation,” Month. Weather Rev., vol. 127, pp. 1408–1432, 1999.
75. A. W. Heemink, M. Verlaan, and A. J. Segers “Variance reduced ensemble Kalman filtering,” Month. Weather Rev., vol. 129, pp. 1718–1728, 2001.
76. A. C. Lorenc “The potential of the ensemble Kalman filter for NWP—A comparison with 4D-var,” Q. J. R. Meteorol. Soc., vol. 129, pp. 3183–3203, 2003.
77. P. L. Houtekamer and H. L. Mitchell “A sequential ensemble Kalman filter for atmospheric data assimilation,” Month. Weather Rev., vol. 129, pp. 123–137, 2001.
78. H. L. Mitchell, P. L. Houtekamer, and G. Pellerin “Ensemble size, balance, and model-error representation in an ensemble Kalman filter,” Month. Weather Rev., vol. 130, pp. 2791–2808, 2002.
79. D. M. Barker “Southern high-latitude ensemble data assimilation in the Antarctic mesoscale prediction system,” Month. Weather Rev., vol. 133, pp. 3431–3449, 2005.
80. D. C. Dowell, F. Zhang, L. J. Wicker, C. Snyder, and N. A. Crook “Wind and temperature retrievals in the 17 May 1981 Arcadia, Oklahoma, super-cell: Ensemble Kalman filter experiments,” Month. Weather Rev., vol. 132, pp. 1982–2005, 2004.
81. M. Buehner and M. Charron, “Spectral and spatial localization of back-ground-error correlations for data assimilation,” Q. J. R. Meteorol. Soc., vol. 133, pp. 615–630, 2007.
82. O. Pannekoucke, L. Berre, and G. Desroziers, “Filtering properties of wavelets for local background-error correlations,” Q. J. R. Meteorol. Soc., vol. 133, pp. 363–379, 2007.
83. X. Wang and C. H. Bishop “Improvement of ensemble reliability with a new dressing kernel,” Q. J. R. Meteorol. Soc., vol. 131, pp. 965–986, 2005.
84. J. L. Anderson and S. L. Anderson, “A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts,” Month. Weather Rev., vol. 127, pp. 2741–2758,1999.
85. J. L. Anderson “An adaptive covariance inflation error correction algorithm for ensemble filters,” Tellus A, vol. 59, pp. 210–224, 2007.
86. C. Bishop and Z. Toth, “Ensemble transformation and adaptive observations,” J. Atmos. Sci., vol. 56, pp. 1748–1765,1999.
87. R. H. Langland “Issues in targeted observing,” Q. J. R. Meteorol. Soc., vol. 131, pp. 3409–3425, 2005.
88. J. A. Hansen “Accounting for model error in ensemble-based state estimation and forecasting,” Month. Weather Rev., vol. 130, pp. 2373–2391, 2002.
89. Z. Meng and F. Zhang, “Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation—Part II: Imperfect model experiments,” Month. Weather Rev., vol. 135, pp. 1403–1423, 2007.
90. T. Fujita, D. J. Stensrud, and D. C. Dowell, “Surface data assimilation using an ensemble Kalman filter approach with initial condition and model physics uncertainties,” Month. Weather Rev., vol. 135, pp. 1846–1868,2007.
91. D. S. Zrnic, J. F. Kimpel, D. E. Forsyth, A. Shapiro, G. Crain, R. Ferek, J. Heimmer, W. Benner, T. J. McNellis, and R. J. Vogt “Agile-beam phased array radar for weather observations,” Bull. Amer. Meteorol. Soc., vol. 88, pp. 1753–1766, 2007.
92. J. P. Hacker and C. Snyder, “Ensemble Kalman filter assimilation of fixed screen-height observations in a parameterized PBL,” Month. Weather Rev., vol. 133, pp. 3260–3275, 2005.
93. H. L. Mitchell and P. L. Houtekamer, “An adaptive ensemble Kalman filter,” Month. Weather Rev., vol. 128, pp. 416–433,2000.
94. M. Pan and E. F. Wood, “Data assimilation for estimating the terrestrial water budget using a constrained ensemble Kalman filter,” J. Hydrometeo-rol, vol. 7, pp. 534–547,2006.
95. A. G. Slater and M. P. Clark, “Snow data assimilation via an ensemble Kalman filter,” J. Hydrometeorol., vol. 7, pp. 478–493, 2006.
96. Y. Zhou, D. McLaughlin, and D. Entekhabi, “Assessing the performance of the ensemble Kalman filter for land surface data assimilation,” Month. Weather Rev., vol. 134, pp. 2128–2142,2006.
97. C. L. Keppenne, “Data assimilation into a primitive-equation model with a parallel ensemble Kalman filter,” Month. Weather Rev., vol. 128, pp. 1971–1981,2000.
98. R. N. Miller, M. Ghil, and F. Gauthiez, “Data assimilation into nonlinear stochastic models,” Tellus A, vol. 51, pp. 167–194,1999.
99. G. Evensen and P. J. van Leeuwen “An ensemble Kalman smoother for nonlinear dynamics,” Month. Weather Rev., vol. 128, pp. 1852–1867, 2000.
100. S. Kim, G. L. Eyink, J. M. Restrepo, F. J. Alexander, and G. Johnson, “Ensemble filtering for nonlinear dynamics,” Month. Weather Rev., vol. 131, pp. 2586–2594,2003.
101. S. Lakshmivarahan and S. K. Dhall, Analysis and Design of Parallel Algorithms. New York: McGraw Hill, 1990.
102. J. Dongarra, I. Duff, P. Gaffney, and S. McKee, Vector and Parallel Computing. New York: Ellis Horwood Ltd., 1989.
103. W. Gropp, E. Lusk, and A. Skjellum, Using MPI. Cambridge, MA: MIT Press, 1994.
104. C. L. Keppenne and M. M. Rienecker “Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model,” Month. Weather Rev., vol. 130, pp. 2951–2965, 2002.
105. E. Ott, B. R. Hunt, I. Szunyogh, A. V. Zimin, E. J. Kostelich, M. Corazza, E. Kalnay, D. J. Patil, and J. A. Yorke “A local ensemble Kalman filter for atmospheric data assimilation,” Tellus A, vol. 56, pp. 415–428, 2004.
106. P. L. Houtekamer and H. L. Mitchell “A sequential ensemble Kalman filter for atmospheric data assimilation,” Month. Weather Rev., vol. 129, pp. 123–137, 2001.
107. J. L. Anderson and N. Collins, “Scalable implementations of ensemble filter algorithms for data assimilation,” J. Atmos. Ocean. Technol., vol. 24, pp. 1452–1463,2007.