Applications of information theory in ensemble data assimilation

Quarterly Journal of the Royal Meteorological Society

Volumn 133, Issue 627, 2007, Pages 1533-1545

  Zupanski, Dusanka ^a   Hou, Arthur Y ^b   Zhang, Sara Q ^b   Zupanski, Milija ^a   Kummerow, Christian D ^a   Cheung, Samson H ^c  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b NASA GODDARD SPACE FLIGHT CENTER   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

3D Var; Ensemble data assimilation; Information theory; Kalman filter; Maximum Likelihood Ensemble Filter

Indexed keywords

DATA PROCESSING; KALMAN FILTERS; MAXIMUM LIKELIHOOD ESTIMATION; WEATHER FORECASTING;

ENSEMBLE DATA ASSIMILATION; ENSEMBLE SUBSPACE; INFORMATION MATRIX; MAXIMUM LIKELIHOOD ENSEMBLE FILTER;

INFORMATION THEORY;

DATA ASSIMILATION; ENSEMBLE FORECASTING; EOS; KALMAN FILTER; MAXIMUM LIKELIHOOD ANALYSIS;

EID: 35549011350     PISSN: 00359009     EISSN: None     Source Type: Journal    
DOI: 10.1002/qj.123     Document Type: Article

References (62)

1. Abramov RV, Majda AJ. 2004. Quantifying uncertainty for non-Gaussian ensembles in complex systems. SIAM J. Sci. Comput. 26: 411-447.
2. Abramov R, Majda A, Kleeman R. 2005. Information theory and predictability for low-frequency variability. J. Atmos. Sci. 62: 65-87.
3. Anderson JL. 2001. An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 129: 2884-2903.
4. Bishop CH, Etherton BJ, Majumdar SJ. 2001. Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Weather Rev. 129: 420-436.
5. Cohn SE. 1997. An introduction to estimation theory. J. Meteorol. Soc. Jpn 75: 257-288.
6. Dee DP. 1995. On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Weather Rev. 123: 1128-1145.
7. DelSole T. 2004. Predictability and information theory. Part I: Measures of predictability. J. Atmos. Sci. 61: 2425-2440.
8. 2. J. Appl. Meteorol. 43: 373-378.
9. Evensen G. 1994. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 99(C5): 10143-10162.
10. Fisher M. 2003. 'Estimation of entropy reduction and degrees of freedom for signal for large variational analysis systems'. ECMWF Tech. Memo. No. 397. 18 pp.
11. Fletcher SJ, Zupanski M. 2006. A data assimilation method for log-normally distributed observational errors. Q. J. R. Meteorol. Soc. 132: 2505-2520.
12. Gaspari G, Cohn SE. 1999. Construction of correlation functions in two and three dimensions. Q. J. R. Meteorol. Soc. 125: 723-757.
13. Gill PE, Murray W, Wright MH. 1981. Practical optimization. Academic Press: London.
14. Hamill TM, Snyder C. 2000. A hybrid ensemble Kalman filter-3D variational analysis scheme. Mon. Weather Rev. 128: 2905-2919.
15. Hamill TM, Whitaker JS, Snyder C. 2001. Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Weather Rev. 129: 2776-2790.
16. Heemink AW, Verlaan M, Segers AJ. 2001. Variance reduced ensemble Kalman filtering. Mon. Weather Rev. 129: 1718-1728.
17. Horn RA, Johnson CR. 1985. Matrix analysis. Cambridge University Press.
18. Hoteit I, Pham D-T, Blum J. 2002. A simplified reduced order Kalman filtering and application to altimetric data assimilation in tropical Pacific. J. Mar. Syst. 36: 101-127.
19. Hoteit I, Pham D-T, Blum J. 2003. A semi-evolutive filter with partially local correction basis for data assimilation in oceanography. Oceanol. Acta 26: 511-524.
20. Hou AY, Zhang SQ, da Silva AM, Olson WS. 2000. Improving assimilated global datasets using TMI rainfall and columnar moisture observations. J. Climate 13: 4180-4195.
21. Hou AY, Zhang SQ, da Silva AM, Olson WS, Kummerow CD, Simpson J. 2001. Improving global analysis and short-range forecast using rainfall and moisture observations derived from TRMM and SSM/I passive microwave sensors. Bull. Am. Meteorol. Soc. 82: 659-679.
22. Hou AY, Zhang SQ, Reale O. 2004. Variational continuous assimilation of TMI and SSM/I rain rates: Impact on GEOS-3 hurricane analyses and forecasts. Mon. Weather Rev. 132: 2094-2109.
23. Houtekamer PL, Mitchell HL. 1998. Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev. 126: 796-811.
24. Johnson C. 2003. 'Information content of observations in variational data assimilation'. Ph.D. thesis, Department of Meteorology, University of Reading, 218 pp. Available from University of Reading, Whiteknights, PO Box 220, Reading, RG6 2AX, UK.
25. Keppenne CL. 2000. Data assimilation into a primitive-equation model with a parallel ensemble Kalman filter. Mon. Weather Rev. 128: 1971-1981.
26. Kleeman R. 2002. Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci. 59: 2057-2072.
27. L'Ecuyer TS, Gabriel P, Leesman K, Cooper SJ, Stephens GL. 2006. Objective assessment of the information content of visible and infrared radiance measurements for cloud microphysical property retrievals over the global oceans. Part I: Liquid clouds. J. Appl. Meteorol. Clim. 45: 20-41.
28. Lermusiaux PFJ, Robinson AR. 1999. Data assimilation via error subspace statistical estimation. Part I: Theory and schemes. Mon. Weather Rev. 127: 1385-1407.
29. Luenberger DG. 1984. Linear and nonlinear programming. 2nd edn. Addison-Wesley.
30. Majda AJ, Kleeman R, Cai D. 2002. A mathematical framework for quantifying predictability through relative entropy. Methods Appl. Anal. 9: 425-444.
31. Ménard R, Cohn SE, Chang L-P, Lyster PM. 2000. Assimilation of stratospheric chemical tracer observations using a Kalman filter. Part I: Formulation. Mon. Weather Rev. 128: 2654-2671.
32. Mitchell HL, Houtekamer PL. 2000. An adaptive ensemble Kalman filter. Mon. Weather Rev. 128: 416-433.
33. Mitchell HL, Houtekamer PL, Pellerin G. 2002. Ensemble size, balance, and model-error representation in an ensemble Kalman filter. Mon. Weather Rev. 130: 2791-2808.
34. Navon IM, Zou X, Derber J, Sela J. 1992. Variational data assimilation with an adiabatic version of the NMC spectral model. Mon. Weather Rev. 120: 1433-1446.
35. Oczkowski M, Szunyogh I, Patil DJ. 2005. Mechanisms for the development of locally low-dimensional atmospheric dynamics. J. Atmos. Sci. 62: 1135-1156.
36. Ott E, Hunt BR, Szunyogh I, Zimin AV, Kostelich EJ, Corazza M, Kalnay E, Patil DJ, Yorke JA. 2004. A local ensemble Kalman filter for atmospheric data assimilation. Tellus 56A: 415-428.
37. Patil DJ, Hunt BR, Kalnay E, Yorke JA, Ott E. 2001. Local low dimensionality of atmospheric dynamics. Phys. Rev. Lett. 86: 5878-5881.
38. 2 surface fluxes from atmospheric trace gas observations. J. Geophys. Res. 110: D24304, DOI: 10.1029/2005JD006157.
39. Pham DT. 2001. Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Weather Rev. 129: 1194-1207.
40. Pham DT, Verron J, Roubaud MC. 1998. A singular evolutive extended Kalman filter for data assimilation in oceanography. J. Mar. Syst. 16: 323-340.
41. Purser RJ, Huang H-L. 1993. Estimating effective data density in a satellite retrieval or an objective analysis. J. Appl. Meteorol. 32: 1092-1107.
42. Rabier F, Fourrie N, Djalil C, Prunet P. 2002. Channel selection methods for Infrared Atmospheric Sounding Interferometer radiances. Q. J. R. Meteorol. Soc. 128: 1011-1027.
43. Reichle RH, McLaughlin DB, Entekhabi D. 2002a. Hydrologic data assimilation with the ensemble Kalman filter. Mon. Weather Rev. 130: 103-114.
44. Reichle RH, Walker JP, Koster RD, Houser PR. 2002b. Extended versus ensemble Kalman filtering for land data assimilation. J. Hydrometorology 3: 728-740.
45. Rodgers CD. 2000. Inverse methods for atmospheric sounding: Theory and practice. World Scientific Publishing: Singapore.
46. Roulston MS, Smith LA. 2002. Evaluating probabilistic forecasts using information theory. Mon. Weather Rev. 130: 1653-1660.
47. Schneider T, Griffies SM. 1999. A conceptual framework for predictability studies. J. Climate. 12: 3133-3155.
48. Shannon CE, Weaver W. 1949. The mathematical theory of communication. University of Illinois Press: Urbana.
49. Szunyogh I, Kostelich EJ, Gyarmati G, Patil DJ, Hunt BR, Kalnay E, Ott E, Yorke JA. 2005. Assessing a local ensemble Kalman filter: Perfect model experiments with the National Centers for Environmental Prediction global model. Tellus 57A: 528-545.
50. Tippett MK, Anderson JL, Bishop CH, Hamill TM, Whitaker JS. 2003. Ensemble square root filters. Mon. Weather Rev. 131: 1485-1490.
51. Uzunoglu B, Fletcher SJ, Zupanski M, Navon IM. 2007. Adaptive ensemble member size reduction and inflation. Q. J. R. Meteorol. Soc. (in press).
52. van Leeuwen PJ. 2001. An ensemble smoother with error estimates. Mon. Weather Rev. 129: 709-728.
53. Wahba G. 1985. Design criteria and eigensequence plots for satellite-computed tomography. J. Atmos. Oceanic Technol. 2: 125-132.
54. Wahba G, Johnson DR, Gao F, Gong J. 1995. Adaptive tuning of numerical weather prediction models: Randomized GCV in three-and four-dimensional data assimilation. Mon. Weather Rev. 123: 3358-3370.
55. Wang X, Bishop CH. 2003. A comparison of breeding and ensemble transform Kalman filter ensemble forecast schemes. J. Atmos. Sci. 60: 1140-1158.
56. Wei M, Toth Z, Wobus R, Zhu Y, Bishop CH, Wang X. 2006. Ensemble Transform Kalman Filter-based ensemble perturbations in an operational global prediction system at NCEP. Tellus 58A: 28-44.
57. Whitaker JS, Hamill TM. 2002. Ensemble data assimilation without perturbed observations. Mon. Weather Rev. 130: 1913-1924.
58. Zhang F, Snyder C, Sun J. 2004. Impacts of initial estimate and observation availability on convective-scale data assimilation with an ensemble Kalman filter. Mon. Weather Rev. 132: 1238-1253.
59. Zupanski D, Zupanski M. 2006. Model error estimation employing an ensemble data assimilation approach. Mon. Weather Rev. 134: 1337-1354.
60. Zupanski D, Denning AS, Uliasz M, Zupanski M, Schuh AE, Rayner PJ, Peters W, Corbin KD. 2007. Carbon flux bias estimation employing Maximum Likelihood Ensemble Filter (MLEF). J. Geophys. Res. (in press).
61. Zupanski M. 2005. Maximum likelihood ensemble filter: Theoretical aspects. Mon. Weather Rev. 133: 1710-1726.
62. Zupanski M, Fletcher SJ, Navon IM, Uzunoglu B, Heikes RP, Randall DA, Ringler TD, Daesccu D. 2006. Initiation of ensemble data assimilation. Tellus 58A: 159-170.