Beyond gaussian statistical modeling in geophysical data assimilation

Monthly Weather Review

Volumn 138, Issue 8, 2010, Pages 2997-3023

  Bocquet, Marc ^a,b   Pires, Carlos A ^c   Wu, Lin ^a,b  

^a EDF R AND D   (France)

^b INRIA   (France)

^c UNIVERSITY OF LISBON   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

ATMOSPHERIC CHEMISTRY; BAYESIAN NETWORKS; GAUSSIAN NOISE (ELECTRONIC); GEOPHYSICS; KALMAN FILTERS; MAXIMUM ENTROPY METHODS; STATISTICAL MECHANICS; STATISTICAL METHODS;

ENSEMBLE KALMAN FILTER; GAUSSIAN STATISTICAL MODELS; GEOPHYSICAL APPLICATIONS; HIGH-DIMENSIONAL SYSTEMS; NON-GAUSSIAN FEATURES; NONLINEAR AND NON-GAUSSIAN; PROPOSAL DISTRIBUTION; VARIATIONAL SOLUTIONS;

GAUSSIAN DISTRIBUTION;

DATA ASSIMILATION; ENSEMBLE FORECASTING; GAUSSIAN METHOD; GEOPHYSICAL METHOD; GEOSTATISTICS; KALMAN FILTER; NUMERICAL MODEL;

EID: 77955429089     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2010MWR3164.1     Document Type: Review

References (125)

1. Anderson, J. L., and S. L. Anderson, 1999: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Mon. Wea. Rev., 127, 2741-2758.
2. Anderson, T. W., and D. A. Darling, 1952: Asymptotic theory of certain "goodness of fit" criteria based on stochastic processes. Ann. Math. Stat., 23, 193-212.
3. Andersson, E., and H. Järvinen, 1999: Variational quality control. Quart. J. Roy. Meteor. Soc., 125, 697-722.
4. Andersson, E., M. Fisher, E. Hólm, L. Isaksen, G. Radnóti, and Y. Trémolet, 2005: Will the 4D-Var approach be defeated by nonlinearity? Tech. Rep. 479, ECMWF, 28 pp. [Available online at http://www.ecmwf.int/publications/library/ecpublications/_pdf/tm/401-500/tm479.pdf.]
5. Andersson, E., and Coauthors, 2007: Analysis and forecast impact of the main humidity observing systems. Quart. J. Roy. Meteor. Soc., 133, 1473-1485.
6. Auroux, D., 2007: Generalization of the dual variational data assimilation algorithm to a nonlinear layered quasi-geostrophic ocean model. Inverse Probl., 23, 2485-2503.
7. Barndorff-Nielsen, O. E., and D. R. Cox, 1989: Asymptotic Techniques for Use in Statistics. Meteor. Monogr., No. 31, Chapman & Hall, 252 pp.
8. Bellman, R., 1961: Adaptive Control Processes: A Guided Tour. Princeton University Press, 255 pp.
9. Bengtsson, T., C. Snyder, and D. Nychka, 2003: Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res., 108, 8775, doi:10.1029/2002JD002900.
10. Berliner, M. L., and C. K. Wikle, 2007: Approximate importance sampling Monte Carlo for data assimilation. Physica D, 230, 37-49.
11. Bertino, L., G. Evensen, and H. Wackernagel, 2003: Sequential data assimilation techniques in oceanography. Int. Stat. Rev., 71, 223-241.
12. Bishop, C. H., B. J. Etherton, and S. J. Majumdar, 2001: Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Wea. Rev., 129, 420-436.
13. Bocquet, M., 2005a: Grid resolution dependence in the reconstruction of an atmospheric tracer source. Nonlinear Processes Geophys., 12, 219-234.
14. Bocquet, M., 2005b: Reconstruction of an atmospheric tracer source using the principle of maximum entropy. I: Theory. Quart. J. Roy. Meteor. Soc., 131, 2191-2208.
15. Bocquet, M., 2005c: Reconstruction of an atmospheric tracer source using the principle of maximum entropy. II: Applications. Quart. J. Roy. Meteor. Soc., 131, 2209-2223.
16. Bocquet, M., 2007: High resolution reconstruction of a tracer dispersion event. Quart. J. Roy. Meteor. Soc., 133, 1013-1026.
17. Bocquet, M., 2008: Inverse modelling of atmospheric tracers: Non-Gaussian methods and second-order sensitivity analysis. Nonlinear Processes Geophys., 15, 127-143.
18. Borwein, J. M., and A. S. Lewis, 2000: Convex Analysis and Nonlinear Optimization: Theory and Examples. Springer, 273 pp.
19. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: One-month experiments with real observations. Mon. Wea. Rev., 138, 1567-1586.
20. Buizza, R., and A. Montani, 1999: Targeted observations using singular vectors. J. Atmos. Sci., 56, 2965-2985.
21. Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719-1724.
22. Cane, M. A., A. Kaplan, R. N. Miller, B. Y. Tang, E. C. Hackert, and A. J. Busalacchi, 1996: Mapping tropical Pacific sea level: Data assimilation via a reduced state space Kalman filter. J. Geophys. Res., 101 (C10), 22 599-22 617.
23. Carrassi, A., A. Trevisan, and F. Uboldi, 2007: Adaptive observations and assimilation in the unstable subspace by breeding on the data-assimilation system. Tellus, 59A, 101-113.
24. Carrassi, A., M. Ghil, A. Trevisan, and F. Uboldi, 2008: Data assimilation as a nonlinear dynamical systems problem: Stability and convergence of the prediction-assimilation system. Chaos, 18, 023112.
25. Chapnik, B., G. Desroziers, F. Rabier, and O. Talagrand, 2006: Diagnosis and tuning of observational error in a quasi-operational data assimilation setting. Quart. J. Roy. Meteor. Soc., 132, 543-565.
26. Cohn, S. E., 1997: An introduction to estimation theory. J. Meteor. Soc. Japan, 75, 257-288.
27. Cohn, S. E., A. da Silva, J. Guo, M. Sienkiewicz, and D. Lamich, 1998: Assessing the effects of data selection with the DAO physical-space statistical analysis system. Mon. Wea. Rev., 126, 2913-2926.
28. Courtier, P., 1997: Dual formulation of four-dimensional varia-tional assimilation. Quart. J. Roy. Meteor. Soc., 123, 2449-2461.
29. Courtier, P., and O. Talagrand, 1987: Variational assimilation of meteorological observation with the adjoint vorticity equation. II: Numerical results. Quart. J. Roy. Meteor. Soc., 113, 1329-1347.
30. Cover, T. M., and J. A. Thomas, 1991: Elements of Information Theory. Wiley Series in Telecommunications, Wiley-Interscience, 542 pp.
31. Daescu, D. N., and I. M. Navon, 2004: Adaptive observations in the context of 4D-Var data assimilation. Meteor. Atmos. Sci., 85, 205-226.
32. Davoine, X., and M. Bocquet, 2007: Inverse modelling-based reconstruction of the Chernobyl source term available for long-range transport. Atmos. Chem. Phys., 7, 1549-1564.
33. Del Moral, P., 2004: Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications. Springer-Verlag, 566 pp.
34. Desroziers, G., L. Berre, B. Chapnik, and P. Poli, 2005: Diagnosis of observation, background and analysis-error statistics in observation space. Quart. J. Roy. Meteor. Soc., 131, 3385-3396.
35. Doucet, A., S. Godsill, and C. Andrieu, 2000: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput., 10, 197-208.
36. Doucet, A., N. de Freitas, and N. Gordon, Eds., 2001: Sequential Monte Carlo Methods in Practice. Springer-Verlag, 612 pp.
37. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10 143-10 162.
38. Evensen, G., 1997: Advanced data assimilation for strongly nonlinear dynamics. Mon. Wea. Rev., 125, 1342-1354.
39. Evensen, G., 2003: The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dyn., 53, 343-367.
40. Eyink, G. L., and S. Kim, 2006: A maximum entropy method for particle filtering. J. Stat. Phys., 123, 1071-1128.
41. Fisher, M., M. Leutbecher, and G. A. Kelly, 2005: On the equivalence between Kalman smoothing and weak-constraint four-dimensional variational data assimilation. Quart. J. Roy. Meteor. Soc., 131, 3235-3246.
42. Fletcher, S. J., and M. Zupanski, 2006: A data assimilation method for log-normally distributed observational errors. Quart. J.Roy. Meteor. Soc., 132, 2505-2519.
43. Fujita, T., D. J. Stensrud, and D. C. Dowell, 2007: Surface data assimilation using an ensemble Kalman filter approach with initial condition and model physics uncertainties. Mon. Wea. Rev., 135, 1846-1868.
44. Gardiner, C. W., 2004: Handbook of Stochastic Methods: For Physics, Chemistry and the Natural Sciences. 3rd ed. Springer Series in Synergetics, Springer, 415 pp.
45. Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723-757.
46. Gauthier, P., 1992: Chaos and quadri-dimensional data assimilation: A study based on the Lorenz model. Tellus, 44A, 2-17.
47. Gilks, W. R., and C. Berzuini, 2001: Following a moving target-Monte Carlo inference for dynamic Bayesian models. J. Roy. Stat. Soc. B, 63, 127-146.
48. Gordon, N. J., D. J. Salmond, and A. F. M. Smith, 1993: Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proc. F, 140, 107-113.
49. Hamill, T. M., J. S. Whitaker, and C. Snyder, 2001: Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Wea. Rev., 129, 2776-2790.
50. Handschin, J., and D. Mayne, 1969: Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering. Int. J. Control, 9, 547-559.
51. Harlim, J., and B. R. Hunt, 2007: A non-Gaussian ensemble filter for assimilating infrequent noisy observations. Tellus, 59A, 225-237.
52. Haven, K., A. Majda, and R. Abramov, 2005: Quantifying predictability through information theory: Small sample estimation in a non-Gaussian framework. J. Comput. Phys., 206, 334-362.
53. Heemink, A. W., M. Verlaan, and A. J. Segers, 2001: Variance reduced ensemble Kalman filtering. Mon. Wea. Rev., 129, 1718-1728.
54. Hólm, E., 2007: Humidity control variable and supersaturation. Proc. Workshop on Flow-Dependent Aspects of Data Assimilation, Reading, United Kingdom, ECMWF, 143-150.
55. Hólm, E., E. Andersson, A. Beljaars, P. Lopez, J.-F. Mahfouf, A. J. Simmons, and J.-N. Thépaut, 2002: Assimilation and modelling of the hydrological cycle: ECMWF's status and plans. Tech. Rep. 383, ECMWF, 57 pp. [Available online at http://www.ecmwf.int/publications/library/ecpublications/_pdf/tm/301-400/tm383.pdf.]
56. Hoteit, I., 2008: A reduced-order simulated annealing approach for four-dimensional variational data assimilation in meteorology and oceanography. Int. J. Numer. Methods Fluids, 58, 1181-1199.
57. Hoteit, I., D.-T. Pham, G. Triantafyllou, and G. Korres, 2008: A new approximate solution of the optimal nonlinear filter for data assimilation in meteorology and oceanography. Mon. Wea. Rev., 136, 317-334.
58. Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
59. Houtekamer, P. L., and H. L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 123-137.
60. Houtekamer, P. L., and H. L. Mitchell, 2005: Ensemble Kalman filtering. Quart. J. Roy. Meteor. Soc., 131, 3269-3289.
61. Houtekamer, P. L., H. L. Mitchell, and X. Deng, 2009: Model error representation in an operational ensemble Kalman filter. Mon. Wea. Rev., 137, 2126-2143.
62. Huber, P. J., 1973: Robust regression: Asymptotics, conjectures, and Monte Carlo. Ann. Stat., 1, 799-821.
63. Hunt, B. R., and Coauthors, 2004: Four-dimensional ensemble Kalman filtering. Tellus, 56A, 273-277.
64. Hyvärinen, A., and E. Oja, 2000: Independent component analysis: Algorithms and applications. Neural Networks, 13, 411-430.
65. Ide, K., P. Courtier, M. Ghil, and A. Lorenc, 1999: Unified notation for data assimilation: Operational, sequential and variational. J. Meteor. Soc. Japan, 75, 181-189.
66. Jazwinski, A. H., 1970: Stochastic Processes and Filtering Theory. Academic Press, 376 pp.
67. Kalnay, E., H. Li, T. Miyoshi, S.-C. Yang, and J. Ballabrera, 2007: 4D-Var or ensemble Kalman filter. Tellus, 59A, 758-773.
68. Kitagawa, G., 1987: Non-Gaussian state-space modeling of non-stationary time series. J. Amer. Stat. Assoc., 82, 1032-1063.
69. Kleeman, R., 2002: Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci., 59, 2057-2072.
70. Kleeman, R., 2007: Statitical predictibility in the atmosphere and other dynamical systems. Physica D, 230, 65-71.
71. Krüger, J., 1993: Simulated annealing: A tool for data assimilation into an almost steady model state. J. Phys. Oceanogr., 23, 679-688.
72. Krysta, M., and M. Bocquet, 2007: Source reconstruction of an accidental radionuclide release at European scale. Quart. J. Roy. Meteor. Soc., 133, 529-544.
73. Kullback, S., 1959: Information Theory and Statistics. Wiley, 395 pp.
74. Laroche, S., and P. Gauthier, 1998: A validation of the incremental formulation of 4D variational data assimilation in a nonlinear barotropic flow. Tellus, 50A, 557-572.
75. Lauvernet, C., J.-M. Brankart, F. Castruccio, G. Broquet, P. Braseur, and J. Verron, 2009: A truncated Gaussian filter for data assimilation with inequality constraints: Application to the hydrostatic stability condition in ocean models. Ocean Modell., 27, 1-17.
76. Lawson, W. G., and J. A. Hansen, 2004: Implications of stochastic and determinisitic filters as ensemble-based data assimilation methods in varying regimes of error growth. Mon. Wea. Rev., 132, 1966-1981.
77. Le Dimet, F.-X., and O. Talagrand, 1986: Variational algotrithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus, 38A, 97-110.
78. Le Dimet, F.-X., H.-E. Ngodock, B. Luong, and J. Verron, 1997: Sensitivity analysis in variational data assimilation. J. Meteor. Soc. Japan, 75, 245-255.
79. Leith, C. E., 1974: Theoretical skill of Monte Carlo forecast. Mon. Wea. Rev., 102, 409-418.
80. Lermusiaux, P. F. J., and A. R. Robinson, 1999: Data assimilation via error subspace statistical estimation. Part I: Theory and schemes. Mon. Wea. Rev., 127, 1385-1407.
81. Lilliefors, H. W., 1967: On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J. Amer. Stat. Assoc., 62, 399-402.
82. Lions, J.-L., O. P. Manley, R. Temam, and S. Wang, 1997: Physical interpretation of the attractor dimension for the primitive equations of atmospheric circulation. J. Atmos. Sci., 54, 1137-1143.
83. Lorenc, A. C., 1986: Analysis methods for numerical weather prediction. Quart. J. Roy. Meteor. Soc., 112, 1177-1194.
84. Lorenc, A. C., and T. Payne, 2007: 4D-Var and the butterfly effect: Statistical four-dimensional data assimilation for a wide range of scales. Quart. J. Roy. Meteor. Soc., 133, 607-614.
85. Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130-141.
86. Lorenz, E. N., 1969: The predictibility of a flow which possesses many scales of motion. Tellus, 21, 289-307.
87. Lorenz, E. N., and K. E. Emmanuel, 1998: Optimal sites for supplementary weather observations: Simulation with a small model. J. Atmos. Sci., 55, 399-414.
88. MacKay, D. J. C., 2003: Information Theory, Inference and Learning Algorithms. Cambridge University Press, 550 pp.
89. Meng, Z., and F. Zhang, 2007: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part II: Imperfect model experiments. Mon. Wea. Rev., 135, 1403-1423.
90. Miller, R. N., M. Ghil, and F. Gauthiez, 1994: Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci., 51, 1037-1056.
91. Miller, R. N., E. F. Carter, and S. T. Blue, 1999: Data assimilation into nonlinear stochastic models. Tellus, 51A, 167-194.
92. Mitchell, H. L., and P. L. Houtekamer, 2009: Ensemble Kalman filter configurations and their performance with the logistic map. Mon. Wea. Rev., 137, 4325-4343.
93. Nakano, S., G. Ueno, and T. Higuchi, 2007: Merging particle filter for sequential data assimilation. Nonlinear Processes Geophys., 14, 395-408.
94. Nerger, L., W. Hiller, and J. Schröter, 2005: A comparison of error subspace Kalman filters. Tellus, 57A, 715-735.
95. Nodop, K., R. Connolly, and F. Girardi, 1998: The field campaigns of the European Tracer Experiment (ETEX): Overview and results. Atmos. Environ., 32, 4095-4108.
96. Papadakis, N., 2007: Assimilation de données images: Application au suivi de courbes et de champs de vecteurs (Image data assimilation: Application to curve and vector fields tracking). Ph.D. thesis, Université de Rennes I, 242 pp.
97. Patil, D., R. Hunt, E. Kalnay, J. A. Yorke, and E. Ott, 2001: Local low dimensionality of atmospheric dynamics. Phys. Rev. Lett., 86, 5878-5881.
98. Pham, D. T., 2001: Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Wea. Rev., 129, 1194-1207.
99. Pham, D. T., J. Verron, and M. Roubaud, 1998: A singular evolutive extended Kalman filter for data assimilation in oceanography. J. Mar. Syst., 16, 323-340.
100. Pires, C. A., and R. Perdigão, 2007: Non-Gaussianity and asymmetry of the winter monthly precipitation estimation from NAO. Mon. Wea. Rev., 135, 430-448.
101. Pires, C. A., R. Vautard, and O. Talagrand, 1996: On extending the limits of variational assimilation in nonlinear chaotic systems. Tellus, 48A, 96-121.
102. Pires, C. A., O. Talagrand, and M. Bocquet, 2010: Diagnosis and impacts of non-Gaussianity of innovations in data assimilation. Physica D, 239, 1701-1717.
103. Rabier, F., H. Järvinen, E. Klinker, J.-F. Mahfouf, and A. Simmons, 2000: The ECMWF operational implementation of four-dimensional variational assimilation. I: Experimental results with simplified physics. Quart. J. Roy. Meteor. Soc., 126, 1143-1170.
104. Rodgers, C. D., 2000: Inverse Methods for Atmospheric Sounding. Series on Atmospheric, Oceanic and Planetary Physics, Vol. 2, World Scientific, 238 pp.
105. Sakov, P., and P. R. Oke, 2008: Implications of the form of the ensemble transformation in the ensemble square root filters. Mon. Wea. Rev., 136, 1042-1053.
106. Shapiro, S. S., and M. B. Wilk, 1965: An analysis of variance test for normality (complete samples). Biometrika, 52, 591-611.
107. Silverman, B. W., 1986: Density Estimation for Statistics and Data Analysis. Chapman and Hall, 175 pp.
108. Simon, E., and L. Bertino, 2009: Application of the Gaussian anamorphosis to assimilation in a 3-D coupled physical-ecosystem model of the North Atlantic with the EnKF: A twin experiment. Ocean Sci., 5, 495-510.
109. Snyder, C., T. Bengtsson, P. Bickel, and J. L. Anderson, 2008: Obstacles to high-dimensional particle filtering. Mon. Wea. Rev., 136, 4629-4640.
110. Spiller, E. T., A. Budhiraja, K. Ide, and C. K. R. T. Jones, 2008: Modified particle filter methods for assimilating Lagrangian data into a point-vortex model. Physica D, 237, 1498-1506.
111. Talagrand, O., and P. Courtier, 1987: Variational assimilation of meteorological observation with the adjoint vorticity equation. I: Theory. Quart. J. Roy. Meteor. Soc., 113, 1311-1328.
112. Tippett, M. K., J. L. Anderson, C. H. Bishop, T. M. Hamill, and J. S. Whitaker, 2003: Ensemble square root filters. Mon. Wea. Rev., 131, 1485-1490.
113. Trémolet, Y., 2004: Diagnostics of linear and incremental approximations in 4D-Var. Quart. J. Roy. Meteor. Soc., 130, 2233-2251.
114. Trémolet, Y., 2006: Accounting for an imperfect model in 4D-Var. Quart. J. Roy. Meteor. Soc., 132, 2483-2504.
115. Tribbia, J. J., and D. P. Baumhefner, 2004: Scale interactions and atmospheric predictability: An updated perspective. Mon. Wea. Rev., 132, 703-713.
116. Uzunoglu, B., 2007: Adaptive observations in ensemble assimilation. Comput. Methods Appl. Mech. Eng., 196, 4207-4221.
117. Van der Merwe, R., A. Doucet, N. de Freitas, and E. Wan, 2000: The unscented particle filter. Tech. Rep. CUED/F-INFENG/TR 380, Engineering Department, Cambridge University, 45 pp.
118. van Leeuwen, P. J., 2009: Particle filtering in geophysical systems. Mon. Wea. Rev., 137, 4089-4114.
119. Verlaan, M., and A. W. Heemink, 2001: Nonlinearity in data assimilation applications: A practical method for analysis. Mon. Wea. Rev., 129, 1578-1589.
120. Wackernagel, H., 2003: Multivariate Geostatistics. 3rd ed. Springer, 403 pp.
121. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913-1924.
122. Wu, L., V. Mallet, M. Bocquet, and B. Sportisse, 2008: A comparison study of data assimilation algorithms for ozone forecasts. J. Geophys. Res., 113, D20310, doi:10.1029/2008JD009991.
123. Xiong, X., I. M. Navon, and B. Uzunoglu, 2006: A note on the particle filter with posterior Gaussian resampling. Tellus, 58A, 456-460.
124. Zakai, M., 1969: On the optimal filtering of diffusion processes. Z. Wahrsch., 11, 230-243.
125. Zupanski, M., 2005: Maximum likelihood ensemble filter: Theoretical aspects. Mon. Wea. Rev., 133, 1710-1726.