Filtering of background error variances and correlations by local spatial averaging: A review

Monthly Weather Review

Volumn 138, Issue 10, 2010, Pages 3693-3720

  Berre, Loïk ^a   Desroziers, Gérald ^a  

^a CENTRE NATIONAL DE RECHERCHES MÉTÉOROLOGIQUES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AVERAGING TECHNIQUE; BACKGROUND ERRORS; BACKGROUND-ERROR COVARIANCES; CORRELATION FUNCTION; CORRELATION LENGTH SCALE; ENSEMBLE KALMAN FILTER; LINEAR ESTIMATION THEORY; NUMERICAL WEATHER PREDICTION; PROBABILISTIC FORECASTING; SAMPLING NOISE; SIGNAL OF INTERESTS; SMALL SCALE; SPATIAL AVERAGING; SPATIAL AVERAGING TECHNIQUES; SPATIAL FILTERS; SPATIAL STRUCTURE; VARIANCE FIELDS; VARIATIONAL DATA ASSIMILATION;

DATA PROCESSING; WEATHER FORECASTING;

INNOVATION;

DATA ASSIMILATION; ENSEMBLE FORECASTING; ERROR ANALYSIS; KALMAN FILTER; PROBABILITY; WEATHER FORECASTING;

EID: 77958479703     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2010MWR3111.1     Document Type: Review

References (67)

1. Anderson, J.L., 2007: Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter. Physica D, 230, 99-111.
2. Andersson, E., and M. Fisher, 1999: Background errors for observed quantities and their propagation in time. Proc. ECMWF Workshop on Diagnosing Data Assimilation Systems, Reading, United Kingdom, ECMWF, 81-90. [Available online at http://www.ecmwf.int/publications/library/do/references/list/17155.].
3. Bannister, R.N., 2008: A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances. Quart. J. Roy. Meteor. Soc., 134, 1951-1970.
4. Belo Pereira, M., and L. Berre, 2006: The use of an ensemble approach to study the background error covariances in a global NWP model. Mon. Wea. Rev., 134, 2466-2489.
5. Berre, L., 2000: Estimation of synoptic and meso scale forecast error covariances in a limited-area model. Mon. Wea. Rev., 128, 644-667.
6. Berre, L., S.E. Sxtefǎnescu, and M. Belo Pereira, 2006: The representation of the analysis effect in three error simulation techniques. Tellus, 58A, 196-209.
7. Berre, L., O. Pannekoucke, G. Desroziers, S.E. Sxtefǎnescu, B. Chapnik, and L.Raynaud, 2007: Avariational assimilation ensemble and the spatial filtering of its error covariances: Increase of sample size by local spatial averaging. Proc. ECMWF Workshop on Flow-Dependent Aspects of Data Assimilation, Reading, United Kingdom, ECMWF, 151-168. [Available online at http://www.ecmwf.int/publications/library/do/references/list/14092007.].
8. Berre, L., G. Desroziers, L. Raynaud, R. Montroty, and F. Gibier, 2009: Consistent operational ensemble variational assimilation. Extended Abstracts, Fifth WMO Int. Symp. on Data Assimilation, Melbourne, Australia, WMO, N.196.
9. Berrocal, V.J., A.E. Raftery, and T. Gneiting, 2007: Combining spatial statistical and ensemble information in probabilistic weather forecasts. Mon. Wea. Rev., 135, 1386-1402.
10. Bishop, C.H., and D. Hodyss, 2007: Flow adaptive moderation of spurious ensemble correlations and its use in ensemblebased data assimilation. Quart. J. Roy. Meteor. Soc., 133, 2029-2044.
11. Bishop, C.H., and D. Hodyss, 2009a: Ensemble covariances adaptively localized with ECO-RAP. Part 1: Tests on simple error models. Tellus, 61A, 84-96.
12. Bishop, C.H., and D. Hodyss, 2009b: Ensemble covariances adaptively localized with ECO-RAP. Part 2: Astrategy for the atmosphere. Tellus, 61A, 97-111.
13. Boer, G.J., 1983: Homogeneous and isotropic turbulence on the sphere. J. Atmos. Sci., 40, 154-163.
14. Bouttier, F., 1993: The dynamics of error covariances in a barotropic model. Tellus, 45A, 408-423.
15. Bouttier, F., 1994: Sur la prévision de la qualitédes prévisions météorologiques (The forecast of weather forecast quality). Ph.D. dissertation, UniversitéPaul Sabatier, Toulouse, France, 240 pp. [Available from Université Paul Sabatier, 118 route de Narbonne, 31062 Toulouse CEDEX, France.].
16. Buehner, M., 2005: Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational NWP setting. Quart. J. Roy. Meteor. Soc., 131, 1013-1043.
17. Buehner, M., and M. Charron, 2007: Spectral and spatial localization of background error correlations for data assimilation. Quart. J. Roy. Meteor. Soc., 133, 615-630.
18. Courtier, P., and Coauthors, 1998: The ECMWF implementation of three-dimensional variational assimilation (3D-Var). Part I: Formulation. Quart. J. Roy. Meteor. Soc., 124, 1783-1807.
19. Daget, N., A.T. Weaver, and M.A. Balmaseda, 2009: Ensemble estimation of background-error variances in a three-dimensional variational data assimilation system for the global ocean. Quart. J. Roy. Meteor. Soc., 135, 1071-1094.
20. Daley, R., 1991: Atmospheric Data Analysis. Cambridge University Press, 460 pp.
21. Daley, R., 1992: Estimating model-error covariances for application to atmospheric data assimilation. Mon. Wea. Rev., 120, 1735-1746.
22. Deckmyn, A., and L. Berre, 2005: A wavelet approach to representing background error covariances in a limited-area model. Mon. Wea. Rev., 133, 1279-1294.
23. Derber, J., and F. Bouttier, 1999: A reformulation of the background error covariance in the ECMWF global data assimilation system. Tellus, 51A, 195-221.
24. Desroziers, G., L. Berre, B. Chapnik, and P. Poli, 2005: Diagnosis of observation, background and analysis error statistics in observation space. Quart. J. Roy. Meteor. Soc., 131, 3385-3396.
25. Drozdov, O., and A. Shepelevskii, 1946: The theory of interpolation in a stochastic field of meteorological elements and its application to meteorological map and network rationalization problems. Trudy Niu Gugms Series, Vol. 1, No. 13, Russian Hydrological and Meteorological Service.
26. Evensen, G., 1994: Sequential data assimilation with a non-linear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99, 143-162.
27. Fisher, M., 2003: Background error covariance modelling. Proc. ECMWF Seminar on Recent Developments in Data Assimilation, Reading, United Kingdom, ECMWF, 45-63.
28. Fisher, M., 2004: On the equivalence between Kalman smoothing and weak-constraint four-dimensional variational data assimilation. ECMWF Tech. Memo. 447, ECMWF, 12 pp.
29. Fisher, M., and P. Courtier, 1995: Estimating the covariance matrices of analysis and forecast error in variational data assimilation. ECMWF Tech. Memo. 220, ECMWF, 27 pp.
30. Gandin, L., 1963: Objective Analysis of Meteorological Fields (in Russian). Gridromet, 242 pp.
31. Gaspari, G., and S.E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723-757.
32. Gustafsson, N., L. Berre, S. Hörnquist, X.-Y. Huang, M. Lindskog, B. Navasques, K.S. Mogensen, and S. Thorsteinsson, 2001: Three-dimensional variational data assimilation for a limited area model. Part I: General formulation and the background error constraint. Tellus, 53A, 425-446.
33. Hamill, T.M., J.S. Whitaker, and C. Snyder, 2001: Distancedependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Wea. Rev., 129, 2776-2790.
34. Hollingsworth, A., 1987: Objective analysis for numerical weather prediction: Short-and medium-range numerical weather prediction. Proc. WMO/IUGG NWP Symp., Tokyo, Japan, Meteorological Society of Japan, 11-59.
35. Hollingsworth, A., and P. Lönnberg, 1986: The statistical structure of shortrange forecast errors as determined from radiosonde data. Part I: The wind field. Tellus, 38A, 111-136.
36. Houtekamer, P.L., and H.L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
37. Houtekamer, P.L., and H.L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 796-811.
38. Houtekamer, P.L., L. Lefaivre, J. Derome, H. Ritchie, and H.L. Mitchell, 1996: A system simulation approach to ensemble prediction. Mon. Wea. Rev., 124, 1225-1242.
39. Houtekamer, P.L., H.L. Mitchell, and X. Deng, 2009: Model error representation in an operational ensemble Kalman filter. Mon. Wea. Rev., 137, 2126-2143.
40. Ingleby, N.B., 2001: The statistical structure of forecast errors and its representation in the Met. Office Global 3-D Variational Data Assimilation Scheme. Quart. J. Roy. Meteor. Soc., 127, 209-232.
41. Isaksen, L., M. Fisher, and J. Berner, 2007: Use of analysis ensembles in estimating flow-dependent background error variance. Proc. ECMWF Workshop on Flow-Dependent Aspects of Data Assimilation, Reading, United Kingdom, ECMWF, 65-86. [Available online at http://www.ecmwf.int/publications/library/do/references/list/14092007.].
42. Kucukkaraca, E., and M. Fisher, 2006: Use of analysis ensembles in estimating flow-dependent background error variances. ECMWF Tech. Memo. 492, ECMWF, 16 pp.
43. Le Dimet, F.-X., and O. Talagrand, 1986: Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus, 38A, 97-110.
44. Li, H., E. Kalnay, and T. Miyoshi, 2009: Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter. Quart. J. Roy.Meteor. Soc., 135, 523-533.
45. Lindskog, M., N. Gustafsson, and K.S. Mogensen, 2006: Representation of background error standard deviations in a limited area model data assimilation system. Tellus, 58A, 430-444.
46. Lindskog, M., O. Vignes, N. Gustafsson, T. Landelius, and S. Thorsteinsson, 2007: Background errors in HIRLAM variational data assimilation. Proc. ECMWF Workshop on Flow-Dependent Aspects of Data Assimilation, Reading, United Kingdom, ECMWF, 113-123. [Available online at http://www.ecmwf.int/publications/library/do/references/list/14092007.].
47. Lönnberg, P., and A. Hollingsworth, 1986: The statistical structure of short-range forecast errors as determined from radiosonde data. Part II: The covariance of height and wind errors. Tellus, 38A, 137-161.
48. Lorenc, A.C., 1986: Analysis methods for numerical weather prediction. Quart. J. Roy. Meteor. Soc., 112, 1177-1194.
49. Lorenc, A.C., and Coauthors, 2000: The Met. Office global threedimensional variational data assimilation scheme. Quart. J.Roy. Meteor. Soc., 126, 2991-3012.
50. McNally, A., 2000: Estimates of short-term forecast-temperature error correlations and the implications for radiance-data assimilation. Quart. J. Roy. Meteor. Soc., 126, 361-373.
51. Monin, A.S., and A.M. Yaglom, 1971: Statistical Fluid Mechanics. Vol. 1, Mechanics of Turbulence, The MIT Press, 782 pp.
52. Pannekoucke, O., 2008: Modélisation des structures locales de covariance des erreurs de prévision à l'aide des ondelettes (Modelling of local covariance structures of forecast errors using wavelets). Ph.D. dissertation, Université Paul Sabatier, 207 pp. [Available from Université Paul Sabatier, 118 route de Narbonne, 31062 Toulouse CEDEX, France.].
53. Pannekoucke, O., L. Berre, and G. Desroziers, 2007: Filtering properties of wavelets for local background error correlations. Quart. J. Roy. Meteor. Soc., 133, 363-379.
54. Pannekoucke, O., L. Berre, and G. Desroziers, 2008: Background-error correlation lengthscale estimates and their sampling statistics. Quart. J. Roy. Meteor. Soc., 134, 497-508.
55. Parrish, D.F., and J.C. Derber, 1992: The National Meteorological Center's Spectral Statistical Interpolation analysis system. Mon. Wea. Rev., 120, 1747-1763.
56. Rabier, F., A. McNally, E. Andersson, P. Courtier, P. Undén, J. Eyre, A. Hollingsworth, and F. Bouttier, 1998: TheECMWF implementation of three-dimensional variational assimilation (3D-Var). II: Structure functions. Quart. J. Roy. Meteor. Soc., 124, 1809-1829.
57. Raynaud, L., L. Berre, and G. Desroziers, 2008: Spatial averaging of ensemble-based background-error variances. Quart. J. Roy. Meteor. Soc., 134, 1003-1014.
58. Raynaud, L., L. Berre, and G. Desroziers, 2009: Objective filtering of ensemble-based background-error variances. Quart. J. Roy. Meteor. Soc., 135, 1177-1199.
59. Rhodin, A., and H. Anlauf, 2007: Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices. Proc. ECMWF Workshop on Flow-Dependent Aspects of Data Assimilation, Reading, United Kingdom, ECMWF, 169-183. [Available online at http://www.ecmwf.int/publications/library/do/references/list/14092007.].
60. Rutherford, I.D., 1972: Data assimilation by statistical interpolation of forecast error fields. J. Atmos. Sci., 29, 809-815.
61. Sacher, W., and P. Bartello, 2008: Sampling errors in the ensemble Kalman filtering. Mon. Wea. Rev., 136, 3035-3049.
62. Talagrand, O., 1997: Assimilation of observations, an introduction. J. Meteor. Soc. Japan, 75, 191-209.
63. Thépaut, J.-N., P. Courtier, G. Belaud, and G. Lemaître, 1996: Dynamical structure functions in a four-dimensional variational assimilation: A case study. Quart. J. Roy. Meteor. Soc., 122, 535-561.
64. Weaver, A.T., and P. Courtier, 2001: Correlation modelling on the sphere using a generalized diffusion equation. Quart. J. Roy. Meteor. Soc., 127, 1815-1846.
65. Wu, W.-S., R.J. Purser, and D.F. Parrish, 2002: Three-dimensional variational analysis with spatially inhomogeneous covariances. Mon. Wea. Rev., 130, 2905-2916.
66. Xu, Q., H. Lu, S. Gao, M. Xue, and M. Tong, 2008: Time-expanded sampling for ensemble Kalman filter: Assimilation experiments with simulated radar observations. Mon. Wea. Rev., 136, 2651-2667.
67. Yang, S.C., E. Kalnay, B. Hunt, and N.E. Bowler, 2009: Weight interpolation for efficient data assimilation with the Local Ensemble Transform Kalman Filter. Quart. J. Roy. Meteor. Soc., 135, 251-262.