Covariance regularization in inverse space

Quarterly Journal of the Royal Meteorological Society

Volumn 135, Issue 642, 2009, Pages 1133-1156

  Ueno, Genta ^a,b   Tsuchiya, Takashi ^a  

^a INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

4D Var; Covariance selection; Data assimilation; Ensemble kalman filter; Gaussian graphical model

Indexed keywords

4D-VAR; COVARIANCE SELECTION; DATA ASSIMILATION; ENSEMBLE KALMAN FILTER; GAUSSIAN GRAPHICAL MODEL;

CONTROL THEORY; DATA PROCESSING; GRAPHIC METHODS; KALMAN FILTERS; MAXIMUM LIKELIHOOD; NEWTON-RAPHSON METHOD; VALUE ENGINEERING;

COVARIANCE MATRIX;

CORRELATION; COVARIANCE ANALYSIS; DATA ASSIMILATION; ENSEMBLE FORECASTING; GAUSSIAN METHOD; GRAPHICAL METHOD; INVERSE ANALYSIS; KALMAN FILTER; NUMERICAL MODEL; WAVELET ANALYSIS; WEATHER FORECASTING;

EID: 70149119424     PISSN: 00359009     EISSN: None     Source Type: Journal    
DOI: 10.1002/qj.445     Document Type: Article

References (61)

1. Akaike H. 1974. A new look at the statistical model identification. IEEE Trans. Autom. Control AC-19: 716-723.
2. Akaike H. 1977. 'On entropy maximization principle'. In Applications of Statistics, Proceedings of the symposium held at Wright State University, Dayton, Ohio, 14-18 June 1976, Krishnaiah PR. (ed.) North-Holland Publishing Company: Amsterdam, pp 27-41.
3. Alves O, Robert C. 2005. Tropical Pacific Ocean model error covariances from Monte Carlo simulations. Q. J. R. Meteorol. Soc. 131: 3643-3658, DOI: 10.1256/qj.05.113.
4. Bishop CH, Hodyss D. 2007. Flow-adaptive moderation of spurious ensemble correlations and its use in ensemble-based data assimilation. Q. J. R. Meteorol. Soc. 133: 2029-2044, DOI: 10.1002/qj.169.
5. Borovikov A, Rienecker MM, Keppenne CL, Johnson GC. 2005. Multivariate error covariance estimates by Monte Carlo simulation for assimilation studies in the Pacific Ocean. Mon. Weather Rev. 133: 2310-2334, DOI: 10.1175/MWR2984.1.
6. Boyd S, Vandenberghe L. 2004. Convex optimization. Cambridge University Press: Cambridge, UK.
7. Buehner M. 2005. Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational nwp setting. Q. J. R. Meteorol. Soc. 131: 1013-1043.
8. Buehner M, Charron M. 2007. Spectral and spatial localization of background-error correlations for data assimilation. Q. J. R. Meteorol. Soc. 133: 615-630.
9. Chin TM, Mariano AJ, Chassignet EP. 1999. Spatial regression and multiscale approximations for sequential data assimilation in ocean models. J. Geophys. Res. 104(C4): 7991-8014.
10. Courtier P, Th́epaut JN, Hollingsworth A. 1994. A strategy for operational implementation of 4D-Var, using an incremental approach. Q. J. R. Meteorol. Soc. 120: 1367-1387.
11. Courtier P, Andersson E, Heckley W, Pailleux J, Vasiljević D, Hamrud M, Hollingsworth A, Rabier F, Fisher M. 1998. The ECMWF implementation of three-dimensional variational assimilation (3DVar). I: Formulation. Q. J. R. Meteorol. Soc. 124: 1783-1807.
12. Cullen MJP. 2003. Four-dimensional variational data assimilation: A new formulation of the background-error covariance matrix based on a potential-vorticity representation. Q. J. R. Meteorol. Soc. 129: 2777-2796, DOI: 10.1256/qj.02.10.
13. Daley R. 1991. Atmospheric data analysis, Cambridge Atmospheric and Space Science Series, vol. 2. Cambridge University Press: Cambridge, UK.
14. Deckmyn A, Berre L. 2005. A wavelet approach to representing background error covariances in a limited-area model. Mon.Weather Rev. 133: 1279-1294, DOI: 10.1175/MWR2929.1.
15. Dempster AP. 1972. Covariance selection. Biometrics 28(1): 157-175.
16. Derber J, Bouttier F. 1999. A reformulation of the background error covariance in the ECMWF global data assimilation system. Tellus A 51(2): 195-221.
17. Derber J, Rosati A. 1989. A global oceanic data assimilation system. J. Phys. Oceanogr. 19: 1333-1347.
18. Desroziers G. 1997. A coordinate change for data assimilation in spherical geometry of frontal structures. Mon. Weather Rev. 125: 3030-3038.
19. Diggle PJ, Ribeiro PJ, Jr. 2007. Model-based geostatistics. Springer Series in Statistics, Springer-Verlag: Berlin.
20. Egbert GD, Bennett AF, Foreman MGG. 1994. TOPEX/POSEIDON tides estimated using a global inverse model. J. Geophys. Res. 99(C12): 24821-24852.
21. Evensen G. 2003. The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dyn. 53: 343-367.
22. Fisher M. 2003. 'Background-error covariance modelling'. In Proceedings of seminar on Recent developments in data assimilation for atmosphere and ocean, 8-12 September 2003. ECMWF: Reading, UK, pp 45-64.
23. Fisher M, Andersson E. 2001. 'Developments in 4D-Var and Kalman filtering'. Technical Memorandum 347, ECMWF: Reading, UK.
24. Frehlich R. 2006. Adaptive data assimilation including the effect of spatial variations in observation error. Q. J. R. Meteorol. Soc. 132: 1225-1257, DOI: 10.1256/qj.05.146.
25. Fu LL, Fukumori I, Miller RN. 1993. Fitting dynamic models to the Geosat sea level observations in the tropical Pacific Ocean. Part II: A linear, wind-driven model. J. Phys. Oceanogr. 23: 2162-2181.
26. Fukumori I. 2001. Data assimilation by models. In: Satellite altimetry and earth sciences, International Geophysics Series, vol. 69, Fu LL, Cazenave A. (eds.) Academic Press: pp 237-265.
27. Gaspari G, Cohn SE. 1999. Construction of correlation functions in two and three dimensions. Q. J. R. Meteorol. Soc. 125: 723-757.
28. Gaspari G, Cohn SE, Guo J, Pawson S. 2006. Construction and application of covariance functions with variable length-fields. Q. J. R. Meteorol. Soc. 132: 1815-1838, DOI: 10.1256/qj.05.08.
29. Gauthier P, Buehner M, Fillion L. 1998. 'Background-error statistics modelling in a 3D variational data assimilation scheme: Estimation and impact on the analyses'. In Proceedings of Workshop on diagnosis of data assimilation systems, 2-4 November 1998. ECMWF: Reading, UK. pp 131-145.
30. Gneiting T. 1999. Correlation functions for atmospheric data analysis. Q. J. R. Meteorol. Soc. 125: 2449-2449.
31. Gneiting T. 2002. Compactly supported correlation functions. J. Multivariate Anal. 83: 493-508, DOI: 10.1006/jmva.2001.2056.
32. Hamill TM, Whitaker JS, Snyder C. 2001. Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Weather Rev. 129: 2776-2790.
33. Hollingsworth A, Lönnberg P. 1986. The statistical structure of shortrange forecast errors as determined from radiosonde data. Part I: The wind field. Tellus A 38(2): 111-136.
34. Houtekamer PL, Lefaivre L, Derome J, Ritchie H, Mitchell HL. 1996. A system simulation approach to ensemble prediction. Mon.Weather Rev. 124(6): 1225-1242.
35. Houtekamer PL, Mitchell HL. 2001. A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev. 129: 123-137.
36. Jackson DR, Keil M, Devenish BJ. 2008. Use of Canadian Quick covariances in the Met Office data assimilation system. Q. J. R. Meteorol. Soc. 134: 1567-1582, DOI: 10.1002/qj.294.
37. Keppenne CL, Rienecker MM, Jacob JP, Kovach R. 2008. Error covariance modeling in the GMAO ocean ensemble Kalman filter. Mon. Weather Rev. 136: 2964-2982, DOI: 10.1175/2007MWR2243.1.
38. Konishi S, Kitagawa G. 2007. Information criteria and statistical modeling. Springer Series in Statistics. Springer: Berlin.
39. Lauritzen SL. 1996. Graphical models. Oxford Statistical Science Series, vol. 17. Oxford University Press: Oxford, UK.
40. Lönnberg P, Hollingsworth A. 1986. The statistical structure of shortrange forecast errors as determined from radiosonde data. Part II: The covariance of height and wind errors. Tellus A 38(2): 137-161.
41. Lorenc AC. 1992. Iterative analysis using covariance functions and filters. Q. J. R. Meteorol. Soc. 118: 569-591.
42. Lorenc AC. 1997. Development of an operational variational assimilation scheme. J. Meteorol. Soc. Japan 75(1B): 339-346.
43. Magnus JR, Neudecker H. 1999. Matrix differential calculus with applications in statistics and econometrics. Wiley Series in Probability and Statistics, John Wiley & Sons:
44. Menemenlis D, Chechelnitsky M. 2000. Error estimates for an ocean general circulation model from altimeter and acoustic tomography data. Mon. Weather Rev. 128(3): 763-778, DOI: 10.1175/1520-0493(2000)128<0763:EEFAOG>2.0.CO;2.
45. Nychka D, Wikle C, Royle JA. 2002. Multiresolution models for nonstationary spatial covariance functions. Statistical Modelling 2(4): 315-331, DOI: 10.1191/1471082x02st037oa.
46. Oke PR, Allen JS, Miller RN, Egbert GD, Kosro PM. 2002. Assimilation of surface velocity data into a primitive equation coastal ocean model. J. Geophys. Res. 107(C9): DOI: 10.1029/2000JC000511.
47. Pannekoucke O, Berre L, Desroziers G. 2007. Filtering properties of wavelets for local background-error correlations. Q. J. R. Meteorol. Soc. 133: 363-379, DOI: 10.1002/qj.33.
48. Pannekoucke O, Berre L, Desroziers G. 2008. Background-error correlation length-scale estimates and their sampling statistics. Q. J. R. Meteorol. Soc. 134: 497-508, DOI: 10.1002/qj.212.
49. Parrish DF, Derber JC. 1992. The National Meteorological Center's spectral statistical-interpolation analysis system. Mon. Weather Rev. 120: 1747-1763.
50. Polavarapu S, Ren S, Rochon Y, Sankey D, Ek N, Koshyk J, Tarasick D. 2005. Data assimilation with the Canadian Middle Atmosphere Model. Atmos.-Ocean 43(1): 77-100.
51. Purser RJ, Wu WS, Parrish DF, Roberts NM. 2003a. Numerical aspects of the application of recursive filters to variational statistical analysis. Part I: Spatially homogeneous and isotropic Gaussian covariances. Mon. Weather Rev. 131(8): 1524-1535.
52. Purser RJ, Wu WS, Parrish DF, Roberts NM. 2003b. Numerical aspects of the application of recursive filters to variational statistical analysis. Part II: Spatially inhomogeneous and anisotropic general covariances. Mon. Weather Rev. 131(8): 1536-1548, DOI: 10.1175//2543.1.
53. Raynaud L, Berre L, Desroziers G. 2008. Spatial averaging of ensemble-based background-error variances. Q. J. R. Meteorol. Soc. 134: 1003-1014, DOI: 10.1002/qj.245.
54. Rhodin A, Anlauf H. 2007. Representation of inhomogeneous, nonseparable covariances by sparse wavelet-transformed matrices. In Proceedings of workshop on Flow-dependent aspects of data assimilation, 11-13 June 2007. ECMWF: Reading, UK. pp 169-183.
55. Riishøjgaard LP. 1998. A direct way of specifying flow-dependent background error correlations for meteorological analysis systems. Tellus A 50(1): 42-57.
56. Schwarz G. 1978. Estimating the dimension of a model. Ann. Stat. 6(2): 461-464.
57. Trémolet Y. 2007. Model-error estimation in 4D-Var. Q. J. R. Meteorol. Soc. 133: 1267-1280, DOI: 10.1002/qj.94.
58. Tsuchiya T, Xia Y. 2007. An extension of the standard polynomial-time primal-dual path-following algorithm to the weighted determinant maximization problem with semidefinite constraints. Pacific J. Optimization 3(1): 165-182.
59. Ueno G, Higuchi T, Kagimoto T, Hirose N. 2007. Application of the ensemble Kalman filter and smoother to a coupled atmosphereocean model. SOLA 3(1): 5-8.
60. Vandenberghe L, Boyd S, Wu SP. 1998. Determinant maximization with linear matrix inequality constraints. SIAM J. Matrix Anal. Appl. 19(2): 499-533.
61. Weaver A, Courtier P. 2001. Correlation modelling on the sphere using a generalized diffusion equation. Q. J. R. Meteorol. Soc. 127: 1815-1846.