Maximum likelihood estimation of error covariances in ensemble-based filters and its application to a coupled atmosphere-ocean model

Quarterly Journal of the Royal Meteorological Society

Volumn 136, Issue 650, 2010, Pages 1316-1343

  Ueno, Genta ^a,b   Higuchi, Tomoyuki ^a,b   Kagimoto, Takashi ^c   Hirose, Naoki ^d  

^a INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c JAPAN AGENCY FOR MARINE EARTH SCIENCE AND TECHNOLOGY   (Japan)

^d KYUSHU UNIVERSITY   (Japan)

Author keywords

Data assimilation; El Ni o; Ensemble Kalman filter; Westerly wind bursts

Indexed keywords

BOOTSTRAP METHOD; COUPLED MODELS; COVARIANCE PARAMETERS; DATA ASSIMILATION; ENSEMBLE KALMAN FILTER; ERROR COVARIANCES; EVOLUTION PROCESS; FILTERING METHOD; INTERMEDIATE COUPLED MODEL; KALMAN SMOOTHER; NON-LINEARITY; OBSERVATION EQUATION; OBSERVATION NOISE; OCEAN MODEL; OPTIMAL ERROR; OPTIMAL PARAMETER; SAMPLING ERRORS; SEA SURFACE TEMPERATURES; STATISTICAL SIGNIFICANCE; SYSTEM EQUATIONS; SYSTEM NOISE; TOPEX/POSEIDON; WESTERLY WIND BURSTS; WESTERN PACIFIC; WIND ANOMALIES;

CONTROL NONLINEARITIES; DATA PROCESSING; ESTIMATION; GEODETIC SATELLITES; KALMAN FILTERS; NICKEL COMPOUNDS; NONLINEAR EQUATIONS; OCEANOGRAPHY; OPTIMIZATION; SAMPLING; WIND STRESS;

MAXIMUM LIKELIHOOD ESTIMATION;

ATMOSPHERE-OCEAN COUPLING; BOOTSTRAPPING; COVARIANCE ANALYSIS; DATA ASSIMILATION; EL NINO; ENSEMBLE FORECASTING; GENERAL CIRCULATION MODEL; KALMAN FILTER; MAXIMUM LIKELIHOOD ANALYSIS; NONLINEARITY; TOPEX-POSEIDON; WESTERLY;

PACIFIC OCEAN;

EID: 77956199369     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.654     Document Type: Article

References (84)

1. Anderson BDO, Moore JB. 2005. Optimal filtering. Dover Publications: New York.
2. Ballabrera-Poy J, Busalacchi AJ, Murtugudde R. 2001. Application of a reduced-order Kalman filter to initialize a coupled atmosphere-ocean model: Impact on the prediction of ElNiño. J. Climate 14: 1720-1737.
3. Batstone C, Hendon HH. 2005. Characteristics of stochastic variability associated with ENSO and the role of the MJO. J. Climate 18: 1773-1789.
4. Bennett AF, Chua BS, Harrison DE, McPhaden MJ. 1998. Generalized inversion of Tropical Atmosphere-Ocean data and a coupled model of the tropical Pacific. J. Climate 11: 1768-1792.
5. Bennett AF, Chua BS, Harrison DE, McPhaden MJ. 2000. Generalized inversion of Tropical Atmosphere-Ocean (TAO) data and a coupled model of the tropical Pacific. Part II: The 1995-96 La Niña and 1997-98 El Niño. J. Climate 13: 2770-2785.
6. Blanchet I, Frankignoul C, Cane MA. 1997. A comparison of adaptive Kalman filters for a tropical Pacific Ocean model. Mon. Weather Rev. 125: 40-58.
7. Boulanger J-P, Menkes C, Lengaigne M. 2004. Role of high- and low-frequency winds and wave reflection in the onset, growth and termination of the 1997-1998 El Niño. Clim. Dyn. 22: 267-280.
8. Busalacchi AJ, Cane MA. 1985. Hindcasts of sea level variations during the 1982-83 El Niño. J. Phys. Oceanogr. 15: 213-221.
9. Cane MA. 1984. Modeling sea level during El Niño. J. Phys. Oceanogr. 14: 1864-1874.
10. Cane MA, Patton RJ. 1984. A numerical model for low-frequency equatorial dynamics. J. Phys. Oceanogr. 14: 1853-1863.
11. Chapnik B, Desroziers G, Rabier F, Talagrand O. 2004. Properties and first application of an error statistics tuning method in variational assimilation. Q. J. R. Meteorol. Soc. 130: 2253-2275.
12. Chen D, Cane MA. 2008. El Niño prediction and predictability. J. Comput. Phys. 227: 3625-3640.
13. Cohn SE. 1997. An introduction to estimation theory. J. Meteorol. Soc. Japan 75: 257-288.
14. Dee DP. 1995. On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Weather Rev. 123: 1128-1145.
15. Dee DP, da Silva AM. 1999. Maximum-likelihood estimation of forecast and observation error covariance parameters. Part I: Methodology. Mon. Weather Rev. 127: 1822-1834.
16. Dee DP, Gaspari G, Redder C, Rukhovets L, da Silva AM. 1999. Maximum-likelihood estimation of forecast and observation error covariance parameters. Part II: Applications. Mon. Weather Rev. 127: 1835-1849.
17. Desroziers G, Ivanov S. 2001. Diagnosis and adaptive tuning of observation-error parameters in a variational assimilation. Q. J. R. Meteorol. Soc. 127: 1433-1452.
18. Desroziers G, Berre L, Chapnik B, Poli P. 2005. Diagnosis of observation, background and analysis-error statistics in observation space. Q. J. R. Meteorol. Soc. 131: 3385-3396.
19. Diggle PJ, Ribeiro Jr PJ. 2007. Model-based geostatistics. Springer Series in Statistics. Springer-Verlag: Berlin.
20. Efron B, Tibshirani RJ. 1993. An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability, No. 57. Chapman and Hall/CRC Press.
21. Eisenman I, Yu L, Tziperman E. 2005. Westerly wind bursts: ENSO's tail rather than the dog? J. Climate 18: 5224-5238.
22. Evensen G. 2003. The Ensemble Kalman Filter: Theoretical formulation and practical implementation. Ocean Dyn. 53: 343-367.
23. Fedorov AV. 2002. The response of the coupled tropical ocean-atmosphere to westerly wind bursts. Q. J. R. Meteorol. Soc. 128: 1-23.
24. Fletcher SJ, Zupanski M. 2006. A data assimilation method for lognormally distributed observational errors. Q. J. R. Meteorol. Soc. 132: 2505-2519.
25. Fu L-L, Fukumori I, Miller RN. 1993. Fitting dynamic models to the Geosat sea level observations in the tropical Pacific Ocean. Part II: A linear, wind-driven model. J. Phys. Oceanogr. 23: 2162-2181.
26. Fukumori I. 1995. Assimilation of TOPEX sea level measurements with a reduced-gravity, shallow-water model of the tropical Pacific Ocean. J. Geophys. Res. 100: 25027-25039.
27. Fukumori I. 2001. Data assimilation by models. In Satellite altimetry and earth sciences, Fu L-L, Cazenave A. (eds.) 237-265. International Geophysics Series No. 69. Academic Press.
28. Gaspar P, Wunsch C. 1989. Estimates from altimeter data of barotropic Rossby waves in the northwestern Atlantic Ocean. J. Phys. Oceanogr. 19: 1821-1844.
29. Gebbie G, Tziperman E. 2009. Predictability of SST-modulated westerly wind bursts. J. Climate 22: 3894-3909.
30. Gebbie G, Eisenman I, Wittenberg A, Tziperman E. 2007. Modulation of westerly wind bursts by sea surface temperature: A semi-stochastic feedback for ENSO. J. Atmos. Sci. 64: 3281-3295.
31. Gelb A. (ed.) 1974. Applied Optimal Estimation. MIT Press.
32. Gill AE. 1982. Atmosphere-Ocean Dynamics. International Geophysics Series No. 30. Academic Press.
33. Gordon NJ, Salmond DJ, Smith AFM. 1993. Novel approach to nonlinear/non-Gaussian Bayesian state estimation. Radar and Signal Processing, IEE Proceedings-F 140: 107-113.
34. Hendon HH, Wheeler MC, Zhang C. 2007. Seasonal dependence of the MJO-ENSO relationship- J. Climate 20: 531-543.
35. Higuchi T. 1995. On the resampling scheme in the filtering procedure of the Kitagawa Monte Carlo Filter. Research Memo. No. 556. Institute of StatisticalMathematics: Tokyo.
36. Hoang S, Baraille R, Talagrand O, Carton X, De Mey P. 1997. Adaptive filtering: Application to satellite data assimilation in oceanography. Dyn. Atmos. Oceans 27: 257-281.
37. Kaplan A, Cane MA, Chen D, Witter DL, Cheney RE. 2004. Small-scale variability and model error in tropical Pacific sea level. J. Geophys. Res. 109: C02001, DOI: 10.1029/2002JC001743.
38. Karspeck AR, Anderson JL. 2007. Experimental implementation of an ensemble adjustment filter for an intermediate ENSO model. J. Climate 20: 4638-4658.
39. Kitagawa G. 1993. 'A Monte Carlo filtering and smoothing method for non-Gaussian nonlinear state space models'. In Proceedings of the 2nd US-Japan Seminar on Statistical Time Series Analysis, Honolulu, Hawaii, 25-29 January 1993. 110-131.
40. Kitagawa G. 1996. Monte Carlo filter and smoother for non-Gaussian nonlinear state space models. J. Comput. Graph. Statist. 5: 1-25.
41. Kitagawa G, Gersch W. 1996. Smoothness priors analysis of time series. Lecture Notes in Statistics No. 116. Bickel P, Diggle P, Fienberg S, Krickeberg K, Olkin I, Wermuth N, Zeger S. (eds.) Springer-Verlag: New York.
42. Kondrashov D, Sun C, Ghil M. 2008. Data assimilation for a coupled ocean-atmosphere model. Part II: Parameter estimation. Mon. Weather Rev. 136: 5062-5076.
43. Kug J-S, Jin F-F, Sooraj KP, Kang I-S. 2008. State-dependent atmospheric noise associated with ENSO. Geophys. Res. Lett. 35: L05701, DOI: 10.1029/2007GL032017.
44. Kug J-S, Sooraj KP, Kim D, Kang I-S, Jin F-F, Takayabu YN, Kimoto M. 2009. Simulation of state-dependent high-frequency atmospheric variability associated with ENSO. Clim. Dyn. 32: DOI: 10.1007/s00382-008-0434-2.
45. Lee T, Boulanger J-P, Foo A, Fu L-L, Giering R. 2000. Data assimilation by an intermediate coupled ocean-atmosphere model: Application to the 1997-1998 El Niño. J. Geophys. Res. 105: 26063-26087.
46. Lengaigne M, Guilyardi E, Boulanger J-P, Menkes C, Delecluse P, Inness P, Cole J, Slingo J. 2004. Triggering of El Niño by westerly wind events in a coupled general circulation model. Clim. Dyn. 23: 601-620.
47. Magnus JR, Neudecker H. 1999. Matrix Differential Calculus with applications in Statistics and Econometrics. Wiley Series in Probability and Statistics. John Wiley and Sons: Chichester, UK.
48. Maybeck PS. 1982. Stochastic models, estimation, and control, Vol. 2. Mathematics in Science and Engineering, vol. 141-2 Academic Press.
49. McPhaden MJ. 1999. Genesis and evolution of the 1997-98 El Niño. Science 283: 950-954.
50. McPhaden MJ. 2004. Evolution of the 2002-03 El Niño. Bull. Am. Meteorol. Soc. 85: 677-695.
51. McPhaden MJ. 2008. Evolution of the 2006-07 El Niño: The role of intraseasonal to interannual time-scale dynamics. Adv. Geosci. 14: 219-230.
52. Mehra RK. 1970. On the identification of variances and adaptive Kalman filtering. IEEE Trans. Autom. Control AC-15: 175-184.
53. Menemenlis D, Chechelnitsky M. 2000. Error estimates for an ocean general circulation model from altimeter and acoustic tomography data. Mon. Weather Rev. 128: 763-778.
54. Miller RN, Cane MA. 1989. A Kalman filter analysis of sea level height in the tropical Pacific. J. Phys. Oceanogr. 19: 773-790.
55. Miller RN, Busalacchi AJ, Hackert EC. 1995. Sea surface topography fields of the tropical Pacific from data assimilation. J. Geophys. Res. 100: 13389-13425.
56. Mitchell HL, Houtekamer PL. 2000. An adaptive ensemble Kalman filter. Mon. Weather Rev. 128: 416-433.
57. Myers KA, Tapley BD. 1976. Adaptive sequential estimation with unknown noise statistics. IEEE Trans. Autom. Control 21: 520-523.
58. Neelin JD, Battisti DS, Hirst AC, Jin F-F, Wakata Y, Yamagata T, Zebiak SE. 1998. ENSO theory. J. Geophys. Res. 103: 14261-14290.
59. Perez CL, Moore AM, Zavala-Garay J, Kleeman R. 2005. A comparison of the influence of additive and multiplicative stochastic forcing on a coupled model of ENSO. J. Climate 18: 5066-5085.
60. Perigaud CM, Cassou C. 2000. Importance of oceanic decadal trends and westerly wind bursts for forecasting El Niño. Geophys. Res. Lett. 27: 389-392.
61. Purser RJ, Parrish DF. 2003. A Bayesian technique for estimating continuously varying statistical parameters of a variational assimilation. Meteorol. Atmos. Phys. 82: 209-226.
62. Reynolds RW, Rayner NA, Smith TM, Stokes DC, Wang W. 2002. An improved insitu and satellite SST analysis for climate. J. Climate 15: 1609-1625.
63. Roulston MS, Neelin JD. 2000. The response of an ENSO model to climate noise, weather noise and intraseasonal forcing. Geophys. Res. Lett. 27: 3723-3726.
64. Saad Y. 2003. Iterative Methods for Sparse Linear Systems. SIAM.
65. Seiki A, Takayabu YN. 2007. Westerly wind bursts and their relationship with intraseasonal variations and ENSO. Part I: Statistics. Mon. Weather Rev. 135: 3325-3345.
66. Sun C, Hao Z, Ghil M, Neelin JD. 2002. Data assimilation for a coupled ocean-atmosphere model. Part I: Sequential state estimation. Mon. Weather Rev. 130: 1073-1099.
67. Talagrand O. 1999. 'A posteriori evaluation and verification of analysis and assimilation algorithms'. In Proceedings of Workshop on Diagnosis of Data Assimilation Systems, 2-4 November 1998. ECMWF: Reading, UK. 17-28.
68. Tziperman E, Yu L. 2007. Quantifying the dependence of westerly wind bursts on the large-scale tropical Pacific SST. J. Climate 20: 2760-2768.
69. Ueno G, Tsuchiya T. 2009. Covariance regularization in inverse space. Q. J. R. Meteorol. Soc. 135: 1133-1156.
70. Ueno G, Higuchi T, Kagimoto T, Hirose N. 2006. 'Prediction of ocean state by data assimilation with the ensemble Kalman filter'. In Proceedings of Joint 3rd International Conference on Soft Computing and Intelligent Systems and 7th International Symposium on advanced Intelligent Systems (SCIS and ISIS 2006). Tokyo. 1884-1889.
71. Ueno G, Higuchi T, Kagimoto T, Hirose N. 2007. Application of the ensembleKalman filter and smoother to a coupled atmosphere-ocean model. SOLA 3: 5-8.
72. van Leeuwen PJ. 2009. Particle filtering in geophysical systems. Mon. Weather Rev. 137: 4089-4114.
73. Vecchi GA, Harrison DE. 2000. Tropical Pacific sea surface temperature anomalies, El Niño, and equatorial westerly wind events. J. Climate 13: 1814-1830.
74. Vecchi GA, Wittenberg AT, Rosati A. 2006. Reassessing the role of stochastic forcing in the 1997-1998 El Niño. Geophys. Res. Lett. 33: L01706, DOI: 10.1029/2005GL024738.
75. Yu L, Weller RA, Liu WT. 2003. Case analysis of a role of ENSO in regulating the generation of westerly wind bursts in the Western Equatorial Pacific. J. Geophys. Res. 108: C4, 3128, DOI: 10.1029/2002JC001498.
76. Zavala-Garay J, Moore AM, Perez CL, Kleeman R. 2003. The response of a coupled model of ENSO to observed estimates of stochastic forcing. J. Climate 16: 2827-2842.
77. Zavala-Garay J, Zhang C, Moore AM, Kleeman R. 2005. The linear response of ENSO to the Madden-Julian Oscillation. J. Climate 18: 2441-2459.
78. Zavala-Garay J, Zhang C, Moore AM, Wittenberg AT, Harrison MJ, Rosati A, Vialard J, Kleeman R. 2008. Sensitivity of hybrid ENSO models to unresolved atmospheric variability. J. Climate 21: 3704-3721.
79. Zebiak SE, Cane MA. 1987. A model El Niño-Southern Oscillation. Mon. Weather Rev. 115: 2262-2278.
80. Zhang C, Gottschalck J. 2002. SST anomalies of ENSO and the Madden-Julian oscillation in the equatorial Pacific. J. Climate 15: 2429-2445.
81. Zheng F, Zhu J. 2008. Balanced multivariate model errors of an intermediate coupled model for ensemble Kalman filter data assimilation. J. Geophys. Res. 113: C07002, DOI: 10.1029/2007JC004621.
82. Zheng F, Zhu J, Zhang R-H, Zhou G-Q. 2006. Ensemble hindcasts of SST anomalies in the tropical Pacific using an intermediate coupled model. Geophys. Res. Lett. 33: L19604, DOI: 10.1029/2006GL026994.
83. Zheng F, Zhu J, Zhang R-H. 2007. Impact of altimetry data on ENSO ensemble initializations and predictions. Geophys. Res. Lett. 34: L13611, DOI: 10.1029/2007GL030451.
84. Zheng F, Zhu J, Wang H, Zhang R-H. 2009. Ensemble hindcasts of ENSO events over the past 130 years using a large number of ensembles. Adv. Atmos. Sci. 26: C07002, 359-327. DOI: 10.1007/s00376-009-0359-7.