EnKF and hybrid gain ensemble data assimilation. Part I: EnKF implementation

Monthly Weather Review

Volumn 143, Issue 12, 2015, Pages 4847-4864

  Hamrud, Mats ^a   Bonavita, Massimo ^a   Isaksen, Lars ^a  

^a EUROPEAN CENTRE FOR MEDIUM RANGE WEATHER FORECASTS   (United Kingdom)

Author keywords

Data assimilation; Kalman filters; Mathematical and statistical techniques; Models and modeling

Indexed keywords

KALMAN FILTERS; MATHEMATICAL MODELS; METEOROLOGY;

COMPUTATIONAL PROPERTIES; DATA ASSIMILATION; ENSEMBLE BASED DATA ASSIMILATION; ENSEMBLE DATA ASSIMILATION; HORIZONTAL RESOLUTION; NOVEL ALGORITHM; STATE OF THE ART; STATISTICAL TECHNIQUES;

ALGORITHMS;

ALGORITHM; DATA ASSIMILATION; ENSEMBLE FORECASTING; KALMAN FILTER; NUMERICAL MODEL; WEATHER FORECASTING; WIND FIELD;

EID: 84957827985     PISSN: 00270644     EISSN: 15200493     Source Type: Journal    
DOI: 10.1175/MWR-D-14-00333.1     Document Type: Article

References (55)

1. Anderson, E., and H. Järvinen, 1999: Variational quality control. Quart. J. Roy. Meteor. Soc., 125, 697-722, doi:10.1002/qj.49712555416.
2. Anderson, J. L., 2009: Spatially and temporally varying adaptive covariance inflation for ensemble filters. Tellus, 61A, 72-83, doi:10.1111/j.1600-0870.2008.00361.x.
3. Anderson, J. L., and N. Collins, 2007: Scalable implementations of ensemble filter algorithms for data assimilation. J. Atmos. Oceanic Technol., 24, 1452-1463, doi:10.1175/JTECH2049.1.
4. 3 2013 Third Workshop on Irregular Applications: Architectures and Algorithms, Denver, CO, ACM, doi:10.1145/2535753.2535760. [Available online at http://nldr.library.ucar.edu/repository/assets/osgc/OSGC-000-000-020-135.pdf.]
5. Berner, J., G. J. Shutts, M. Leutbecher, and T. N. Palmer, 2009: A spectral stochastic kinetic energy backscatter scheme and its impact on flow-dependent predictability in the ECMWF ensemble prediction system. J. Atmos. Sci., 66, 603-626, doi:10.1175/2008JAS2677.1.
6. Bonavita, M., L. Isaksen, and E. Holm, 2012: On the use of EDA background error variances in the ECMWF 4D-Var. Quart. J. Roy. Meteor. Soc., 138, 1540-1559, doi:10.1002/qj.1899.
7. Bonavita, M., M. Hamrud, and L. Isaksen, 2015a: EnKF and hybrid gain ensemble data assimilation. Part II: EnKF and hybrid gain results. Mon. Wea. Rev., 143, 4865-4882, doi:10.1175/MWR-D-15-0071.1.
8. Bonavita, M., E. Hólm, L. Isaksen, and M. Fisher, 2015b: The evolution of the ECMWF hybrid data assimilation system. Quart. J. Roy. Meteor. Soc., doi:10.1002/qj.2652, in press.
9. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010a: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part I: Description and single-observation experiments. Mon. Wea. Rev., 138, 1550-1566, doi:10.1175/2009MWR3157.1.
10. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010b: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: One-month experiments with real observations. Mon. Wea. Rev., 138, 1567-1586, doi:10.1175/2009MWR3158.1.
11. Buizza, R., M. Miller, and T. N. Palmer, 1999: Stochastic representation of model uncertainties in the ECMWF Ensemble Prediction System. Quart. J. Roy. Meteor. Soc., 125, 2887-2908, doi:10.1002/qj.49712556006.
12. Clayton, A. M., A. C. Lorenc, and D. M. Barker, 2013: Operational implementation of a hybrid ensemble/4D-Var global data assimilation system at the Met Office. Quart. J. Roy. Meteor. Soc., 139, 1445-1461, doi:10.1002/qj.2054.
13. Dee, D. P., 2004: Variational bias correction of radiance data in the ECMWF system. Proc. ECMWF Workshop on the Assimilation of High Spectral Resolution Sounders in NWP, Reading, United Kingdom, ECMWF, 97-112.
14. Dee, D. P., 2005: Bias and data assimilation. Quart. J. Roy. Meteor. Soc., 131, 3323-3343, doi:10.1256/qj.05.137.
15. Derber, J. C., and W.-S. Wu, 1998: The use of TOVS cloudcleared radiances in the NCEP SSI analysis system. Mon. Wea. Rev., 126, 2287-2299, doi:10.1175/1520-0493(1998)126, 2287: TUOTCC.2.0.CO;2.
16. ECMWF, 2010: SMS users guide. ECMWF, 114 pp. [Available online at http://old.ecmwf.int/archive/publications/manuals/sms/downloads/smsmanual_2010.pdf.]
17. ECMWF, 2014: Integrated Forecasting System documentation, cycle 40R1. ECMWF. [Available online at http://www.ecmwf.int/en/forecasts/documentation-and-support/changes-ecmwf-model/cycle-41r1.]
18. Evensen, G., 2004: Sampling strategies and square root analysis schemes for the EnKF. Ocean Dyn., 54, 539-560, doi:10.1007/s10236-004-0099-2.
19. Fertig, E. J., and Coauthors, 2009: Observation bias correction with an ensemble Kalman filter. Tellus, 61A, 210-226, doi:10.1111/j.1600-0870.2008.00378.x.
20. Fouilloux, A., 2010: ODB (Observational Database): Past, present and future. Proc. 14th Workshop on Use of High Performance Computing in Meteorology, Reading, United Kingdom, ECMWF. [Available online at http://old.ecmwf.int/newsevents/meetings/workshops/2010/high_performance:computing_14th/presentations/Fouilloux.pdf.]
21. Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723-757, doi:10.1002/qj.49712555417.
22. Gauthier, P., and J.-N. Thépaut, 2001: Impact of the digital filter as a weak constraint in the preoperational 4DVAR assimilation system ofMétéo-France. Mon. Wea. Rev., 129, 2089-2102, doi:10.1175/1520-0493(2001)129, 2089:IOTDFA.2.0.CO;2.
23. Greybush, S. J., E. Kalnay, T. Miyoshi, K. Ide, and B. R. Hunt, 2011: Balance and ensemble Kalman filter localization techniques. Mon. Wea. Rev., 139, 511-522, doi:10.1175/2010MWR3328.1.
24. Hamill, T. M., J. S. Whitaker, and C. Snyder, 2001: Distancedependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Wea. Rev., 129, 2776-2790, doi:10.1175/1520-0493(2001)129, 2776:DDFOBE.2.0.CO;2.
25. Hoskins, B. J., and A. J. Simmons, 1975: A multi-layer spectral model and the semi-implicit method. Quart. J. Roy. Meteor. Soc., 101, 637-655, doi:10.1002/qj.49710142918.
26. Houtekamer, P. L., and H. L. Mitchell, 2001:A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 123-137, doi:10.1175/1520-0493(2001)129, 0123: ASEKFF.2.0.CO;2.
27. Houtekamer, P. L., and H. L. Mitchel, 2005: Ensemble Kalman filtering. Quart. J. Roy. Meteor. Soc., 131, 3269-3289, doi:10.1256/qj.05.135.
28. Houtekamer, P. L., X. Deng, H. L. Mitchell, S.-J. Baek, and N. Gagnon, 2014a: Higher resolution in an operational ensembleKalman filter. Mon. Wea. Rev., 142, 1143-1162, doi:10.1175/MWR-D-13-00138.1.
29. Houtekamer, P. L., B. He, and H. L. Mitchell, 2014b: Parallel implementation of an ensemble Kalman filter. Mon. Wea. Rev., 142, 1163-1182, doi:10.1175/MWR-D-13-00011.1.
30. Hunt, B. R., E. J. Kostelich, and I. Szunyogh, 2007: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. PhysicaD, 230, 112-126, doi:10.1016/j.physd.2006.11.008.
31. Isaksen, L., 2012: Data assimilation on future computer architectures. Proc. Seminar on Data Assimilation for Atmosphere and Ocean, Reading, United Kingdom, ECMWF, 301-322. [Available online at http://old.ecmwf.int/publications/library/ecpublications/_pdf/seminar/2011/Isaksen.pdf.]
32. Isaksen, L., M. Bonavita, R. Buizza, M. Fisher, J. Haseler, M. Leutbecher, and L. Raynaud, 2010: Ensemble of data assimilations at ECMWF. ECMWF Tech. Memo. 636, 45 pp. [Available online at http://old.ecmwf.int/publications/library/ecpublications/_pdf/tm/601-700/tm636.pdf.]
33. Kepert, J. D., 2009: Covariance localisation and balance in an ensemble Kalman filter. Quart. J. Roy. Meteor. Soc., 135, 1157-1176, doi:10.1002/qj.443.
34. Keppenne, C. L., and M. M. Rienecker, 2002: Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model. Mon. Wea. Rev., 130, 2951-2965, doi:10.1175/1520-0493(2002)130, 2951: ITOAMP.2.0.CO;2.
35. Kuhl, D.D., T. E. Rosmond, C. H. Bishop, J. McLay, andN. L. Baker, 2013: Comparison of hybrid ensemble/4DVar and 4DVar within the NAVDAS-AR data assimilation framework. Mon. Wea. Rev., 141, 2740-2758, doi:10.1175/MWR-D-12-00182.1.
36. Lorenc, A. C., 2003: The potential of the ensemble Kalman filter for NWP: A comparison with 4D-Var. Quart. J. Roy. Meteor. Soc., 129, 3183-3203, doi:10.1256/qj.02.132.
37. Lynch, P., and X.-Y. Huang, 1992: Initialization of the HIRLAM model using a digital filter. Mon. Wea. Rev., 120, 1019-1034, doi:10.1175/1520-0493(1992)120, 1019:IOTHMU.2.0.CO;2.
38. Mitchell, H. L., and P. L. Houtekamer, 2000: An adaptive ensemble Kalman filter. Mon. Wea. Rev., 128, 416-433, doi:10.1175/1520-0493(2000)128, 0416:AAEKF.2.0.CO;2.
39. Miyoshi, T., 2011: The Gaussian approach to adaptive covariance inflation and its implementation with the local ensemble transform Kalman filter. Mon. Wea. Rev., 139, 1519-1535, doi:10.1175/2010MWR3570.1.
40. Miyoshi, T., Y. Sato, and T. Kadowaki, 2010: Ensemble Kalman filter and 4D-Var intercomparison with the Japanese Operational Global Analysis and Prediction System. Mon. Wea. Rev., 138, 2846-2866, doi:10.1175/2010MWR3209.1.
41. NASA, 2002: Advanced Microwave Sounding Unit-A (AMSU-A) instrument guide. [Available online at http://disc.gsfc.nasa.gov/AIRS/documentation/amsu_instrument_guide.shtml.]
42. Ott, E., and Coauthors, 2004: A local ensemble Kalman filter for atmospheric data assimilation. Tellus, 56A, 415-428, doi:10.1111/j.1600-0870.2004.00076.x.
43. Palmer, T. N., R. Buizza, F. Doblas-Reyes, T. Jung, M. Leutbecher, G. J. Shutts, M. Steinheimer, and A. Weisheimer, 2009: Stochastic parametrization and model uncertainty. ECMWF Tech. Memo. 598, ECMWF, Shinfield Park, Reading, United Kingdom, 40 pp. [Available online at http://old.ecmwf.int/publications/library/ecpublications/_pdf/tm/501-600/tm598.pdf.]
44. Polavarapu, S. M., S. Ren, A. Clayton, D. Sankey, and Y. Rochon, 2004: On the relationship between incremental analysis updating and incremental digital filtering. Mon. Wea. Rev., 132, 2495-2502, doi:10.1175/1520-0493(2004)132, 2495: OTRBIA.2.0.CO;2.
45. Rabier, F., H. Järvinen, E. Klinker, J.-F. Mahfouf, and A. Simmons, 2000: The ECMWF operational implementation of fourdimensional variational assimilation. Part I: Experimental results with simplified physics. Quart. J. Roy. Meteor. Soc., 126, 1143-1170, doi:10.1002/qj.49712656415.
46. Saarinen, S., 2004: ODB user guide. ECMWF, 288 pp. [Available online at http://old.ecmwf.int/archive/research/ifsdocs/CY28r1/pdf_files/odb.pdf.]
47. Shutts, G., 2005: A kinetic energy backscatter algorithm for use in ensemble prediction systems. Quart. J. Roy. Meteor. Soc., 131, 3079-3102, doi:10.1256/qj.04.106.
48. Shutts, G., and T. Palmer, 2004: The use of high resolution numerical simulations of tropical circulation to calibrate stochastic physics schemes. Proc. ECMWF/CLIVAR Workshop on Simulation and Prediction of Intra-seasonal Variability with Emphasis on the MJO, Reading, United Kingdom, ECMWF, 83-102. [Available online at http://old.ecmwf.int/publications/library/ecpublications/_pdf/workshop/2003/MJO/ws_mjo_shutts.pdf.]
49. Simmons, A. J., and C. Temperton, 1997: Stability of a two-time-level semi-implicit integration scheme for gravity wave motion. Mon. Wea. Rev., 125, 600-615, doi:10.1175/1520-0493(1997)125, 0600: SOATTL.2.0.CO;2.
50. Szunyogh, I., E. J. Kostelich, G. Gyarmati, E. Kalnay, B. R. Hunt, E. Ott, E. Satterfield, and J. A. Yorke, 2008: A local ensemble transform Kalman filter data assimilation system for the NCEP global model. Tellus, 60A, 113-130, doi:10.1111/j.1600-0870.2007.00274.x.
51. Tavolato, C., and L. Isaksen, 2015: On the use of a Huber norm for observation quality control in the ECMWF 4D-Var. Quart. J. Roy. Meteor. Soc., 141, 1514-1527, doi:10.1002/qj.2440
52. Tippett, M. K., J. L. Anderson, C. H. Bishop, T. M. Hamill, and J. S. Whitaker, 2003: Ensemble square root filters. Mon. Wea. Rev., 131, 1485-1490, doi:10.1175/1520-0493(2003)131, 1485: ESRF.2.0.CO;2.
53. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913-1924, doi:10.1175/1520-0493(2002)130, 1913: EDAWPO.2.0.CO;2.
54. Whitaker, J. S., and T. M. Hamill, 2012: Evaluating methods to account for system errors in ensemble data assimilation. Mon. Wea. Rev., 140, 3078-3089, doi:10.1175/MWR-D-11-00276.1.
55. Whitaker, J. S., G. P. Compo, and J.-N. Thépaut, 2009: A comparison of variational and ensemble-based data assimilation systems for reanalysis of sparse observations. Mon. Wea. Rev., 137, 1991-1999, doi:10.1175/2008MWR2781.1.