Parallel implementation of an ensemble Kalman filter

Monthly Weather Review

Volumn 142, Issue 3, 2014, Pages 1163-1182

  Houtekamer, P L ^a   He, Bin ^a   Mitchell, Herschel L ^a  

^a ENVIRONMENT CANADA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL ASPECTS; COMPUTATIONAL CHALLENGES; ENSEMBLE KALMAN FILTER; ENSEMBLE MEMBERS; PARALLEL IMPLEMENTATIONS; SCALING EXPERIMENTS; SOFTWARE SYSTEMS; TIME INTERPOLATION;

EXPERIMENTS;

KALMAN FILTERS;

ALGORITHM; ENSEMBLE FORECASTING; INTERPOLATION; KALMAN FILTER; NUMERICAL MODEL; SOFTWARE;

CANADA;

EID: 84896781747     PISSN: 00270644     EISSN: 15200493     Source Type: Journal    
DOI: 10.1175/MWR-D-13-00011.1     Document Type: Article

References (39)

1. Amdahl, G. M., 1967: Validity of the single processor approach to achieving large-scale computing capabilities. Spring Joint Computing Conf., Atlantic City, NJ, American Federation of Information Processing Societies, 483-485.
2. Anderson, J. L., 2001: An ensemble adjustment Kalman filter for data assimilation. Mon. Wea. Rev., 129, 2884-2903.
3. Anderson, J. L., and N. Collins, 2007: Scalable implementations of ensemble filter algorithms for data assimilation. J. Atmos. Oceanic Technol., 24, 1452-1463.
4. Aparicio, J. M., G. Deblonde, L. Garand, and S. Laroche, 2009: Signature of the atmospheric compressibility factor in COSMIC, CHAMP, and GRACE radio occultation data. J. Geophys. Res., 114, D16114, doi:10.1029/2008JD011156.
5. Benkner, S., D. F. Kvasnicka, and M. Lucka, 2002: Experiments with Cholesky factorization on clusters of SMPs. Proc. European Conf. on Numerical Methods and Computational Mechanics, University of Miskolc, Miskolc, Hungary, European Community on Computational Methods in Applied Sciences. [Available online at http://eprints.cs.univie.ac.at/1172/.]
6. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010a: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part I: Description of single-observation experiments. Mon. Wea. Rev., 138, 1550-1566.
7. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010b: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: One-month experiments with real observations. Mon. Wea. Rev., 138, 1567-1586.
8. Chandra, R., L. Dagum, D. Kohr, D. Maydan, J. McDonald, and R. Menon, 2001: Parallel programming in OpenMP. Academic Press, 230 pp.
9. Cohn, S. E., A. da Silva, J. Guo, M. Sienkiewicz, and D. Lamich, 1998: Assessing the effects of data selection with the DAO physical-space statistical analysis system. Mon. Wea. Rev., 126, 2913-2926.
10. Côté, J., S. Gravel, A. Méthot, A. Patoine, M. Roch, and A. Staniforth, 1998: The operational CMC-MRB Global Environmental Multiscale (GEM) model. Part I: Design considerations and formulation. Mon. Wea. Rev., 126, 1373-1395.
11. Courtier, P., J.-N. Thépaut, and A. Hollingsworth, 1994: A strategy for operational implementation of 4D-Var, using an incremental approach. Quart. J. Roy. Meteor. Soc., 120, 1367-1387.
12. Daley, R., 1991: Atmospheric Data Analysis. Cambridge University Press, 457 pp.
13. Evensen, G., and P. J. van Leeuwen, 1996: Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with a quasigeostrophic model. Mon. Wea. Rev., 124, 85-96.
14. Fowler, M., 1999: Refactoring: Improving the Design of Existing Code. Addison-Wesley, 431 pp.
15. Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723-757.
16. Girard, C., and Coauthors, 2014: Staggered vertical discretization of the Canadian Environmental Multiscale (GEM) model using a coordinate of the log-hydrostatic-pressure type. Mon. Wea. Rev., 142, 1183-1196.
17. Golub, G. H., and C. F. Van Loan, 1996: Matrix Computations. 3rd ed. The Johns Hopkins University Press, 694 pp.
18. Gropp, W., E. Lusk, and A. Skjellum, 1994: Using MPI: Portable Parallel Programming with the Message-Passing Interface. The MIT Press, 307 pp.
19. Hager, G., and G. Wellein, 2011: Introduction to High Performance Computing for Scientists and Engineers. Chapman and Hall/ CRC, 330 pp.
20. Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
21. Houtekamer, P. L., and H. L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 123-137.
22. Houtekamer, P. L., and H. L. Mitchell, 2005: Ensemble Kalman filtering. Quart. J. Roy. Meteor. Soc., 131, 3269-3289.
23. Houtekamer, P. L., and H. L. Mitchell, and X. Deng, 2009: Model error representation in an operational ensemble Kalman filter. Mon. Wea. Rev., 137, 2126-2143.
24. Houtekamer, P. L., X. Deng, H. L. Mitchell, S.-J. Baek, and N. Gagnon, 2014: Higher resolution in an operational ensemble Kalman filter. Mon. Wea. Rev., 142, 1143-1162.
25. Isaksen, L., 2012: Data assimilation on future computer architectures. Proc. ECMWF Seminar on Data Assimilation for Atmosphere and Ocean, Reading, United Kingdom,ECMWF, 301-322.
26. Keppenne, C. L., and M. M. Rienecker, 2002: Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model. Mon. Wea. Rev., 130, 2951-2965.
27. Lorenc, A. C., 2003: The potential of the ensemble Kalman filter for NWP-Acomparison with 4D-Var. Quart. J. Roy. Meteor. Soc., 129, 3183-3203.
28. Mandel, J., 2006: Efficient implementation of the ensemble Kalman filter. Center for Computational Mathematics Rep. 231, University of Colorado at Denver and Health Sciences Center, 9 pp. [Available online at math.ucdenver.edu/ccm/reports/ rep231.pdf.]
29. Meuer, H., E. Strohmaier, J. Dongarra, and H. Simon, cited 2012: The Top500 list: Twenty years of insight into HPC performance. [Available online at www.top500.org/lists/2012/11.]
30. Mitchell, H. L., and P. L. Houtekamer, 2009: Ensemble Kalman filter configurations and their performance with the logistic map. Mon. Wea. Rev., 137, 4325-4343.
31. Mitchell, H. L., and P. L. Houtekamer, and G. Pellerin, 2002: Ensemble size, balance, and model-error representation in an ensemble Kalman filter. Mon. Wea. Rev., 130, 2791-2808.
32. Nerger, L., and W. Hiller, 2013: Software for ensemble-based data assimilation systems-Implementation strategies and scalability. Comput. Geosci., 55, 110-118.
33. Saunders, R., M. Matricardi, and P. Brunel, 1999: An improved fast radiative transfer model for assimilation of satellite radiance observations. Quart. J. Roy. Meteor. Soc., 125, 1407- 1425.
34. Szunyogh, I., E. J. Kostelich, G. Gyarmati, E. Kalnay, B. R. Hunt, E. Ott, E. Satterfield, and J. A. Yorke, 2008: A local ensemble transform Kalman filter data assimilation system for the NCEP global model. Tellus, 60A, 113-130.
35. Tippett, M. K., J. L. Anderson, C.H. Bishop, T. M. Hamill, and J. S. Whitaker, 2003: Ensemble square root filters. Mon. Wea. Rev., 131, 1485-1490.
36. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913- 1924.
37. Whitaker, J. S., and T. M. Hamill, X. Wei, Y. Song, and Z. Toth, 2008: Ensemble data assimilation with the NCEP Global Forecast System. Mon. Wea. Rev., 136, 463-482.
38. Yang, S.-C., E. Kalnay, B. Hunt, and N. E. Bowler, 2009: Weight interpolation for efficient data assimilation with the local ensemble transform Kalman filter. Quart. J. Roy. Meteor. Soc., 135, 251-262.
39. Zhang, F., Y. Weng, J. A. Sippel, Z. Meng, and C. H. Bishop, 2009: Cloud-resolving hurricane initialization and prediction through assimilation of Doppler radar observations with an ensemble Kalman filter. Mon. Wea. Rev., 137, 2105- 2125.