A hybrid mpi-openmp parallel algorithm and performance analysis for an ensemble square root filter designed for multiscale observations

Journal of Atmospheric and Oceanic Technology

Volumn 30, Issue 7, 2013, Pages 1382-1397

  Wang, Yunheng ^a   Jung, Youngsun ^a   Supinie, Timothy A ^a   Xue, Ming ^a  

^a UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECOMPOSITION STRATEGY; ENSEMBLE SQUARE ROOT FILTER; INTER-NODE COMMUNICATION; MESSAGE PASSING INTERFACE; NETWORKING TOPOLOGIES; OPEN MULTIPROCESSINGS; PERFORMANCE ANALYSIS; SHARED MEMORY SYSTEM;

COMMUNICATION; DOMAIN DECOMPOSITION METHODS; PARALLEL ALGORITHMS; PARALLEL ARCHITECTURES; RADAR; SCALABILITY; SUPERCOMPUTERS;

APPLICATION PROGRAMMING INTERFACES (API);

ALGORITHM; DATA ASSIMILATION; ENSEMBLE FORECASTING; KALMAN FILTER; PARALLEL COMPUTING; WEATHER FORECASTING;

EID: 84881355221     PISSN: 07390572     EISSN: 15200426     Source Type: Journal    
DOI: 10.1175/JTECH-D-12-00165.1     Document Type: Article

References (51)

1. Anderson, J. L., 2001: An ensemble adjustment Kalman filter for data assimilation. Mon. Wea. Rev., 129, 2884-2903
2. Anderson, J. L., 2003: A local least square framework for ensemble filtering. Mon. Wea. Rev., 131, 634-642
3. Anderson, J. L., and N. Collins, 2007: Scalable implementations of ensemble filter algorithms for data assimilation. J. Atmos. Oceanic Technol., 24, 1452-1463
4. Bishop, C. H., B. J. Etherton, and S. J. Majumdar, 2001: Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Wea. Rev., 129, 420-436
5. Brewster, K., M. Hu, M. Xue, and J. Gao, 2005: Efficient assimilation of radar data at high resolution for short-range numerical weather prediction. Extended Abstracts, World Weather Research Programme Int. Symp. on Nowcasting and Very Short Range Forecasting, Toulouse, France, Météo-France and Eumetsat, 3.06. [Available online at http://www.meteo.fr/cic/wsn05/DVD/index.html.]
6. Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: One-month experiments with real observations. Mon. Wea. Rev., 138, 1567-1586
7. Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719-1724
8. Campbell, W. F., C. H. Bishop, and D. Hodyss, 2010: Vertical covariance localization for satellite radiances in ensemble Kalman filters. Mon. Wea. Rev., 138, 282-290
9. Caya, A., J. Sun, and C. Snyder, 2005: A comparison between the 4D-VAR and the ensemble Kalman filter techniques for radar data assimilation. Mon. Wea. Rev., 133, 3081-3094
10. Courtier, P., and O. Talagrand, 1987: Variational assimilation of meteorological observations with the adjoint equation. Part II: Numerical results. Quart. J. Roy. Meteor. Soc., 113, 1329-1347
11. Dong, J., M. Xue, and K. K. Droegemeier, 2011: The analysis and impact of simulated high-resolution surface observations in addition to radar data for convective storms with an ensemble Kalman filter. Meteor. Atmos. Phys., 112, 41-61
12. Dowell, D. C., F. Zhang, L. J. Wicker, C. Snyder, and N. A. Crook, 2004: Wind and temperature retrievals in the 17 May 1981 Arcadia, Oklahoma, supercell: Ensemble Kalman filter experiments. Mon. Wea. Rev., 132, 1982-2005
13. Dowell, D. C.,L. J. Wicker, and C. Snyder, 2011: Ensemble Kalman filter assimilation of radar observations of the 8 May 2003 Oklahoma City supercell: Influence of reflectivity observations on storm-scale analysis. Mon. Wea. Rev., 139, 272-294
14. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model usingMonte Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10 143-10 162
15. Evensen, G., 2003: The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dyn., 53, 343-367
16. Evensen, G., and P. J. van Leeuwen, 1996: Assimilation ofGeosat altimeter data for the Agulhas Current using the ensemble Kalman filter with a quasigeostrophic model. Mon. Wea. Rev., 124, 85-96
17. Gao, J., M. Xue, Z. Wang, and K. K. Droegemeier, 1998: The initial condition and explicit prediction of convection using ARPS adjoint and other retrievals methods with WSR-88D data. Preprints, 12th Conf. on Numerical Weather Prediction, Phoenix, AZ, Amer. Meteor. Soc., 176-178
18. Hamill, T. M., J. S. Whitaker, M. Fiorino, and S. G. Benjamin, 2011: Global ensemble predictions of 2009's tropical cyclones initialized with an ensemble Kalman filter. Mon. Wea. Rev., 139, 668-688
19. Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811
20. Jung, Y., M. Xue, G. Zhang, and J. Straka, 2008: Assimilation of simulated polarimetric radar data for a convective storm using ensemble Kalman filter. Part II: Impact of polarimetric data on storm analysis. Mon. Wea. Rev., 136, 2246-2260
21. Jung, Y., M. Xue, and M. Tong, 2012: Ensemble Kalman filter analyses of the 29-30 May 2004 Oklahoma tornadic thunderstorm using one- and two-moment bulk microphysics schemes, with verification against polarimetric data. Mon. Wea. Rev., 140, 1457-1475
22. Keppenne, C. L., and M. M. Rienecker, 2002: Initial testing of a massively parallel ensemble Kalman filter with the Poseidon isopycnal ocean general circulation model. Mon. Wea. Rev., 130, 2951-2965
23. Le Dimet, F. X., and O. Talagrand, 1986: Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus, 38A, 97-110
24. Li, X., and M. Parashar, 2007: Hybrid runtime management of space-time heterogeneity for parallel structured adaptive applications. IEEE Trans. Parallel Distrib. Syst., 18, 1202-1214
25. Liu, H., and M. Xue, 2006: Retrieval of moisture from slant-path water vapor observations of a hypothetical GPS network using a three-dimensional variational scheme with anisotropic background error. Mon. Wea. Rev., 134, 933-949
26. Michalakes, J., J. Dudhia, D. Gill, T. Henderson, J. Klemp, W. Skamarock, and W. Wang, 2004: TheWeather Research and Forecast model: Software architecture and performance. Proc. 11th Workshop on the Use of High Performance Computing in Meteorology, Reading, United Kingdom, ECMWF, 156-168
27. Milbrandt, J. A., and M. K. Yau, 2005: A multimoment bulk microphysics parameterization. Part I: Analysis of the role of the spectral shape parameter. J. Atmos. Sci., 62, 3051-3064
28. Parashar, M., X. Li, and S. Chandra, 2010: Advanced Computational Infrastructures for Parallel and Distributed Adaptive Applications. John Wiley & Sons, 518 pp
29. Ray, P. S.,B. Johnson, K.W. Johnson, J. S. Bradberry, J. J. Stephens, K. K. Wagner, R. B. Wilhelmson, and J. B. Klemp, 1981: The morphology of several tornadic storms on 20 May 1977. J. Atmos. Sci., 38, 1643-1663
30. Sakov, P., G. Evensen, and L. Bertino, 2010: Asynchronous data assimilation with the EnKF. Tellus, 62, 24-29
31. Sathye, A., M. Xue, G. Bassett, and K. K. Droegemeier, 1997: Parallel weather modeling with the Advanced Regional Prediction System. Parallel Comput., 23, 2243-2256
32. Snook, N., M. Xue, and J. Jung, 2011: Analysis of a tornadic meoscale convective vortex based on ensemble Kalman filter assimilation ofCASAX-band and WSR-88D radar data. Mon. Wea. Rev., 139, 3446-3468
33. Snyder, C., and F. Zhang, 2003: Assimilation of simulated Doppler radar observations with an ensemble Kalman filter. Mon. Wea. Rev., 131, 1663-1677
34. Sun, J., and N. A. Crook, 1997: Dynamical and microphysical retrieval from Doppler radar observations using a cloud model and its adjoint. Part I: Model development and simulated data experiments. J. Atmos. Sci., 54, 1642-1661
35. Szunyogh, I., E. J. Kostelich, G. Gyarmati, E. Kalnay, B. R. Hunt, E. Ott, and E. Satterfield, 2008: A local ensemble tranform Kalman filter data assimilation system for the NCEP global model. Tellus, 60A, 113-130
36. Tippett, M. K., J. L. Anderson, C.H. Bishop, T. M. Hamill, and J. S. Whitaker, 2003: Ensemble square root filters. Mon. Wea. Rev., 131, 1485-1490
37. Tong, M., and M. Xue, 2005: Ensemble Kalman filter assimilation of Doppler radar data with a compressible nonhydrostatic model: OSS experiments. Mon. Wea. Rev., 133, 1789-1807
38. Tong, M., and M. Xue, 2008: Simultaneous estimation of microphysical parameters and atmospheric state with simulated radar data and ensemble square root Kalman filter. Part II: Parameter estimation experiments. Mon. Wea. Rev., 136, 1649-1668
39. Wang, S., M. Xue, and J. Min, 2013: A four-dimensional asynchronous ensemble square-root filter (4DEnSRF) algorithm and tests with simulated radar data. Quart. J. Roy. Meteor. Soc., 139, 805-819
40. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913-1924
41. Wu, B., J. Verlinde, and J. Sun, 2000: Dynamical and microphysical retrievals from Doppler radar observations of a deep convective cloud. J. Atmos. Sci., 57, 262-283
42. Xue, M., and Coauthors, 1996: The 1996 CAPS spring operational forecasting period: Realtime storm-scale NWP, Part II: Operational summary and examples. Preprints, 11th Conf. Numerical Weather Prediction, Norfolk, VA, Amer. Meteor. Soc., 297-300
43. Xue, M., K. K. Droegemeier, and V. Wong, 2000: The Advanced Regional Prediction System (ARPS)-A multiscale nonhydrostatic atmospheric simulation and prediction tool. Part I: Model dynamics and verification. Meteor. Atmos. Phys., 75, 161-193
44. Xue, M., and Coauthors, 2001: The Advanced Regional Prediction System (ARPS)-A multi-scale nonhydrostatic atmospheric simulation and prediction tool. Part II: Model physics and applications. Meteor. Atmos. Phys., 76, 143-165
45. Xue, M., D.-H. Wang, J. Gao, K. Brewster, and K. K. Droegemeier, 2003: The Advanced Regional Prediction System (ARPS), storm-scale numerical weather prediction and data assimilation. Meteor. Atmos. Phys., 82, 139-170
46. Xue, M.,M. Tong, and K. K. Droegemeier, 2006: An OSSE framework based on the ensemble square root Kalman filter for evaluating the impact of data from radar networks on thunderstorm analysis and forecasting. J. Atmos. Oceanic Technol., 23, 46-66.
47. Xue, M., K. K. Droegemeier, and D. Weber, 2007: Numerical prediction of high-impact local weather: A driver for petascale computing. Petascale Computing: Algorithms and Applications, Taylor & Francis Group, LLC, 103-124
48. Xue, M.,M. Tong, and G. Zhang, 2009: Simultaneous state estimation and attenuation correction for thunderstorms with radar data using an ensemble Kalman filter: Tests with simulated data. Quart. J. Roy. Meteor. Soc., 135, 1409-1423
49. Xue, M., Y. Jung, and G. Zhang, 2010: State estimation of convective storms with a two-moment microphysics scheme and an ensemble Kalman filter: Experiments with simulated radar data. Quart. J. Roy. Meteor. Soc., 136, 685-700
50. Xue, M., and Coauthors, 2011: Realtime convection-permitting ensemble and convection-resolving deterministic forecasts of CAPS for the Hazardous Weather Testbed 2010 Spring Experiment. Extended Abstracts, 24th Conf. on Weather Forecasting/20th Conf. NumericalWeather Prediction, Seattle, WA, Amer. Meteor. Soc., 9A.2. [Available online at https://ams.confex.com/ams/91Annual/webprogram/Manuscript/Paper183227/Xue_CAPS_2011_SpringExperiment_24thWAF20thNWP_ExtendedAbstract.pdf.]
51. Zhang, S.,M. J. Harrison, A.T. Wittenberg, A. Rosati, J. L. Anderson, and V. Balaji, 2005: Initialization of an ENSO forecast system using a parallelized ensemble filter. Mon. Wea. Rev., 133, 3176-3201