Coarse-grained component concurrency in Earth system modeling: Parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework

Geoscientific Model Development

Volumn 9, Issue 10, 2016, Pages 3605-3616

  Balaji, V ^a   Benson, Rusty ^b   Wyman, Bruce ^b   Held, Isaac ^b  

^a PRINCETON UNIVERSITY   (United States)

^b NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; CLIMATE MODELING; COMPUTER SIMULATION; GEOPHYSICS; HARDWARE; LABORATORY METHOD; RADIATIVE TRANSFER; SOFTWARE; TIMESCALE;

EID: 84991628326     PISSN: 1991959X     EISSN: 19919603     Source Type: Journal    
DOI: 10.5194/gmd-9-3605-2016     Document Type: Article

References (42)

1. Adler, R. F., Huffman, G. J., Chang, A., Ferraro, R., Xie, P.-P., Janowiak, J., Rudolf, B., Schneider, U., Curtis, S., Bolvin, D., Gruber, A., Susskind, J., Arkin, P., and Nelkin, E.: The Version-2 Global Precipitation Climatology Project (GPCP) monthly precipitation analysis (1979-present), J. Hydrometeorol., 4, 1147-1167, 2003.
2. Alexander, K. and Easterbrook, S. M.: The software architecture of climate models: a graphical comparison of CMIP5 and EMICAR5 configurations, Geosci. Model Dev., 8, 1221-1232, doi:10.5194/gmd-8-1221-2015, 2015.
3. Balaji, V.: The Flexible Modeling System, in: Earth System Modelling-Volume 3, edited by: Valcke, S., Redler, R., and Budich, R., SpringerBriefs in Earth System Sciences, Springer Berlin Heidelberg, 33-41, 2012.
4. Balaji, V.: Climate Computing: The State of Play, Comput. Sci. Eng., 17, 9-13, 2015.
5. Balaji, V., Anderson, J., Held, I., Winton, M., Durachta, J., Malyshev, S., and Stouffer, R. J.: The Exchange Grid: a mechanism for data exchange between Earth System components on independent grids, in: Parallel Computational Fluid Dynamics: Theory and Applications, Proceedings of the 2005 International Conference on Parallel Computational Fluid Dynamics, 24-27 May, College Park, MD, USA, edited by: Deane, A., Brenner, G., Ecer, A., Emerson, D., McDonough, J., Periaux, J., Satofuka, N., and Tromeur-Dervout, D., Elsevier, 2006.
6. Balaji, V., Maisonnave, E., Zadeh, N., Lawrence, B. N., Biercamp, J., Fladrich, U., Aloisio, G., Benson, R., Caubel, A., Durachta, J., Foujols, M.-A., Lister, G., Mocavero, S., Underwood, S., and Wright, G.: CPMIP: Measurements of Real Computational Performance of Earth System Models, Geosci. Model Dev. Discuss., doi:10.5194/gmd-2016-197, in review, 2016.
7. Bozzo, A., Pincus, R., Sandu, I., and Morcrette, J.-J.: Impact of a spectral sampling technique for radiation on ECMWF weather forecasts, J. Adv. Model. Earth Syst., 6, 1288-1300, 2014.
8. Chandra, R., Menon, R., Dagum, L., Kohr, D., Maydan, D., and McDonald, J.: Parallel Programming in OpenMP, Morgan-Kaufmann, Inc., 2001.
9. Charles, J., Sawyer,W., Dolz, M. F., and Catalán, S.: Evaluating the performance and energy efficiency of the COSMO-ART model system, Computer Science-Research and Development, 30, 177-186, 2015.
10. Chien, A. A. and Karamcheti, V.: Moore's Law: The First Ending and A New Beginning, Computer, 12, 48-53, 2013.
11. Cumming, B., Fourestey, G., Fuhrer, O., Gysi, T., Fatica, M., and Schulthess, T. C.: Application centric energy-efficiency study of distributed multi-core and hybrid CPU-GPU systems, in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, IEEE Press, 819-829, 2014.
12. Dahan-Dalmedico, A.: History and Epistemology of Models: Meteorology (1946-1963) as a Case Study, Arch. Hist. Exact Sci., 55, 395-422, doi:10.1007/s004070000032, 2001.
13. Dennis, J. M., Vertenstein, M., Worley, P. H., Mirin, A. A., Craig, A. P., Jacob, R., and Mickelson, S.: Computational performance of ultra-high-resolution capability in the Community Earth System Model, Int. J. High Perform. C., 26, 5-16, 2012.
14. Donner, L. J.,Wyman, B. L., Hemler, R. S., Horowitz, L.W., Ming, Y., Zhao, M., Golaz, J.-C., Ginoux, P., Lin, S.-J., Schwarzkopf, M. D., Austin, J., Alaka, G., Cooke, W. F., Delworth, T. L., Freidenreich, S. M., Gordon, C. T., Griffies, S. M., Held, I. M., Hurlin, W. J., Klein, S. A., Knutson, T. R., Langenhorst, A. R., Lee, H.-C., Lin, Y., Magi, B. I., Malyshev, S. L., Milly, P. C. D., Naik, V., Nath, M. J., Pincus, R., Ploshay, J. J., Ramaswamy, V., Seman, C. J., Shevliakova, E., Sirutis, J. J., Stern,W. F., Stouffer, R. J., Wilson, R. J., Winton, M., Wittenberg, A. T., and Zeng, F.: The Dynamical Core, Physical Parameterizations, and Basic Simulation Characteristics of the Atmospheric Component AM3 of the GFDL Global Coupled Model CM3, J. Climate, 24, 3484-3519, 2011.
15. Düben, P. D., Joven, J., Lingamneni, A., McNamara, H., De Micheli, G., Palem, K. V., and Palmer, T.: On the use of inexact, pruned hardware in atmospheric modelling, Philos. T. Roy. Soc. A., 372, doi:10.1098/rsta.2013.0276, 2014.
16. Durran, D. R.: Numerical Methods forWave Equations in Geophysical Flud Dynamics, Springer-Verlag, 1999.
17. Ford, R., Glover, M., Ham, D., Hobson, M., Maynard, C., Mitchell, L., Mullerworth, S., Pickles, S., Rezny, M., Riley, G., Wood, N., and Ashworth, M.: Towards Performance Portability with GungHo, in: EGU General Assembly Conference Abstracts, EGU General Assembly, Vienna, p. 13243, 2014.
18. Freidenreich, S. and Ramaswamy, V.: A New Multiple-Band Solar Radiative Parameterization for General Circulation Models, J. Geophys. Res.-Atmos., 104, 31389-31409, 1999.
19. Fuhrer, O., Osuna, C., Lapillonne, X., Gysi, T., Cumming, B., Bianco, M., Arteaga, A., and Schulthess, T. C.: Towards a performance portable, architecture agnostic implementation strategy for weather and climate models, Supercomputing Frontiers and Innovations, 1, 45-62, 2014.
20. Gates, W. L.: AMIP: The Atmospheric Model Intercomparison Project, B. Am. Meteorol. Soc., 73, 1962-1970, 1992.
21. Govett, M., Middlecoff, J., and Henderson, T.: Directive-based parallelization of the NIM weather model for GPUs, in: Proceedings of the First Workshop on Accelerator Programming using Directive, IEEE Press, 55-61, 2014.
22. Gropp, W., Huss-Lederman, S., Lumsdaine, A., Lusk, E., Nitzberg, B., Saphir,W., and Snir, M.: MPI: The Complete Reference. The MPI-2 Extensions, vol. 2, MIT Press, 1998.
23. Harris, L. M. and Lin, S.-J.: A two-way nested global-regional dynamical core on the cubed-sphere grid, Mon. Weather Rev., 141, 283-306, 2013.
24. Hourdin, F., Mauriten, T., Getellman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., Rauser, F., Rio, C., Tomassini, L., Watanabe, M., and Williamson, D.: The art and science of climate model tuning, B. Am. Meteorol. Soc., 97, online first, doi:10.1175/BAMS-D-15-00135.1, 2016.
25. Iacono, M. J., Berthiaume, D., and Michalakes, J.: Enhancing Efficiency Of The RRTMG Radiation Code With GPU And MIC Approaches For Numerical Weather Prediction Models, in: 14th Conf. on Atmospheric Radiation, Boston, MA, Amer. Meteor. Soc., p. 156, 2014.
26. Kogge, P., Bergman, K., Borkar, S., Campbell, D., Carson, W., Dally,W., Denneau, M., Franzon, P., Harrod,W., Hill, K., Hiller, J., Karp, S., Keckler, S., Klein, D., Lucas, R., Richards, M., Scarpelli, A., Scott, S., Snavely, A., Sterling, T., Williams, R. S., and Yelick, K.: Exascale computing study: Technology challenges in achieving exascale systems, Tech. Rep. 15, DARPA Information Processing Techniques Office, 2008.
27. Korkmaz, P., Akgul, B., Chakrapani, L., and Palem, K.: Advocating noise as an agent for ultra low-energy computing: Probabilistic CMOS devices and their characteristics, Jpn. J. Appl. Phys., SSDM Special Issue Part, 1, 3307-3316, 2006.
28. Loeb, N. G., Wielicki, B. A., Doelling, D. R., Smith, G. L., Keyes, D. F., Kato, S., Manalo-Smith, N., and Wong, T.: Toward optimal closure of the Earth's top-of-atmosphere radiation budget, J. Climate, 22, 748-766, 2009.
29. Manners, J., Thelen, J., Petch, J., Hill, P., and Edwards, J.: Two fast radiative transfer methods to improve the temporal sampling of clouds in numerical weather prediction and climate models, Q. J. Roy. Meteor. Soc., 135, 457-468, 2009.
30. Mittal, S. and Vetter, J. S.: A Survey of CPU-GPU Heterogeneous Computing Techniques, ACM Comput. Surv., 2015.
31. Morcrette, J.-J.: On the effects of the temporal and spatial sampling of radiation fields on the ECMWF forecasts and analyses, Mon. Weather Rev., 128, 876-887, 2000.
32. Morcrette, J.-J., Mozdzynski, G., and Leutbecher, M.: A reduced radiation grid for the ECMWF Integrated Forecasting System, Mon. Weather Rev., 136, 4760-4772, 2008.
33. Pauluis, O. and Emanuel, K.: Numerical instability resulting from infrequent calculation of radiative heating, Mon. Weather Rev., 132, 673-686, 2004.
34. Pincus, R. and Stevens, B.: Monte Carlo spectral integration: A consistent approximation for radiative transfer in large eddy simulations, J. Adv. Model. Earth Syst., 1, online only, doi:10.3894/JAMES.2009.1.1, 2009.
35. Platzman, G. W.: The ENIAC Computations of 1950-Gateway to Numerical Weather Prediction, B. Am. Meteorol. Soc., 60, 302-312, 1979.
36. Ridge, D., Becker, D., Merkey, P., and Sterling, T.: Beowulf: harnessing the power of parallelism in a pile-of-PCs, in: Aerospace Conference, 1997 Proceedings, vol. 2, 79-91, 1997.
37. 2O continuum: A GCM experiment, J. Geophys. Res.-Atmos., 104, 9467-9488, 1999.
38. Solomon, S.: Climate change 2007-the physical science basis: Working group I contribution to the fourth assessment report of the IPCC, vol. 4, Cambridge University Press, 2007.
39. Sterling, T. L.: Beowulf cluster computing with Linux, MIT press, 2002.
40. Xu, K.-M. and Randall, D. A.: Impact of interactive radiative transfer on the macroscopic behavior of cumulus ensembles. Part I: Radiation parameterization and sensitivity tests, J. Atmos. Sci., 52, 785-799, 1995.
41. Xue, W., Yang, C., Fu, H., Wang, X., Xu, Y., Gan, L., Lu, Y., and Zhu, X.: Enabling and Scaling a Global Shallow-Water Atmospheric Model on Tianhe-2, in: Parallel and Distributed Processing Symposium, 2014 IEEE 28th International, 745-754, doi:10.1109/IPDPS.2014.82, 2014.
42. Zhao, M., Golaz, J.-C., Held, I., Ramaswamy, V., Lin, S.-J., Ming, Y., Ginoux, P.,Wyman, B., Donner, L., Paynter, D., and Guo, H.: Uncertainty in model climate sensitivity traced to representations of cumulus precipitation microphysics, J. Climate, 29, 543-560, 2016.