The art and science of climate model tuning

Bulletin of the American Meteorological Society

Volumn 98, Issue 3, 2017, Pages 589-602

  Hourdin, Frédéric ^a   Mauritsen, Thorsten ^b   Gettelman, Andrew ^c   Golaz, Jean Christophe ^d,m   Balaji, Venkatramani ^e   Duan, Qingyun ^f   Folini, Doris ^g   Ji, Duoying ^f   Klocke, Daniel ^h   Qian, Yun ⁱ   Rauser, Florian ^b   Rio, Catherine ^a   Tomassini, Lorenzo ^b,l   Watanabe, Masahiro ^j   Williamson, Daniel ^k  

^a CNRS   (France)

^b MAX PLANCK INSTITUTE FOR METEOROLOGY   (Germany)

^c NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^d NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

^e PRINCETON UNIVERSITY   (United States)

^f BEIJING NORMAL UNIVERSITY   (China)

^g ETH ZURICH   (Switzerland)

^h DEUTSCHER WETTERDIENST   (Germany)

ⁱ PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

^j UNIVERSITY OF TOKYO   (Japan)

^k UNIVERSITY OF EXETER   (United Kingdom)

^l MET OFFICE   (United Kingdom)

^m LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

EARTH ATMOSPHERE; METEOROLOGY;

ART AND SCIENCE; MULTI-MODEL;

CLIMATE MODELS;

EID: 85017007215     PISSN: 00030007     EISSN: None     Source Type: Journal    
DOI: 10.1175/BAMS-D-15-00135.1     Document Type: Article

References (58)

1. Arakawa, R. A., and W. H. Schubert, 1974: Interaction of a cumulus cloud ensemble with the large-scale environment. Part I. J. Atmos. Sci., 31, 674-701, doi:10.1175/1520-0469(1974)031<0674:IOACCE>2.0.CO;2.
2. Ayotte, K. W., and Coauthors, 1996: An evaluation of neutral and convective planetary boundary-layer parameterizations relative to large eddy simulations. Bound.-Layer Meteor., 79, 131-175, doi:10.1007/BF00120078.
3. Balaji, V., R. Benson, B. Wyman, and I. Held, 2016: Coarse-grained component concurrency in Earth system modeling: Parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework. Geosci. Model Dev., 9, 3605-3616, doi:10.5194/gmd-9-3605-2016.
4. Bellprat, O., S. Kotlarski, D. Lüthi, and C. Schär, 2012: Objective calibration of regional climate models. J. Geophys. Res., 117, D23115, doi:10.1029/2012JD018262.
5. Bony, S., J.-L. Dufresne, H. Le Treut, J.-J. Morcrette, and C. Senior, 2004: On dynamic and thermodynamic components of cloud changes. Climate Dyn., 22, 71-86, doi:10.1007/s00382-003-0369-6.
6. Burnham, K. P., and D. R. Anderson, 2002: Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. 2nd ed. Springer, 488 pp.
7. Cess, R. D., and Coauthors, 1989: Interpretation of cloud-climate feedback as produced by 14 atmospheric general circulation models. Science, 245, 513-516, doi:10.1126/science.245.4917.513.
8. Couvreux, F., F. Hourdin, and C. Rio, 2010: Resolved versus parametrized boundary-layer plumes. Part I: A parametrization-oriented conditional sampling in large-eddy simulations. Bound.-Layer Meteor., 134, 441-458, doi:10.1007/s10546-009-9456-5.
9. Currin, C., T. Mitchell, M. Morris, and D. Ylvisakerc, 1991: Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J. Amer. Stat. Assoc., 86, 953-963, doi:10.1080/01621459.1991.10475138.
10. Dalmedico, A. D., 2001: History and epistemology of models: Meteorology (1946-1963) as a case study. Arch. Hist. Exact Sci., 55, 395-422, doi:10.1007/s004070000032.
11. Edwards, N. R., D. Cameron, and J. Rougier, 2011: Precalibrating an intermediate complexity climate model. Climate Dyn., 37, 1469-1482, doi:10.1007/s00382-010-0921-0.
12. Edwards, P. N., 2001: Representing the global atmosphere: Computer models, data, and knowledge about climate change. Changing the Atmosphere: Expert Knowledge and Environmental Governance, C. A. Miller and P. N. Edwards, Eds., MIT Press, 31-66.
13. -, 2010: A Vast Machine: Computer Models, Climate Data, and The Politics of Global Warming. MIT Press, 552 pp.
14. Fisher, R. A., 1922: On the mathematical foundations of theoretical statistics. Philos. Trans. Roy. Soc., A222, 309-368, doi:10.1098/rsta.1922.0009.
15. Forster, P. M., T. Andrews, P. Good, J. M. Gregory, L. S. Jackson, and M. Zelinka, 2013: Evaluating adjusted forcing and model spread for historical and future scenarios in the CMIP5 generation of climate models. J. Geophys. Res. Atmos., 118, 1139-1150, doi:10.1002/jgrd.50174.
16. Gettelman, A., J. E. Kay, and K. M. Shell, 2012: The evolution of climate sensitivity and climate feedbacks in the Community Atmosphere Model. J. Climate, 25, 1453-1469, doi:10.1175/JCLI-D-11-00197.1.
17. Golaz, J.-C., J.-C. Golaz, and H. Levy, 2013: Cloud tuning in a coupled climate model: Impact on 20th century warming. Geophys. Res. Lett., 40, 2246-2251, doi:10.1002/grl.50232.
18. Hansen, J., and Coauthors, 2005: Efficacy of climate forcings. J. Geophys. Res., 110, D18104, doi:10.1029/2005JD005776.
19. Haylock, R., and A. O'Hagan, 1996: On inference for outputs of computationally expensive algorithms with uncertainty on the inputs. Bayesian Statistics 5, J. M. Bernardo et al., Eds., Oxford University Press, 629-637.
20. Held, I. M., 2005: The gap between simulation and understanding in climate modeling. Bull. Amer. Meteor. Soc., 86, 1609-1614, doi:10.1175/BAMS-86-11-1609.
21. Heymsfield, A. J., and L. J. Donner, 1990: A scheme for parameterizing ice-cloud water content in general circulation models. J. Atmos. Sci., 47, 1865-1877, doi:10.1175/1520-0469(1990)047<1865:ASFPIC>2.0.CO;2.
22. Hourdin, F., and Coauthors, 2013a: Impact of the LMDZ atmospheric grid configuration on the climate and sensitivity of the IPSL-CM5A coupled model. Climate Dyn., 40, 2167-2192, doi:10.1007/s00382-012-1411-3.
23. -, and Coauthors, 2013b: LMDZ5B: The atmospheric component of the IPSL climate model with revisited parameterizations for clouds and convection. Climate Dyn., 40, 2193-2222, doi:10.1007/s00382-012-1343-y.
24. Jackson, C. S., M. K. Sen, G. Huerta, Y. Deng, and K. P. Bowman, 2008: Error reduction and convergence in climate prediction. J. Climate, 21, 6698-6709, doi:10.1175/2008JCLI2112.1.
25. Jam, A., F. Hourdin, C. Rio, and F. Couvreux, 2013: Resolved versus parametrized boundary-layer plumes. Part III: Derivation of a statistical scheme for cumulus clouds. Bound.-Layer Meteor., 147, 421-441, doi:10.1007/s10546-012-9789-3.
26. Kennedy, M., and A. O'Hagan, 2001: Bayesian calibration of computer models. J. Roy. Stat. Soc., 63B, 425-464, doi:10.1111/1467-9868.00294.
27. Kiehl, J. T., 2007: Twentieth century climate model response and climate sensitivity. Geophys. Res. Lett., 34, L22710, doi:10.1029/2007GL031383.
28. Kim, D., A. H. Sobel, A. D. Del Genio, Y. Chen, S. J. Camargo, M.-S. Yao, M. Kelley, and L. Nazarenko, 2012: The tropical subseasonal variability simulated in the NASA GISS general circulation model. J. Climate, 25, 4641-4659, doi:10.1175/JCLI-D-11-00447.1.
29. -, and Coauthors, 2014: Process-oriented MJO simulation diagnostic: Moisture sensitivity of simulated convection. J. Climate, 27, 5379-5395, doi:10.1175/JCLI-D-13-00497.1.
30. L'Ecuyer, T. S., and Coauthors, 2015: The observed state of the energy budget in the early twenty-first century. J. Climate, 28, 8319-8346, doi:10.1175/JCLI-D-14-00556.1.
31. Liu, C., M. W. Moncrieff, and W. W. Grabowski, 2001: Hierarchical modelling of tropical convective systems using explicit and parametrized approaches. Quart. J. Roy. Meteor. Soc., 127, 493-515, doi:10.1002/qj.49712757213.
32. Loeb, N. G., B. A. Wielicki, D. R. Doelling, G. L. Smith, D. F. Keyes, S. Kato, N. Manalo-Smith, and T. Wong, 2009: Toward optimal closure of the earth's top-of-atmosphere radiation budget. J. Climate, 22, 748-766, doi:10.1175/2008JCLI2637.1.
33. Lynch, P., 2008: The origins of computer weather prediction and climate modeling. J. Comput. Phys., 227, 3431-3444, doi:10.1016/j.jcp.2007.02.034.
34. Manabe, S., and K. Bryan, 1969: Climate calculations with a combined ocean-atmosphere model. J. Atmos. Sci., 26, 786-789, doi:10.1175/1520-0469(1969)026<0786:CCWACO>2.0.CO;2.
35. -, and R. T. Wetherald, 1975: The effects of doubling the CO2 concentration on the climate of a general circulation model. J. Atmos. Sci., 32, 3-15, doi:10.1175/1520-0469(1975)032<0003:TEODTC>2.0.CO;2.
36. Mauritsen, T., and Coauthors, 2012: Tuning the climate of a global model. J. Adv. Model. Earth Syst., 4, M00A01, doi:10.1029/2012MS000154.
37. Murphy, J. M., D. M. H. Sexton, D. N. Barnett, G. S. Jones, M. J. Webb, M. Collins, and D. A. Stainforth, 2004: Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature, 430, 768-772, doi:10.1038/nature02771.
38. -, and Coauthors, 2009: UK climate projections science report: Climate change projections. Met Office Hadley Centre, 192 pp. [Available online at http://ukclimateprojections.metoffice.gov.uk/media.jsp?mediaid=87894&filetype=pdf
39. Neelin, J. D., A. Bracco, H. Luo, J. C. McWilliams, and J. E. Meyerson, 2010: Considerations for parameter optimization and sensitivity in climate models. Proc. Natl. Acad. Sci. USA, 107, 21 349-21 354, doi:10.1073/pnas.1015473107.
40. Notz, D., 2015: How well must climate models agree with observations? Philos. Trans. Roy. Soc. London, A373, 20140164, doi:10.1098/rsta.2014.0164.
41. Phillips, N. A., 1956: The general circulation of the atmosphere: A numerical experiment. Quart. J. Roy. Meteor. Soc., 82, 123-164, doi:10.1002/qj.49708235202.
42. Qian, Y., and Coauthors, 2015: Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5. J. Adv. Model. Earth Syst., 7, 382-411, doi:10.1002/2014MS000354.
43. Rougier, J. C., 2007: Probabilistic inference for future climate using an ensemble of climate model evaluations. Climatic Change, 81, 247-264, doi:10.1007/s10584-006-9156-9.
44. Sacks, J., W. J. Welch, T. J. Mitchell, and H. P. Wynn, 1989: Design and analysis of computer experiments. Stat. Sci., 4, 409-435, doi:10.1214/ss/1177012413.
45. Schmidt, G. A., and Coauthors, 2014: Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive. J. Adv. Model. Earth Syst., 6, 141-184, doi:10.1002/2013MS000265.
46. Sexton, D. M. H., J. M. Murphy, M. Collins, and M. J. Webb, 2012: Multivariate probabilistic projections using imperfect climate models part I: Outline of methodology. Climate Dyn., 38, 2513-2542, doi:10.1007/s00382-011-1208-9.
47. Smagorinsky, J., 1963: General circulation experiments with the primitive equations. Mon. Wea. Rev., 91, 99-164, doi:10.1175/1520-0493(1963)091<0099:GCEWTP>2.3.CO;2.
48. Suzuki, K., J.-C. Golaz, and G. L. Stephens, 2013: Evaluating cloud tuning in a climate model with satellite observations. Geophys. Res. Lett., 40, 4464-4468, doi:10.1002/grl.50874.
49. Tebaldi, C., and R. Knutti, 2007: The use of the multi-model ensemble in probabilistic climate projections. Philos. Trans. Roy. Soc. London, A365, 2053-2075, doi:10.1098/rsta.2007.2076.
50. Tiedtke, M., 1989: A comprehensive mass flux scheme for cumulus parameterization in large-scale models. Mon. Wea. Rev., 117, 1779-1800, doi:10.1175/1520-0493(1989)117<1779:ACMFSF>2.0.CO;2.
51. Wan, H., P. J. Rasch, K. Zhang, Y. Qian, H. Yan, and C. Zhao, 2014: Short ensembles: An efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models. Geosci. Model Dev., 7, 1961-1977, doi:10.5194/gmd-7-1961-2014.
52. Williamson, D., M. Goldstein, and A. Blaker, 2012: Fast linked analyses for scenario based hierarchies. J. Roy. Stat. Soc., 61C, 665-692, doi:10.1111/j.1467-9876.2012.01042.x.
53. -,-, L. Allison, A. Blaker, P. Challenor, L. Jackson, and K. Yamazaki, 2013: History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble. Climate Dyn., 41, 1703-1729, doi:10.1007/s00382-013-1896-4.
54. -, A. T. Blaker, C. Hampton, and J. Salter, 2015: Identifying and removing structural biases in climate models with history matching. Climate Dyn., 45, 1299-1324, doi:10.1007/s00382-014-2378-z.
55. Yang, B., and Coauthors, 2013: Uncertainty quantification and parameter tuning in the CAM5 Zhang-McFarlane convection scheme and impact of improved convection on the global circulation and climate. J. Geophys. Res. Atmos., 118, 395-415, doi:10.1029/2012JD018213.
56. Zhang, K., and Coauthors, 2014: Technical note: On the use of nudging for aerosol-climate model intercomparison studies. Atmos. Chem. Phys., 14, 8631-8645, doi:10.5194/acp-14-8631-2014.
57. Zhang, T., L. Li, Y. Lin, W. Xue, F. Xie, H. Xu, and X. Huang, 2015: An automatic and effective parameter optimization method for model tuning. Geosci. Model Dev., 8, 3579-3591, doi:10.5194/gmd-8-3579-2015.
58. Zou, L., Y. Qian, T. Zhou, and B. Yang, 2014: Parameter tuning and calibration of RegCM3 with MIT-Emanuel cumulus parameterization scheme over CORDEX East Asia domain. J. Climate, 27, 7687-7701, doi:10.1175/JCLI-D-14-00229.1.