Reliability and importance of structural diversity of climate model ensembles

Climate Dynamics

Volumn 41, Issue 9-10, 2013, Pages 2745-2763

  Yokohata, Tokuta ^a   Annan, James D ^b   Collins, Matthew ^c   Jackson, Charles S ^d   Shiogama, Hideo ^a   Watanabe, Masahiro ^e   Emori, Seita ^a   Yoshimori, Masakazu ^e   Abe, Manabu ^a   Webb, Mark J ^f   Hargreaves, Julia C ^b  

^a NATIONAL INSTITUTE FOR ENVIRONMENTAL STUDIES   (Japan)

^b JAPAN AGENCY FOR MARINE EARTH SCIENCE AND TECHNOLOGY   (Japan)

^c UNIVERSITY OF EXETER   (United Kingdom)

^d UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^e UNIVERSITY OF TOKYO   (Japan)

^f MET OFFICE   (United Kingdom)

Author keywords

Climate model; Degree of freedom; Multi model ensembles; Perturbed physics ensembles; Rank histogram; Reliability

Indexed keywords

CLIMATE MODELING; CLIMATOLOGY; ENSEMBLE FORECASTING; HISTOGRAM; RELIABILITY ANALYSIS; UNCERTAINTY ANALYSIS;

EID: 84886725472     PISSN: 09307575     EISSN: 14320894     Source Type: Journal    
DOI: 10.1007/s00382-013-1733-9     Document Type: Article

References (85)

1. Abe M, Shiogama H, Hargreaves JC, Annan JD, Nozawa T, Emori S (2009) Correlation between Inter-model similarities in spatial pattern for present and projected future mean. Clim SOLA 5: 133-136. doi: 10. 2151/sola. 2009-034.
2. Roeckner E et al (1996) The atmospheric general circulation model ECHAM4, MPI Report No. 218.
3. Roeckner E et al (2003) The atmospheric general circulation model ECHAM5 Report No. 349.
4. Marti O et al (2006) The new IPSL climate system model: IPSL-CM4. Scientific Note IPSL Pole Modeling, No. 26.
5. Bellouin N et al (2007) Improved representation of aerosols for HadGEM2, Meteorological Office Hadley Centre, Technical Note 73.
6. Trenberth KE et al (2007) Observations: surface and atmospheric climate change. In: Solomon et al (eds) Climate change 2007: the physical science basis. Contribution of Working Group I to the fourth assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge.
7. Collins WJ et al (2008) Evaluation of the HadGEM2 model, Meteorological Office Hadley Centre, Technical Note 74.
8. Williams DN et al (2011) The earth system grid federation: software framework supporting CMIP5 data analysis and dissemination. CLIVAR Exchanges, No. 56, International CLIVAR Project Office, Southampton, United Kingdom, 40-42.
9. Yukimoro S et al (2011) Technical report of the Meteorological Research Institute, 64, 83.
10. Annan JD, Hargreaves JC (2010) Reliability of the CMIP3 ensemble. Geophys Res Lett 37: L02703. doi: 10. 1029/2009GL041994.
11. Annan JD, Hargreaves JC (2011) Understanding the CMIP3 multi-model ensemble. J Clim 24: 4529-4538. doi: 10. 1175/2011JCLI3873. 1.
12. Annan JD, Hargreaves JC, Ohgaito R, Abe-Ouchi A, Emori S (2005a) Efficiently constraining climate sensitivity with ensembles of Paleoclimate simulations. Sci On-line Lett Atmos 1: 181-184.
13. Annan JD, Hargreaves JC, Edwards NR, Marsh R (2005b) Parameter estimation in an intermediate complexity Earth system model using an ensemble Kalman filter. Ocean Model 8(1-2): 135-154.
14. Bretherton CS, Windmann M, Dymnikov VP, Wallace JM, Blade I (1999) The effective number of spatial degrees of freedom of a time-varying field. J Clim 12: 1990-2009.
15. Cess RD et al (1990) Intercomparison and interpretation of climate feedback processes in 19 atmospheric general circulation models. J Geophys Res 95: 16601-16615.
16. Collins M, Tett SFB, Cooper C (2001) The internal climate variability of HadCM3, a version of the Hadley Centre coupled model without flux adjustments. Clim Dyn 17(1): 61-81.
17. Collins WD, Rasch PJ, Boville BA, Hack JJ, McCaa JR, Williamson DL, Kiehl JT, Briegleb B, Bitz C, Lin S (2004) Description of the NCAR Community Atmosphere Model (CAM3. 0), Technical Note TN-464 + STR, National Center for Atmospheric Research, Boulder, 214 pp.
18. Collins M, Booth BBB, Harris GR, Murphy JM, Sexton DMH, Webb MJ (2006a) Towards quantifying uncertainty in transient climate change. Clim Dyn 27: 127-147.
19. Collins WD, Rasch PJ, Boville BA, Hack JJ, McCaa JR, Williamson DL, Briegleb BP, Bitz CM, Lin SJ, Zhang M (2006b) The formulation and atmospheric simulation of the Community Atmosphere Model version 3 (CAM3), J. Climate 19: 2144-2161.
20. Collins M, Booth BBB, Harris GR, Murphy JM, Sexton DMH, Webb MJ (2010) Climate model errors, feedbacks and forcings: a comparison of perturbed physics and multi-model ensembles. Clim Dyn. doi: 10. 1007/s00382-010-0808-0.
21. Collins WJ et al (2011) Development and evaluation of an Earth-system model-HadGEM2. Geosci Model Dev Discuss 4: 997-1062. doi: 10. 5194/gmdd-4-997-2011.
22. Collins M, Chandler RE, Cox PM, Huthnance JM, Rougier J, Stephenson DB (2012) Quantifying future climate change. Nat Clim Change 2: 403-409. doi: 10. 1038/nclimate1414.
23. Delworth TL et al (2006) GFDL's CM2 global coupled climate models-Part 1: formulation and simulation characteristics. J Clim 19: 643-674.
24. K-1 Model Developers (2004) K-1 coupled GCM (MIROC) description. K-1 Tech. Rep. 1, University of Tokyo, 1-34.
25. Flato GM (2005) The third generation coupled global climate model (CGCM3), http://www. ec. gc. ca/ccmac-cccma/default. asp?lang=En&n=1299529F-1.
26. Gent PR et al (2011) The community climate system model version 4. J Clim 24: 4973-4991. doi: 10. 1175/2011JCLI4083. 1.
27. Gettelman A, Kay JE, Shell KM (2012) The evolution of climate sensitivity and climate feedbacks in the community atmosphere model. J Clim 25(5): 1453-1469.
28. Gleckler PJ, Taylor KE, Doutriaux C (2008) Performance metrics for climate models. J Geophys Res 113: D06104. doi: 10. 1029/2007JD008972.
29. Gnanadesikan A et al (2006) GFDL's CM2 global coupled climate models-Part 2: the baseline ocean simulation. J Clim 19: 675-697.
30. Gordon CC et al (2000) The simulation of SST, sea ice extents and ocean heat transport in a version of the Hadley Centre coupled model without flux adjustments. Clim Dyn 16: 147-168.
31. Haak H et al (2003) Formation and propagation of great salinity anomalies. Geophys Res Lett 30: 1473. doi: 10. 1029/2003GL17065.
32. Hargreaves JC, Paul A, Ohgaito R, Abe-Ouchi A, Annan JD (2011) Are paleoclimate model ensembles consistent with the MARGO data synthesis? Clim Past 7: 917-933. doi: 10. 5194/cp-7-917-2011.
33. Jackson CS, Sen MK, Stoffa PL (2004) An efficient stochastic Bayesian approach to optimal parameter and uncertainty estimation for climate model predictions. J Clim 17: 2828-2841.
34. Jackson CS, Sen MK, Huerta G, Deng Y, Bowman KP (2008) Error reduction and convergence in climate prediction. J Clim 21: 6698-6709.
35. Johns TC et al (2006) The new Hadley Centre climate model HadGEM1: evaluation of coupled simulations. J Clim 19(7): 1327-1353. doi: 10. 1175/JCLI3712. 1.
36. Jolliffe I, Primo C (2008) Evaluating rank histograms using decompositions of the Chi square test statistic. Mon Weath Rev 136: 2133-2139. doi: 10. 1175/2007MWR2219. 1.
37. Jones CD et al (2011) The HadGEM2-ES implementation of CMIP5 centennial simulations. Geosci Model Dev 4: 543-570. doi: 10. 5194/gmd-4-543-2011.
38. Klocke D, Pincus R, Quaas J (2011) On constraining estimates of climate sensitivity with present-day observations through model weighting. J Clim 24(23): 6092-6099. doi: 10. 1175/2011JCLI4193. 1.
39. Knutti R (2010) The end of model democracy? Clim Change 102: 395-404. doi: 10. 1007/s10584-010-9800-2.
40. Legutke S, Maier-Reimer E (1999) Climatology of the HOPE-G Global Ocean General Circulation Model, DKRZ Techn. Report 21.
41. Marsland SJ, Haak H, Jungclaus JH, Latif M, Röske F (2003) The Max-Planck-Institute global ocean/sea ice model with orthogonal curvilinear coordinates. Ocean Model 5(2): 91-127. doi: 10. 1016/S1463-5003(02)00015-X.
42. Martin GM, Dearden C, Greeves C, Hinton T, Inness P et al (2004) Evaluation of the atmospheric performance of HadGAM/GEM1, Hadley Centre Technical Note No. 54, Hadley Centre for Climate Prediction and Research/Met Office, Exeter.
43. Martin GM et al (2006) The physical properties of the atmosphere in the new Hadley Centre Global Environmental Model, HadGEM1-Part 1: model description and global climatology. J Clim 19(7): 1274-1301. doi: 10. 1175/JCLI3636. 1.
44. Martin GM et al (2011) The HadGEM2 family of Met Office unified model climate configurations. Geosci Model Dev 4: 723-757. doi: 10. 5194/gmd-4-723-2011.
45. Masson D, Knutti R (2011) Climate model genealogy. Geophys Res Lett 38: L08703. doi: 10. 1029/2011GL046864.
46. McFarlane NA, Boer GJ, Blanchet J-P, Lazare M (1992) The Canadian climate centre second-generation general circulation model and its equilibrium climate. J Clim 5: 1013-1044.
47. Meehl GA, Stocker T et al (2007) Global climate projections. I. Climate change 2007: the physical science basis. In: Solomon S, Qin D, Manning M, Chen Z, Marquis M, Averyt KB, Tignor M, Miller HL (eds) Contribution of working Group I to the fourth assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge.
48. Min et al (2004) Climatology and in ternal variability in a 1000-year control simulation with the coupled climate model ECHO-G, Tellus A.
49. Murphy JM, Sexton DMH, Barnett DN, Jones GS, Webb MJ, Collins M, Stainforth DA (2004) Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature 430: 768-772.
50. Murphy JM, Booth BBB, Collins M, Harris GR, Sexton D, Webb MJ (2007) A methodology for probabilistic predictions of regional climate change from perturbed physics ensembles. Philos Trans R Soc Lond A 365: 1993-2028.
51. Pacanowski RC, Dixon K, Rosati A (1993) The GFDL modular ocean model users guide, Version 1. 0. GFDL Ocean Group technical report No. 2, Geophysical Fluid Dynamics Laboratory, Princeton.
52. Pope VD, Gallani ML, Rowntree PR, Stratton RA (2000) The impact of new physical parametrizations in the Hadley Centre climate model-HadAM3. Clim Dyn 16: 123-146.
53. Raddatz TJ et al (2007) Will the tropical land biosphere dominate the climate-carbon cycle feedback during the twenty first century? Clim Dyn 29: 565-574. doi: 10. 1007/s00382-007-0247-8.
54. Ringer MA et al (2006) The physical properties of the atmosphere in the new Hadley Centre Global Environmental Model, HadGEM1-Part 2: aspects of variability and regional climate. J Clim Am Meteorol Soc 19(7): 1302-1326. doi: 10. 1175/JCLI3713. 1.
55. Roberts MJ (2004) The Ocean Component of HadGEM1. GMR Report Annex IV. D. 3, Hadley Centre for Climate Prediction and Research/Met Office, Exeter.
56. Rotstayn LD, Collier MA, Dix MR, Feng Y, Gordon HB, Farrell SPO, Smith IN, Syktus J (2010) Improved simulation of Australian climate and ENSO-related climate variability in a GCM with an interactive aerosol treatment. Int J Climatol 30(7): 1067-1088. doi: 10. 1002/joc. 1952.
57. Sakaguchi K, Zeng X, Brunke MA (2012) The hindcast skill of the CMIP ensembles for the surface air temperature trend. J Geophys Res 117: D16113. doi: 10. 1029/2012JD017765.
58. Sakamoto TT, Komuro Y, Nishimura T, Ishii M, Tatebe H, Shiogama H, Hasegawa A, Toyoda T, Mori M, Suzuki T, Imada Y, Nozawa T, Takata K, Mochizuki T, Ogochi K, Emori S, Hasumi H, Kimoto M (2012) MIROC4h-a new high-resolution atmosphere-ocean coupled general circulation model. J Met Soc Jpn 90: 325-359. doi: 10. 2151/jmsj. 2012-301.
59. Salas-Mélia D, Chauvin F, Déqué M, Douville H, Gueremy JF, Marquet P, Planton S, Royer JF, Tyteca S (2005) Description and validation of the CNRM-CM3 global coupled model. CNRM technical report 103. Available from http://www. cnrm. meteo. fr/scenario2004/paper_cm3. pdf.
60. Sanderson BM (2011) A multi-model study of parametric uncertainty in predictions of climate response to rising greenhouse gas concentrations. J Clim. doi: 10. 1175/2010JCLI3498. 1.
61. Sexton DMH, Murphy JM, Collins M, Webb MJ (2012) Multivariate probabilistic projections using imperfect climate models Part I: outline of methodology. Clim Dyn 38: 2513-2542. doi: 10. 1007/s00382-011-1208-9.
62. Shibata K, Yoshimura H, Oizumi M, Hosaka M, Sugi M (1999) A simulation of troposphere, stratosphere and mesosphere with an MRI/JMA98 GCM. Pap Meteorol Geophys 50: 15-53.
63. Shiogama, H, Emori S, Hanasaki N, Abe M, Masutomi Y, Takahashi K, Nozawa T (2011) Observational constraints indicate risk of drying in the Amazon basin. Nat 684 Commun, 2, Article No 253.
64. Shiogama H, Watanabe M, Yoshimori M, Yokohata T, Ogura T, Annan JD, Hargreaves JC, Abe M, Kamae Y, O'ishi R, Nobui R, Emori S, Nozawa T, Abe-Ouchi A, Kimoto M (2012) Perturbed physics ensemble using the MIROC5 coupled atmosphere-ocean GCM without flux corrections: experimental design and results. Clim Dyn 39: 3041-3056. doi: 10. 1007/s00382-012-1441-x.
65. Smith RD, Gent PR (2004) Reference manual for the Parallel Ocean Program (POP), Ocean component of the Community Climate System Model (CCSM2. 0 and 3. 0). Technical Report LA-UR-02-2484, Los Alamos National Laboratory, Los Alamos.
66. Smith DM, Cusack S, Colman AW, Folland CK, Harris GR, Murphy JM (2007) Improved surface temperature prediction for the coming decade from a global climate model. Science 317: 796-799. doi: 10. 1126/science. 1139540.
67. Smith DM, Eade R, Dunstone NJ, Fereday D, Murphy JM, Pohlman H, Scaife AA (2010) Skilful multi-year predictions of Atlantic hurricane frequency. Nat Geosci 3: 846-849. doi: 10. 1038/ngeo1004.
68. Stainforth DA et al (2005) Uncertainty in predictions of the climate response to rising levels of greenhouse gases. Nature 433: 403-406.
69. Stouffer RJ et al (2006) GFDL's CM2 global coupled climate models-Part 4: idealized climate response. J Clim 19: 723-740.
70. Tatebe H, Ishii M, Mochizuki T, Chikamoto Y, Sakamoto TT, Komuro Y, Mori M, Yasunaka S, Watanabe M, Ogochi K, Suzuki T, Nishimura T, Kimoto M (2012) The Initialization of the MIROC climate models with hydrographic data assimilation for decadal prediction. J Met Soc Jpn 90: 275-294. doi: 10. 2151/jmsj. 2012-A14.
71. Taylor KE, Stouffer RJ, Meehl GA (2012) An overview of CMIP5 and the experiment design. Bull Am Meteor Soc 93: 485-498. doi: 10. 1175/BAMS-D-11-00094. 1.
72. Volodin E, Dianskii NA, Gusev AV (2010) Simulating presentday climate with the INMCM4. 0 coupled model of the atmospheric and oceanic general circulations. Izv Atmos Ocean Phys 46(4): 414-431. doi: 10. 1134/S000143381004002X.
73. Washington WM, Weatherly JM, Meehl GA, Semtner AJJ, Bettge TW, Craig AP, Strand WG, Arblaster J, Wayland VB, James R (2000) Parallel climate model (PCM) control and transient simulations. Clim Dyn 16: 755-774.
74. Watanabe M et al (2010) Improved climate simulation by MIROC5: mean states, variability, and climate sensitivity. J Clim 23: 6312-6335. doi: 10. 1175/2010JCLI3679. 1.
75. Watanabe S et al (2011) MIROC-ESM: model description and basic results of CMIP5-20c3m experiments. Geosci Model Dev Discuss 4: 1063-1128. doi: 10. 5194/gmdd-4-1063-2011.
76. Watanabe M, Shiogama H, Yokohata T, Kamae Y, Yoshimori M, Ogura T, Annan JD, Hargreaves JC, Emori S, Kimoto M (2012) Using a multi-physics ensemble for exploring diversity in cloud shortwave feedback in GCMs. J Clim 25: 5416-5431. doi: 10. 1175/JCLI-D-11-00564. 1.
77. Webb MJ et al (2006) On the contribution of local feedback mechanisms to the range of climate sensitivity in two GCM ensembles. Clim Dyn 27: 17-38.
78. Wilks DS (2004) The minimum spanning tree histogram as a verification tool for multidimensional ensemble forecasts. Mon Wea Rev 132: 1329-1340.
79. Wittenberg AT et al (2006) GFDL's CM2 global coupled climate models-Part 3: tropical Pacific climate and ENSO. J Clim 19: 698-722.
80. Yokohata T et al (2008) Comparison of equilibrium and transient responses to CO2 increase in eight state-of-the-art climate models. Tellus 60: 946-961.
81. Yokohata T, Webb MJ, Collins M, Williams KD, Yoshimori M, Hargreaves JC, Annan JD (2010) Structural similarities and differences in climate responses to CO2 increase between two perturbed physics ensembles. J Clim 23(6): 1392-1410.
82. Yokohata T, Annan JD, Collins M, Jackson CS, Tobis M, Hargreaves JC (2012) Reliability of multi-model and structurally different single-model ensembles. Clim Dyn. doi: 10. 1007/s00382-011-1203-1.
83. Yu Y, Yu R, Zhang X, Liu H (2002) A flexible global coupled climate model. Adv Atmos Sci 19: 169-190.
84. Yu Y, Zhang X, Guo Y (2004) Global coupled ocean- atmosphere general circulation models in LASG/IAP. Adv Atmos Sci 21: 444-455.
85. Yukimoto S, Noda A, Kitoh A, Sugi M, Kitamura Y et al (2001) The new Meteorological Research Institute global ocean-atmosphere coupled GCM (MRI-CGCM2)-Model climate and variability. Pap Meteorol Geophys 51: 47-88.