Methodological aspects of the validation of decadal predictions

Climate Research

Volumn 55, Issue 3, 2013, Pages 181-200

  Gangstø, Reidun ^a,b   Weigel, Andreas P ^a   Liniger, Mark A ^a   Appenzeller, Christof ^a  

^a FEDERAL OFFICE OF METEOROLOGY AND CLIMATOLOGY METEOSWISS   (Switzerland)

^b NORWEGIAN METEOROLOGICAL INSTITUTE   (Norway)

Author keywords

Bias drift correction; Cross validation; Decadal predictions; Detrending; Jackknife; Sampling uncertainty; Seasonal forecasts

Indexed keywords

CLIMATE VARIABILITY; CROSS VALIDATION; DATA SETS; DETRENDING; DRIFT-CORRECTION METHODS; FIRST YEAR; GLOBAL ANNUAL MEAN TEMPERATURE; GLOBAL-MEAN TEMPERATURE; HINDCASTS; JACKKNIFE; LEADTIME; LEAVE-ONE-OUT; LOCAL SCALE; METHODOLOGICAL ASPECTS; MODEL DRIFT; PROJECT DATABASE; SEASONAL FORECASTING; SEASONAL FORECASTS; TOY MODELS;

CLIMATOLOGY; ESTIMATION; STATISTICAL METHODS;

FORECASTING;

CLIMATE MODELING; DATABASE; DECADAL VARIATION; ESTIMATION METHOD; FORECASTING METHOD; NUMERICAL MODEL; PROJECT ASSESSMENT; SAMPLING; SEASONAL VARIATION;

EID: 84873054108     PISSN: 0936577X     EISSN: 16161572     Source Type: Journal    
DOI: 10.3354/cr01135     Document Type: Article

References (53)

1. Balmaseda M, Anderson D (2009) Impact of initialization strategies and observations on seasonal forecast skill. Geophys Res Lett 36: L01701, doi:10.1029/2008GL035561
2. Barnston A, van den Dool H (1993) A degeneracy in crossvalidated skill in regression-based forecasts. J Clim 6: 963-977 (Pubitemid 23384149)
3. Collins M, Botzet A, Carril A, Drange H and others (2006) Interannual to decadal climate predictability in the North Atlantic: a multimodel-ensemble study. J Clim 19:1195-1203 (Pubitemid 43670773)
4. Dee D, Uppala S, Simmons A, Berrisford P and others (2011) The ERA-Interim reanalysis: configuration and performance of the data assimilation system. Q J R Meteorol Soc 137: 553-597
5. Doblas-Reyes F, Hagedorn R, Palmer T (2005) The rationale behind the success of multi-model ensembles in seasonal forecasting. II. Calibration and combination. Tellus A 57: 234-252 (Pubitemid 40659621)
6. Doblas-Reyes F, Weisheimer A, Palmer T, Murphy J, Smith D (2010) Forecast quality assessment of the ENSEMBLES seasonal-to-decadal stream 2 hindcasts. European Centre for Medium-Range Weather Forecasts (ECMWF) Tech Memo 621
7. Doblas-Reyes FJ, Balmaseda MA, Weisheimer A, Palmer TN (2011) Decadal climate prediction with the European Centre for Medium-Range Weather Forecasts coupled forecast system: impact of ocean observations. J Geophys Res 116: D19111, doi:10.1029/2010JD015394
8. Domingues CM, Church JA, White NJ, Gleckler PJ, Wijffels SE, Barker PM, Dunn JR (2008) Improved estimates of upper-ocean warming and multi-decadal sea-level rise. Nature 453: 1090-1093 (Pubitemid 351871742)
9. Dunstone NJ, Smith DM, Eade R (2011) Multi-year predictability of the tropical Atlantic atmosphere driven by the high latitude North Atlantic Ocean. Geophys Res Lett 38: L14701, doi:10.1029/2011GL047949
10. Efron B, Gong G (1983) A leisurely look at the bootstrap, the jackknife, and cross-validation. Am Stat 37: 36-48
11. Fyfe JC, Merryfield WJ, Kharin V, Boer GJ, Lee WS, von Salzen K (2011) Skillful predictions of decadal trends in global mean surface temperature. Geophys Res Lett 38: L22801, doi:10.1029/2011GL049508
12. García-Serrano J, Doblas-Reyes FJ (2012) On the assessment of near-surface global temperature and North Atlantic multi-decadal variability in the ENSEMBLES decadal hindcast. Clim Dyn 39: 2025-2040
13. Hagedorn R, Doblas-Reyes F, Palmer T (2005) The rationale behind the success of multi-model ensembles in seasonal forecasting. I. Basic concept. Tellus A 57: 219-233 (Pubitemid 40659620)
14. International CLIVAR Project Office (2011) Decadal and bias correction for decadal climate predictions. International CLIVAR Project Office, CLIVAR Publication Series 150
15. IPCC (2007) Climate change 2007: the physical science basis. Contribution of working group I to the fourth assessment report of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge
16. Ishii M, Kimoto M (2009) Reevaluation of historical ocean heat content variations with an XBT depth bias correction. J Oceanogr 65: 287-299
17. Keenlyside NS, LatifM, Jungclaus J, Kornblueh L, Roeckner E (2008) Advancing decadal-scale climate prediction in the North Atlantic sector. Nature 453: 84-88 (Pubitemid 351630335)
18. Kim H, Webster PJ, Curry JA (2012) Evaluation of shortterm climate change prediction in multi-model CMIP5 decadal hindcasts. Geophys Res Lett 39: L10701, doi: 10.1029/2012GL051644
19. Krueger O, Von Storch J (2011) A simple empirical model for decadal climate prediction. J Clim 24: 1276-1283
20. Latif M, Collins M, Pohlmann H, Keenlyside NS (2006) Review of predictability studies of Atlantic sector climate on decadal time scales. J Clim 19: 5971-5987 (Pubitemid 46085089)
21. Latif M, Delworth T, Dommenget D, Drange H and others (2010) Dynamics of decadal climate variability and implications for its prediction. In: Hall J, Harrison DE, Stammer D (eds) Proc OceanObs09: sustained ocean observations and information for society, Vol 2. Publication WPP-306, ESA, doi:10.5270/ OceanObs09.cwp.53
22. Lean J, Rind D (2009) How will Earth's surface temperature change in future decades? Geophys Res Lett 36: L15708, doi:10.1029/2009GL038932
23. Liniger MA, Mathis H, Appenzeller C, Doblas-Reyes FJ (2007) Realistic greenhouse gas forcing and seasonal forecasts. Geophys Res Lett 34: L04705, doi:10.1029/2006GL028335 (Pubitemid 47272081)
24. Luo JJ, Masson S, Behera SK, Yamagata T (2008) Extended ENSO predictions using a fully coupled ocean-atmosphere model. J Clim 21: 84-93 (Pubitemid 351395660)
25. Mason SJ (2011) Seasonal and longer-range forecasts. In: Jolliffe IT, Stephenson DB (eds) Forecast verification: a practioner's guide in atmospheric science, 2nd edn. Wiley, Chichester, p 203-220
26. Mason SJ, Baddour O (2008) Statistical modeling. In: Troccoli A (ed) Seasonal climate variability: forecasting and managing risk. Springer Academic Publishers, New York, NY, p 167-206
27. Masson D, Knutti R (2011) Spatial-scale dependence of climate model performance in the CMIP3 ensemble. J Clim 24: 2680-2692
28. Matei D, Pohlmann H, Jungclaus J, Müller W, Haak H, Marotzke J (2012) Two tales of initializing decadal climate prediction experiments with the ECHAM/MPI-OM model. J Clim 25:8502-8523
29. Meehl G, Goddard L, Murphy J, Stouffer R and others (2009) Decadal prediction: can it be skillful? Bull Am Meteorol Soc 90: 1467-1485
30. Mochizuki T, Ishii M, Kimoto M, Chikamoto Y and others (2010) Pacific decadal oscillation hindcasts relevant to near-term climate prediction. Proc Natl Acad Sci USA 107: 1833-1837
31. Murphy J, Kattsov V, Keenlyside N, Kimoto M and others (2010) Towards prediction of decadal climate variability and change. Procedia Environ Sci 1: 287-304
32. Pohlmann H, Jungclaus J, Kohl A, Stammer D, Marotzke J (2009) Initializing decadal climate predictions with the GECCO Oceanic Synthesis: effects on the North Atlantic. J Clim 22: 3926-3938
33. Scaife AA, Copsey D, Gordon C, Harris C and others (2011) Improved Atlantic winter blocking in a climate model. Geophys Res Lett 38: L23703, doi:10.1029/2011GL049573
34. Smith DM, Cusack S, Colman A, Folland C, Harris G, Mur-phy J (2007) Improved surface temperature prediction for the coming decade from a global climate model. Science 317: 796-799 (Pubitemid 47257915)
35. Smith DM, Eade R, Dunstone N, Fereday D, Murphy J, Pohlmann H, Scaife A (2010) Skilful multi-year predictions of Atlantic hurricane frequency. Nat Geosci 3: 846-849
36. Solomon A, Goddard L, Kumar A, Carton J and others (2011) Distinguishing the roles of natural and anthropogenically forced decadal forced climate variability: implications for prediction. Bull Am Meteorol Soc 92: 141-156
37. Stockdale TN (1997) Coupled ocean-atmosphere forecasts in the presence of climate drift. Mon Weather Rev 125: 809-818
38. Taylor KE, Stouffer RJ, Meehl GA (2012) An overview of CMIP5 and the experiment design. Bull Am Meteorol Soc 92:485-498
39. Uppala S, Kallberg P, Simmons A, Andrae U and others (2005) The ERA-40 re-analysis. Q J R Meteorol Soc 131: 2961-3012 (Pubitemid 43186171)
40. van der Linden P, Mitchell J (2009) ENSEMBLES: climate change and its impacts: summary of research and results from the ENSEMBLES project. Met Office Hadley Centre, Exeter
41. van Oldenborgh GJ, Doblas-Reyes FJ, Wouters B, Hazeleger W (2012) Decadal prediction skill in a multi-model ensemble. Clim Dyn 38: 1263-1280
42. Vera C, Barange M, Dube O, Goddard L and others (2010) Needs assessment for climate information on decadal timescales and longer. Procedia Environ Sci 1: 275-286
43. von Storch H, Zwiers FW (1999) Statistical analysis in climate research. Cambridge University Press, Cambridge
44. Weigel AP (2011) Ensemble forecasts. In: Jolliffe IT, Stephenson DB (eds) Forecast verification: a practioner's guide in atmospheric science 2nd edn. Wiley, Chichester, p 141-166
45. Weigel AP, Bowler N (2009) Comment on 'Can multi-model combination really enhance the prediction skill of probabilistic ensemble forecasts?'. Q J R Meteorol Soc 135: 535-539
46. Weigel AP, Liniger MA, Appenzeller C (2007) The discrete Brier and ranked probability skill scores. Mon Weather Rev 135: 118-124 (Pubitemid 46188846)
47. Weigel AP, Liniger MA, Appenzeller C (2008a) Can multimodel combination really enhance the prediction skill of probabilistic ensemble forecasts? Q J R Meteorol Soc 134: 241-260 (Pubitemid 351512725)
48. Weigel AP, Baggenstos D, Liniger MA, Vitart F, Appenzeller C (2008b) Probabilistic verification of monthly temperature forecasts. Mon Weather Rev 136: 5162-5182
49. Weigel AP, Liniger MA, Appenzeller C (2009) Seasonal ensemble forecasts: Are recalibrated single models better than multimodels? Mon Weather Rev 137: 1460-1479
50. Wilks DS (2006) Statistical methods in the atmospheric sciences, 2nd edn. International Geophysics Series, Vol. 91. Academic Press, London
51. Wolter K, Timlin MS (2011) El Niño/Southern Oscillation behaviour since 1871 as diagnosed in an extended multivariate ENSO index (MEI.ext). Int J Climatol 31: 1074-1087
52. Yeager S, Karspeck A, Danabasoglu G, Tribbia J, Teng H (2012) A decadal prediction case study: late twentiethcentury North Atlantic Ocean heat content. J Clim 25: 5173-5189
53. Zhang S (2011) Impact of observation-optimized model parameters on decadal predictions: simulation with a simple pycnocline prediction model. Geophys Res Lett 38: L02702, doi:10.1029/2010GL046133