A verification framework for interannual-to-decadal predictions experiments

Climate Dynamics

Volumn 40, Issue 1-2, 2013, Pages 245-272

  Goddard, L ^a   Kumar, A ^b   Solomon, A ^c   Smith, D ^d   Boer, G ^e   Gonzalez, P ^a   Kharin, V ^e   Merryfield, W ^e   Deser, C ^f   Mason, S J ^a   Kirtman, B P ^g   Msadek, R ^b   Sutton, R ^h   Hawkins, E ^h   Fricker, T ⁱ   Hegerl, G ^j   Ferro, C A T ⁱ   Stephenson, D B ⁱ   Meehl, G A ^f   Stockdale, T ^k   Burgman, R ^o   Greene, A M ^a   Kushnir, Y ^l   Newman, M ^c   Carton, J ^m   Fukumori, I ⁿ   Delworth, T ^b   more..

^a Earth Institute   (United States)

^b NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

^c UNIVERSITY OF COLORADO   (United States)

^d MET OFFICE   (United Kingdom)

^e ENVIRONMENT CANADA   (Canada)

^f NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^g UNIVERSITY OF MIAMI   (United States)

^h UNIVERSITY OF READING   (United Kingdom)

ⁱ UNIVERSITY OF EXETER   (United Kingdom)

^j UNIVERSITY OF EDINBURGH   (United Kingdom)

^k EUROPEAN CENTRE FOR MEDIUM RANGE WEATHER FORECASTS   (United Kingdom)

^l Department of Earth and Environmental Sciences   (United States)

^m UNIVERSITY OF MARYLAND   (United States)

ⁿ NASA HEADQUARTERS   (United States)

^o FLORIDA INTERNATIONAL UNIVERSITY   (United States)

more..

Author keywords

CMIP5; Decadal; Prediction; Uncertainty; Verification

Indexed keywords

AIR TEMPERATURE; ANNUAL VARIATION; CLIMATE CHANGE; DECADAL VARIATION; ENSEMBLE FORECASTING; HINDCASTING; UNCERTAINTY ANALYSIS; WEATHER FORECASTING;

EID: 84871928605     PISSN: 09307575     EISSN: 14320894     Source Type: Journal    
DOI: 10.1007/s00382-012-1481-2     Document Type: Article

References (60)

1. Arora V, Scinocca J, Boer G, Christian J, Denman KL, Flato G, Kharin V, Lee W, Merryfield W (2011) Carbon emission limits required to satisfy future representative concentration pathways of greenhouse gases. Geophys Res Lett: L05805. doi: 10. 1029/2010GL046270.
2. Barnston AG, Li S, Mason SJ, DeWitt DG, Goddard L, Gong X (2010) Verification of the first 11 years of IRI's seasonal climate forecasts. J App Meteor Climatol 49(3): 493-520. doi: 10. 1175/2009JAMC2325. 1.
3. Boer GJ (2004) Long time-scale potential predictability in an ensemble of coupled climate models. Clim Dyn 24: 29-44.
4. Boer GJ, Lambert SJ (2008) Multi-model decadal potential predictability of precipitation and temperature. Geophys Res Lett 35: L05706. doi: 10. 1029/2008GL033234.
5. Branstator G, Teng H (2010) Two limits of initial-value decadal predictability in a CGCM. J Clim 23: 6292-6311.
6. Brohan P, Kennedy JJ, Harris I, Tett SFB, Jones PD (2006) Uncertainty estimates in regional and global observed temperature changes: a new data set from 1850. J Geophys Res 111: D12106. doi: 10. 1029/2005JD006548.
7. Collins M et al (2006) Interannual to decadal climate predictability in the North Atlantic: a multi model-ensemble study. J Clim 19: 1195-1203.
8. Collins M, Booth BBB, Bhaskaran B, Harris GR, Murphy JM, Sexton DMH, Webb MJ (2010) Climate model errors, feedbacks and forcing: a comparison of perturbed physics and multi-model ensembles. Clim Dyn. doi: 10. 1007/s00382-101-0808-0.
9. Du Y, Xie S-P (2008) Role of atmospheric adjustments in the tropical Indian Ocean warming during the 20th century in climate models. Geophys Res Lett 35: L08712. doi: 10. 1029/2008GL033631.
10. Giannini A, Saravanan R, Chang P (2003) Oceanic forcing of Sahel rainfall on interannual to interdecadal timescales. Science 302: 1027-1030.
11. Gneiting T, Raftery AE (2007) Strictly proper scoring rules, prediction, and estimation. J Amer Stat Assoc 102: 359-378. doi: 10. 1198/016214506000001437.
12. Goddard L, Barnston AG, Mason SJ (2003) Evaluation of the IRI's "net assessment" seasonal climate forecasts: 1997-2001. Bull Amer Meteor Soc 84: 1761-1781.
13. Goddard L, Dilley M (2005) El Nino: catastrophe or opportunity. J Clim 18: 651-665.
14. Goddard L, Hurrell JW, Kirtman BP, Murphy J, Stockdale T, Vera C (2012) Two time scales for the price of one (almost). Bull Amer Meteor Soc 93: 621-629. doi: 10. 1175/BAMS-D-11-00220. 1.
15. Goldenberg SB, Landsea CW, Mestas-Nuñez AM, Gray WM (2001) The recent increase in Atlantic hurricane activity: causes and implications. Science 293: 474-479.
16. Gordon C et al (2000) The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments. Clim Dyn 16: 147-168.
17. Graham RJ, Yun W-T, Kim J, Kumar A, Jones D, Bettio L, Gagnon N, Kolli RK, Smith D (2011) Long-range forecasting and the global framework for climate services. Clim Res 47: 47-55. doi: 10. 3354/cr00963.
18. Griffies SM, Bryan K (1997) Predictability of North Atlantic multidecadal climate variability. Science 275: 181-184.
19. Hagedorn R, Doblas-Reyes FJ, Palmer TN (2005) The rationale behind the success of multi-model ensembles in seasonal forecasting-I. Basic concept. Tellus A 57: 219-233. doi: 10. 1111/j. 1600-0870. 2005. 00103. x.
20. ICPO (International CLIVAR Project Office) (2011) Decadal and bias correction for decadal climate predictions. January. International CLIVAR Project Office, CLIVAR Publication Series No. 150, 6 pp. Available from http://eprints. soton. ac. uk/171975/1/150_Bias_Correction. pdf.
21. Johnson C, Bowler N (2009) On the reliability and calibration of ensemble forecasts. Mon Wea Rev 137: 1717-1720.
22. Keenlyside NS, Latif M, Jungclaus J, Kornblueh L, Roeckner E (2008) Advancing decadal-scale climate prediction in the North Atlantic sector. Nature 453: 84-88. doi: 10. 1038/nature06921.
23. Kharin VV, Boer GJ, Merryfield WJ, Scinocca JF, Lee W-S (2012) Statistical adjustment of decadal predictions in a changing climate. Geophys Res Lett. (in revision).
24. Knight JR, Allan RJ, Folland CK, Vellinga M, Mann ME (2005) A signature of persistent natural thermohaline circulation cycles in observed climate. Geophys Res Lett 32: L20708. doi: 10. 1029/2005GL024233.
25. Kumar A (2009) Finite samples and uncertainty estimates for skill measures for seasonal predictions. Mon Wea Rev 137: 2622-2631.
26. Kumar A et al (2012) An analysis of the non-stationarity in the bias of sea surface temperature forecasts for the NCEP Climate Forecast System (CFS) version 2. Mon Wea Rev (to appear). http://journals. ametsoc. org/doi/abs/10. 1175/MWR-D-11-00335. 1.
27. Livezey RE, Chen WY (1983) Statistical field significance and its determination by Monte Carlo methods. Mon Weather Rev 111: 46-59.
28. Meehl GA, Hu A, Santer BD (2009) The mid-1970s climate shift in the Pacific and the relative roles of forced versus inherent decadal variability. J Clim 22: 780-792.
29. Meehl GA, Hu A, Tebaldi C (2010) Decadal prediction in the Pacific region. J Clim 23: 2959-2973.
30. Meehl GA et al. (2012) Decadal climate prediction: an update from the trenches. Bull Amer Meteorol Soc. (Submitted).
31. Merryfield WJ et al. (2011) The Canadian seasonal to interannual prediction system (CanSIPS). Available on-line from http://collaboration. cmc. ec. gc. ca/cmc/cmoi/product_guide/docs/lib/op_systems/doc_opchanges/technote_cansips_20111124_e. pdf.
32. Msadek R, Dixon KW, Delworth TL, Hurlin W (2010) Assessing the predictability of the Atlantic meridional overturning circulation and associated fingerprints. Geophys Res Lett: 37. doi: 10. 1029/2010GL044517.
33. Murphy AH (1988) Skill scores based on the mean squared error and their relationships to the correlation coefficient. Mon Wea Rev 116: 2417-2424.
34. NRC (1999) Adequacy of climate observing systems. The National Academies Press, Washington, DC, p 66.
35. Pierce DW, Barnett TP, Tokmakian R, Semtner A, Maltrud M, Lysne J, Craig A (2004) The ACPI project, element 1: initializing a coupled climate model from observed initial conditions. Clim Change 62: 13-28.
36. Pohlmann H, Botzet M, Latif M, Roesch A, Wild M, Tschuc P (2004) Estimating the decadal predictability of a coupled AOGCM. J Clim 17: 4463-4472.
37. Power SB, Mysak LA (1992) On the interannual variability of arctic sea-level pressure and sea ice. Atmos Ocean 30: 551-577.
38. Räisänen J, Ylhäisi JS (2011) How much should climate model output be smoothed in space? J Clim 24: 867-880.
39. Rayner NA, Parker DE, Horton EB, Folland CK, Alexander LV, Rowell DP, Kent EC, Kaplan A (2003) Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century. J Geophys Res 108: 4407. doi: 10. 1029/2002JD002670.
40. Robertson AW, Lall U, Zebiak SE, Goddard L (2004) Improved combination of multiple atmospheric GCM ensembles for seasonal prediction. Mon Wea Rev 132: 2732-2744.
41. Robson J, Sutton R, Lohmann K, Smith D, Palmer MD (2012) Causes of the rapid warming of the North Atlantic Ocean in the mid-1990s. J Clim 25: 4116-4134. doi: 10. 1175/JCLI-D-11-00443. 1.
42. Rudolf B, Becker A, Schneider U, Meyer-Christoffer A, Ziese M (2010) GPCC Status Report December 2010. GPCC, December 2010, 7 pp.
43. Schneider U, Fuchs T, Meyer-Christoffer A, Rudolf B (2008) Global precipitation analysis products of the GPCC. Global Precipitation Climatology Centre (GPCC), DWD, Internet Publikation, pp 1-12.
44. Smith DM, Murphy JM (2007) An objective ocean temperature and salinity analysis using covariances from a global climate model. J Geophys Res 112: C02022. doi: 10. 1029/2005JC003172.
45. Smith D, Cusack S, Colman A, Folland C, Harris G, Murphy J (2007) Improved surface temperature prediction for the coming decade from a global circulation model. Science 317: 796-799.
46. Smith TM, Reynolds RW, Peterson TC, Lawrimore J (2008) Improvements to NOAA's historical merged land-ocean surface temperature analysis (1880-2006). J Clim 21: 2283-2296.
47. Smith DM, Eade R, Dunstone NJ, Fereday D, Murphy JM, Pohlmann H, Scaife AA (2010) Skilful multi-year predictions of Atlantic hurricane frequency. Nat Geosci. doi: 10. 1038/NGEO1004.
48. Stephenson DB, Coelho CAS, Doblas-Reyes FJ, Balmaseda M (2005) Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions. Tellus A 57: 253-264. doi: 10. 1111/j. 1600-0870. 2005. 00110. x.
49. Stockdale TN (1997) Coupled ocean-atmosphere forecasts in the presence of climate drift. Mon Wea Rev 125: 809-818.
50. Tang Y, Kleeman R, Moore AM, Vialard J, Weaver A (2004) An off-line, numerically efficient initialization scheme in an oceanic general circulation model for El Nino-Southern Oscillation prediction. J Geophys Res 109: C05014. doi: 10. 1029/2003JC002159.
51. Taylor KE, Stouffer RJ, Meehl GA (2012) An overview of CMIP5 and the experiment design. Bull Amer Meteorol Soc 92: 485-498. doi: 10. 1175/BAMS-D-11-00094. 1.
52. Teng H, Branstator G, Meehl GA (2011) Predictability of the Atlantic overturning circulation and associated surface patterns in two CCSM3 climate change ensemble experiments. J Clim 24: 6054-6076. doi: 10. 1175/2011JCLI4207. 1.
53. Thompson DWJ, Wallace JM, Kennedy JJ, Jones PD (2010) An abrupt drop in Northern Hemisphere sea surface temperature around 1970. Nature 467: 444-447. doi: 10. 1038/nature09394.
54. Ting M, Kushnir Y, Seager R, Li C (2009) Forced and internal 20th century SST trends in the North Atlantic. J Clim 22(6): 1469-1481. doi: 10. 1175/2008JCLI2561. 1.
55. Tippett MK, Goddard L, Barnston AG (2005) Statistical-dynamical seasonal forecasts of Central Southwest Asia winter precipitation. J Clim 18: 1831-1843.
56. Trenberth KE, Hurrell JW (1994) Decadal atmosphere-ocean variations in the Pacific. Clim Dyn 9: 303-319.
57. Troccoli A, Balmaseda MA, Segschneider J, Vialard J, Anderson DLT, Haines K, Stockdale T, Vitart F, Fox AD (2002) Salinity adjustments in the presence of temperature data assimilation. Mon Wea Rev 130: 89-102.
58. Vera C, Barange M, Dube OP, Goddard L, Griggs D, Kobysheva N, Odada E, Parey S, Polovina J, Poveda G, Seguin B, Trenberth K (2010) Needs assessment for climate information on decadal timescales and longer. Procedia Environ Sci 1: 275-286. doi: 10. 1016/j. proenv. 2010. 09. 017.
59. Wang W, Chen M, Kumar A (2010) An assessment of the CFS real-time seasonal forecasts. Wea Fcsting 25: 950-969.
60. Zhang R, Delworth TL (2006) Impact of Atlantic multidecadal oscillations on India/Sahel rainfall and Atlantic hurricanes. Geophys Res Lett 33: L17712. doi: 10. 1029/2006GL026267.