Probabilistic skill in ensemble seasonal forecasts

Quarterly Journal of the Royal Meteorological Society

Volumn 141, Issue 689, 2015, Pages 1085-1100

  Smith, Leonard A ^a,b   Du, Hailiang ^a   Suckling, Emma B ^a   Niehörster, Falk ^a  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

DEMETER; Ensemble forecasts; ENSEMBLES; Forecast skill; Seasonal forecasts

Indexed keywords

PROBABILITY; PROBABILITY DISTRIBUTIONS;

CLIMATOLOGICAL DISTRIBUTIONS; DEMETER; EMPIRICAL PROBABILITIES; ENSEMBLE FORECASTS; ENSEMBLES; INTER-ANNUAL PREDICTIONS; OPERATIONAL FORECASTS; SEASONAL FORECASTS;

FORECASTING;

DEMETER; ENSEMBLE FORECASTING; NUMERICAL MODEL; PROBABILITY; SEASONALITY; WEATHER FORECASTING;

EID: 84932093710     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.2403     Document Type: Article

References (37)

1. Alessandri A, Borrelli A, Masina S, Pietro PD, Carril A, Cherchi A, Gualdi S, Navarra A. 2010. The INGV-CMCC seasonal prediction system: Improved ocean initial conditions. Mon. Weather Rev. 138: 2930-2952.
2. Alessandri A, Borrelli A, Navarra A, Arribas A, Déqué M, Rogel P, Weisheimer A. 2011. Evaluation of probabilistic quality and value of the ensembles multimodel seasonal forecasts: Comparison with DEMETER. Mon. Weather Rev. 139: 581-607.
3. Bernardo JM. 1979. Expected information as expected utility. Ann. Stat. 7: 686-690.
4. Bowler NE, Arribas A, Mylne KR. 2008. The benefits of multi-analysis and poor-mans ensembles. Mon. Weather Rev. 136: 4113-4129.
5. Bröcker J, Smith LA. 2006. Scoring probabilistic forecasts: On the importance of being proper. Weather and Forecasting 22: 382-388.
6. Bröcker J, Smith LA. 2007. From ensemble forecasts to predictive distribution functions. Tellus A 60: 663-678.
7. Coelho CAS, Stephenson DB, Balmaseda M, Doblas-Reyes FJ, van Oldenborgh GJ. 2006. Towards an integrated seasonal forecasting system for South America. J. Clim. 19: 3704-3721.
8. Doblas-Reyes FJ, Hagedorn R, Palmer TN. 2005. The rationale behind the success of multi-model ensembles in seasonal forecasting. Part II: Calibration and combination. Tellus A 57: 234-252.
9. Doblas-Reyes FJ, Weisheimer A, Palmer TN, Murphy JM, Smith D. 2010. Forecast Quality Assessment of the ENSEMBLES Seasonal-to-decadal Stream 2 Hindcasts, Technical Memorandum 621. ECMWF: Reading, UK.
10. Good IJ. 1952. Rational decisions. J. R. Stat. Soc. XIV: 107-114.
11. Hagedorn R, Smith LA. 2009. Communicating the value of probabilistic forecasts with weather roulette. Meteorol. Appl. 16: 143-155.
12. Hagedorn R, Doblas-Reyes FJ, Palmer TN. 2005. The rationale behind the success of multi-model ensembles in seasonal forecasting. Part I: Basic concept. Tellus A 57: 219-233.
13. Hewitt CD, Griggs DJ. 2004. Ensembles-based predictions of climate changes and their impacts. Eos Trans. Am. Geophys. Union 85: 566.
14. Ingleby B, Huddleston M. 2007. Quality control of ocean temperature and salinity profiles -historical and real-time data. J. Mar. Syst. 65 158-175.
15. Kang I-S, Yoo J. 2006. Examination of multi-model ensemble seasonal prediction methods using a simple climate system. Clim. Dyn. 26: 285-294.
16. Kelly JL Jr. 1956. A new interpretation of information rate. Bell Syst. Tech. J. 35: 917-926.
17. Kirtman BP, Min D, Infanti JM, Kinter JL III, Paolino DA, Zhang Q, van den Dool H, Saha S, Mendez MP, Becker E, Peng P, Tripp P, Huang J, DeWitt DG, Tippett MK, Barnston G, Li S, Rosati A, Schubert SD, Rienecker M, Suarez M, Li ZE, Marshak J, Lim Y-K, Tribbia J, Pegion K, Merryfield WJ, Denis B, Wood EF. 2013. The North American Multi-Model Ensemble (NMME): Phase-1 seasonal to interannual prediction, phase-2 toward developing intra-seasonal prediction. Bull. Am. Meteorol. Soc. 95: 585-601.
18. Krishnamurti TN, Kishtawal CM, LaRow TE, Bachiochi DR, Zhang Z, Williford CE, Gadgil S, Surendran S. 1999. Improved weather and seasonal climate forecasts from multimodel superensemble. Science 285 1548-1550.
19. McSharry PE, Smith LA. 1999. Better nonlinear models from noisy data: Attractors with maximum likelihood. Phys. Rev. Lett. 83: 4285-4288.
20. Palmer TN, Alessandri A, Andersen U, Cantelaube P, Davey M, Délécluse P, Déqué M, Diez E, Doblas-Reyes FJ, Feddersen H, Graham R, Gualdi S, Guérémy J-F, Hagedorn R, Hoshen M, Keenlyside N, Latif M, Lazar A, Maisonnave E, Marletto V, Morse AP, Orfila B, Rogel P. 2004. Development of a European multimodel ensemble system for seasonal-to-interannual prediction (DEMETER). Bull. Am. Meteorol. Soc. 85 853-872.
21. Peng P, Kumar A, van den Dool H, Barnston AG. 2002. An analysis of multimodel ensemble predictions for seasonal climate anomalies. J. Geophys. Res. 107: 4710, doi: 10.1029/2002JD002712.
22. Raftery AE, Gneiting T, Balabdaoui F, Polakowski M. 2005. Using Bayesian model averaging to calibrate forecast ensembles. Mon. Weather Rev. 131: 1155-1174.
23. Rajagopalan B, Lall U, Zebiak SE. 2002. Categorical climate forecasts through regularization and optimal combination of multiple GCM ensembles. Mon. Weather Rev. 130: 1792-1811.
24. Roulston MS, Smith LA. 2002. Evaluating probabilistic forecasts using information theory. Mon. Weather Rev. 130: 1653-1660.
25. Roulston MS, Smith LA. 2003. Combining dynamical and statistical ensembles. Tellus 55A: 16-30.
26. Smith DM, Eade R, Dunstone NJ, Fereday D, Murphy JM, Pohlmann H, Scaife AA. 2010. Skilful multi-year predictions of Atlantic hurricane frequency. Nat. Geosci. 3: 846-849.
27. Smith LA. 1992. Identification and prediction of low-dimensional dynamics. Physica D 58: 50-76.
28. Smith LA. 1997. In Proceedings International School of Physics 'Enrico Fermi', Course CXXXIII, Cini G. (ed.): 177-246. Societa Italiana di Fisica: Bologna, Italy.
29. Suckling EB, Smith LA. 2013. An evaluation of decadal probability forecasts from state-of-the-art climate models. J. Clim. 26: 23.
30. The Met Office. 2013. 3-month Outlook for Contingence Planning: User Guidance, HM Government document. The Met Office: Devon, UK. http://www.metoffice.gov.uk/media/pdf/g/o/3-month_Outlook_User_Guidance-150.pdf (accessed 10 July 2014).
31. Van Den Dool HM. 2007. Empirical Methods in Short-term Climate Prediction. Oxford University Press: Oxford, UK.
32. van Oldenborgh GJ, Balmaseda MA, Ferranti L, Stockdale TN, Anderson DLT. 2005. Did the ECMWF seasonal forecast model outperform statistical ENSO forecast models over the last 15 years? J. Clim. 18: 3240-3249.
33. Vitart F, Huddleston MR, Déqué M, Peake D, Palmer TN, Stockdale TN, Davey MK, Ineson S, Weisheimer A. 2007. Dynamically-based seasonal forecast of Atlantic tropical storm activity issued in June by EUROSIP. Geophys. Res. Lett. 34: L16815, doi: 10.1029/2007GL030740.
34. Wang B, Lee J-Y, Kang I-S, Shukla J, Park CK, Kumar A, Schemm J, Cocke S, Kug JS, Luo JJ, Zhou T, Wang B, Fu X, Yun WT, Alves O, Jin E, Kinter J, Kirtman B, Krishnamurti T, Lau N, Lau W, Liu P, Pegion P, Rosati T, Schubert S. 2009. Advance and prospectus of seasonal prediction: Assessment of the APCC/CliPAS 14-model ensemble retrospective seasonal prediction (19802004). Clim. Dyn. 33: 93-117.
35. Weigel AP, Liniger MA, Appenzeller C. 2008. Can multi-model combination really enhance the prediction skill of probabilistic ensemble forecasts? Q. J. R. Meteorol. Soc. 134: 241C260.
36. Weisheimer A, Doblas-Reyes FJ, Palmer TN, Alessandri A, Arribas A, Déqué M, Keenlyside N, MacVean M, Navarra A, Rogel P. 2009. ENSEMBLES: A new multi-model ensemble for seasonal-to-annual predictions and Skill and progress beyond DEMETER in forecasting tropical Pacific SSTs. Geophys. Res. Lett. 36: L21711, doi: 10.1029/2009GL040896.
37. Wilks DS. 2005. Statistical Methods in the Atmospheric Sciences, International Geophysics 91 (2nd edn). Academic Press: Oxford, UK.