Addressing model uncertainty in seasonal and annual dynamical ensemble forecasts

Quarterly Journal of the Royal Meteorological Society

Volumn 135, Issue 643, 2009, Pages 1538-1559

  Doblas Reyes, F J ^a   Weisheimer, A ^a   Deque A ^b   Keenlyside, N ^c   McVean, M ^d   Murphy, J M ^d   Rogel, P ^e   Smith, D ^d   Palmer, T N ^a  

^a European Centre for Medium Range Weather Forecasts Reading   (United States)

^b CENTRE NATIONAL DE RECHERCHES MÉTÉOROLOGIQUES   (France)

^c GEOMAR HELMHOLTZ CENTRE FOR OCEAN RESEARCH KIEL   (Germany)

^d Hadley Centre   (United States)

^e CERFACS   (France)

Author keywords

Ensemble forecast; Forecast quality; Model uncertainty; Probability forecasts; Seasonal prediction

Indexed keywords

ENSEMBLE FORECAST; FORECAST QUALITY; MODEL UNCERTAINTY; PROBABILITY FORECASTS; SEASONAL PREDICTION;

CLIMATOLOGY; EXPERIMENTS; STOCHASTIC MODELS; UNCERTAINTY ANALYSIS;

FORECASTING;

CLIMATE MODELING; CLIMATE PREDICTION; ENSEMBLE FORECASTING; PARAMETERIZATION; PROBABILITY; UNCERTAINTY ANALYSIS;

EID: 70349607473     PISSN: 00359009     EISSN: None     Source Type: Journal    
DOI: 10.1002/qj.464     Document Type: Article

References (53)

1. Adler RF, Huffman GJ, Chang A, Ferraro R, Xie P-P, Janowiak J, Rudolf B, Schneider U, Curtis S, Bolvin D, Gruber A, Susskind J, Arkin P, Nelkin E. 2003. The version-2 Global Precipitation Climatology Project (GPCP) monthly precipitation analysis (1979-present). J. Hydrometeorol. 4: 1147-1167.
2. Anderson DLT, Stockdale T, Balmaseda MA, Ferranti L, Vitart F, Molteni F, Doblas-Reyes FJ, Mogensen K, Vidard A. 2007. "Development of the ECMWF seasonal forecast System 3.' ECMWF Technical Memorandum 503. Available from http://www.ecmwf.int/publications/library/do/references/show?id=87744.
3. Balmaseda MA, Vidard A, Anderson DLT. 2008. The ECMWF ocean analysis system: ORA-S3. Mon. Weather Rev. 136: 3018-3034.
4. Berner J, Doblas-Reyes FJ, Palmer TN, Shutts G, Weisheimer A. 2008. Impact of a quasi-stochastic cellular automaton backscatter scheme on the systematic error and seasonal prediction skill of a global climate model. Philos. Trans. R. Soc. London A 366: 2561-2579.
5. Br̈ocker J, Smith LA. 2007. Increasing the reliability of reliability diagrams. Weather and Forecasting 22: 651-661.
6. Coelho CAS, Stephenson DB, Balmaseda M, Doblas-Reyes FJ, van Oldenborgh GJ. 2006. Towards an integrated seasonal forecasting system for South America. J. Climate 19: 3704-3721.
7. Collins M, Booth BBB, Harris GR, Murphy JM, Sexton DMH, Webb MJ. 2006. Towards quantifying uncertainty in transient climate change. Clim. Dyn. 27: 127-147.
8. D́eqúe M. 2007. "ENSEMBLES stream-1 hindcasts: From the season to the decade with four coupled models.' Pp 133-139 in Proceedings ECMWF Workshop on Ensemble prediction. Available from http://www.ecmwf.int/publications/library/do/references/list/12052007.
9. Doblas-Reyes FJ, Hagedorn R, Palmer TN. 2005. The rationale behind the success of multi-model ensembles in seasonal forecasting. II: Calibration and combination. Tellus A 57: 234-252.
10. Doblas-Reyes FJ, Hagedorn R, Palmer TN, Morcrette J-J. 2006. Impact of increasing greenhouse gas concentrations in seasonal ensemble forecasts. Geophys. Res. Lett. 33: L07708, DOI:10.1029/2005GL025061.
11. Doblas-Reyes FJ, Coelho CAS, Stephenson DB. 2008. How much does simplification of probability forecasts reduce forecast quality? Meteorol. Appl. 15: 155-162.
12. Ferro CAT. 2007. Comparing probabilistic forecasting systems with the Brier score. Weather and Forecasting 22: 1076-1088.
13. Gordon C, Cooper C, Senior CA, Banks H, Gregory JM, Johns TC, Mitchell JFB, Wood RA. 2000. The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments. Clim. Dyn. 16: 147-168.
14. Graham RJ, Gordon M, Mclean PJ, Ineson S, Huddleston MR, Davey MK, Brookshaw A, Barnes RTH. 2005. A performance comparison of coupled and uncoupled versions of the Met Office seasonal prediction general circulation model. Tellus A 57: 320-339.
15. Hagedorn R, Doblas-Reyes FJ, Palmer TN. 2005. The rationale behind the success of multi-model ensembles in seasonal forecasting. I: Basic concept. Tellus A 57: 219-233.
16. Hamill TM, Whitaker JS. 2006. Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Weather Rev. 134: 3209-3229.
17. Hsu W-R, Murphy AH. 1986. The attributes diagram: A geometrical framework for assessing the quality of probability forecasts. Int. J. Forecasting 2: 285-293.
18. Jin F-F, Lin L, Timmermann A, Zhao J. 2007. Ensemblemean dynamics of the ENSO recharge oscillator under statedependent stochastic forcing. Geophys. Res. Lett. 34: L03807, DOI:10.1029/2006GL027372.
19. Jolliffe IT. 2007. Uncertainty and inference for verification measures. Weather and Forecasting 22: 637-650.
20. Jolliffe IT, Stephenson DB (eds). 2003. Forecast verification: A practitioner's guide in atmospheric science. Wiley and Sons: London.
21. Keenlyside NS, Latif M, Botzet M, Jungclaus J, Schulzweida U. 2005. A coupled method for initializing El Nĩno Southern Oscillation forecasts using sea surface temperature. Tellus A 57: 340-356.
22. Keenlyside NS, Latif M, Jungclaus J, Kornblueh L, Roeckner E. 2008. Advancing decadal-scale climate prediction in the North Atlantic sector. Nature 453: 84-88.
23. Lanzante JR. 2005. A cautionary note on the use of error bars. J. Climate 18: 3699-3703.
24. Murphy AH. 1986. A new decomposition of the Brier score: Formulation and interpretation. Mon. Weather Rev. 114: 2671-2673.
25. Murphy JM, Sexton DMH, Barnett DN, Jones GS, Webb MJ, Collins M, Stainforth DA. 2004. Quantification of modeling uncertainties in a large ensemble of climate change simulations. Nature 430: 768-772.
26. Nicholls N. 2001. The insignificance of significance testing. Bull. Am. Meteorol. Soc. 82: 981-986.
27. Palmer TN. 2000. Predicting uncertainty in forecasts of weather and climate. Rep. Prog. Phys. 63: 71-116.
28. Palmer TN. 2001. A nonlinear dynamical perspective on model error: A proposal for non-local stochastic-dynamic parametrization in weather and climate prediction models. Q. J. R. Meteorol. Soc. 127: 279-304.
29. Palmer TN, Anderson DLT. 1994. The prospects for seasonal forecasting - A review paper. Q. J. R. Meteorol. Soc. 120: 755-793.
30. Palmer TN, Alessandri A, Andersen U, Cantelaube P, Davey M, D́eĺecluse P, D́eqúe M, D́iez E, Doblas-Reyes FJ, Feddersen H, Graham R, Gualdi S, Gúeŕemy J-F, Hagedorn R, Hoshen M, Keenlyside NS, Latif M, Lazar A, Maisonnave E, Marletto V, Morse AP, Orfila B, Rogel P, Terres J-M, Thomson MC. 2004. Development of a European multimodel ensemble system for seasonal-to-interannual prediction (DEMETER). Bull. Am. Meteorol. Soc. 85: 853-872.
31. Palmer TN, Buizza R, Hagedorn R, Lawrence A, Leutbecher M, Smith L. 2006. 'Ensemble prediction: a pedagogical perspective.' ECMWF Newsletter 106: 10-17.
32. Palmer TN, Doblas-Reyes FJ, Weisheimer A, Rodwell MJ. 2008. Towards seamless prediction: Calibration of climate change projections using seasonal forecasts. Bull. Am. Meteorol. Soc. 89: 459-470.
33. Richardson DS. 2001. Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Q. J. R. Meteorol. Soc. 127: 2473-2489.
34. Rodwell MJ, Doblas-Reyes FJ. 2006. Medium-range, monthly, and seasonal prediction for Europe and the use of forecast information. J. Climate 19: 6025-6046.
35. Rogel P, Weaver AT, Daget N, Ricci S, Machu E. 2005. Ensembles of global ocean analyses for seasonal climate prediction: Impact of temperature assimilation. Tellus A 57: 375-386.
36. Roulston MS, Smith LA. 2003. Combining dynamical and statistical ensembles. Tellus A 55: 16-30.
37. Saha S, Nadiga S, Thiaw C, Wang J, Wang W, Zhang Q, van den Dool HM, Pan H-L, Moorthi S, Behringer D, Stokes D, Pẽna M, Lord S, White G, Ebisuzaki W, Peng P, Xie P. 2006. The NCEP Climate Forecast System. J. Climate 19: 3483-3517.
38. Salas y Ḿelia D. 2002. A global coupled sea-ice-ocean model. Ocean Modelling 4: 137-172.
39. Schubert S, Koster R, Hoerling M, Seager R, Lettenmaier D, Kumar A, Gutzler D. 2007. Predicting drought on seasonal-to-decadal time scales. Bull. Am. Meteorol. Soc. 88: 1625-1630.
40. Shutts GJ. 2005. A kinetic energy backscatter algorithm for use in ensemble prediction systems. Q. J. R. Meteorol. Soc. 131: 3079-3102.
41. Shutts GJ, Palmer TN. 2007. Convective forcing fluctuations in a cloud-resolving model: Relevance to the stochastic parameterization. J. Climate 20: 187-202.
42. Smith DM, Murphy JM. 2007. An objective ocean temperature and salinity analysis using covariances from a global climate model. J. Geophys. Res. 112: C02022, DOI:10.1029/2005JC003172.
43. Smith DM, Cusack S, Colman AW, Folland CK, Harris GR, Murphy JM. 2007. Improved surface temperature prediction for the coming decade from a global climate model. Science 317: 796-799.
44. Smith LA. 2002. What might we learn from climate forecasts? Proc. Natl. Acad. Sci. 99: 2487-2492.
45. Stainforth DA, Aina T, Christensen C, Collins M, Faull N, Frame DJ, Kettleborough JA, Knight S, Martin A, Murphy JM, Piani C, Sexton D, Smith LA, Spicer RA, Thorpe AJ, Allen MR. 2005. Uncertainty in predictions of the climate response to rising levels of greenhouse gases. Nature 433: 403-406.
46. Stephenson DB, Coelho CAS, Doblas-Reyes FJ, Balmaseda MA. 2005. Forecast assimilation: A unified framework for the combination of multi-model weather and climate predictions. Tellus A 57: 253-264.
47. Stephenson DB, Coelho CAS, Jolliffe IT. 2008. Two extra components in the Brier score decomposition. Weather and Forecasting 23: 752-757.
48. Stockdale TN, Anderson DLT, Alves JOS, Balmaseda MA. 1998. Global seasonal rainfall forecasts using a coupled ocean-atmosphere model. Nature 392: 370-373.
49. Tang Y, Kleeman R, Moore AM. 2005. Reliability of ENSO dynamical predictions. J. Atmos. Sci. 62: 1770-1791.
50. Uppala SM, Kallberg PW, Simmons AJ, Andrae U, Da Costa Bechtold V, Fiorino M, Gibson JK, Haseler J, Hernandez A, Kelly GA, Li X, Onogi K, Saarinen S, Sokka N, Allan RP, Andersson E, Arpe K, Balmaseda MA, Beljaars ACM, van de Berg L, Bidlot J, Bormann N, Caires S, Chevallier F, Dethof A, Dragosavac M, Fisher M, Fuentes M, Hagemann S, H́olm E, Hoskins BJ, Isaksen L, Janssen PAEM, Jenne R, McNally AP, Mahfouf J-F, Morcrette J-J, Rayner NA, Saunders RW, Simon P, Sterl A, Trenberth KE, Untch A, Vasiljevic D, Viterbo P, Woollen J. 2005. The ERA-40 re-analysis. Q. J. R. Meteorol. Soc. 131: 2961-3012.
51. Wang B, Lee J-Y, Kang I-S, Shukla J, Park C-K, Kumar A, Schemm J, Cocke S, Kug J-S, Luo J-J, Zhou T, Fu X, Yun W-T, Alves O, Jin EK, Kinter J, Kirtman B, Krishnamurti T, Lau NC, Lau W, Liu P, Pegion P, Rosati T, Schubert S, Stern W, Suarez M, Yamagata T. 2009. Advance and prospectus of seasonal prediction: Assessment of the APCC/CliPAS 14-model ensemble retrospective seasonal prediction (1980-2004). Clim. Dyn. 33: 93-117.
52. Webb MJ, Senior CA, Sexton DMH, Ingram WJ, Williams KD, Ringer MA, McAvaney BJ, Colman R, Soden BJ, Gudgel R, Knutson T, Emori S, Ogura T, Tsushima Y, Andronova N, Li B, Musat I, Bony S, Taylor KE. 2006. On the contribution of local feedback mechanisms to the range of climate sensitivity in two GCM ensembles. Clim. Dyn. 27: 17-38.
53. Weigel AP, Liniger MA, Appenzeller C. 2007. Generalization of the discrete Brier and ranked probability skill scores for weighted multimodel ensemble forecasts. Mon.Weather Rev. 135: 2778-2785.