Probabilistic verification of monthly temperature forecasts

Monthly Weather Review

Volumn 136, Issue 12, 2008, Pages 5162-5182

  Weigel, Andreas P ^a   Baggenstos, Daniel ^a   Liniger, Mark A ^a   Vitart, Frédéric ^b   Appenzeller, Christof ^a  

^a FEDERAL OFFICE OF METEOROLOGY AND CLIMATOLOGY METEOSWISS   (Switzerland)

^b EUROPEAN CENTRE FOR MEDIUM RANGE WEATHER FORECASTS   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANNUAL CYCLES; BOOTSTRAP METHODS; CLIMATIC CONDITIONS; CONFIDENCE INTERVALS; ENSEMBLE MEMBERS; EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS; EXTRATROPICAL; GLOBAL CIRCULATION MODELS; HINDCAST; HINDCASTS; LEAD-TIME; MONTHLY FORECASTING SYSTEMS; OPERATIONAL FORECASTS; OPERATIONAL TEMPERATURES; PROBABILISTIC EVALUATIONS; PROBABILISTIC SKILLS; PROBABILISTIC VERIFICATIONS; RANKED PROBABILITY SKILL SCORES; RE CALIBRATIONS; SEASONAL PREDICTIONS; SOUTH AMERICA; SURFACE TEMPERATURES; TEMPERATURE FORECASTS;

CLIMATOLOGY; OCEAN ENGINEERING; OCEANOGRAPHY; RISK ANALYSIS; RISK MANAGEMENT; WEATHER FORECASTING;

RISK PERCEPTION;

CLIMATE CONDITIONS; CLIMATE PREDICTION; ENSEMBLE FORECASTING; ESTIMATION METHOD; HINDCASTING; SURFACE TEMPERATURE; WEATHER FORECASTING;

AFRICA; SOUTH AFRICA; SOUTH AMERICA; SOUTHERN AFRICA; SUB-SAHARAN AFRICA;

EID: 64149124509     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2008MWR2551.1     Document Type: Article

References (65)

1. Anderson, D. L. T., and Coauthors, 2003: Comparison of the ECMWF seasonal forecast systems 1 and 2, including the relative performance for the 1997/8 El Niño. ECMWF Tech. Memo 404, 93 pp.
2. Baggenstos, D., 2007: Probabilistic verification of operational monthly temperature forecasts. Tech. Rep. 76, Federal Bureau of Meteorology and Climatology MeteoSwiss, Zurich, Switzerland, 52 pp.
3. Baldwin, M. P., D. B. Stephenson, D. W. J. Thompson, T. J. Dunkerton, A. J. Charlton, and A. O'Neill, 2003: Stratospheric memory and skill of extended-range weather forecasts. Science, 301, 636-640.
4. Barnston, A. G., S. J. Mason, L. Goddard, D. G. DeWitt, and S. E. Zebiak, 2003: Multimodel ensembling in seasonal climate forecasting at IRI. Bull. Amer. Meteor. Soc., 84, 1783-1796.
5. Bolius, D., P. Calanca, A. Weigel, and M. A. Liniger, 2007: Prediction of moisture availability in agricultural soils using probabilistic monthly forecasts. Geophysical Research Abstracts, Vol. 9, EGU2007-A-02175, European Geosciences Union, 1 p. [Available online at http://www.cosis.net/abstracts/EGU2007/02175/EGU2007-J-02175.pdf.]
6. Buizza, R., and T. N. Palmer, 1995: The singular-vector structure of the atmospheric global circulation. J. Atmos. Sci., 52, 1434-1456.
7. Buizza, R., and T. N. Palmer, 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev., 126, 2508-2518.
8. Buizza, R., P. L. Houtekamer, Z. Toth, G. Pellerin, M. Wei, and Y. Zhu, 2005: A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Wea. Rev., 133, 1076-1097.
9. Candille, G., C. Côté, P. L. Houtekamer, and G. Pellerin, 2007: Verification of ensemble prediction systems against observations. Mon. Wea. Rev., 135, 2688-2699.
10. Cassou, C., 2008: Madden-Julian Oscillation influence on North Atlantic weather regimes at medium-range timescales. Geophysical Research Abstracts, Vol. 10, EGU2008-A-11008. [Available online at http://www.cosis.net/abstracts/EGU2008/11008/EGU2008-A-11008.pdf.]
11. Chatfield, C., 2004: The Analysis of Time Series. 6th ed. Chapman and Hall/CRC, 333 pp.
12. Cherry, J., H. Cullen, M. Visbeck, A. Small, and C. Uvo, 2005: Impacts of the North Atlantic Oscillation on Scandinavian hydropower production and energy markets. Water Res. Manage., 19, 1573-1650.
13. Doblas-Reyes, F. J., R. Hagedorn, and T. N. Palmer, 2005: The rational behind the success of multi-model ensembles in seasonal forecasting. Part II: Calibration and combination. Tellus, 57A, 234-252.
14. ECMWF, cited 2007: Monthly forecasting. [Available online at http://www.ecmwf.int/research/monthly_forecasting/index.html.]
15. Efron, B., and G. Gong, 1983: A leisurely look at the bootstrap, the jackknife, and cross-validation. Amer. Stat., 37, 36-48.
16. Epstein, E. S., 1969: A scoring system for probability forecasts of ranked categories. J. Appl. Meteor., 8, 985-987.
17. Ferranti, L., T. N. Palmer, F. Molteni, and E. Klinker, 1990: Tropical-extratropical interaction associated with the 30-60 day oscillation and its impact on medium and extended range prediction. J. Atmos. Sci., 47, 2177-2199.
18. Ferro, C. A. T., D. S. Richardson, and A. P. Weigel, 2008: On the effect of ensemble size on the discrete and continuous ranked probability scores. Meteor. Appl., 15, 19-24.
19. Giorgi, F., and R. Francisco, 2000: Uncertainties in regional climate change prediction: A regional analysis of ensemble simulations with the HADCM2 coupled AOGCM. Climate Dyn., 16, 169-182.
20. Graham, R. J., M. Gordon, P. J. McLean, S. Ineson, M. R. Huddleston, M. K. Davey, A. Brookshaw, and R. T. H. Barnes, 2005: A performance comparison of coupled and uncoupled versions of the Met Office seasonal prediction general circulation model. Tellus, 57A, 320-339.
21. Hamill, T. M., and J. Juras, 2006: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132, 2905-2923.
22. Hamill, T. M., J. S. Whitaker, and X. Wei, 2004: Ensemble reforecasting: Improving medium-range forecast skill using retrospective forecasts. Mon. Wea. Rev., 132, 1434-1447.
23. Hurrell, J. W., 1995: Decadal trends in the North Atlantic Oscillation: Regional temperatures and precipitation. Science, 269, 676-679.
24. Joliffe, I. T., 2007: Uncertainty and inference for verification measures. Wea. Forecasting, 22, 637-650.
25. Jung, T., 2005: Systematic errors of the atmospheric circulation in the ECMWF forecasting system. Quart. J. Roy. Meteor. Soc., 131, 1045-1073.
26. Jung, T., M. Hilmer, E. Ruprecht, S. Kleppek, S. K. Gulev, and O. Zolina, 2003: Characteristics of the recent eastward shift of interannual NAO variability. J. Climate, 16, 3371-3382.
27. Kumar, A., A. G. Barnston, and M. P. Hoerling, 2001: Seasonal predictions, probabilistic verifications, and ensemble size. J. Climate, 14, 1671-1676.
28. Kunz, H., S. C. Scherrer, M. A. Liniger, and C. Appenzeller, 2007: The evolution of ERA-40 surface temperatures and total ozone compared to Swiss time series. Meteor. Z., 16, 171-181.
29. Kurihara, K., 2002: Climate-related service at the Japan Meteorology Agency. Extended Abstracts, Asia-Pacific Economic Cooperation Climate Network (APCN) Second Working Group Meeting, Seoul, South Korea, APCN. [Available onlinea http://www.apcc21.net/common/ download.php?filenamesem=(12)Koich%20Kurihara.pdf.]
30. Lnger, M. A., H. Mathis, C. Appenzeller, and F. J. Doblas-Reyes, 2007: Realistic greenhouse gas forcing and seasonal forecasts. Geophys. Res. Lett., 34, L04705, doi:10.1029/2006GL028335.
31. Madden, R. A., and P. R. Julian, 1971: Detection of a 40-50 day oscillation in the zonal wind in the tropical Pacific. J. Atmos. Sci., 28, 702-708.
32. Mason, S. J., 2004: On using "climatology" as a reference strategy in the Brier and ranked probability skill scores. Mon. Wea. Rev., 132, 1891-1895.
33. McGregor, G. R., M. Cox, Y. Cui, Z. Cui, M. K. Davey, R. F. Graham, and A. Brookshaw, 2006: Winter-season climate prediction for the U.K. health sector. J. Appl. Meteor. Climatol., 45, 1782-1792.
34. Meinke, H., and R. C. Stone, 2005: Seasonal and inter-annual climate forecasting: The new tool for increasing preparedness to climate variability and change in agricultural planning and operations. Climatic Change, 70, 221-253.
35. Molteni, F., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The new ECMWF Ensemble Prediction System: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73-119.
36. Müller, W. A., C. Appenzeller, F. J. Doblas-Reyes, and M. A. Liniger, 2005: A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small ensemble sizes. J. Climate, 18, 1513-1523.
37. Murphy, A. H., 1969: On the ranked probability skill score. J. Appl. Meteor., 8, 988-989.
38. Palmer, 1971: A note on the ranked probability skill score. J. Appl. Meteor., 10, 155-156.
39. Palmer, T. N., 2001: A nonlinear dynamical perspective on model error: A proposal for non-local stochastic-dynamic parameterization in weather and climate prediction models. Quart. J. Roy. Meteor. Soc., 127, 279-304.
40. Pavan, V., S. Tibaldi, and C. Brankovic, 2000: Seasonal prediction of blocking frequency: Results from winter ensemble experiments. Quart. J. Roy. Meteor. Soc., 126, 2125-2142.
41. Puri, K., J. Barkmeijer, and T. N. Palmer, 2001: Tropical singular vectors computed with linearized diabatic physics. Quart. J. Roy. Meteor. Soc., 127, 709-731.
42. Richardson, D. S., 2001: Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Quart. J. Roy. Meteor. Soc., 127, 2473-2489.
43. Rodwell, M. J., and F. J. Doblas-Reyes, 2006: Medium-range, monthly, and seasonal prediction for Europe and the use of forecast information. J. Climate, 19, 6025-6046.
44. Scherrer, S. C., M. Croci-Maspoli, C. Schwierz, and C. Appenzeller, 2006: Two-dimensional indices of atmospheric blocking and their statistical relationship with winter climate patterns in the Euro-Atlantic region. Int. J. Climatol., 26, 233-249.
45. Schneider, T., and S. M. Griffies, 1999: A conceptual framework for predictability studies. J. Climate, 12, 3133-3155.
46. Schwierz, C., C. Appenzeller, H. C. Davies, M. A. Liniger, W. Muller, T. F. Stocker, and M. Yoshimore, 2006: Challenges posed by and approaches to the study of seasonal-to-decadal climate variability. Climatic Change, 79, 31-63.
47. Shukla, J., 1981: Dynamical predictability of monthly means. J. Atmos. Sci., 38, 2547-2572.
48. Shukla, J., and Coauthors, 2000: Dynamical seasonal prediction. Bull. Amer. Meteor. Soc., 81, 2593-2606.
49. Simmons, A. J., and Coauthors, 2004: Comparison of trends and low-frequency variability in CRU, ERA-40, and NCEP/NCAR analyses of surface air temperature. J. Geophys. Res., 109, D24115, doi:10.1029/2004JD005306.
50. Terray, L., E. Sevault, E. Guilyardi, and O. Thual, 1995: The OASIS coupler user guide version 2.0. CERFACS Tech. Rep. TR/CMGC/95-46, 123 pp.
51. Toth, Z., E. Kalnay, S. Tracton, R. Wobus, and J. Irwin, 1997: A synoptic evaluation of the NCEP ensemble. Wea. Forecasting, 12, 140-153.
52. Toth, Z., O. Talagrand, G. Candille, and Y. Zhu, 2003: Probability and ensemble forecasts. Forecast Verification - A Practitioner's Guide in Atmospheric Science, I. T. Joliffe and D. B. Stephenson, Eds., John Wiley and Sons, 137-163.
53. Uppala, S. M., and Coauthors, 2005: The ERA-40 re-analysis. Quart. J. Roy. Meteor. Soc., 131, 2961-3012.
54. Vialard, J., F. Vitart, M. Balmaseda, T. Stockdale, and D. Anderson, 2005: An ensemble generation method for seasonal forecasting with an ocean-atmosphere coupled model. Mon. Wea. Rev., 133, 441-453.
55. Vitart, F., 2004: Monthly forecasting at ECMWF. Mon. Wea. Rev., 132, 2761-2779.
56. Vitart, F., S. Woolnough, M. A. Balmaseda, and A. M. Tompkins, 2007: Monthly forecast of the Madden-Julian oscillation using a coupled GCM. Mon. Wea. Rev., 135, 2700-2715.
57. Waliser, D. E., 2006: Predictability of tropical intraseasonal variability. Predictability of Weather and Climate, T. Palmer and R. Hagedorn, Eds., Cambridge University Press, 275-305.
58. WCRP, 2008: WCRP position paper on seasonal prediction. Report from the First WCRP Seasonal Prediction Workshop (Barcelona, Spain, 4-7 June 2007). ICPO Publ. 127, 24 pp.
59. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2007a: The discrete Brier and ranked probability skill scores. Mon. Wea. Rev., 135, 118-124.
60. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2007b: Generalization of the discrete brier and ranked probability skill scores for weighted multimodel ensemble forecasts. Mon. Wea. Rev., 135, 2778-2785.
61. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2008: Can multi-model combination really enhance the prediction skill of ensemble forecasts? Quart. J. Roy. Meteor. Soc., 134, 241-260.
62. Wilks, D. S., 2002: Smoothing forecast ensembles with fitted probability distributions. Quart. J. Roy. Meteor. Soc., 128, 2821-2836.
63. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. International Geophysics Series, Vol. 91, Academic Press, 627 pp.
64. Wolff, J. O., E. Maier-Raimer, and S. Legutke, 1997: The Hamburg ocean primitve equation model. Deutsches Klimarechenzentrum, Tech. Rep. 13, Hamburg, Germany, 98 pp.
65. Zeng, L., 2000: Weather derivatives and weather insurance: Concept, application, and analysis. Bull. Amer. Meteor. Soc., 81, 2075-2082.