Comparing probabilistic forecasting systems with the Brier score

Weather and Forecasting

Volumn 22, Issue 5, 2007, Pages 1076-1088

  Ferro, Christopher A T ^a  

^a UNIVERSITY OF EXETER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ESTIMATION; PRECIPITATION (METEOROLOGY); PROBABILITY;

BINARY EVENTS; BRIER SCORE; CONFIDENCE INTERVAL; ENSEMBLE SIZE; PROBABILISTIC FORECASTING SYSTEM;

WEATHER FORECASTING;

ENSEMBLE FORECASTING; PERFORMANCE ASSESSMENT; PRECIPITATION ASSESSMENT; PROBABILITY; WEATHER FORECASTING;

EID: 35948942400     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/WAF1034.1     Document Type: Article

References (27)

1. Bergsma, W. P., 2004: Testing conditional independence for continuous random variables. EURANDOM Tech. Rep. 2004-048, 19 pp.
2. Bradley, A. A., T. Hashino, and S. S. Schwartz, 2003: Distributions-oriented verification of probability forecasts for small data samples. Wea. Forecasting, 18, 903-917.
3. Brier, G. W., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 1-3.
4. Briggs, W., and D. Ruppert, 2005: Assessing the skill of yes/no predictions. Biometrics, 61, 799-807.
5. Buizza, R., and T. N. Palmer, 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev., 126, 2503-2518.
6. Chatfield, C., 2004: The Analysis of Time Series: An Introduction. Chapman and Hall, 333 pp.
7. Davison, A. C., and D. V. Hinkley, 1997: Bootstrap Methods and Their Application. Cambridge University Press, 592 pp.
8. DiCiccio, T. J., A. C. Monti, and G. A. Young, 2006: Variance stabilization for a scalar parameter. J. Roy. Stat. Soc., 68B, 281-303.
9. Diebold, F. X., and R. S. Mariano, 1995: Comparing predictive accuracy. J. Bus. Econ. Stat., 13, 253-263.
10. Hall, P., 1987: On the bootstrap and continuity correction. J. Roy. Stat. Soc., 49B, 82-89.
11. Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155-167
12. Jolliffe, I. T., 2007: Uncertainty and inference for verification measures. Wea. Forecasting, 22, 637-650.
13. Jolliffe, I. T., and D. B. Stephenson, 2003: Forecast Verification: A Practitioner's Guide in Atmospheric Science. John Wiley and Sons, 240 pp.
14. Kane, T. L., and B. G. Brown, 2000: Confidence intervals for some verification measures-a survey of several methods. Preprints, 15th Conf. on Probability and Statistics, Asheville, NC, Amer. Meteor. Soc., 46-49.
15. Lahiri, S. N., 1993: Bootstrapping the Studentized sample mean of lattice variables. J. Mult. Anal., 45, 247-256.
16. Müller, W. A., C. Appenzeller, F. J. Doblas-Reyes, and M. A. Liniger, 2005: A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small ensemble sizes. J. Climate, 18, 1513-1523.
17. Palmer, T. N., and Coauthors, 2004: Development of a European Multimodel Ensemble System for Seasonal to Interannual Prediction (DEMETER). Bull. Amer. Meteor. Soc., 85, 853-872.
18. Potts, J. M., 2003: Basic concepts. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., John Wiley and Sons, 13-36.
19. Richardson, D. S., 2001: Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Quart. J. Roy. Meteor. Soc., 127, 2473-2489.
20. Romano, J. P., 1988: A bootstrap revival of some nonparametric distance tests. J. Amer. Stat. Assoc., 83, 698-708.
21. Seaman, R., I. Mason, and F. Woodcock, 1996: Confidence intervals for some performance measures of yes-no forecasts. Aust. Meteor. Mag., 45, 49-53.
22. Severini, T. A., 2005: Elements of Distribution Theory. Cambridge University Press, 515 pp.
23. Stephenson, D. B., 2000: Use of the "odds ratio" for diagnosing forecast skill. Wea. Forecasting, 15, 221-232.
24. Thornes, J. E., and D. B. Stephenson, 2001: How to judge the quality and value of weather forecast products. Meteor. Appl., 8, 307-314.
25. Wilks, D. S., 1997: Resampling hypothesis tests for autocorrelated fields. J. Climate, 10, 65-82.
26. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2d ed. Academic Press, 627 pp.
27. Woodcock, F., 1976: The evaluation of yes/no forecasts for scientific and administrative purposes. Mon. Wea. Rev., 104, 1209-1214.