Proper scores for probability forecasts can never be equitable

Monthly Weather Review

Volumn 136, Issue 4, 2008, Pages 1505-1510

  Jolliffe, Ian T ^a,b   Stephenson, David B ^a  

^a UNIVERSITY OF EXETER   (United Kingdom)

^b NONE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER NETWORKS; FORECASTING; PROBABILITY; STATISTICS;

(PL) PROPERTIES; AMERICAN METEOROLOGICAL SOCIETY (AMS); BRIER SKILL SCORE; DESIRABLE PROPERTIES; FORECASTING SYSTEMS; PROBABILITY FORECASTING;

RISK ASSESSMENT;

CLIMATE PREDICTION; PROBABILITY; WEATHER FORECASTING;

EID: 42549131599     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2007MWR2194.1     Document Type: Article

References (17)

1. Brier, G. W., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 1-3.
2. Ferro, C. A. T., D. S. Richardson, and A. P. Weigel, 2008: On the effect of ensemble size on the discrete and continuous ranked probability scores. Meteor. Appl., in press.
3. Gandin, L. S., and A. H. Murphy, 1992: Equitable skill scores for categorical forecasts. Mon. Wea. Rev., 120, 361-370.
4. Gneiting, T., and A. E. Raftery, 2007: Strictly proper scoring rules, prediction, and estimation. J. Amer. Stat. Assoc., 102, 359-378.
5. Jolliffe, I. T., and J. F. Foord, 1975: Assessment of long-range forecasts. Weather, 30, 172-181.
6. Jolliffe, I. T., and D. B. Stephenson, Eds., 2003: Forecast Verification: A Practitioner's Guide in Atmospheric Science. John Wiley and Sons, 254 pp.
7. Mason, I. B., 2003: Binary events. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, E.ds., John Wiley and Sons, 37-76.
8. Mason, S. J., 2004: On using "climatology" as a reference strategy in the Brier and ranked probability skill scores. Mon. Wea. Rev., 132, 1891-1895.
9. Müller, W. A., C. Appenzeller, F. J. Doblas-Reyes, and M. A. Liniger, 2005: A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small ensemble sizes. J. Climate, 18, 1513-1523.
10. Murphy, A. H., 1973: Hedging and skill scores for probability forecasts. J. Appl. Meteor., 12, 215-223.
11. Murphy, A. H., 1993: What is a good forecast? An essay on the nature of goodness in weather forecasting. Wea. Forecasting, 8, 281-293.
12. Murphy, A. H., 1996: The Finley affair: A signal event in the history of forecast verification. Wea. Forecasting, 11, 3-20.
13. Murphy, A. H., and E. S. Epstein, 1967: A note on probability forecasts and "hedging." J. Appl. Meteor., 6, 1002-1004.
14. Savage, L. J., 1971: Elicitation of personal probabilities and expectations. J. Amer. Stat. Assoc., 66, 783-801.
15. Toth, Z., O. Talagrand, G. Candille, and Y. Zhu, 2003: Probability and ensemble forecasts. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., John Wiley and Sons, 137-163.
16. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2007: The discrete Brier and ranked probability skill scores. Mon. Wea. Rev., 135, 118-124.
17. Winkler, R. L., and A. H. Murphy, 1968: "Good" probability assessors. J. Appl. Meteor., 7, 751-758.