Information-based skill scores for probabilistics forecasts

Monthly Weather Review

Volumn 136, Issue 1, 2008, Pages 352-363

  Ahrens, Bodo ^a,b   Walser, André ^c  

^a ETH ZURICH   (Switzerland)

^b GOETHE UNIVERSITY   (Germany)

^c FEDERAL OFFICE OF METEOROLOGY AND CLIMATOLOGY METEOSWISS   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

DATA PROCESSING; INFORMATION THEORY; METEOROLOGY; PROBABILITY;

PROBABILISTICS FORECAST; RANKED MUTUAL INFORMATION SKILL SCORES; RANKED PROBABILITY SKILL SCORE;

WEATHER FORECASTING;

ENSEMBLE FORECASTING; EXPERIMENTAL STUDY; INFORMATION PROCESSING; PROBABILITY; RANKING; WEATHER FORECASTING;

EID: 39749190760     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2007MWR1931.1     Document Type: Article

References (36)

1. Ahrens, B., 2003: Evaluation of precipitation forecasting with the limited area model ALADIN in an alpine watershed. Meteor. Z., 12, 245-255.
2. Ahrens, B., U. Karstens, B. Rockel, and R. Stuhlmann, 1998: On the validation of the atmospheric model REMO with ISCCP data and precipitation measurements using simple statistics. Meteor. Atmos. Phys., 68, 127-142.
3. Atger, F., 1999: The skill of ensemble prediction systems. Mon. Wea. Rev., 127, 1941-1953.
4. Brier, G., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 1-3.
5. Cover, T., and J. Thomas, 1991: Elements of Information Theory. Wiley, 542 pp.
6. Daan, H., 1985: Sensitivity of verification scores to the classification of the predictand. Mon. Wea. Rev., 113, 1384-1392.
7. DelSole, T., 2004: Predictability and information theory. Part I: Measures of predictability. J. Atmos. Sci., 61, 2425-2440.
8. Eagleson, P. S., 2002: Ecohydrology - Darwinian Expression of Vegetation Form and Function. Cambridge University Press, 443 pp.
9. Efron, B., and R. J. Tibshirani, 1993: An Introduction to the Bootstrap. Chapman and Hall, 436 pp.
10. Ehrendorfer, M., 1997: Predicting the uncertainty of numerical weather forecasts: A review. Meteor. Z., 6, 147-183.
11. Good, I., 1952: Rational decisions. J. Roy. Stat. Soc., 14, 107-114.
12. Jolliffe, I., and D. B. Stephenson, Eds., 2003: Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wiley and Sons, 240 pp.
13. Katz, R., and M. Ehrendorfer, 2006: Bayesian approach to decision making using ensemble weather forecasts. Wea. Forecasting, 21, 220-231.
14. Leung, L.-Y., and G. North, 1990: Information theory and climate prediction. J. Climate, 3, 5-14.
15. Marsigh, C., F. Boccanera, A. Montani, and T. Paccagnella, 2005: The COSMO-LEPS mesoscale ensemble system: Validation of the methodology and verification. Nonlinear Processes Geophys., 12, 527-536.
16. Mason, S. J., 2004: On using "climatology" as a reference strategy in the Brier and ranked probability skill scores. Mon. Wea. Rev., 132, 1891-1895.
17. Matheson, J., and R. L. Winkler, 1976: Scoring rules for continuous probability distributions. Manage. Sci., 22, 1087-1096.
18. Miller, G., 1955: Note on the bias of information estimates. Information Theory in Psychology II-B, H. Quastler, Ed., Free Press, 95-100.
19. Molini, A., P. La Barbera, and L. Lanza, 2006: Correlation patterns and information flows in rainfall fields. J. Hydrol., 322, 89-104.
20. Montani, A., and Coauthors, 2003: Operational limited-area ensemble forecasts based on the Lokal Modell. ECMWF Newsletter, No. 98, ECMWF, Reading, United Kingdom, 2-7.
21. Müller, W., C. Appenzeller, F. Doblas-Reyes, and M. Liniger, 2005: A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small ensemble sizes. J. Climate, 18, 1513-1523.
22. Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595-600.
23. Murphy, A. H., 1996: The Finley affair: A signal event in the history of forecast verification. Wea. Forecasting, 11, 3-20.
24. Murphy, A. H., 1997: Forecast verification. Economic Value of Weather and Climate Forecasts, A. Murphy and R. Katz, Eds., Cambridge University Press, 19-70.
25. Murphy, A. H. and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
26. Palmer, T. N., 2000: Predicting uncertainty in forecasts of weather and climate. Rep. Prog. Phys., 63, 71-116.
27. Paninski, L., 2003: Estimation of entropy and mutual information. Neural Comput., 15, 1191-1253.
28. Rodriguez-Iturbe, I., D. Cox, and V. Isham, 1987: Some models for rainfall based on stochastic point processes. Proc. Roy. Soc. London, 410, 269-288.
29. Roulston, M. S., and L. A. Smith, 2002: Evaluating probabilistic forecasts using information theory. Mon. Wea. Rev., 130, 1653-1660.
30. Schuermann, T., 2004: Bias analysis in entropy estimation. J. Phys. A, 37, L295-L301, doi:10.1088/0305-4470/37/27/L02.
31. Selten, R., 1998: Axiomatic characterization of the quadratic scoring rule. Exp. Econ., 1, 43-62.
32. Shannon, C. E., 1948: A mathematical theory of communication. Bell Syst. Tech. J., 27, 379-423.
33. Stanski, H., L. Wilson, and W. Burrows, 1989: Survey of common verification methods in meteorology. Tech. Rep. WMO/TD 358, WMO World Weather Watch, 81 pp.
34. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2007a: The discrete Brier and ranked probability skill scores. Mon. Wea. Rev., 135, 118-124.
35. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2007b: Generalization of the discrete Brier and ranked probability skill scores for weighted multimodel ensemble forecasts. Mon. Wea. Rev., 135, 2778-2785.
36. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. Academic Press, 627 pp.