A generic forecast verification framework for administrative purposes

Monthly Weather Review

Volumn 137, Issue 1, 2009, Pages 331-349

  Mason, Simon J ^a   Weigel, Andreas P ^b  

^a Lamont Campus   (United States)

^b FEDERAL OFFICE OF METEOROLOGY AND CLIMATOLOGY METEOSWISS   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ALTERNATIVE FORCED CHOICES; COMPLEX INFORMATIONS; CONTINUOUS VARIABLES; DICHOTOMOUS OUTCOMES; GENERAL PUBLICS; PROBABILISTIC FORECASTS; VERIFICATION FRAMEWORKS;

ACOUSTIC FIELDS;

FORECASTING;

FORECASTING METHOD; NUMERICAL METHOD; OBSERVATIONAL METHOD; PROBABILITY DENSITY FUNCTION; WEATHER FORECASTING;

EID: 64149125312     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/2008MWR2553.1     Document Type: Article

References (28)

1. Agresti, A., 1984: Analysis of Ordinal Categorical Data. Wiley, 304 pp.
2. Bowler, N., 2008: Accounting for the effect of observation errors on verification of MOGRPS. Meteor. Appl., 15, 199-205.
3. Brier, G. W., and R. A. Allen, 1951: Verification of weather forecasts. Compendium of Meteorology, T. F. Malone, Ed., Amer. Meteor. Soc., 841-848.
4. Bröcker, J., and L. A. Smith, 2007: Scoring probabilistic forecasts: The importance of being proper. Wea. Forecasting, 22, 382-388.
5. Conover, W. J., 1999: Practical Nonparametric Statistics. Wiley, 584 pp.
6. Doblas-Reyes, F. C., C. A. S. Coelho, and D. B. Stephenson, 2008: How much does simplification of probability forecasts reduce forecast quality? Meteor. Appl., 15, 155-162.
7. Epstein, E. S., 1969: A scoring system for probability forecasts of ranked categories. J. Appl. Meteor., 8, 985-987.
8. Glahn, H. R., 2004: Discussion of verification concepts in Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wea. Forecasting, 19, 769-775.
9. Green, D. M., and J. A. Swets, 1989: Signal Detection Theory and Psychophysics. Peninsula Publishing, 521 pp.
10. Jolliffe, I. T., 2004: P stands for.... Weather, 59, 77-79.
11. Jolliffe, I. T., and D. B. Stephenson, 2003: Introduction. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., Wiley, 1-12.
12. Jolliffe, I. T., and D. B. Stephenson, 2008: Proper scores for probability forecasts can never be equitable. Mon. Wea. Rev., 136, 1505-1510.
13. Kharin, V. V., and F. W. Zwiers, 2003: Improved seasonal probability forecasts. J. Climate, 16, 1684-1701.
14. Lindeman, R. H., P. F. Merando, and R. Z. Gold, 1980: Introduction to Bivariate and Multivariate Statistics. Scott Foresman, 444 pp.
15. Livezey, R. E., and M. Timofeyeva, 2008: The first decade of long-lead U.S. seasonal forecasts: Insights from a skill analysis. Bull. Amer. Meteor. Soc., 89, 843-854.
16. Mason, I. T., 2003: Binary events. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., Wiley, 37-76.
17. Mason, S. J., 2004: On using "climatology" as a reference strategy in the Brier and ranked probability skill scores. Mon. Wea. Rev., 132, 1891-1895.
18. Mason, S. J., 2008: Understanding forecast verification statistics. Meteor. Appl., 15, 31-40.
19. Mason, S. J., and N. E. Graham, 2002: Areas beneath the relative operating characteristics (ROC) and levels (ROL) curves: Statistical significance and interpretation. Quart. J. Roy. Meteor. Soc., 128, 2145-2166.
20. Murphy, A. H., 1991: Forecast verification: Its complexity and dimensionality. Mon. Wea. Rev., 119, 1590-1601.
21. Murphy, A. H., 1993: What is a good forecast? An essay on the nature of goodness in weather forecasting. Wea. Forecasting, 8, 281-293.
22. Murphy, A. H., 1996: The Finley affair: A signal event in the history of forecast verification. Wea. Forecasting, 11, 3-20.
23. Murphy, A. H., and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
24. Nicholls, N., 2001: The insignificance of significance testing. Bull. Amer. Meteor. Soc., 82, 981-986.
25. Palmer, T. N., and Coauthors, 2004: Development of a European ensemble system for seasonal to inter-annual prediction (DEMETER). Bull. Amer. Meteor. Soc., 85, 853-872.
26. Sheskin, D. J., 2007: Handbook of Parametric and Nonparametric Statistical Procedures. Chapman and Hall/CRC, 1776 pp.
27. Thomson, M. C., F. J. Doblas-Reyes, S. J. Mason, R. Hagedorn, S. J. Connor, T. Phindela, A. P. Morse, and T. N. Palmer, 2006: Multi-model ensemble seasonal climate forecasts for malaria early warning. Nature, 439, 576-579.
28. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. Academic Press, 648 pp.