On reliability analysis of multi-categorical forecasts

Nonlinear Processes in Geophysics

Volumn 15, Issue 4, 2008, Pages 661-673

  Brocker J ^a  

^a MAX PLANCK INSTITUT FÜR PHYSIK KOMPLEXER SYSTEME   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING METHOD; PROBABILITY; RELIABILITY ANALYSIS; TEMPERATURE ANOMALY;

EID: 49149083729     PISSN: 10235809     EISSN: 16077946     Source Type: Journal    
DOI: 10.5194/npg-15-661-2008     Document Type: Article

References (22)

1. Anderson, J. L.: A method for producing and evaluating probabilistic forecasts from ensemble model integrations, J. Climate, 9, 1518-1530, 1996.
2. Breiman, L.: Probability, Addison-Wesley-Publishing, 1973.
3. Bröcker, J.: Decomposition of Proper Scores, Tech. rep., Max-Planck-Institut für Physik komplexer Systeme, Dresden, arXiv:0806.0813 [physics.ao-ph], 2008.
4. Bröcker, J. and Smith, L. A.: Scoring Probabilistic Forecasts: The Importance of Being Proper, Weather and Forecasting, 22, 382-388, 2007a.
5. Bröcker, J. and Smith, L. A.: Increasing the Reliability of Reliability Diagrams, Weather and Forecasting, 22, 651-661, 2007b.
6. Devroye, L.: Non-Uniform Random Variate Generation, Springer Verlag, 1986.
7. Elmore, K. L.: Alternatives to the Chi-Square Test for Evaluating Rank Histograms from Ensemble Forecasts, Weather and Forecasting, 20, 789-795, 2005.
8. Epstein, E. S.: A scoring system for probability forecasts of ranked categories, J. Appl. Meteorol., 8, 985-987, 1969.
9. Gneiting, T. and Raftery, A.: Strictly Proper Scoring Rules, Prediction, and Estimation, J. Am. Statist. Assoc., 102, 359-378, 2007.
10. Gneiting, T., Balabdaoui, F., and Raftery, A. E.: Probabilistic Forecasts, Calibration, and Sharpness, Tech. rep., Department of Statistics, University of Washington, 2005.
11. Hamill, T. M.: Interpretation of rank histograms for verifying ensemble forecasts, Mon. Weather Rev., 129, 550-560, 2001.
12. Hamill, T. M. and Colucci, S. J.: Verification of Eta-RSM Short Range Ensemble Forecasts, Mon. Weather Rev., 125, 1312-1327, 1997.
13. Hamill, T. M. and Colucci, S. J.: Evaluation of Eta-RSM Ensemble Probabilistic Precipitation Forecasts, Mon. Weather Rev., 126, 711-724, 1998.
14. Hansen, J. and Smith, L.: Extending the Limits of Forecast Verification with the Minimum Spanning Tree, Mon. Weather Rev., 132, 1522-1528, 2004.
15. Mood, A. M., Graybill, F. A., and Boes, D. C.: Introduction to the Theory of Statistics, McGraw-Hill Series in Probability and Statistics, McGraw-Hill, 1974.
16. Murphy, A. H.: A note on the ranked probability score, J. Appl. Meteorol., 10, 155, 1971.
17. Murphy, A. H. and Winkler, R. L.: Reliability of Subjective Probability Forecasts of Precipitation and Temperature, Appl. Statist., 26, 41-47, 1977.
18. Murphy, A. H. and Winkler, R. L.: A General Framework for Forecast Verification, Mon. Weather Rev., 115, 1330-1338, 1987.
19. Talagrand, O., Vautard, R., and Strauss, B.: Evaluation of Probabilistic Prediction Systems, in: Workshop on Predictability, pp. 1-25, ECMWF, 1997.
20. Toth, Z., Talagrand, O., Candille, G., and Zhu, Y.: Probability and Ensemble Forecasts, in: Forecast Verification, edited by: Jolliffe, I. T. and Stephenson, D. B., chap. 7, pp. 137-163, John Wiley & Sons, Ltd., Chichester, 2003.
21. Toth, Z., Talagrand, O., and Zhu: The attributes of forecast systems: A framework for the evaluation and calibration of weather forecasts, in: Predictability of Weather and Climate, edited by: Palmer, T. N. and Hagedorn, R., pp. 584-595, Cambridge University Press, 2005.
22. Wilks, D. S.: Statistical Methods in the Athmospheric Sciences, vol. 59 of International Geophysics Series, Academic Press, second edn., 2006.