A skill score based on economic value for probability forecasts

Meteorological Applications

Volumn 8, Issue 2, 2001, Pages 209-219

  Wilks, D S ^a  

^a Department of Population Medicine and Diagnostic Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL MECHANICS; DECISION MAKING; FORECASTING;

DECISION MAKERS; DECISION PROBLEMS; ECONOMIC VALUES; GRAPHICAL DISPLAYS; PROBABILITY FORECASTS; RELATIVE OPERATING CHARACTERISTICS; ROC CURVES; SKILL SCORE;

COSTS;

COMPUTER SIMULATION; COMPUTER SYSTEM; DECISION MAKING; ECONOMIC ANALYSIS; FORECASTING METHOD; GRAPHICAL METHOD; PROBABILITY;

EID: 0000613410     PISSN: 13504827     EISSN: None     Source Type: Journal    
DOI: 10.1017/S1350482701002092     Document Type: Article

References (40)

1. Atger, F. (1999). The skill of ensemble prediction systems. Mon. Wea. Rev., 127: 1941-1953.
2. Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78: 1-3.
3. Buizza, R., Hollingsworth, A., Lalaurette, F. & Ghelli, A. (1999). Probabilistic predictions of precipitation using the ECMWF ensemble prediction system. Weather and Forecasting, 14: 168-189.
4. Clemen, R. T. (1996). Making Hard Decisions: an Introduction to Decision Analysis. Second edition, Duxbury Press, Belmont, California.
5. Eckel, F. A. & Walters, M. K. (1998). Calibrated probabilistic quantitative precipitation forecasts based on the MRF ensemble. Weather and Forecasting, 13: 1132-1147.
6. Ehrendorfer, M. & Murphy, A. H. (1988). Comparative evaluation of weather forecasting systems: sufficiency, quality, and accuracy. Mon. Wea. Rev., 116: 1757-1770.
7. Ehrendorfer, M. & Murphy, A. H. (1992). Evaluation of prototypical climate forecasts: the sufficiency relation. J. Climate, 5: 876-887.
8. Gandin, L. S., Murphy, A. H. & Zhukovsky, E. E. (1992). Economically optimal decisions and the value of meteorological information. In Preprints, 5th International Meeting on Statistical Climatology, 22-26 June 1992, Toronto, Canada. J64-J71.
9. Glahn, H. R. & Lowry, D. A. (1972). The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteorol., 11: 1203-1211.
10. Harvey, L. O. Jr., Hammond, K. R., Lusk, C. M. & Mross, E. F. (1992). The application of signal detection theory to weather forecasting behavior. Mon. Wea. Rev., 120: 863-883.
11. Hsu, R.-W. & Murphy, A. H. (1986). The attributes diagram: a geometrical framework for assessing the quality of probability forecasts. Int. J. Forecasting, 2: 285-293.
12. Katz, R. W. & Murphy, A. H. (1997). Forecast value: prototype decision-making models. In Economic Value of Weather and Climate Forecasts, R. W. Katz and A. H. Murphy, eds., Cambridge University Press, 183-217.
13. Krzysztofowicz, R. (1983). Why should a forecaster and a decision maker use Bayes theorem. Water Resources Res., 19: 327-336.
14. Krzysztofowicz, R. (1992). Bayesian correlation score: a utilitarian measure of forecast skill. Mon. Wea Rev., 120: 208-219.
15. Krzysztofowicz, R. & Long, D. (1990). Fusion of detection probabilities and comparison of multisensor systems. IEEE Transactions on Systems, Man, and Cybernetics, 20: 665-677.
16. Krzysztofowicz, R. & Long, D. (1991). Forecast sufficiency characteristic: construction and application. Int. J. Forecasting, 7: 39-45.
17. Mason, I. (1982). A model for assessment of weather forecasts. Australian Meteorol. Mag., 30: 291-303.
18. Mason, S. J. & Graham, N. E. (1999). Conditional probabilities, relative operating characteristics, and relative operating levels. Weather and Forecasting, 14: 713-725.
19. Murphy, A. H. (1966). A note on the utility of probabilistic predictions and the probability score in the cost-loss ratio situation. J. Appl. Meteorol., 5: 534-537.
20. Murphy, A. H. (1969). Measures of the utility of probabilistic predictions in cost-loss ratio decision situations in which knowledge of the cost-loss ratios is incomplete. J. Appl. Meteorol., 8: 863-873.
21. Murphy, A. H. (1977). The value of climatological, categorical and probabilistic forecasts in the cost-loss situation. Mon. Wea. Rev., 105: 803-816.
22. Murphy, A. H. (1991). Forecast verification: its complexity and dimensionality. Mon. Wea. Rev., 119: 1590-1601.
23. Murphy, A. H. (1997). Forecast Verification. In Economic Value of Weather and Climate Forecasts, R. W. Katz and A. H. Murphy, eds., Cambridge University Press, 19-74.
24. Murphy, A. H. & Daan, H. (1985). Forecast evaluation. In Probability, Statistics and Decision Making in the Atmospheric Sciences, A. H. Murphy and R.W. Katz, eds., Westview Press, Boulder, Colorado, 379-437.
25. Murphy, A. H. & Ehrendorfer, M. (1987). On the relationship between the accuracy and value of forecasts in the cost-loss ratio situation. Weather and Forecasting, 2: 243-251.
26. Murphy, A. H. & Epstein, E. S. (1989). Skill scores and correlation coefficients in model verification. Mon. Wea. Rev., 117: 572-581.
27. Murphy, A. H. & Wilks, D. S. (1998). A case study of the use of statistical models in forecast verification: precipitation probability forecasts. Weather and Forecasting, 13: 795-810
28. Murphy, A. H. & Winkler, R. L. (1987). A general framework for forecast verification. Mon. Wea. Rev., 115: 1330-1338.
29. Murphy, A. H. & Ye, Q. (1990). Comparison of objective and subjective precipitation probability forecasts: the sufficiency relation. Mon. Wea. Rev., 118: 1783-1792.
30. Mylne, K. R. (1999). The use of forecast value calculations for optimal decision-making using probability forecasts. In Preprints, 17th Conference on Weather Analysis and Forecasting, American Meteorological Society, Boston, Massachusetts, 235-239.
31. Richardson, D. S. (2000). Skill and economic value of the ECMWF ensemble prediction system. Q. J. R. Meteorol. Soc., 126: 649-667.
32. Roebber, P. J. & Bosart, L. F. (1996). The complex relationship between forecast skill and forecast value: a real-world analysis. Weather and Forecasting, 11: 544-559.
33. Stanski, H. R., Wilson, L. J. & Burrows, W. R. (1989). Survey of Common Verification Methods in Meteorology. WMO World Weather Watch Tech. Report No. 8, WMOI TD No. 358, 114pp.
34. Swets, J. A. (1973). The relative operating characteristic in psychology. Science, 182: 990-1000.
35. Thompson, J. C. (1952). On the operational deficiencies in categorical weather forecasts. Bull. Am. Meteorol. Soc., 33: 223-226.
36. Thompson, J. C. & Brier, G. W. (1955). The economic utility of weather forecasts. Mon. Wea. Rev., 83: 249-254.
37. Wilks, D. S. (1995). Statistical Methods in the Atmospheric Sciences. International Geophysics Series, Vol. 59, Academic Press, 464 pp.
38. Wilks, D. S. (1997). Forecast value: prescriptive decision studies. In Economic Value of Weather and Climate Forecasts, R. W. Katz and A. H. Murphy, eds., Cambridge University Press, 109-145.
39. Wilks, D. S. (2000). Diagnostic verification of the Climate Prediction Center long-lead outlooks. J. Climate, 13: 2389-2403.
40. Winkler, R. L. & Murphy, A. H. (1985). Decision Analysis. In Probability, Statistics and Decision Making in the Atmospheric Sciences, A. H. Murphy and R. W. Katz, eds., Westview Press, Boulder, Colorado, 493-524.