Distributions-oriented verification of probability forecasts for small data samples

Weather and Forecasting

Volumn 18, Issue 5, 2003, Pages 903-917

  Bradley, A Allen ^a   Hashino, Tempei ^a   Schwartz, Stuart S ^b  

^a UNIVERSITY OF IOWA   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; ESTIMATION; MONTE CARLO METHODS; QUALITY CONTROL; STATISTICAL METHODS;

FORECAST QUALITY;

WEATHER FORECASTING;

DATA QUALITY; MODELING; PROBABILITY; WEATHER FORECASTING;

EID: 0344899039     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/1520-0434(2003)018<0903:DVOPFF>2.0.CO;2     Document Type: Article

References (35)

1. Bowman, A. W., and A. Azzalini, 1997: Applied Smoothing Techniques for Data Analysis: The Kernel Approach with S-Plus Illustrations. Oxford University Press, 208 pp.
2. Brier, G. W., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 1-3.
3. Brooks, H. E., and C. A. Doswell, 1996: A comparison of measures-oriented and distributions-oriented approaches to forecast verification. Wea. Forecasting, 11, 288-303.
4. Clemen, R. T., and R. L. Winkler, 1987: Calibrating and combining precipitation probability forecasts. Probability and Bayesian Statistics, R. Viertl, Ed., Plenum Press, 97-110.
5. Connor, G. J., and F. Woodcock, 2000: The application of synoptic stratification to precipitation forecasting in the trade wind regime. Wea. Forecasting, 15, 276-297.
6. Cox, D. R., and E. J. Snell, 1989: Analysis of Binary Data. 2d ed. Chapman and Hall, 236 pp.
7. Day, G. N., 1985: Extended streamflow forecasting using NWSRFS. J. Water Resour. Plan. Manage., 111, 157-170.
8. Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155-167.
9. Hashino, T., A. A. Bradley, and S. S. Schwartz, 2002: Verification of probabilistic streamflow forecasts. IIHR Rep. 427, IIHR-Hydroscience and Engineering, Iowa City, IA.
10. Hosmer, D. W., Jr., and S. Lemeshow, 1989: Applied Logistic Regression. John Wiley and Sons, 307 pp.
11. Kane, T. L., and B. G. Brown, 2000: Confidence intervals for some verification measures-A survey of several methods. Preprints, 15th Conf. on Probability and Statistics in the Atmospheric Sciences, Asheville, NC. Amer. Meteor. Soc., 46-49.
12. Katz, R. W., A. H. Murphy, and R. L. Winkler, 1982: Assessing the value of frost forecast to orchardists: A dynamic decision-making approach. J. Appl. Meteor., 21, 518-531.
13. Krzysztofowicz, R., and D. Long, 1991: Beta likelihood models of probabilistic forecasts. Int. J. Forecasting, 7, 47-55.
14. Murphy, A. H., 1991: Forecast verification: Its complexity and dimensionality. Mon. Wea. Rev., 119, 1590-1601.
15. Murphy, A. H., 1997: Forecast verification. Economic Value of Weather and Climate Forecasts, R. W. Katz and A. H. Murphy, Eds., Cambridge University Press, 19-74.
16. Murphy, A. H., and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
17. Murphy, A. H., and R. L. Winkler, 1992: Diagnostic verification of probability forecasts. Int. J. Forecasting, 7, 435-455.
18. Murphy, A. H., and D. S. Wilks, 1998: A case study of the use of statistical models in forecast verification: Precipitation probability forecasts. Wea. Forecasting, 13, 795-810.
19. Nottingham, Q. J., J. B. Birch, and B. A. Bodt, 2000: Local logistic regression: An application to Army penetration data. J. Stat. Comput. Simulat., 66 (1), 35-50.
20. Rajagopalan, B., and U. Lall, 1995: A kernel estimator for discrete distributions. J. Nonparametric Stat., 4, 409-426.
21. Scott, D. W., 1992: Multivariate Density Estimation: Theory, Practice, and Visualization. Wiley, 317 pp.
22. Seaman, R., I. Mason, and F. Woodcock, 1996: Confidence intervals for some performance measures of yes-no forecasts. Aust. Meteor. Mag., 45, 49-53.
23. Smith, J. A., G. N. Day, and M. D. Kane, 1992: Nonparametric framework for long-range streamflow forecasting. J. Water Resour. Plan. Manage., 118, 82-92.
24. Stephenson, D. B., 2000: Use of the "odds ratio" for diagnosing forecast skill. Wea. Forecasting. 15, 221-232.
25. Thornes, J. E., and D. B. Stephenson, 2001: How to judge the quality and value of weather forecast products. Meteor. Appl., 8, 307-314.
26. Titterington, D. M., 1980: A comparative study of kernel-based density estimates for categorical data. Technometrics, 22, 259-268.
27. Wang, M.-C., and J. Van Ryzin, 1981: A class of smooth estimators for discrete distribution. Biometrika, 68, 301-309.
28. Wilks, D. S., 1991: Representing serial correlation of meteorological events and forecasts in dynamic decision analytic model. Mon. Wea. Rev., 119, 1640-1662.
29. Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp.
30. Wilks, D. S., 2000: Diagnostic verification of the Climate Prediction Center Long-Lead Outlooks, 1995-98, J. Climate, 13, 2389-2403.
31. Wilks, D. S., and A. H. Murphy, 1986: A decision-analytic study of the joint value of seasonal precipitation and temperature forecasts in a choice-of-crop problem. Atmos.-Ocean, 24, 353-368.
32. Wilks, D. S., and K. W. Shen, 1991: Threshold relative-humidity duration forecasts for plant-disease prediction. J. Appl. Meteor., 30, 463-477.
33. Wilks, D. S., R. E. Pitt, and G. W. Fick, 1993: Modeling optimal alfalfa harvest scheduling using short-range weather forecasts. Agric. Syst., 42, 277-305.
34. Woodcock, F., 1976: The evaluation of yes/no forecasts for scientific and administrative purposes. Mon. Wea. Rev., 104, 1209-1214.
35. Zhang, S., R. J. Karunamuni, and M. C. Jones, 1999: An improved estimator of the density function at the boundary. J. Amer. Stat. Assoc., 94, 1231-1241.