Relationship between precipitation forecast errors and skill scores of dichotomous forecasts

Weather and Forecasting

Volumn 25, Issue 1, 2010, Pages 355-365

  Tartaglione, Nazario ^a  

^a UNIVERSITY OF CAMERINO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINGENCY TABLE; CONTINUOUS PRECIPITATION; EQUITABLE THREAT SCORE; ERROR MODEL; FORECAST ERRORS; MONTE CARLO SIMULATION; MULTIPLICATIVE CASCADES; PRECIPITATION FORECAST; SKILL SCORE;

COMPUTER SIMULATION; MONTE CARLO METHODS; TIME SERIES; WEATHER FORECASTING;

ERRORS;

COMPUTER SIMULATION; ERROR ANALYSIS; MONTE CARLO ANALYSIS; PERFORMANCE ASSESSMENT; PRECIPITATION (CLIMATOLOGY); WEATHER FORECASTING;

EID: 77953553216     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/2009WAF2222211.1     Document Type: Article

References (37)

1. Accadia, C., S.Mariani,M.Casaioli, A. Lavagnini, and A. Speranza, 2003, Sensitivity of precipitation forecast skill scores to bilinear interpolation and a simple nearest-neighbor average method on high-resolution verification grids. Wea. Forecasting, 18, 918-932.
2. Accadia, C., S.Mariani,M.Casaioli, A. Lavagnini, and A. Speranza, 2005, Verification of precipitation forecasts from two limited-area models over Italy and comparison with ECMWF forecasts using a resampling technique. Wea. Forecasting, 20, 276-300.
3. Baldwin, M. E., and J. S. Kain, 2006, Sensitivity of several performance measures to displacement error, bias, and event frequency. Wea. Forecasting, 21, 636-648.
4. Bernardet, L., and Coauthors, 2008, The Developmental Testbed Center and its Winter Forecasting Experiment. Bull. Amer. Meteor. Soc., 89, 611-627.
5. Bradley, A. A., T. Hashino, and S. S. Schwartz, 2003, Distributionsoriented verification of probability forecasts for small data samples. Wea. Forecasting, 18, 903-917.
6. Bradley, A. A., S. S. Schwartz, and T. Hashino, 2008, Sampling uncertainty and confidence intervals for the Brier score and Brier skill score. Wea. Forecasting, 23, 992-1006
7. Brill, K. F., 2009, A general analytic method for assessing sensitivity to bias of performance measures for dichotomous forecasts. Wea. Forecasting, 24, 307-318.
8. Case, J. L., J. Manobianco, A. V. Dianic, M. M. Wheeler, D. E. Harms, and C. R. Parks, 2002, Verification of highresolution RAMS forecasts over east-central Florida during the 1999 and 2000 summer months. Wea. Forecasting, 17, 1133-1151.
9. Charba, J. P., D. W. Reynolds, B. E. McDonald, and G. M. Carter, 2003, Comparative verification of recent quantitative precipitation forecasts in the NationalWeather Service: A simple approach for scoring forecast accuracy. Wea. Forecasting, 18, 161-183.
10. Cherubini, T., A. Ghelli, and F. Lalaurette, 2002, Verification of precipitation forecasts over the Alpine region using a high density. Wea. Forecasting, 17, 238-249.
11. Ciach,G. J., 2003, Local randomerrors in tipping-bucket rain gauge measurements. J. Atmos. Oceanic Technol., 20, 752-759.
12. Daan, H., 1985, Sensitivity of verification scores to the classification of the predictand. Mon. Wea. Rev., 113, 1384-1392.
13. Doswell, C. A., III, R. Davies-Jones, and D. L. Keller, 1990, On summary measures of skill in rare event forecasting based on contingency tables. Wea. Forecasting, 5, 576-585.
14. Ebert, E. E., and W. A. Gallus Jr., 2009, Toward better understanding of the contiguous rain area (CRA) method for spatial forecast verification. Wea. Forecasting, 24, 1401-1415.
15. Flores, C., 2004, Multiplicative cascade models for rain in hydrometeorological disasters riskmanagement.ASTIN-Kolloquium, Bergen,Norway, Int. Actuarial Association. [Available online at http://www.actuaries.org/ASTIN/Colloquia/Bergen/Flores.pdf.]
16. Gandin, L. S., and A. H. Murphy, 1992, Equitable skill scores for categorical forecasts. Mon. Wea. Rev., 120, 361-370.
17. Germann, U., G. Galli, M. Boscacci, and M. Bolliger, 2006, Radar precipitation measurement in a mountainous region. Quart. J. Roy. Meteor. Soc., 132, 1669-1692.
18. Gilbert, G. K., 1884, Finley's tornado predictions. Amer. Meteor. J., 1, 166-172.
19. Goldreich, Y., 2002, The Climate of Israel: Observation, Research and Application. Springer, 298 pp.
20. Hamill, T. M., 1999, Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155-167.
21. Hamill, T. M., and J. Juras, 2006, Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132, 2905-2923.
22. Hanssen, A. W., and W. J. A. Kuipers, 1965, On the relationship between the frequency of rain and various meteorological parameters. Koninklijk Ned. Meteor. Instit., Meded. Verhand., 81, 2-15.
23. Huffman, G. J., 1997, Estimates of root-mean-square random error for finite samples of estimated precipitation. J. Appl. Meteor., 36, 1191-1201.
24. Jolliffe, I. T., 2007, Uncertainty and inference for verification measures. Wea. Forecasting, 22, 637-650.
25. Jolliffe, I. T., and D. B. Stephenson, 2003, Forecast Verification: A Practitioner's Guide in Atmospheric Science. Wiley, 240 pp.
26. Kitzmiller, D., 2005, Research to operations for improved precipitation estimates and forecasts. FirstQuantitative Precipitation Estimation Workshop, Norman,OK, NWS-NSSL. [Available online at http://www.nssl.noaa.gov/projects/q2/2005wkshp/presentations.php.]
27. Lakshmanan, V., A. Fritz, T. Smith, K. Hondl, and G. Stumpf, 2007, An automated technique to quality control radar reflectivity data. J. Appl. Meteor. Climatol., 46, 288-305.
28. Mason, I., 1989, Dependence of the critical success index on sample climate and threshold probability.Aust.Meteor.Mag., 37, 75-81.
29. Mason, S. J., 2008, Understanding forecast verification statistics. Meteor. Appl., 15, 31-40.
30. Mesinger, F., 2008, Bias adjusted precipitation threat scores. Adv. Geosci., 16, 137-142.
31. Něspor, V., and B. Sevruk, 1999, Estimation of wind-induced error of rainfall gauge measurements using a numerical simulator. J. Atmos. Oceanic Technol., 16, 450-464.
32. Roof, S., and C. Callagan, 2003, The climate of Death Valley, California. Bull. Amer. Meteor. Soc., 84, 1725-1739.
33. Stephenson, D. B., B. Casati, C. A. T. Ferro, and C. A. Wilson, 2008, The extreme dependency score: A non-vanishing measure for forecasts of rare events. Meteor. Appl., 15, 41-50.
34. Wilks, D. S., 2006, Statistical Methods in Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.
35. Winston, H. A., 1988, A comparison of three radar-based severestorm-detection algorithms on Colorado high plains thunderstorms. Wea. Forecasting, 3, 131-140.
36. Woodcock, F., 1976, The evaluation of yes/no forecasts for scientific and administrative purposes. Mon. Wea. Rev., 104, 1209-1214.
37. Zwiers, F. W., 1987, Statistical considerations for climate experiments. Part II: Multivariate tests. J. Climate Appl. Meteor., 26, 477-487.