Incorporating misclassification error in skill assessment

Monthly Weather Review

Volumn 133, Issue 11, 2005, Pages 3382-3392

  Briggs, William ^a   Pocernich, Matt ^b   Ruppert, David ^c  

^a WEILL CORNELL MEDICAL COLLEGE   (United States)

^b NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^c Cornell University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ICE; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBABILITY; STATISTICAL TESTS; TORNADOES; WEATHER FORECASTING;

CLIMATE SKILL; MISCLASSIFICATION ERROR MODEL;

METEOROLOGY;

ACCURACY ASSESSMENT; ERROR ANALYSIS; WEATHER FORECASTING;

EID: 28944449426     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/MWR3032.1     Document Type: Article

References (19)

1. Briggs, W., 2005: A general method of incorporating forecast cost and loss in value scores. Mon. Wea. Rev., 133, 3393-3397.
2. Briggs, W., and D. Ruppert, 2004: Assessing the skill of yes/no forecasts for Markov observations. Preprints, 17th Conf. on Probability and Statistics in the Atmospheric Sciences, Seattle, WA, Amer. Meteor. Soc, CD-ROM, 2.2.
3. Briggs, W., and D. Ruppert, 2005: Assessing the skill of yes/no forecasts. Biometrics, 61, 799-807.
4. Brown, B. G., G. Thompson, R. T. Bruintjes, R. Bullock, and T. Kane, 1997: Intercomparison of in-flight icing algorithms. Part II: Statistical verification results. Wea. Forecasting, 12, 890-914.
5. Finley, J. P., 1884: Tornado forecasts. Amer. Meteor. J., 1, 85-88.
6. Geisler, F. H., J. J. Jelinek, J. N. Joslyn, and F. Gelland, 1988: Acute cervical spine trauma: Evaluation with 1.5-T MR imaging. Radiology, 166, 807-816.
7. Hamill, T. M., 1998: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155-167.
8. Mozer, J. B., and W. M. Briggs, 2003: Skill in real-time solar wind shock forecasts. J. Geophys. Res., 108, 1262, doi:10.1029/2003JA009827.
9. Murphy, A. H., 1996: The Finley affair: A signal event in the history of forecast verification. Wea. Forecasting, 11, 3-20.
10. Murphy, A. H., and A. Ehrendorfer, 1987: One the relationship between the accuracy and value of forecasts in the cost-loss ratio situation. Wea. Forecasting, 2, 243-251.
11. Murphy, A. H., and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
12. Parker, R. A., and R. B. Davis, 1999: Evaluating whether a binary decision rule operates better than chance. Biom. J., 41, 25-31.
13. Pocernich, M. J., C. Wolff, and T. Fowler, 2004: Statistical models of aircraft icing. Preprints, 17th Conf. on Probability and Statistics in the Atmospheric Sciences, Seattle, WA, Amer. Meteor. Soc., CD-ROM, 1.4.
14. Sand, W. R., and C. Biter, 1997: Pilot response to icing: It depends. Preprints, Seventh Conf. on Aviation, Range, and Aerospace Meteorology, Long Beach, CA, Amer. Meteor. Soc., 116-119.
15. Schervish, M. J., 1989: A general method for comparing probability assessors. Ann. Stat., 17, 1856-1879.
16. Self, S. G., and K. Y. Liang, 1987: Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. J. Amer. Stat. Assoc., 82, 605-610.
17. Speheger, D. A., C. A. Doswell III, and G. J. Stumpf, 2002: The tornadoes of 3 May 1999: Event verification in central Oklahoma and related issues. Wea. Forecasting, 17, 362-381.
18. Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp.
19. Wolff, C. A., and B. C. Bernstein, 2004: Scales of aircraft icing: A comparison of icing PIREPs to liquid water measurements from research aircraft. Preprints, 11th Conf. on Aviation, Range, and Aerospace Meteorology, Hyannis, MA, Amer. Meteor. Soc., CD-ROM, 8.4.