An extended procedure for implementing the relative operating characteristic graphical method

Journal of Applied Meteorology and Climatology

Volumn 45, Issue 9, 2006, Pages 1215-1223

  Semazzi, Fredrick H M ^a   Mera, Roberto J ^a  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLIMATE CHANGE; CLIMATOLOGY; GEOMETRY; GRAPHIC METHODS;

CLIMATE PREDICTION SYSTEM (CPS); ECONOMIC VALUE (EV); RELATIVE OPERATING CHARACTERISTIC (ROC); SEMAZZI-MERA SKILL SCORE (SMSS);

WEATHER FORECASTING;

CLIMATOLOGY; ENSEMBLE FORECASTING; GRAPHICAL METHOD; WEATHER FORECASTING;

EID: 33750291179     PISSN: 15588424     EISSN: None     Source Type: Journal    
DOI: 10.1175/JAM2397.1     Document Type: Article

References (32)

1. American Meteorological Society, 2001: AMS statement: Seasonal to interannual climate prediction (adopted by AMS Council 14 January 2001). Bull. Amer. Meteor. Soc., 82, 701-704.
2. Buizza, R., and T. N. Palmer, 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev., 126, 2503-2518.
3. Buizza, R., T. Petroliagis, T. N. Palmer, J. Barkmeijer, M. Hamrud, A. Hollingsworth, A. Simmons, and N. Wedi, 1998: Impact of model resolution and ensemble size on the performance of an ensemble prediction system. Quart. J. Roy. Meteor. Soc., 124, 1935-1960.
4. Hamill, T. M., and J. Juras, 2006: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., in press.
5. Hanley, J. A., and B. J. McNeil, 1982: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
6. Hanley, J. A., and B. J. McNeil, 1983: A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148, 839-843.
7. Harvey, L. O., Jr., K. R. Hammond, C. M. Lusk, and E. F. Mross, 1992: The application of signal detection theory to weather forecasting behavior. Mon. Wea. Rev., 120, 863-883.
8. Jalihal, D., and L. W. Nolte, 1994: Signal detection theory and reconstruction algorithms - Performance for images in noise. IEEE Trans. Biomed. Eng., 41, 501-504.
9. Juras, J., 2000: Comments on "Probabilistic predictions of precipitation using the ECMWF ensemble prediction system." Wea. Forecasting, 15, 365-366.
10. Kharin, V. V., and F. W. Zwiers, 2003: On the ROC score of probability forecasts. J. Climate, 16, 4145-4150.
11. Kheshgi, H. S., and B. S. White, 2001: Testing distributed parameter hypotheses for the detection of climate change. J. Climate, 14, 3464-3481.
12. Laman, D. M., G. H. Wieneke, H. van Duijn, R. J. Veldhuizen, and A. C. van Huffelen, 2005: QEEG changes during carotid clamping in carotid endarterectomy: Spectral edge frequency parameters and relative band power parameters. J. Clin. Neurophysiol., 22, 244-252.
13. Marzban, C., 2004: The ROC curve and its area under it as performance measures. Wea. Forecasting, 19, 1106-1114.
14. Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291-303.
15. Mason, S. J., and N. E. Graham, 2002: Areas beneath the relative operating characteristics (ROC) and levels (ROL) curves: Statistical significance and interpretation. Quart. J. Roy. Meteor. Soc., 128, 2145-2166.
16. Mason, S. J., L. Goddard, N. E. Graham, E. Yulaeva, L. Sun, and P. A. Arkin, 1999: The IRI seasonal climate prediction system and the 1997/98 El Niño event. Bull. Amer. Meteor. Soc., 80, 1853-1873.
17. McNeil, B. J., and S. J. Adelstein, 1976: Determining the value of diagnostic and screening tests. J. Nucl. Med., 17, 439-448.
18. Molesworth, A. M., L. E. Cuevas, S. J. Connor, A. More, and M. C. Thomson, 2003: Environmental risk and meningitis in Africa. Emerging Infect. Dis., 9, 1287-1293.
19. Mylne, K. R., 1999: The use of forecast value calculations for optimal decision making using probability forecasts. Preprints, 17th Conf. on Weather Analysis and Forecasting, Denver, CO, Amer. Meteor. Soc., 235-239.
20. Palmer, T. N., C. Brankovic, and D. S. Richardson, 2000: A PROVOST probability and decision-model analysis of PROVOST seasonal multi-model ensemble integrations. Quart. J. Roy. Meteor. Soc., 126, 2013-2034.
21. Richardson, D. S., 2000a: Skill and economic value of the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 126, 649-668.
22. Richardson, D. S., 2000b: Applications of cost-loss models. Proc. Seventh ECMWF Workshop on Meteorological Operational Systems, Reading, United Kingdom, ECMWF, 209-213.
23. Richardson, D. S., 2001: Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Quart. J. Roy. Meteor. Soc., 127, 2473-2489.
24. Roebber, P. J., and L. F. Bosart, 1996: The complex relationship between forecast skill and forecast value: A real world analysis. Wea. Forecasting, 11, 544-559.
25. Stanski, H. R., L. J. Wilson, and W. R. Burrows, 1989: Survey of common verification methods in meteorology. WMO World Weather Watch Tech. Rep. 8, WMO/TD 358, 114 pp.
26. Swets, J. A., 1973: The relative operating characteristic in psychology. Science, 182, 990-999.
27. Swets, J. A., and R. M. Pickett, 1982: Evaluation of Diagnostic Systems: Methods from Signal Detection Theory. Academic Press, 253 pp.
28. Walter, S. D., and L. M. Irwig, 1988: Estimation of test error rates, disease prevalence, and relative risk from misclassified data. J. Clin. Epidemiol., 41, 923-938.
29. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. Cambridge University Press, 630 pp.
30. Wilson, L. J., 2000: Comments on "Probabilistic predictions of precipitation using the ECMWF ensemble prediction system." Wea. Forecasting, 15, 361-364.
31. World Meteorological Organization, 1992: Section III, Attachment II.7 and II.8 (revised in 2002). Manual on the Global Data-Processing System, WMO No. 485, 217 pp. [Available online at http://www.wmo.int/web/www/DPS/ Manual/WMO485.pdf.]
32. Zhu, Y., Z. Toth, R. Wobus, D. Richardson, and K. Mylne, 2002: The economic value of ensemble weather forecasts. Bull. Amer. Meteor. Soc., 83, 73-83.