Intercomparison of global model precipitation forecast skill in 2010/11 using the SEEPS score

Monthly Weather Review

Volumn 140, Issue 8, 2012, Pages 2720-2733

  Haiden, Thomas ^a   Rodwell, Mark J ^a   Richardson, David S ^a   Okagaki, Akira ^b   Robinson, Tom ^c   Hewson, Tim ^d  

^a EUROPEAN CENTRE FOR MEDIUM RANGE WEATHER FORECASTS   (United Kingdom)

^b JAPAN METEOROLOGICAL AGENCY   (Japan)

^c ENVIRONMENT CANADA   (Canada)

^d MET OFFICE   (United Kingdom)

Author keywords

Forecast verification

Indexed keywords

BROKEN DOWN; CONTINGENCY TABLE; DEEP CONVECTION; EXTRATROPICS; FORECAST ERRORS; FORECAST VERIFICATIONS; GEOGRAPHICAL VARIATIONS; GLOBAL MODELS; GRID-BOX; HEAVY PRECIPITATION; INTERCOMPARISONS; NUMERICAL WEATHER PREDICTION MODELS; PRECIPITATION FORECAST; PROBABILITY SPACES; RAIN GAUGES;

TROPICS;

WEATHER FORECASTING;

ACCURACY ASSESSMENT; COMPARATIVE STUDY; EFFICIENCY MEASUREMENT; ERROR ANALYSIS; GEOGRAPHICAL VARIATION; NUMERICAL MODEL; PRECIPITATION ASSESSMENT; RAINGAUGE; WEATHER FORECASTING;

EID: 84867940939     PISSN: 00270644     EISSN: 15200493     Source Type: Journal    
DOI: 10.1175/MWR-D-11-00301.1     Document Type: Article

References (29)

1. Abel, S. J., D. N. Walters, and G. Allen, 2010: Evaluation of stratocumulus cloud prediction in the Met Office forecast model during VOCALS-Rex. Atmos. Chem. Phys., 10, 10 541-10 559.
2. Bechtold, P., M. Köhler, T. Jung, F. Doblas-Reyes, M. Leutbecher, M. J. Rodwell, F. Vitart, and G. Balsamo, 2008: Advances in simulating atmospheric variability with the ECMWF model: From synoptic to decadal time-scales. Quart. J. Roy. Meteor. Soc., 134, 1337-1351.
3. Brill, K. F., 2009: A general analytic method for assessing sensitivity to bias of performance measures for dichotomous forecasts. Wea. Forecasting, 24, 307-318.
4. Csima, G., and A. Ghelli, 2008: On the use of the intensity-scale verification technique to assess operational precipitation forecasts. Meteor. Appl., 15, 145-154.
5. Ebert, E. E., U. Damrath, W. Wergen, and M. E. Baldwin, 2003: The WGNE assessment of short-term quantitative precipitation forecasts. Bull. Amer. Meteor. Soc., 84, 481-492.
6. Gandin, L. S., and A. H. Murphy, 1992: Equitable skill scores for categorical forecasts. Mon. Wea. Rev., 120, 361-370.
7. Gerrity, J. P., 1992:A note on Gandin and Murphy's equitable skill score. Mon. Wea. Rev., 120, 2709-2712.
8. Ghelli, A., and F. Lalaurette, 2000: Verifying precipitation forecasts using upscaled observations. ECMWF Newsletter, No. 87, ECMWF, Reading, United Kingdom, 9-17.
9. Göber, M., E. Zsoster, and D. S. Richardson, 2008: Could a perfect model ever satisfy a naïve forecaster? On grid box mean versus point verification. Meteor. Appl., 15, 359-365.
10. Gregory, D., and P. R. Rowntree, 1990: A mass flux convection scheme with representation of cloud ensemble characteristics and stability-dependent closure. Mon. Wea. Rev., 118, 1483-1506.
11. Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155-167.
12. Hamill, T. M., 2012: Verification of TIGGE multimodel and ECMWF reforecast-calibrated probabilistic precipitation forecasts over the contiguous United States. Mon. Wea. Rev., 140, 2232-2252.
13. Hamill, T. M., and J. Juras, 2006: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132, 2905-2923.
14. Kain, J. S., and J. M. Fritsch, 1990: A one-dimensional entraining/detraining plume model and its application in convective parameterization. J. Atmos. Sci., 47, 2784-2802.
15. Kleist, D. T., D. F. Parrish, J. C. Derber, R. Treadon, R.M. Errico, and R. Yang, 2009: Improving incremental balance in the GSI 3DVAR analysis system. Mon. Wea. Rev., 137, 1046-1060.
16. Lanzante, J. R., 2005: A cautionary note on the use of error bars. J. Climate, 18, 3699-3703.
17. Pan, H.-L., and W.-S. Wu, 1995: Implementing a mass flux convective parameterization package for the NMC Medium-Range Forecast Model. NMC Office Note 409, 40 pp. [Available from NOAA/NWS/NCEP, Environmental Modeling Center, WWB, Room 207, Washington, DC 20233.]
18. Peirce, C. S., 1884: The numerical measure of the success of predictions. Science, 4, 453-454.
19. Richardson, D. S., and Coauthors, 2009: Verification statistics and evaluations of ECMWF forecasts in 2008-2009. ECMWF Tech. Memo. 606, Reading, United Kingdom, 45 pp.
20. Rodwell, M. J., D. S. Richardson, T. D. Hewson, and T. Haiden, 2010: A new equitable score suitable for verifying precipitation in numerical weather prediction. Quart. J. Roy. Meteor. Soc., 136, 1344-1363.
21. Shapiro, M., and Coauthors, 2010: An Earth-system Prediction Initiative for the twenty-first century. Bull. Amer.Meteor. Soc., 91, 1377-1388.
22. Simmons, A. J., and A. Hollingsworth, 2002: Some aspects of the improvement in skill of numerical weather prediction. Quart. J. Roy. Meteor. Soc., 128, 647-677.
23. Sundqvist, H., E. Berge, and J. E. Kristjansson, 1989: Condensation and cloud parameterization studies with a mesoscale numerical weather prediction model. Mon. Wea. Rev., 117, 1641-1657.
24. Wilks, D. S., 1997: Resampling hypothesis tests for autocorrelated fields. J. Climate, 10, 65-82.
25. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.
26. Wilson, D. R., A. C. Bushell, A. M. Kerr-Munslow, J. D. Price, and C. J. Morcrette, 2008: PC2: A prognostic cloud fraction and condensation scheme. I: Scheme description. Quart. J. Roy. Meteor. Soc., 134, 2093-2107.
27. Wittmann, C., T.Haiden, and A. Kann, 2010: Evaluating multi-scale precipitation forecasts using high-resolution analysis. Adv. Sci. Res., 4, 89-98.
28. WWRP/WGNE Joint Working Group on Verification, 2008: Recommendations for the verification and intercomparison of QPFs and PQPFs from operational NWP models. WMO Tech Doc. 1485, WWRP 2009-1, revision 2, 37 pp.
29. Zhao, Q., and F. H. Carr, 1997: A prognostic cloud scheme for operational NWP models. Mon. Wea. Rev., 125, 1931-1953.