A diagnostic verification of the precipitation forecasts produced by the Canadian ensemble prediction system

Weather and Forecasting

Volumn 23, Issue 4, 2008, Pages 596-616

  Peel, Syd ^a,b   Wilson, Laurence J ^a  

^a ENVIRONMENT CANADA   (Canada)

^b NONE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 54749142024     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/2008WAF2006099.1     Document Type: Article

References (47)

1. Atger, F., 1999: The skill of ensemble prediction systems. Mon. Wea. Rev., 127, 1941-1953.
2. Atger, F., 2003: Spatial and interannual variability of the reliability of ensemble-based probabilistic forecasts: Consequences for calibrations. Mon. Wea. Rev., 131, 1509-1523.
3. Atger, F., 2004: Estimation of the reliability of ensemble-based probabilistic forecasts. Quart. J. Roy. Meteor. Soc., 130, 627-646.
4. Bonsal, B. R., and E. E. Wheaton, 2005: Atmospheric circulation comparisons between the 2001 and 2002 and the 1961 and 1988 Canadian prairie droughts. Atmos.-Ocean, 43, 163-172.
5. Brier, G. W., 1950: Verification of forecasts expressed in terms of probabilities. Mon. Wea. Rev., 78, 1-3.
6. Bright, D. R., S. J. Weiss, M. S. Wandishin, J. S. Kain, and D. J. Stensrud, 2004: Evaluation of short-range ensemble forecasts during the 2003 SPC/NSSL Spring Program. Preprints, 22nd Conf. on Severe Local Storms, Hyannis, MA, Amer. Meteor. Soc., P15.5. [Available online at http://ams.confex.com/ams/pdfpapers/68921.pdf.]
7. Buizza, R., A. Hollingsworth, F. Lalaurette, and A. Ghelli, 1999a: Probabilistic predictions of precipitation using the ECMWF Ensemble Prediction System. Wea. Forecasting, 14, 168-189.
8. Buizza, R.,, M. Miller, and T. N. Palmer, 1999b: Stochastic simulation of model uncertainties. Quart. J. Roy. Meteor. Soc., 125, 2887-2908.
9. Buizza, R.,, P. L. Houtekamer, Z. Toth, G. Pellerin, M. Wei, and Y. Zhu, 2005: A Comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Wea. Rev., 133, 1076-1097.
10. Candille, G., and O. Talagrand, 2005: Evaluation of probabilistic prediction systems for a scalar variable. Quart. J. Roy. Meteor. Soc., 131, 2131-2150.
11. Cherubini, T., A. Ghelli, and F. Lalaurette, 2002: Verification of precipitation forecasts over the Alpine region using a high-density observing network. Wea. Forecasting, 17, 238-249.
12. Côté, J. S., S. Gravel, A. Méthot, A. Patoine, M. Roch, and A. Staniforth, 1998: The operational CMC/MRB Global Environmental Multiscale (GEM) model. Part I: Design considerations and formulation. Mon. Wea. Rev., 126, 1373-1395.
13. Doswell, C. A., III, 1987: The distinction between large-scale and mesoscale contribution to severe convection: A case study example. Wea. Forecasting, 2, 3-16.
14. Eckel, F. A., and M. K. Walters, 1998: Calibrated probabilistic quantitative precipitation forecasts based on the MRF ensemble. Wea. Forecasting, 13, 1132-1147.
15. Feller, W., 1957: An Introduction to Probability Theory and its Applications. Vol. 1. Wiley, 461 pp.
16. Fritsch, J. M., I. J. Thomas, O. F. Hansen, and G. G. Hardy, 1998: Quantitative precipitation forecasting: Report of the Eighth Prospectus Development Team, U.S. Weather Research Program. Bull. Amer. Meteor. Soc., 79, 285-299.
17. Gauthier, P., C. Charette, L. Fillion, P. Koclas, and S. Laroche, 1999: Implementation of a 3d variational data assimilation system at the Canadian Meteorological Centre. Part 1: The global analysis. Atmos.-Ocean, 37, 103-156.
18. Ghelli, A., and F. Lalaurette, 2000: Verifying precipitation forecasts using upscaled observations. ECMWF Newsletter, No. 87, ECMWF, Reading, United Kingdom, 9-17.
19. Glahn, H., and D. A. Lowry, 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11, 1203-1211.
20. Goodison, B. E., 1978: Accuracy of Canadian snow gage measurements. J. Appl. Meteor., 17, 1542-1548.
21. Hamill, T. M., and S. J. Colucci, 1998: Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126, 711-724.
22. Hamill, T. M., and J. Juras, 2006: Measuring forecast forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132, 2905-2923.
23. Harvey, L. O., Jr., K. R. Hammond, C. M. Lusk, and E. F. Mross, 1992: The application of signal detection theory to weather forecasting behavior. Mon. Wea. Rev., 120, 863-883.
24. Houtekamer, P. L., L. Lefaivre, J. Derome, H. Ritchie, and H. L. Mitchell, 1996: A system simulation approach to ensemble prediction. Mon. Wea. Rev., 124, 1225-1242.
25. Jones, S. C., and Coauthors, 2003: Extratropical transition of tropical cyclones: Forecast challenges, current understanding, and future directions. Wea. Forecasting, 18, 1052-1092.
26. Lefaivre, L., P. L. Houtekamer, A. Bergeron, and R. Verret, 1997: The CMC Ensemble Prediction System. Proc. Sixth Workshop on Meteorological Operational Systems, Reading, United Kingdom, ECMWF, 31-44.
27. Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291-303.
28. Metcalfe, J. R., and B. E. Goodison, 1993: Correction of Canadian winter precipitation data. Proc. Eighth Symp. on Meteorological Observations and Instrumentation, Anaheim, CA, Amer. Meteor. Soc., 338-343.
29. Metcalfe, J. R., B. Routledge, and K. Devine, 1997: Rainfall measurement in Canada: Changing observational methods and archive adjustment procedures. J. Climate, 10, 92-101.
30. Mullen, S. L., and R. Buizza, 2001: Quantitative precipitation forecasts over the United States by the ECMWF Ensemble Prediction System. Mon. Wea. Rev., 129, 638-663.
31. Mullen, S. L., and R. Buizza, 2002: The impact of horizontal resolution and ensemble size on probabilistic forecasts of precipitation by the ECMWF Ensemble Prediction System. Wea. Forecasting, 17, 173-191.
32. Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595-600.
33. Murphy, A. H., 1986: The attributes diagram: A geometric framework for assessing the quality of probability forecasts. Int. J. Forecasting, 2, 285-293.
34. Murphy, A. H., 1993: What is a good forecast? An essay on the nature of goodness in weather forecasting. Wea. Forecasting, 8, 281-293.
35. Murphy, A. H., and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
36. Pellerin, G., L. Lefaivre, P. Houtekamer, and C. Girard, 2003: Increasing the horizontal resolution of ensemble forecasts at CMC. Nonlinear Processes Geophys., 10, 463-468.
37. Petterssen, S., 1956a: Motion and Motion Systems. Vol. 1, Weather Analysis and Forecasting, McGraw-Hill, 428 pp.
38. Petterssen, S., 1956b: Weather and Weather Systems. Vol. 2, Weather Analysis and Forecasting, McGraw-Hill, 266 pp.
39. Richardson, D. S., 2000: Skill and relative economic value of the ECMWF Ensemble Prediction System. Quart. J. Roy. Meteor. Soc., 126, 649-667.
40. Ritchie, H., and C. Beaudoin, 1994: Approximations and sensitivity experiments with a baroclinic semi-Lagrangian spectral model. Mon. Wea. Rev., 122, 2391-2399.
41. Sanders, F., 1986: Trends in skill of Boston forecasts made at MIT 1966-84. Bull. Amer. Meteor. Soc., 67, 170-176.
42. Sanders, F., and J. R. Gyakum, 1980: Synoptic-dynamic climatology of the "bomb." Mon. Wea. Rev., 108, 1589-1606.
43. Stanski, H. R., L. J. Wilson, and W. R. Burrows, 1990: Survey of common verification methods in meteorology. World Weather Watch Tech. Rep. 8., WMO, Geneva, Switzerland, 114 pp.
44. Swets, J. A., and R. M. Pickett, 1982: Evaluation of Diagnostic Systems: Methods from Signal Detection Theory. Academic Press, 253 pp.
45. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Elsevier Academic, 627 pp.
46. Wilson, L. J., 2000: Comments on "Probabilistic predictions of precipitation using the ECMWF Ensemble Prediction System." Wea. Forecasting, 15, 361-364.
47. Yuan, H., S. L. Mullen, X. Gao, S. Sorooshian, J. Du, and H.-M. H. Juang, 2005: Verification of probabilistic quantitative precipitation forecasts over the southwest United States during winter 2002/03 by the RSM ensemble system. Mon. Wea. Rev., 133, 279-294.