Verification of precipitation forecasts from NCEP's short-range ensemble forecast (SREF) system with reference to ensemble streamflow prediction using lumped hydrologic models

Journal of Hydrometeorology

Volumn 13, Issue 3, 2012, Pages 808-836

  Brown, James D ^a,b   Seo, Dong Jun ^c   Du, Jun ^d  

^a NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

^b UNIVERSITY CORPORATION FOR ATMOSPHERIC RESEARCH   (United States)

^c The University of Texas at Arlington   (United States)

^d CLIMATE PREDICTION CENTER   (United States)

Author keywords

Bias; Ensembles; Error analysis; Flood events; Forecast verification; Forecasting; Mesoscale forecasting; Model errors; North America; Numerical weather prediction forecasting; Operational forecasting; Probability forecasts models distribution; Rivers; Short range prediction; Statistical forecasting; Time series; Watersheds

Indexed keywords

ENSEMBLE FORECASTING; ERROR ANALYSIS; FLOOD; MESOSCALE METEOROLOGY; PRECIPITATION (CLIMATOLOGY); PROBABILITY; TIME SERIES; WEATHER FORECASTING;

CALIFORNIA; CASCADE RANGE; SIERRA NEVADA [CALIFORNIA]; UNITED STATES;

EID: 84864767580     PISSN: 1525755X     EISSN: 15257541     Source Type: Journal    
DOI: 10.1175/JHM-D-11-036.1     Document Type: Article

References (66)

1. Bradley, A. A., S. S. Schwartz, and T. Hashino, 2004: Distributionsoriented verification of ensemble streamflow predictions. J. Hydrometeor., 5, 532-545.
2. Brier, G., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 1-3.
3. Brown, J. D., and G. Heuvelink, 2005: Assessing uncertainty propagation through physically based models of soil water flow and solute transport. The Encyclopedia of Hydrological Sciences, M. Anderson, Ed., John Wiley and Sons, 1181-1195.
4. Brown, J. D., and D.-J. Seo, 2010: A nonparametric postprocessor for bias correction of hydrometeorological and hydrologic ensemble forecasts. J. Hydrometeor., 11, 642-665.
5. Brown, J. D., J. Demargne, D.-J. Seo, and Y. Liu, 2010: The Ensemble Verification System (EVS): A software tool for verifying ensemble forecasts of hydrometeorological and hydrologic variables at discrete locations. Environ.Modell. Software, 25, 854-872.
6. Brussolo, E., J. Von Hardenberg, L. Ferraris, N. Rebora, and A. Provenzale, 2008: Verification of quantitative precipitation forecasts via stochastic downscaling. J. Hydrometeor., 9, 1084- 1094.
7. Buerger, G., D. Reusser, and D. Kneis, 2009: Early flood warnings from empirical (expanded) downscaling of the full ECMWF Ensemble Prediction System. Water Resour. Res., 45, W10443, doi:10.1029/2009WR007779.
8. Buizza, R., M. Miller, and T. N. Palmer, 1999: Stochastic representation of model uncertainty in the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 125, 2887- 2908.
9. Charles, M. E., and B. A. Colle, 2009: Verification of extratropical cyclones within the NCEP operational models. Part II: The Short-Range Ensemble Forecast system. Wea. Forecasting, 24, 1191-1214.
10. Clark, A. J., W. A. Gallus Jr., M. Xue, and F. Kong, 2009: A comparison of precipitation forecast skill between small convection-allowing and large convection-parameterizing ensembles. Wea. Forecasting, 24, 1121-1140.
11. Clark, A. J., W. A. Gallus Jr., M. Xue, and F. Kong, 2010: Growth of spread in convectionallowing and convection-parameterizing ensembles. Wea. Forecasting, 25, 594-612.
12. Clark, A. J, and Coauthors, 2011: Probabilistic precipitation forecast skill as a function of ensemble size and spatial scale in a convectionallowing ensemble. Mon. Wea. Rev., 139, 1410-1418.
13. de Elia, R., and R. Laprise, 2003: Distribution-oriented verification of limited-area model forecasts in a perfect-model framework. Mon. Wea. Rev., 131, 2492-2509.
14. Demargne, J., J. Brown, Y. Liu, D.-J. Seo, L. Wu, Z. Toth, and Y. Zhu, 2010: Diagnostic verification of hydrometeorological and hydrologic ensembles. Atmos. Sci. Lett., 11, 114-122.
15. Du, J., and M. Tracton, 2001: Implementation of a real-time shortrange ensemble forecasting system at NCEP: An update. Preprints, Ninth Conf. on Mesoscale Processes, Ft. Lauderdale, FL, Amer. Meteor. Soc., P4.9. [Available online at http://ams.confex.com/ams/WAF-NWP-MESO/techprogram/paper_23074.htm.]
16. Du, J., and Coauthors, 2009:NCEP Short-Range Ensemble Forecast (SREF) system upgrade in 2009. Extended Abstracts, 19th Conf. on Numerical Weather Prediction and 23rd Conf. on Weather Analysis and Forecasting, Omaha, NE, Amer.Meteor. Soc., 4A.4. [Available online at http://ams.confex.com/ams/23WAF19NWP/techprogram/paper_153264.htm.]
17. Eckel, F., and C. Mass, 2005: Aspects of effective mesoscale, shortrange ensemble forecasting. Wea. Forecasting, 20, 328-350.
18. Epstein, E., 1969: Stochastic dynamic prediction. Tellus, 21, 739- 759.
19. Gneiting, T., F. Balabdaoui, and A. E. Raftery, 2007: Probabilistic forecasts, calibration and sharpness. J. Roy. Stat. Soc., 69B, 243-268.
20. Green, D., and J. Swets, 1966: Signal Detection Theory and Psychophysics. John Wiley and Sons, 521 pp.
21. Hamill, T. M., and S. J. Colucci, 1998: Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126, 711-724.
22. Hamill, T. M, and J. Juras, 2006: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132, 2905-2923, doi:10.1256/qj.06.25.
23. Hamill, T. M, and J. S. Whitaker, 2006: Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Wea. Rev., 134, 3209-3229.
24. Hamill, T. M, J. S. Whitaker, and S. L. Mullen, 2006: Reforecasts: An important new dataset for improving weather predictions. Bull. Amer. Meteor. Soc., 87, 33-46.
25. Hamill, T. M, R. Hagedorn, and J. S. Whitaker, 2008: Probabilistic forecast calibration using ECMWF and GFS ensemble reforecasts. Part II: Precipitation. Mon. Wea. Rev., 136, 2620-2632.
26. Hanley, J., 1988: The robustness of the "binormal" assumptions used in fitting ROC curves. Med. Decis. Making, 8, 197- 203.
27. Harris, D., E. Foufoula-Georgiou, K. K. Droegemeier, and J. J. Levit, 2001:Multiscale statistical properties of a high-resolution precipitation forecast. J. Hydrometeor., 2, 406-418.
28. Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15, 559-570.
29. Houtekamer, P. L., H. L. Mitchell, and X. Deng, 2009: Model error representation in an operational ensemble Kalman filter. Mon. Wea. Rev., 137, 2126-2143.
30. Hsu, W.-R., and A. Murphy, 1986: The attributes diagram: A geometrical framework for assessing the quality of probability forecasts. Int. J. Forecast., 2, 285-293.
31. Jolliffe, I. T., and D. B. Stephenson, 2012: Forecast Verification: A Practitioner'sGuide inAtmospheric Science. 2nded. JohnWiley and Sons, 292 pp.
32. Jones, M. S., B. A. Colle, and J. S. Tongue, 2007: Evaluation of a mesoscale short-range ensemble forecast system over the northeast United States. Wea. Forecasting, 22, 36-55.
33. Kobold, M., and K. Suselj, 2005: Precipitation forecasts and their uncertainty as input into hydrological models. Hydrol. Earth Syst. Sci., 9, 322-332.
34. Lahiri, S., 2003: Resampling Methods for Dependent Data. Springer, 388 pp.
35. Mascaro, G., E. R. Vivoni, and R. Deidda, 2010: Implications of ensemble quantitative precipitation forecast errors on distributed streamflow forecasting. J. Hydrometeor., 11, 69-86.
36. McCollor, D., and R. Stull, 2008: Hydrometeorological accuracy enhancement via postprocessing of numerical weather forecasts in complex terrain. Wea. Forecasting, 23, 131-144.
37. Metz, C. E., and X. Pan, 1999: "Proper" binormal ROC curves: Theory and maximum-likelihood estimation. J. Math. Psychol., 43, 1-33.
38. Murphy, A. H., and R. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
39. Pappenberger, F., and R. Buizza, 2009: The skill of ECMWF precipitation and temperature predictions in the Danube basin as forcings of hydrological models. Wea. Forecasting, 24, 749-766.
40. Politis, D. N., and J. P. Romano, 1994: The stationary bootstrap. J. Amer. Stat. Assoc., 89, 1303-1313.
41. Rabier, F., 2006: Overview of global data assimilation developments in numerical weather-prediction centres. Quart. J. Roy. Meteor. Soc., 131, 3215-3233.
42. Raynaud, L., L. Berre, and G. Desroziers, 2012: Accounting for model error in the Météo-France ensemble data assimilation system. Quart. J. Roy. Meteor. Soc., 138, 249-262, doi:10.1002/qj.906.
43. Ruiz, J. J., C. Saulo, and E. Kalnay, 2012: How sensitive are probabilistic precipitation forecasts to the choice of calibration algorithms and the ensemble generation method? Part II: sensitivity to ensemble generation method. Meteor. Appl., doi:10.1002/met.262, in press.
44. Saha, S., and Coauthors, 2006: The NCEP Climate Forecast System. J. Climate, 19, 3483-3517.
45. Schaake, J., and Coauthors, 2007: Precipitation and temperature ensemble forecasts from single-value forecasts. Hydrol. Earth Syst. Sci., 4, 655-717.
46. Schumacher, R. S., and C. A. Davis, 2010: Ensemble-based forecast uncertainty analysis of diverse heavy rainfall events. Wea. Forecasting, 25, 1103-1122.
47. Schwartz, C. S., and Coauthors, 2010: Toward improved convectionallowing ensembles: Model physics sensitivities and optimizing probabilistic guidance with small ensemble membership. Wea. Forecasting, 25, 263-280.
48. Seo, D.-J., 1998: Real-time estimation of rainfall fields using rain gauge data under fractional coverage conditions. J. Hydrol., 208, 25-36.
49. Seo, D.-J., H. D. Herr, and J. C. Schaake, 2006: A statistical post-processor for accounting of hydrologic uncertainty in short-range ensemble streamflow prediction. Hydrol. Earth Syst. Sci., 3, 1987-2035.
50. Sloughter, J. M., A. E. Raftery, T. Gneiting, and C. Fraley, 2007: Probabilistic quantitative precipitation forecasting using Bayesian model averaging. Mon. Wea. Rev., 135, 3209-3220.
51. Stensrud, D. J., J. W. Bao, and T. T. Warner, 2000: Using initial condition and model physics perturbations in short-range ensemble simulations of mesoscale convective systems. Mon. Wea. Rev., 128, 2077-2107.
52. Toth, Z., E. Kalnay, S. M. Tracton, R. Wobus, and J. Irwin, 1997:A synoptic evaluation of the NCEP ensemble. Wea. Forecasting, 12, 140-153.
53. Unger, D. A., H. van den Dool, E. O'Lenic, and D. Collins, 2009: Ensemble regression. Mon. Wea. Rev., 137, 2365-2379.
54. Warner, T., 2011: Numerical Weather and Climate Prediction. Cambridge University Press, 548 pp.
55. Wei, M., Z. Toth, R. Wobus, and Y. Zhu, 2008: Initial perturbations based on the Ensemble Transform (ET) technique in the NCEP Global Operational Forecast System. Tellus, 60, 62-79.
56. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2008: Can multimodel combination really enhance the prediction skill of probabilistic ensemble forecasts? Quart. J. Roy. Meteor. Soc., 134, 241-260.
57. Weigel, A. P., M. A. Liniger, and C. Appenzeller, 2009: Seasonal ensemble forecasts: Are recalibrated single models better than multimodels? Mon. Wea. Rev., 137, 1460-1479.
58. Whitaker, J. S., T. M. Hamill, X. Wei, Y. Song, and Z. Toth, 2008: Ensemble data assimilation with the NCEP Global Forecast System. Mon. Wea. Rev., 136, 463-482.
59. Wilks, D. S., 2006: Comparison of ensemble-MOS methods in the Lorenz '96 setting. Meteor. Appl., 13, 243-256.
60. Wilks, D. S, 2009: Extending logistic regression to provide full-probabilitydistribution MOS forecasts. Meteor. Appl., 16, 361-368.
61. Wu, L., D.-J. Seo, J. Demargne, J. D. Brown, S. Cong, and J. Schaake, 2011: Generation of ensemble precipitation forecast from single-valued quantitative precipitation forecast for hydrologic ensemble prediction. J. Hydrol., 339 (3-4), 281- 298, doi:10.1016/j.jhydrol.2011.01.013.
62. Yuan, H., S. Mullen, X. Gao, S. Sorooshian, J. Du, and H. Juang, 2005: Verification of probabilistic quantitative precipitation forecasts over the southwest United States during winter 2002/03 by the RSM ensemble system. Mon. Wea. Rev., 133, 279-294.
63. Yuan, H., X.Gao, S.L.Mullen, S. Sorooshian, J.Du, andH.-M.H. Juang, 2007: Calibration of probabilistic quantitative precipitation forecasts with an artificial neural network. Wea. Forecasting, 22, 1287-1303.
64. Yuan, H., C. Lu, J. A. McGinley, P. J. Schultz, B. D. Jamison, L. Wharton, and C. J. Anderson, 2009: Evaluation of shortrange quantitative precipitation forecasts from a time-lagged multimodel ensemble. Wea. Forecasting, 24, 18-38.
65. Zappa, M., and Coauthors, 2010: Propagation of uncertainty from observing systems and NWP into hydrological models: COST-731 Working Group 2. Atmos. Sci. Lett., 11, 83-91.
66. Zhao, L.,Q. Duan, J. Schaake,A.Ye, and J.Xia, 2011:Ahydrologic post-processor for ensemble streamflow predictions. Adv. Geosci., 29, 51-59, doi:10.5194/adgeo-29-51-2011.