Investigation of ensemble variance as a measure of true forecast variance

Monthly Weather Review

Volumn 139, Issue 12, 2011, Pages 3954-3963

  Kolczynski Jr , Walter C ^a   Stauffer, David R ^a   Haupt, Sue Ellen ^a   Altman, Naomi S ^a   Deng, Aijun ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Ensembles; Model evaluation performance; Regression analysis; Statistical techniques; Stochastic models

Indexed keywords

ENSEMBLES; ERROR VARIANCE; IDEAL VALUES; MEASURE OF UNCERTAINTY; METEOROLOGICAL PREDICTION; MODEL EVALUATION/PERFORMANCE; PUBLIC SAFETY; QUANTIFIABLE MEASURES; RELIABLE ESTIMATES; SIMPLE METHOD; STATISTICAL TECHNIQUES; THEORETICAL VALUES;

CALIBRATION; FORECASTING; REGRESSION ANALYSIS; STOCHASTIC SYSTEMS; UNCERTAINTY ANALYSIS;

STOCHASTIC MODELS;

ENSEMBLE FORECASTING; PERFORMANCE ASSESSMENT; REGRESSION ANALYSIS; STOCHASTICITY; UNCERTAINTY ANALYSIS; WEATHER FORECASTING;

EID: 84855793804     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/MWR-D-10-05081.1     Document Type: Article

References (28)

1. Barker, T. W., 1991: The relationship between spread and forecast error in extended-range forecasts. J. Climate, 4, 733-742.
2. Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. Mon. Wea. Rev., 125, 99-119.
3. Carroll, R. J., D. Ruppert, and L. A. Stefanski, 1995: Measurement Error in Nonlinear Models. Chapman & Hall, 305 pp.
4. Casella, G., and R. L. Berger, 2001: Statistical Inference. 2nd ed. Duxbery, 660 pp.
5. Dee, D. P., and A. M. DaSilva, 1999: Maximum-likelihood estimation of forecast and observation error covariance parameters. Part I: Methodology. Mon. Wea. Rev., 127, 1822-1834.
6. Dorff, M., and J. Gurland, 1961: Estimation of the parameters of a linear functional relations. J. Roy. Stat. Soc., 23B, 160-170.
7. Fuller, W. A., 1980: Properties of some estimators for the errors-invariables model. Ann. Stat., 8, 407-422.
8. Grimit, E. P., 2004: Probabilistic mesoscale forecast error prediction using short-range ensembles. Ph.D. dissertation, University of Washington, 146 pp.
9. Grimit, E. P.,and C. F. Mass, 2002: Initial results of a mesoscale short-range ensemble forecasting system over the Pacific Northwest. Wea. Forecasting, 17, 192-205.
10. Grimit, E. P., and C. F. Mass, 2007: Measuring the ensemble spread-error relationship with a probabilistic approach: Stochastic ensemble results. Mon. Wea. Rev., 135, 203-221.
11. Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev., 129, 550-560.
12. Hamill, T. M., and S. J. Colucci, 1998: Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126, 711-724.
13. Houtekamer, P. L., 1993: Global and local skill forecasts. Mon. Wea. Rev., 121, 1834-1846.
14. Kalnay, E., and A. Dalcher, 1987: Forecasting forecast skill. Mon. Wea. Rev., 115, 349-356.
15. Kolczynski, W. C., Jr., D. R. Stauffer, S. E. Haupt, and A. Deng, 2009: Ensemble variance calibration for representing meteorological uncertainty for atmospheric transport and dispersion modeling. J. Appl. Meteor. Climatol., 48, 2001-2021.
16. Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev., 102, 409-418.
17. Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130-141.
18. Marzban, C., R. Wang, F. Kong, and S. Leyton, 2011: On the effect of correlations on rank histograms: Reliability of temperature and wind speed forecasts from finescale ensemble reforecasts. Mon. Wea. Rev., 139, 295-310.
19. Murphy, J. M., 1988: The impact of ensemble forecasts on predictability. Quart. J. Roy. Meteor. Soc., 114, 463-493.
20. National Research Council, 2003: Tracking and Predicting the Atmospheric Dispersion of Hazardous Material Releases: Implications for Homeland Security. The National Academies Press, 114 pp.
21. Seidman, A. N., 1981: Averaging techniques in long-range weather forecasting. Mon. Wea. Rev., 109, 1367-1379.
22. Stensrud, D. J., H. E. Brooks, J. Du, M. S. Tracton, and E. Rogers, 1999: Using ensembles for short-range forecasting. Mon. Wea. Rev., 127, 433-446.
23. Wang, X., and C. H. Bishop, 2003: A comparison of breeding and ensemble transform Kalman filter ensemble forecast schemes. J. Atmos. Sci., 60, 1140-1158.
24. Wang, X., and C. H. Bishop, 2005: Improvement of ensemble reliability with a new dressing kernel. Quart. J. Roy. Meteor. Soc., 131, 965-986.
25. Wang, X., C. H. Bishop, and S. J. Julier, 2004: Which is better, an ensemble of positive-negative pairs or a centered spherical simplex ensemble? Mon. Wea. Rev., 132, 1590-1605.
26. Weisstein, E. W., 2010: The CRC Concise Encyclopedia of Mathematics. 3rd ed. Chapman & Hall/CRC, 1200 pp.
27. Whitaker, J. S., and A. F. Loughe, 1998: The relationship between ensemble spread and ensemble mean skill. Mon. Wea. Rev., 126, 3292-3302.
28. Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.