Using Bayesian model averaging to calibrate forecast ensembles

Monthly Weather Review

Volumn 133, Issue 5, 2005, Pages 1155-1174

  Raftery, Adrian E ^a   Gneiting, Tilmann ^a   Balabdaoui, Fadoua ^a   Polakowski, Michael ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLIMATOLOGY; COMPUTER SIMULATION; CORRELATION METHODS; ERROR ANALYSIS; MATHEMATICAL MODELS; PROBABILITY DENSITY FUNCTION; SEA LEVEL;

BAYESIAN MODEL AVERAGING (BMA); PROBABILISTIC WEATHER FORECASTING; SEA LEVEL PRESSURE; SPREAD-ERROR CORRELATION;

WEATHER FORECASTING;

BAYESIAN ANALYSIS; CALIBRATION; WEATHER FORECASTING;

ILEX COOKII;

EID: 20444497873     PISSN: 00270644     EISSN: None     Source Type: Journal    
DOI: 10.1175/MWR2906.1     Document Type: Article

References (54)

1. Anderson, J. L., 1996: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate, 9, 1518-1530.
2. Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. Mon. Wea. Rev., 125, 99-119.
3. Buizza, M. Miller, and T. N. Palmer, 1999: Stochastic representation of model uncertainties in the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 125, 2887-2908.
4. Buizza, P. L. Houtekamer, Z. Toth, G. Pellerin, M. Wei, and Y. Zhu 2005: A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Wea. Rev., 133, 1076-1097.
5. Carter, G. M., J. P. Dallavalle, and H. R. Glahn, 1989: Statistical forecasts based on the National Meteorological Center's numerical weather prediction system. Wea. Forecasting, 4, 401-412.
6. Casella, G., and R. L. Berger, 2001: Statistical Inference. 2d ed. Brooks Cole, 660 pp.
7. Dempster, A. P., N. M. Laird, and D. B. Rubin, 1977: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc., 39B, 1-39.
8. Eckel, F. A., and M. Walters, 1998: Calibrated probabilistic quantitative precipitation forecasts based on the MRF ensemble. Wea. Forecasting, 13, 1132-1147.
9. Eckel, F. A., and C. F. Mass, 2003: Towards an effective short-range ensemble forecast system. Proc. Workshop on Ensemble Forecasting, Val-Morin, QC, Canada. [Available online at http://www.edc.noaa.gov/ people/tom.hamill/cf_workshop_2003.html.]
10. Epstein, E. S., 1969: Stochastic dynamic prediction. Tellus, 21, 739-759.
11. Fisher, R. A., 1922: On the mathematical foundations of theoretical statistics. Philos. Trans. Roy. Soc. London, 222A, 309-368.
12. Gel, Y., A. E. Raftery, and T. Gneiting, 2004: Calibrated probabilistic mesoscale weather field forecasting: The geostatistical output perturbation (GOP) method (with (discussion). J. Amer. Stat. Assoc., 99, 575-590.
13. Glahn, H. R., and D. A. Lowry, 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11, 1202-1211.
14. Gneiting, T., A. E. Raftery, F. Balabdaoui, and A. Westveld, 2003: Verifying probabilistic forecasts: Calibration and sharpness. Proc. Workshop on Ensemble Forecasting, Val-Morin, QC, Canada. [Available online at http://www.cdc.noaa.gov/people/tom.hamill/ ef_workshop_2003.html.]
15. Good, I. J., 1952: Rational decisions. J. Roy. Stat. Soc., 14, 107-114.
16. Grimit, E. P., and C. F. Mass, 2002: Initial results of a mesoscale short-range ensemble forecasting system over the Pacific Northwest. Wea. Forecasting, 17, 192-205.
17. Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev., 129, 550-560.
18. Hamill, T. M., and S. J. Colucci, 1997: Verification of Eta RSM short-range ensemble forecasts. Mon. Wea. Rev., 125, 1312-1327.
19. Hamill, T. M., and S.J. Colucci, 1998: Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126, 711-724.
20. Hamill, C. Snyder, and R. E. Morss, 2000: A comparison of probabilistic forecasts from bred, singular-vector, and perturbed observation ensembles. Mon. Wea. Rev., 128, 1835-1851.
21. Hamill, C. J. S. Whitaker, and X. Wei, 2004: Ensemble re-forecasting: Improving medium-range forecast skill using retrospective forecasts. Mon. Wea. Rev., 132, 1434-1447.
22. Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15, 559-570.
23. Hersbach, R. Mureau, J. D. Opsteegh, and J. Barkmeijer, 2000: A short-range to early-medium-range ensemble prediction system for the European area. Mon. Wea. Rev., 128, 3501-3519.
24. Hoeting, J. A., D. M. Madigan, A. E. Raftery, and C. T. Volinsky, 1999: Bayesian model averaging: A tutorial (with discussion). Stat. Sci., 14, 382-401. [A corrected version is available online at www.stat.washington.edu/www/research/online/hoeting1999.pdf.]
25. Hou, D., E. Kalnay, and K. K. Droegemeier, 2001: Objective verification of the SAMEX'98 ensemble forecast. Mon. Wea. Rev., 129, 73-91.
26. Houtekamer, P. L., 1993: Global and local skill forecasts. Mon. Wea. Rev., 121, 1834-1846.
27. Houtemaker, P. L., and J. Derome, 1995: Methods for ensemble prediction. Mon. Wea. Rev., 123, 2181-2196.
28. Houtemaker, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
29. Houtemaker, P. L., and H. L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 123-137.
30. Kass, R. E., and A. E. Raftery, 1995: Bayes factors. J. Amer. Stat. Assoc., 90, 773-795.
31. Kharin, V. V., and F. W. Zwiers, 2002: Climate predictions with multimodel ensembles. J. Climate, 15, 793-799.
32. Krishnamurti, T. N., C. M. Kishtawal, T. E. LaRow, D. Bachiochi, Z. Zhang, C. E. Williford, S. Gadgil, and S. Surendan, 1999: Improved weather and seasonal climate forecasts from multimodel superensembles. Science, 258, 1548-1550.
33. Leamer, E. E., 1978: Specification Searches. Wiley, 370 pp.
34. Leith, C. E., 1974: Theoretical skill of Monte-Carlo forecasts. Mon. Wea. Rev., 102, 409-418.
35. McCullagh, P., and J. A. Nelder, 1989: Generalized Linear Models. 2d ed. Chapman and Hall, 511 pp.
36. McLachlan, G. J., and T. Krishnan, 1997: The EM Algorithm and Extensions. Wiley, 274 pp.
37. McLachlan, G. J., and D. Peel, 2000: Finite Mixture Models. Wiley, 419 pp.
38. Molteni, F., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The ECMWF ensemble system: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73-119.
39. Pellerin, G., L. Lefaivre, P. L. Houtekamer, and C. Girard, 2003: Increasing the horizontal resolution of ensemble forecasts at CMC. Nonlinear Processes Geophys., 10, 463-468.
40. Raftery, A. E., 1993: Bayesian model selection in structural equation models. Testing Structural Equation Models, K. A. Bollen and J. S. Long, Eds., Sage, 163-180.
41. Raftery, A. E., and Y. Zheng, 2003: Long-run performance of Bayesian model averaging. J. Amer. Stat. Assoc., 98, 931-938.
42. Roulston, M. S., and L. A. Smith, 2002: Evaluating probabilistic forecasts using information theory. Mon. Wea. Rev., 130, 1653-1660.
43. Roulson, M. S., and L. A. Smith, 2003: Combining dynamical and statistical ensembles. Tellus, 55A, 16-30.
44. Scherrer, S. C., C. Appenzeller, P. Eckert, and D. Cattani, 2004: Analysis of the spread-skill relations using the ECMWF ensemble prediction system over Europe. Wea. Forecasting, 19, 552-565.
45. Stefanova, L., and T. N. Krishnamurti, 2002: Interpretation of seasonal climate forecast using Brier skill score, the Florida State University superensemble, and the AMIP-I dataset. J. Climate, 15, 537-544.
46. Stensrud, D. J., H. E. Brooks, J. Du, M. S. Tracton, and E. Rogers, 1999: Using ensembles for short-range forecasting. Mon. Wea. Rev., 127, 433-446.
47. Stern, R. D., and R. Coe, 1984: A model fitting analysis of daily rainfall data (with discussion). J. Roy. Stat. Soc., 147A, 1-34.
48. Talagrand, O., R. Vautard, and B. Strauss, 1997: Evaluation of probabilistic prediction systems. Proc. ECMWF Workshop on Predictability, Reading, United Kingdom, ECMWF, 1-25. [Available from ECMWF, Shinfield Park, Reading, Berkshire RG2 9AX, United Kingdom.]
49. Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at the NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74, 2317-2330.
50. Toth, Z., Y. Zhu, and T. Marchok, 2001: The use of ensembles to identify forecasts with small and large uncertainty. Wea. Forecasting, 16, 463-477.
51. Van den Dool, H. M., and L. Rukhovets, 1994: On the weights for an ensemble-averaged 6-10-day forecast. Wea. Forecasting, 9, 457-465.
52. Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp.
53. Wilks, D. S., 2002: Smoothing forecast ensembles with fitted probability distributions. Quart. J. Roy. Meteor. Soc., 128,, 2821-2836.
54. Wu, C. F. J., 1983: On the convergence properties of the EM algorithm. Ann. Stat., 11, 95-103.