Ensemble Forecasting in the Short to Medium Range: Report from a Workshop

Bulletin of the American Meteorological Society

Volumn 81, Issue 11, 2000, Pages 2653-2664

  Hamill, Thomas M ^a,b   Mullen, Steven L ^c   Snyder, Chris ^a   Toth, Zoltan ^d   Baumhefner, David P ^a  

^a NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^b NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

^c UNIVERSITY OF ARIZONA   (United States)

^d CLIMATE PREDICTION CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001727173     PISSN: 00030007     EISSN: None     Source Type: Journal    
DOI: 10.1175/1520-0477(2000)081<2653:EFITST>2.3.CO;2     Document Type: Conference Paper

References (99)

1. Anderson, J. L., 1996: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate, 9, 1518-1530.
2. _, 1997: The impact of dynamical constraints on the selection of initial conditions for ensemble predictions: Low-order perfect model results. Mon. Wea. Rev., 125, 2969-2983.
3. _, and S. L. Anderson, 1999: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Mon. Wea. Rev., 127, 2741-2758.
4. Atger, F., 1999: The skill of ensemble forecast systems. Mon. Wea. Rev., 127, 1941-1953.
5. Barkmeijer, J., M. van Gijzen, and F. Bouttier, 1998: Singular vectors and estimates of the analysis error covariance metric. Quart. J. Roy. Meteor. Soc., 124, 1695-1713.
6. Black, T. L., 1994: The new NMC mesoscale Eta model: Description and forecast examples. Wea. Forecasting, 9, 265-278.
7. Brooks, H. E., C. A. Doswell, and R. A. Maddox, 1992: On the use of mesoscale and cloud-scale models in operational forecasting. Wea. Forecasting, 7, 120-132.
8. _, M. S. Tracton, D. J. Stensrud, G. DiMego, and Z. Toth, 1995: Short-range ensemble forecasting: Report from a workshop, 25-27 July 1994. Bull. Amer. Meteor. Soc., 76, 1617-1624.
9. Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. Mon. Wea. Rev., 125, 99-119.
10. _, and T. N. Palmer, 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev., 126, 2503-2518.
11. _, and _, 1999: Ensemble data assimilation. Proc. 17th Conf. Weather Analysis and Forecasting, Denver, CO, Amer. Meteor. Soc., 231-234.
12. _, and Coauthors, 1998: Impact of model resolution and ensemble size on the performance of an ensemble prediction system. Quart. J. Roy. Meteor. Soc., 124, 1935-1960.
13. _, A. Hollingsworth, F. Lalaurette, and A. Ghelli, 1999a: Probabilistic predictions of precipitation using the ECMWF ensemble prediction system. Wea. Forecasting, 14, 168-189.
14. _, M. Miller, and T. N. Palmer, 1999b: Stochastic simulation of model uncertainty in the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 125, 2887-2908.
15. Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719-1724.
16. Carter, G. M., J. P. Dallavalle, and H. R. Glahn, 1989: Statistical forecasts based on the National Meteorological Center's numerical weather prediction system. Wea. Forecasting, 4, 401-412.
17. Casella, G., and R. L. Berger, 1990: Statistical Inference. Duxbury Press, 650 pp.
18. Colucci, S. J., and D. P. Baumhefner, 1998: Numerical prediction of the onset of blocking: A case study with forecast ensembles. Mon. Wea. Rev., 126, 773-784.
19. Dee, D. P., and A. M. Da Silva, 1998: Data assimilation in the presence of forecast bias. Quart. J. Roy. Meteor. Soc., 124, 269-295.
20. Du, J., and M. S. Tracton, 1999: Impact of lateral boundary conditions on regional-model ensemble prediction. Research Activities in Atmospheric and Oceanic Modelling, H. Ritchie, Ed., CAS/JSC Working Group Numerical Experimentation Rep. 28, WMO/TD No. 942, 6.7-6.8.
21. _, S. L. Mullen, and F. Sanders, 1997: Short-range ensemble forecasting of quantitative precipitation. Mon. Wea. Rev., 125, 2427-2459.
22. Dudhia, J., J. Klemp, W. C. Skamarock, D. Dempsey, Z. I. Janjic, S. G. Benjamin, and J. M. Brown, 1998: A collaborative effort towards a future community mesoscale model. Preprints, 12th Conf. on Numerical Weather Prediction, Phoenix, AZ, Amer. Meteor. Soc., 42-43.
23. Eckel, F. A., and M. K. Walters, 1998: Calibrated probabilistic quantitative precipitation forecasts based on the MRF ensemble. Wea. Forecasting, 13, 1132-1147.
24. Ehrendorfer, M., 1997: Predicting the uncertainty of numerical weather forecasts: A review. Meteor. Z., 6, 147-183.
25. _, and J. J. Tribbia, 1997: Optimal prediction of forecast error covariances through singular vectors. J. Atmos. Sci., 54, 286-313.
26. Evans, R. E., M. S. J. Harrison, and R. J. Graham, 2000: Joint medium-range ensembles from The Met. Office and ECMWF systems. Mon. Wea. Rev., 128, 3104-3127.
27. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasigeostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5) 10 143-10 162.
28. Fisher, M., 1998: Development of a simplified Kalman filter. Research Department Tech. Memor. 260. 16 pp. [Available from ECMWF, Shinfield Park, Reading, Berkshire RG2 9AX, United Kingdom.]
29. _, and P. Courtier, 1995: Estimating the covariance matrices of analysis and forecast error in variational data assimilation. Research Department Tech. Memor. 220, 28 pp. [Available from ECMWF, Shinfield Park, Reading, Berkshire RG2 9AX, United Kingdom.]
30. Fritsch, J.M., and Coauthors, 1998: Quantitative precipitation forecasting: Report of the eighth prospectus development team, U.S. Weather Research Program. Bull. Amer. Meteor. Soc., 79, 285-299.
31. Gandin, L. S., 1963: Objective Analysis of Meteorological Fields. Gidrometeorologicheskoe Iszatelstvo; English translation, Israel Program for Scientific Translations, 1966, 242 pp.
32. Gandin, L. S., 1963: Objective Analysis of Meteorological Fields. Gidrometeorologicheskoe Iszatelstvo; English translation, Israel Program for Scientific Translations, 1966, 242 pp.
33. Gilmour, I., and L. A. Smith, 1997: Enlightenment in shadows. Applied Nonlinear Dynamics and Stochastic Systems near the Millenium, J. B. Kadtke and A. Bulsara, Eds., AIP, 335-340.
34. Hamill, T. M., 1997: Reliability diagrams for multicategory probabilistic forecasts. Wea. Forecasting, 12, 736-741.
35. _, 1998: Comments on "Short-range ensemble forecasting of explosive Australian east-coast cyclogenesis." Wea. Forecasting, 13, 1205-1207.
36. _, and S. J. Colucci. 1997: Verification of Eta-RSM short-range ensemble forecasts. Mon. Wea. Rev., 125, 1312-1327.
37. _, and _, 1998: Evaluation of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126, 711-724.
38. _, and C. Snyder, 2000: A hybrid ensemble Kalman filter -three-dimensional variational analysis scheme. Mon. Wea. Rev., 128, 2905-2919.
39. _, _, and R. E. Morss, 2000: A comparison of probabilistic forecasts from bred, singular-vector, and perturbed observation ensembles. Mon. Wea. Rev., 128, 1835-1851.
40. Harrison, M. S. J., T. N. Palmer, D. S. Richardson, and R. Buizza, 1999: Analysis and model dependencies in medium-range ensembles: Two transplant case studies. Quart. J. Roy. Meteor. Soc., 126, 2487-2515.
41. Hersbach, H., 2000: Decomposition on the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15, 559-570.
42. Hou, D., E. Kalnay, and K. K. Droegemeier, 2000: Objective verification of SAMEX '98 ensemble forecasts. Mon. Wea. Rev., in press.
43. Houtekamer, P. L., and J. Derome, 1995: Methods for ensemble prediction. Mon. Wea. Rev., 123, 2181-2196.
44. _, and L. Lefaivre, 1997: Using ensemble forecasts for model validation. Mon. Wea. Rev., 125, 2416-2426.
45. _, and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796-811.
46. _, L. Lefaivre, J. Derome, 1996a: The RPN ensemble prediction system. Proc. ECMWF Seminar on Predictability, Vol. II, Reading, United Kingdom, 121-146. [Available from ECMWF, Shinfield Park, Reading, Berkshire, RG2 9AX, United Kingdom.]
47. _, _, _, H. Ritchie, and H. L. Mitchell, 1996b: A system simulation approach to ensemble prediction. Mon. Wea. Rev., 124, 1225-1242.
48. Islam, S., R. L. Bras, and K. A. Emanuel, 1993: Predictability of mesoscale rainfall in the Tropics. J. Appl. Meteor., 32, 297-310.
49. Juang, H.-M., and M. Kanamitsu, 1994: The NMC nested regional spectral model. Mon. Wea. Rev., 122, 3-26.
50. Kalman, R., 1960: A new approach to linear filtering and prediction problems. Trans. AMSE, 82D, 35-45.
51. Katz, R. W., and A. H. Murphy, 1997: Economic Value of Weather and Climate Forecasts. Cambridge University Press, 222 pp.
52. Kobayashi, C., K. Yoshimatsu, S. Maeda, and K. Takano, 1996: Dynamical one-month forecasting at JMA. Preprints, 11th Conf. Numerical Weather Prediction, Norfolk, VA, Amer. Meteor. Soc., 13-14.
53. Krishnamurti, T. N., and Coauthors, 1999: Improved weather and seasonal climate forecasts from mullimodel superensemble. Science, 285, 1548-1550.
54. Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev., 102, 409-418.
55. Leslie, L. M., and M. S. Speer, 1998: Short-range ensemble forecasting of explosive Australian east-coast cyclogenesis. Wea. Forecasting, 13, 822-832.
56. Lorenc, A. C., 1981: A global three-dimensional multivariate statistical interpolation system. Mon. Wea. Rev., 109, 701-721.
57. _, 1986: Analysis methods for numerical weather prediction. Quart. J. Roy. Meteor. Soc., 112, 1177-1194.
58. Lorenz, E. N., 1963: Deterministic nonperiod flow. J. Atmos. Sci., 20, 130-141.
59. _, 1965: A study of the predictability of a 28-variable atmospheric model. Tellus, 17, 321-333.
60. _, 1969: The predictability of a flow which possesses many scales of motion. Tellus, 21, 289-307.
61. _, 1982: Atmospheric predictability experiments with a large numerical model. Tellus, 34, 505-513.
62. Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291-303.
63. Mitchell, H. L., and P. L. Houtekamer, 2000: An adaptive ensemble Kalman filter. Mon. Wea. Rev, 128, 416-433.
64. Molteni, F., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The ECMWF ensemble prediction system: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73-119.
65. Mullen, S. L., and R. Buizza, 2000: Quantitative precipitation forecasts over the United States by the ECMWF ensemble prediction system. Mon. Wea. Rev., in press.
66. _, J. Du, and F. Sanders, 1999: The dependence of ensemble dispersion on analysis-forecast system: Implications to shortrange ensemble forecasting of precipitation. Mon. Wea. Rev., 127, 1674-1686.
67. Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595-600.
68. _, 1991: Forecast verification: Its complexity and dimensionality. Mon. Wea. Rev., 119, 1590-1601.
69. _, 1994: Assessing the economic value of weather forecasts: An overview of methods, results, and issues. Meteor. Appl., 1, 69-73.
70. _, and R. L. Winkler, 1987: A general framework for forecast verification. Mon. Wea. Rev., 115, 1330-1338.
71. Palmer, T. N., 2000: Predicting uncertainty in forecasts of weather and climate. Rep. Prog. Phys., 63, 71-116.
72. _, F. Molteni, R. Mureau, R. Buizza, P. Chapelet, and J. Tribbia, 1993: Ensemble prediction. Proc. ECMWF Seminar on Validation of models over Europe, Vol. 1, Reading, United Kingdom, ECMWF, 21-66. [Available from ECMWF, Shinfield Park, Reading, Berkshire, RG2 9AX, United Kingdom.]
73. Parrish, D. F., and J. C. Derber, 1992: The National Meteorological Center's spectral statistical interpolation analysis system. Mon. Wea. Rev., 120, 1747-1763.
74. Pham, D. T., J. Verron, and M. C. Roubaud, 1998: A singular evolutive extended Kalman filter for data assimilation in oceanography. J. Mar. Sys., 16, 323-340.
75. Pu, Z.-X., E. Kalnay, D. Parrish, W.-S. Wu, and Z. Toth, 1997: The use of bred vectors in the NCEP global 3-D variational data assimilation system. Wea. Forecasting, 12, 689-695.
76. Rennick, M. A., 1995: The ensemble forecast system (FFS). Models Department Tech. Note 2-95, Fleet Numerical and Oceanography Center, 19 pp. [Available from Models Department, FLEMUMMETOCCEN, 7 Grace Hopper Ave., Monterey, CA, 93943.]
77. Richardson, D. S., 2000a: Skill and relative economic value of the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 126, 649-668.
78. _, 2000b: Ensembles using multiple models and analyses. Quart. J. Roy. Meteor. Soc., submitted.
79. Sardeshmuk, P. D., G. P. Compo, and C. Penland, 2000: Changes of probability associated with El Niño. J. Climate, in press.
80. Schlatter, T. W., 1975: Some experiments with a multivariate statistical objective analysis scheme. Mon. Wea. Rev., 103, 246-257.
81. Silverman, B. W., 1986: Density Estimation for Statistics and Data Analysis. Chapman and Hall, 175 pp.
82. Smith, L. A., 1999: Disentangling uncertainty and error: On the predictability of nonlinear systems. Nonlinear Dynamics and Statistics, Alistair E. Mees, Ed., Birkhauer Press, 31-64.
83. _, and I. Gilmour, 1999: Accountability and internal consistency in ensemble formation. Proc. the ECMWF Workshop on Predictability, Reading, United Kingdom, ECMWF, 113-128. [Available from ECMWF, Shinfield Park, Reading, Berkshire, RG2 9AX, United Kingdom.]
84. Stanski, H. R., L. J. Wilson, and W. R. Burrows, 1989: Survey of common verification methods in meteorology. Environment Canada Research Rep. 89-5, 114 pp. [Available from Atmospheric Environment Service, Forecast Research Division, 4905 Dufferin St., Downsview, ON M3H 5T4, Canada.]
85. Stensrud, D. J., and Coauthors, 1999: Using ensembles for shortrange forecasting. Mon. Wea. Rev., 127, 433-446.
86. _, J.-W. Bao, and T. T. Warner, 2000: Using initial condition and model physics perturbations in short-range ensemble simulations of mesoscale convective systems. Mon. Wea. Rev., 128, 2077-2107.
87. Swets, J. A., 1973: The relative operating characteristic in psychology. Science, 182, 990-999.
88. Talagrand, O., R. Vautard, and B. Strauss, 1997: Evaluation of probabilistic prediction systems. Proc. ECMWF Workshop on Predictability, Reading. United Kingdom, ECMWF, 1-26. [Available from ECMWF, Shinfield Park, Reading, Berkshire, RG2 9AX, United Kingdom.]
89. Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74, 2317-2330.
90. _, and _, 1997: Ensemble forecasting at NCEP and the breeding method. Mon. Wea. Rev., 125, 3297-3319.
91. _, _, M. S. Tracton, R. Wobus, and J. Irwin, 1997: A synoptic evaluation of the NCEP ensemble. Wea. Forecasting, 12, 140-153.
92. Van den Dool, H. M., and S. Saha, 1990: Frequency dependence in forecast skill. Mon. Wea. Rev., 118, 128-137.
93. van Leeuwen, P. J., 1999: Comment on "Data assimilation using an ensemble Kalman filter technique." Mon. Wea. Rev., 127, 1374-1377.
94. Vannitsem, S., and C. Nicholis, 1998: Dynamics of fine-scale variables versus averaged observables in a T21L3 quasi-geostrophic model. Quart. J. Roy. Meteor. Soc., 124, 2201-2226.
95. Whitaker, J. S., and A. F. Loughe, 1998: The relationship between ensemble spread and ensemble mean skill. Mon. Wea. Rev., 126, 3292-3302.
96. Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp.
97. Wilson, L. J., W. R. Burrows, and A. Lanzinger, 1999: A strategy for verification of weather element forecasts from an ensemble prediction system. Mon. Wea. Rev., 127, 956-970.
98. Zhu, Y., G. Iyengar, Z. Toth, M. S. Tracton, and T. Marchok, 1996: Objective evaluation of the NCEP global ensemble forecasting system. Preprints, 15th AMS Conf. Weather Analysis and Forecasting, Amer. Meteor. Soc., Norfolk, VA, j79-j82.
99. Ziehmann, C., 2000: Comparison of a single-model EPS with a multi-model ensemble consisting of a few operational models. Tellus, 52A, 280-299.