Predicting outliers in ensemble forecasts

Quarterly Journal of the Royal Meteorological Society

Volumn 137, Issue 660, 2011, Pages 1887-1897

  Siegert, Stefan ^a   Bröcker, Jochen ^a,b   Kantz, Holger ^a  

^a MAX PLANCK INSTITUT FÜR PHYSIK KOMPLEXER SYSTEME   (Germany)

^b LONDON SCHOOL OF ECONOMICS   (United Kingdom)

Author keywords

Forecast probability; Predictability; ROC curves; Skill scores; Talagrand diagrams

Indexed keywords

FORECAST PROBABILITIES; PREDICTABILITY; ROC CURVES; SKILL SCORE; TALAGRAND DIAGRAMS;

STATISTICS;

FORECASTING;

ACCURACY ASSESSMENT; AIR TEMPERATURE; EMPIRICAL ANALYSIS; ENSEMBLE FORECASTING; NUMERICAL MODEL; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; WEATHER FORECASTING;

EID: 80055090580     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.868     Document Type: Article

References (26)

1. Anderson J. 1996. A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate 9: 1518-1530.
2. Anderson J. 1997. The impact of dynamical constraints on the selection of initial conditions for ensemble predictions: Low-order perfect model results. Mon. Weather Rev. 125: 2969-2983.
3. Balakrishnan N, Rao C. (eds.) 1998. Handbook of Statistics 16: Order Statistics: Theory and Methods. Elsevier: Amsterdam.
4. Barkmeijer J, Buizza R, Palmer TN. 1999. 3D-Var Hessian singular vectors and their potential use in the ECMWF Ensemble Prediction System. Q. J. R. Meteorol. Soc. 125: 2333-2351.
5. Bowler N. 2006. Comparison of error breeding, singular vectors, random perturbations and ensemble Kalman filter perturbation strategies on a simple model. Tellus A 58: 538-548.
6. Brier G. 1950. Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 78: 1-3.
7. Bröcker J. 2008. On reliability analysis of multi-categorical forecasts. Nonlin. Proc. Geophys. 15: 661-673.
8. Bröcker J. 2010. Regularized logistic models for probabilistic forecasting and diagnostics. Mon. Weather Rev. 138: 592-604.
9. Buizza R, Houtekamer P, Pellerin G, Toth Z, Zhu Y, Wei M. 2005. A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Weather Rev. 133: 1076-1097.
10. Buizza R, Palmer TN. 1998. Impact of ensemble size on ensemble prediction. Mon. Weather Rev. 126: 2503-2518.
11. DeLong E, DeLong D, Clarke-Pearson D. 1988. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 44: 837-845.
12. Descamps L, Talagrand O. 2007. On some aspects of the definition of initial conditions for ensemble prediction. Mon. Weather Rev. 135: 3260-3272.
13. Egan J. 1975. Signal detection theory and ROC-analysis. Academic Press.
14. Gneiting T, Raftery A. 2007. Strictly proper scoring rules, prediction, and estimation. J. Amer. Statist. Assoc. 102: 359-378.
15. Gradshteyn I, Ryzhik I. 1980. Table of Integrals, Series and Products. (corrected and enlarged ed.) Academic Press: New York, NY.
16. Hamill T, Colucci S. 1997. Verification of Eta-RSM short-range ensemble forecasts. Mon. Weather Rev. 125: 1312-1327.
17. Hastie T, Tibshirani R, Friedman J. 2009. The elements of statistical learning: Data mining, inference and prediction. (2nd ed.) Springer: Berlin.
18. Kalnay E. 2003. Atmospheric modeling, data assimilation, and predictability. Cambridge University Press: Cambridge, UK.
19. Leith CE. 1974. Theoretical skill of Monte Carlo forecasts. Mon. Weather Rev. 102: 409-418.
20. Mood A, Graybill F, Boes D. 1974. Introduction to the theory of statistics. (3rd ed.) McGraw-Hill: New York, NY.
21. Park M, Hastie T. 2008. Penalized logistic regression for detecting gene interactions. Biostatistics 9: 30-50.
22. Roulston M, Smith L. 2002. Evaluating probabilistic forecasts using information theory. Mon. Weather Rev. 130 1653-1660.
23. Sivillo J, Ahlquist J, Toth Z. 1997. An ensemble forecasting primer. Weather and Forecasting 12: 809-818.
24. Talagrand O, Vautard R, Strauss B. 1997. 'Evaluation of probabilistic prediction systems'. In Proceedings of Workshop on Predictability, ECMWF: Reading, UK.
25. Wilks DS. 2006. Statistical methods in the atmospheric sciences. (2nd ed.) Academic Press: New York, NY.
26. Ziehmann C. 2000. Comparison of a single-model EPS with a multi-model ensemble consisting of a few operational models. Tellus A 52: 280-299.