Impact of observational error on the validation of ensemble prediction systems

Quarterly Journal of the Royal Meteorological Society

Volumn 134, Issue 633 B, 2008, Pages 959-971

  Candille, Guillem ^a,b   Talagrand, O ^a  

^a LABORATOIRE DE MÉTÉOROLOGIE DYNAMIQUE   (France)

^b UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

Author keywords

Brier score Decomposition; Perturbed ensemble and observational probability procedures; ROC Curves

Indexed keywords

COMPUTER SIMULATION; ERRORS; FORECASTING; INDUSTRIAL ECONOMICS; LAWS AND LEGISLATION; PROBABILITY; PROBABILITY DISTRIBUTIONS; RANDOM PROCESSES; RISK ASSESSMENT; STANDARDS; RELIABILITY;

BRIER SCORE; BRIER-SCORE DECOMPOSITION; ENSEMB LE METHODS; ENSEMBLE PREDICTION SYSTEMS; NUMERICAL SIMULATIONS; OBSERVATION ERRORS; OPTIMUM VALUE; PERTURBED-ENSEMBLE AND OBSERVATIONAL-PROBABILITY PROCEDURES; RELIABILITY DIAGRAM; ROC CURVES; BRIER SCORES; CURVE AREAS; ENSEMBLE METHODS; OBSERVATIONAL ERRORS; OPTIMUM VALUES; PROBABILITY METHODS; PROBABILITY SCORES; RANK HISTOGRAMS; RELIABILITY DIAGRAMS; SIGNIFICANT IMPACTS;

ERROR ANALYSIS; PROBABILITY DISTRIBUTIONS;

CLIMATE PREDICTION; ENSEMBLE FORECASTING; NUMERICAL MODEL; PROBABILITY; COMPUTER SIMULATION; ERROR ANALYSIS;

EID: 48649099865     PISSN: 00359009     EISSN: None     Source Type: Journal    
DOI: 10.1002/qj.268     Document Type: Article

References (18)

1. Anderson J. 1996. A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate 9: 1518-1530.
2. Atger F. 2004. Relative impact of model quality and ensemble defiencies on the performance of ensemble-based probabilistic forecasts evaluated through the Brier score. Nonlinear Proc. Geoph. 11: 399-409.
3. Bélair S, Crevier L-P, Mailhot J, Bilodeau B, Delage Y. 2003a. Operational implementation of the ISBA land surface scheme in the Canadian regional weather forecast model. Part I: Warm season results. J. Hydrometeorol. 4: 352-370.
4. Bélair S, Crevier L-P, Mailhot J, Bilodeau B, Delage Y. 2003b. Operational implementation of the ISBA land surface scheme in the Canadian regional weather forecast model. Part II: Cold season results. J. Hydrometeorol. 4: 371-386.
5. Brier GW. 1950. Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 78: 1-3.
6. Bowler NE. 2006. Explicit accounting for observation errror in categorical verification of forecasts. Mon. Weather Rev. 134: 1600-1606.
7. Buizza R, Houtekamer PL, Toth Z, Pellerin G, Wei M, Zhu Y. 2005. A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Weather Rev. 133: 1076-1097.
8. Candille G. 2003. Validation des systèmes de prévisions météorologiques probabilistes. PhD thesis, Université Pierre-et-Marie-Curie, Paris.
9. Candille G, Talagrand O. 2005. Evaluation of probabilistic prediction systems for a scalar variable. Q. J. R. Meteorol. Soc. 131: 1-20.
10. Candille G, Côté C, Houtekamer PL, Pellerin G. 2007. Verification of an ensemble prediction system against observations. Mon. Weather Rev. 137: 2688-2699.
11. Elms J. 2003. 'WMO catalogue of radiosondes and upper-air wind systems in use by members in 2002 and compatibility of radiosonde geopotential measurements for period from 1998 to 2001'. In: Instruments and Observing Methods, Report 80, TD 1197, 219 pp. World Meteorological Organization.
12. Mason I. 1982. A model for assessment of weather forecasts. Aust. Meteorol. Mag. 30: 291-303.
13. Mason I. 2003. 'Binary events'. In: Forecast Verification: A Practitioner's Guide in Atmospheric Science, Jolliffe I, Stephenson DB (eds), Wiley: UK. ISBN: 0-471-49759-2, pp 37-76.
14. Murphy AH. 1973. A new vector partition of the probability score. J. Appl. Meteorol. 12(4): 595-600.
15. Saetra O, Hersbach H, Bidlot J-R, Richardson D. 2004. Effects of observation errors on the statistics for ensemble spread and reliability. Mon. Weather Rev. 132(6): 1487-1501.
16. Stanski HR, Wilson LJ, Burrows WR. 1989. Survey of common verification in meteorology. World Weather Watch Report No. 8, TD No. 358, World Meteorological Organization: Geneva, Switzerland, pp. 114.
17. Talagrand O, Vautard R, Strauss B. 1999. 'Evaluation of probabilistic prediction systems'. In: Proceeding of Workshop on Predictability. ECMWF.
18. Toth Z, Talagrand O, Candille G, Zhu Y. 2003. 'Probability and ensemble forecasts'. In: Forecast Verification: A Practitioner's Guide in Atmospheric Science, Jolliffe I, Stephenson DB (eds), Wiley: UK. ISBN: 0-471-49759-2, pp 137-163.