Feature-based diagnostic evaluation of global NWP forecasts

Monthly Weather Review

Volumn 144, Issue 10, 2016, Pages 3871-3893

  Mittermaier, Marion ^a   North, Rachel ^a   Semple, Adrian ^a   Bullock, Randy ^b  

^a MET OFFICE   (United Kingdom)

^b NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

Author keywords

Forecast verification skill; Forecasting; Model evaluation performance; Models and modeling; Numerical weather prediction forecasting

Indexed keywords

FIGHTER AIRCRAFT; FORECASTING; NUMERICAL MODELS;

ANDERSON-DARLING TESTS; FORECAST VERIFICATION/SKILL; MODEL EVALUATION/PERFORMANCE; NUMERICAL WEATHER PREDICTION MODELS; NUMERICAL WEATHER PREDICTION/FORECASTING; SPATIAL VERIFICATIONS; SUBJECTIVE ASSESSMENTS; TRADITIONAL ASSESSMENT;

WEATHER FORECASTING;

NUMERICAL MODEL; SYNOPTIC METEOROLOGY; WEATHER FORECASTING;

EID: 84993661758     PISSN: 00270644     EISSN: 15200493     Source Type: Journal    
DOI: 10.1175/MWR-D-15-0167.1     Document Type: Article

References (24)

1. Ahijevych, D., E. Gilleland, B. Brown, and E. Ebert, 2009: Application of spatial verification methods to idealized and NWP-gridded precipitation forecasts. Wea. Forecasting, 24, 1485-1497, doi:10.1175/2009WAF2222298.1.
2. Anderson, T., and D. Darling, 1952: Asymptotic theory of certain "goodness of fit" criteria based on stochastic processes. Ann. Math. Stat., 23, 193-212, doi:10.1214/aoms/1177729437.
3. Arnold, T., and J. Emerson, 2011: Nonparametric goodness-of-fit tests for discrete null distributions. R J., 3 (2), 34-39.
4. Clayton, A., A. Lorenc, and D. Barker, 2013: Operational implementation of a hybrid ensemble/4D-Var global data assimilation system at the Met Office. Quart. J. Roy. Meteor. Soc., 139, 1445-1461, doi:10.1002/qj.2054.
5. Darling, D., 1957: The Kolmogorov-Smirnov, Cramer-von mises tests. Ann. Math. Stat., 28, 823-838, doi:10.1214/aoms/1177706788.
6. Davies, T., M. Cullen, A. Malcolm, M. Mawson, A. Staniforth, A. White, and N. Wood, 2005: A new dynamical core for the Met Office's global and regional modelling of the atmosphere. Quart. J. Roy. Meteor. Soc., 131, 1759-1782, doi:10.1256/qj.04.101.
7. Davis, C., B. Brown, and R. Bullock, 2006: Object-based verification of precipitation forecasts. Part I: Methods and application to mesoscale rain areas. Mon. Wea. Rev., 134, 1772-1784, doi:10.1175/MWR3145.1.
8. Davis, C., B. Brown, and R. Bullock, 2006: Object-based verification of precipitation forecasts. Part II: Application to convective rain systems. Mon. Wea. Rev., 134, 1785-1795, doi:10.1175/MWR3146.1.
9. Davis, C., B. Brown, R. Bullock, and J. H. Gotway, 2009: The method for object-based diagnostic evaluation (mode) applied to numerical forecasts from the 2005 NSSL/SPC spring program. Wea. Forecasting, 24, 1252-1267, doi:10.1175/2009WAF2222241.1.
10. Ebert, E., 2008: Fuzzy verification of high-resolution gridded forecasts: A review and proposed framework. Meteor. Appl., 15, 51-64, doi:10.1002/met.25.
11. Ebert, E., and J. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol., 239, 179-202, doi:10.1016/S0022-1694(00)00343-7.
12. Ebert, E., and Coauthors, 2013: Progress and challenges in forecast verification. Meteor. Appl., 20, 130-139, doi:10.1002/met.1392.
13. Gallus, W., 2010: Application of object-based verification techniques to ensemble precipitation forecasts. Wea. Forecasting, 25, 144-158, doi:10.1175/2009WAF2222274.1.
14. Gilleland, E., D. Ahijevych, B. Brown, and E. Ebert, 2009: Intercomparison of spatial forecast verification methods. Wea. Forecasting, 24, 1416-1430, doi:10.1175/2009WAF2222269.1.
15. Gilleland, E., D. A. Ahijevych, B. G. Brown, and E. E. Ebert, 2010: Verifying forecasts spatially. Bull. Amer. Meteor. Soc., 91, 1365-1373, doi:10.1175/2010BAMS2819.1.
16. Hortal, M., 2002: The development and testing of a new two-time-level semi-Lagrangian scheme (SETTLS) in the ECMWF forecast model. Quart. J. Roy. Meteor. Soc., 128, 1671-1687, doi:10.1002/qj.200212858314.
17. Jolliffe, I. T., and D. B. Stephenson, Eds., 2011: Forecast Verification: A Practitioner's Guide in Atmospheric Science. 2nd ed. John Wiley and Sons, 292 pp.
18. Lack, S., G. Limpert, and N. Fox, 2010: A object-oriented multiscale verification scheme. Wea. Forecasting, 25, 79-92, doi:10.1175/2009WAF2222245.1.
19. Mass, C., D. Ovens, K. Westrick, and B. Colle, 2002: Does increasing horizontal resolution produce more skillful forecasts? The results of two years of real-time numerical weather prediction over the Pacific Northwest. Bull. Amer. Meteor. Soc., 83, 407-430, doi:10.1175/1520-0477(2002)083<0407:DIHRPM>2.3.CO;2.
20. Mittermaier, M., and R. Bullock, 2013: Using MODE to explore the spatial and temporal characteristics of cloud cover forecasts from high-resolution NWP models. Meteor. Appl., 20, 187-196, doi:10.1002/met.1393.
21. Mittermaier, M., N. Roberts, and S. Thompson, 2013: A long-term assessment of precipitation forecast skill using the Fractions Skill Score. Meteor. Appl., 20, 176-186, doi:10.1002/met.296.
22. Scholz, F., and M. Stephens, 1987: K-sample Anderson-Darling tests. J. Amer. Stat. Assoc., 82, 918-924.
23. Wernli, H., M. Paulat, M. Hagen, and C. Frei, 2008: SAL-A novel quality measure for the verification of quantitative precipitation forecasts. Mon. Wea. Rev., 136, 4470-4487, doi:10.1175/2008MWR2415.1.
24. Wood, N., and Coauthors, 2014: An inherently mass-conserving semi-implicit semi-Lagrangian discretization of the deep-atmosphere global non-hydrostatic equations. Quart. J. Roy. Meteor. Soc., 140, 1505-1520, doi:10.1002/qj.2235.