Comparison of NWP-model chains by using novel verification methods

Meteorologische Zeitschrift

Volumn 22, Issue 4, 2013, Pages 373-393

  Dorninger, Manfred ^a   Gorgas, Theresa ^a,b  

^a UNIVERSITY OF VIENNA   (Austria)

^b ZAMG Zentralanstalt für Meteorologie und Geodynamik   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ATMOSPHERIC SIMULATIONS; ENHANCED RESOLUTIONS; FORECAST AND ANALYSIS; HIGHEST RESOLUTIONS; INDEPENDENT ANALYSIS; MODEL INTER COMPARISONS; POTENTIAL TEMPERATURE; VERIFICATION METHOD;

FLOOD CONTROL; FLOODS;

CHAINS;

CLIMATE MODELING; COMPARATIVE STUDY; MODEL TEST; MODEL VALIDATION; PARAMETERIZATION; PROBABILITY; WAVELET ANALYSIS; WEATHER FORECASTING;

EID: 84890960429     PISSN: 09412948     EISSN: 16101227     Source Type: Journal    
DOI: 10.1127/0941-2948/2013/0488     Document Type: Article

References (67)

1. AHIJEVYCH, D., E. GILLELAND, B. BROWN, E. EBERT, 2009: Application of spatial forecast verificationmethods to gridded precipitation forecasts.-Wea. Forecast. 24, 1485-1497..
2. AHRENS, B., A. BECK, 2008: On upscaling of rain-gauge data for evaluating numerical weather forecasts.-Meteor. Atmos. Phys. 99, 155-167..
3. AMENT, F., M. ARPAGAUS, 2009a: Dphase-cosmoch2: COSMO model forecasts (2.2 km) run by MeteoSwiss for the MAP D-PHASE project.-World Data Center for Climate. DOI: 10.1594/WDCC/dphase-cosmoch2. http://dx.doi.org/DOI:10.1594/WDCC/ dphase-cosmoch2..
4. AMENT, F., M. ARPAGAUS, 2009b: Dphase-cosmoch7: COSMO model forecasts (7 km) run by MeteoSwiss for the MAP D-PHASE project.-World Data Center for Climate. DOI: 10.1594/WDCC/dphase-cosmoch7. http://dx.doi.org/DOI:10.1594/WDCC/ dphase-cosmoch7..
5. AMENT, F., T. WEUSTHOFF, M. ARPAGAUS, 2010: Evaluation of MAP D-PHASE heavy precipitation alerts in Switzerland during summer 2007.-Atmos. Res. 100, 178-189..
6. AMODEI, M., J. STEIN, 2009: Deterministic and fuzzy verification methods for a hierarchy of numerical models.-Meteor. Appl. 16, 191-203..
7. ARPAGAUS, M., M.W. ROTACH, P. AMBROSETTI, F. AMENT, C. APPENZELLER, H.-S. BAUER, A. BEHRENDT, F. BOUTTIER, A. BUZZI, M. CORAZZA, S. DAVOLIO, M. DENHARD, M. DORNINGER, L. FONTANNAZ, J. FRICK, F. FUNDEL, U. GERMANN, T. GORGAS, G. GROSSI, C. HEGG, A. HERING, S. JAUN, C. KEIL, M.A. LINIGER, C. MARSIGLI, R. MCTAGGART-COWAN, A. MONTANI, K. MYLNE, L. PANZIERA, R. RANZI, E. RICHARD, A. ROSSA, D. SANTOS-MUNOZ, C. SCHA R, Y. SEITY, M. STAUDINGER, M. STOLL, S. VOGT, H. VOLKERT, A.WALSER, Y.WANG, J. WERHAHN, V. WULFMEYER, C. WUNRAM, M. ZAPPA, 2009: MAP D-PHASE: Demonstrating forecast capabilities for flood events in the Alpine region-Report on the WWRP Forecast Demonstration Project D-PHASE submitted to the WWRP Joint Scientific Committee.-Veroffentlichungen MeteoSchweiz 78, 79 pp..
8. BAUER, H.-S., T. WEUSTHOFF, M. DORNINGER, V. WULFMEYER, T. SCHWITALLA, T. GORGAS, M. ARPAGAUS, K. WARRACH-SAGI, 2011: Predictive skill of a subset of models participating in D-PHASE in the COPS region.-Quart. J. Roy. Meteor. Soc. 137, 287-305..
9. BAZILE, E., 2009: Dphase-aladfr: ALADIN-France operational model forecasts run by Meteo-France for the MAP D-PHASE project.-World Data Center for Climate, DOI: 10.1594/WDCC/dphase-aladfr, http://dx.doi.org/10.1594/WDCC/ dphase-aladfr..
10. BÉ LAIR, S., M. ROCH, A.-M. LEDUC, P.A. VAILLANCOURT, S. LAROCHE, J. MAILHOT, 2009: Medium-Range Quantitative Precipitation Forecasts from Canadas' New 33-km Deterministic Global Operational System.-Mon. Wea. Rev. 132, 495-518..
11. BENJAMIN, S.G., D. DEVENYI, S.S. WEYGANDT, K.J. BRUNDAGE, J.M. BROWN, G.A. GRELL, D. KIM, B.E. SCHWARTZ, T.G. SMIRNOVA, T.L. SMITH, 2004: An Hourly Assimilation-Forecast Cycle: The RUC.-Wea. Forecast. 24, 690-708..
12. BICA, B., T. KNABL, R. STEINACKER, M. RATHEISER, M. DORNINGER, C. LOTTERANER, S. SCHNEIDER, B. CHIMANI, W. GEPP, S. TSCHANNETT, 2007: Thermally and Dynamically Induced Pressure Features over Complex Terrain from High-Resolution Analyses.-J. Appl. Meteor. Climate 46, 50-65.. (Pubitemid 46210652)
13. BRIGGS, W., R. LEVINE, 1997: Wavelets and Field Forecast Verification.-Mon. Wea. Rev. 125, 199-206..
14. BRILL, K.F., 2002: Automated East-West Phase Error Calculation.-www. cawcr.gov.au/projects/verification/Brill/Brill-EW-PhaseError.html, status: 31 March, 2013..
15. CASATI, B., 2010: New developments of the intensity-scale technique within the Spatial Verification Methods Intercomparison Project.-Wea. Forecast. 25, 113-143..
16. CASATI, B., G. ROSS, D. STEPHENSON, 2004: A new intensity-scale approach for the verification of spatial precipitation forecasts.-Meteor. Appl. 11, 141-154.. (Pubitemid 38990949)
17. CASATI, B., L.J. WILSON, D.B. STEPHENSON, P. NURMI, A. GHELLI, M. POCERNICH, U. DAMRATH, E.E. EBERT, B.G. BROWN, S. MASON, 2008: Review-Forecast verification: Current status and future directions.-Meteor. Appl. 15, 3-18..
18. CHERUBINI, T., A. GHELLI, F. LALAURETTE, 2002: Verification of precipitation forecasts over the Alpine region using a high-density observing network.-Wea. Forecast. 17, 238-249..
19. CÔ TÉ , J., S. GRAVEL, A. MÉ THOT, A. PATOINE, M. ROCH, A. STANIFORTH, 1998: The operational CMC-MRB Global Environmental Multiscale (GEM) model: Part I. Design considerations and formulation.-Mon. Wea. Rev. 126, 1373-1395.. (Pubitemid 128597642)
20. CRESSMAN, G.P., 1959: An operational objective analysis system.-Mon. Wea. Rev. 87, 367-374..
21. DAUBECHIES, I., 1992, Ten Lectures on Wavelets. Chapter 1: The Why, What and How of Wavelets.-Society for Industrial and Applied Mathematics. Philadelphia. Pennsylvania..
22. DORNINGER, M., T. GORGAS, T. SCHWITALLA, M. ARPAGAUS, M. ROTACH, V.WULFMEYER, 2009: Joint D-PHASE-COPS data set (JDC data set). Technical report.-http://cerawww. dkrz.de/WDCC/ui/BrowseExperiments.jspproj=JDC..
23. FISCHER, C., T. MONTMERLE, L. BERRE, L. AUGER, S.E. STEFANESCU, 2005: An overview of the variational assimilation in the ALADIN/France numerical weatherprediction system.-Quart. J. Roy. Meteor. Soc. 131, 3477-3492..
24. FREHLICH, R., 2011: The definition of truth for Numerical Weather Prediction error statistics.-Quart. J. Roy. Meteor. Soc. 137, 84-98..
25. GEBHARDT, C., S.E. THEIS, M. PAULAT, Z.B. BOUALLÈGUE, 2011: Uncertainties in COSMO-DE precipitation forecasts introduced by model perturbations and variation of lateral boundaries.-Atmos. Res. 100, 168-177..
26. GHELLI, A., F. LALAURETTE, 2000: Verifying precipitation forecasts using upscaled observations.-ECMWF Newsletter 87, 9-17..
27. GILLELAND, E., D.A. AHIJEVYCH, B.G. BROWN, B. CASATI, E.E. EBERT, 2009: Intercomparison of Spatial Forecast Verification Methods.-Wea. Forecast. 24, 1416-1430..
28. GILLELAND, E., D.A. AHIJEVYCH, B.G. BROWN, E.E. EBERT, 2010: Verifying forecasts spatially.-Bull. Amer. Meteor. Soc. 47, 1365-1373..
29. GORGAS, T., M. DORNINGER, 2012a: Concepts for a patternoriented analysis ensemble based on observational uncertainties.-Quart. J. Roy. Meteor. Soc. 138, 769-784..
30. GORGAS, T., M. DORNINGER, 2012b: Quantifying verification uncertainty by reference data variation.-Meteorol. Z. 21, 259-277..
31. GORGAS, T., M. DORNINGER, R. STEINACKER, 2009: High resolution analyses based on the D-PHASE & COPS GTS and non-GTS data set.-Ann. Meteorol. 44, 94-95..
32. GRINSTED, A., J. MOORE, S. JEVREJEVA, 2004: Application of the cross wavelet transform and wavelet coherence to geophysical time series.-Nonlin. Processes Geophys. 11, 561-566.. (Pubitemid 40162119)
33. HAGEDORN, R., 2010: On the relative benefits of TIGGE multi-model forecasts and reforcast-calibrated EPS forecasts.-ECMWF Newsletter-Summer 124, 17-23..
34. HAIDEN, T., M.J. RODWELL, D.S. RICHARDSON, A. OKAGAKI, T.ROBINSON, T.HEWSON, 2012: Intercomparison of Global Model Precipitation Forecast Skill in 2010/11 using the SEEPS Score.-Mon. Wea. Rev. 140, 2720-2733..
35. HANLEY, K.E., D.J. KIRSHBAUM, N.M. ROBERTS, G. LEONCINI, 2013: Sensitivities of a Squall Line over Central Europe in a Convective-Scale Ensemble.-Mon. Wea. Rev. 141, 112-133..
36. HOVMO LLER, E., 1949: The Trough-and-Ridge Diagram.-Tellus 1(2), 62-66..
37. LIVINA, V.N., N.R. EDWARDS, S. GOSWAMI, T.M. LENTON, 2008: A wavelet-coefficient score for comparison of twodimensional climatic-data fields.-Quart. J. Roy. Meteor. Soc. 134, 941-955..
38. LORENZ, E.N., 1969: The predictability of a flow which possesses many scales of motion.-Tellus 21, 19-692898, 289-307..
39. MAILHOT, J., S. BÉ LAIR, B. BILODEAU, Y. DELAGE, L. FILLION, L. GARAND, C. GIRARD, A. TREMBLAY, 1998: Scientific Description of RPN Physics Library-Version 3.6.-Recherche en prévision numérique.-Available from RPN, 2121 Trans-Canada Highway, Dorval, PQ H9P 1J3, Canada; also online at http://www.cmc.ec.gc.ca/rpn/physics/physic98.pdf, 188 pp..
40. MAILHOT, J., S. BÉ LAIR, L. LEFAIVRE, B. BILODEAU, M. DESGAGNÉ, C. GIRARD, A. GLATZER, A.-M. LEDUC, A. MÉ THOT, A. PATOINE, A.PLANTE, A.RAHILL, T. ROBINSON, D. TALBOT, A. TREMBLAY, P.VAILLANCOURT, A.ZADRA, A. QADDOURI, 2006: The 15-km version of the Canadian regional forecast system.-Atmos. Ocean. 442, 133-149.. (Pubitemid 43984318)
41. MASS, C.F., D. OVENS, K. WESTRICK, B.A. COLLE, 2002: Does increasing horizontal resolution produce more skillful forecasts.-Bull. Amer. Met. Soc. 83, 407-430..
42. MCTAGGART-COWAN, R., 2009a: Dphase-cmcgemh: Regional GEM model high resolution forecast run by CMC for the MAP D-PHASE project.-World Data Center for Climate, DOI: 10.1594/WDCC/dphase-cmcgemh, http://dx.doi.org/DOI:10.1594/ WDCC/dphase-cmcgemh..
43. MCTAGGART-COWAN, R., 2009b: Dphase-cmcgeml: Regional GEM model high resolution forecast run by CMC for the MAP D-PHASE project.-World Data Center for Climate, DOI: 10.1594/WDCC/dphase-cmcgeml, http://dx.doi.org/DOI:10.1594/ WDCC/dphase-cmcgeml..
44. MITTERMAIER, M., 2006: Using an intensity-scale technique to assess the added benefit of high resolution model precipitation forecasts.-Atmos. Sci. Letters 7, 36-42.. (Pubitemid 43905383)
45. NASH, J., J. SUTCLIFFE, 1970: River flow forecasting through conceptual models part I-A discussion of principles.-J. Hydrol. 10, 282-290..
46. NORTH, R., M. TRUEMAN, M. MITTERMAIER, M.J. RODWELL, 2013: An assessment of the SEEPS and SEDI metrics for the verification of 6 h forecast precipitation accumulations.-Meteor. Appl. 20, 164-175..
47. NURMI, P., 2003: Recommendations on the verification of local weather forecasts.-ECMWF Technical Memorandum 430..
48. PAEGLE, J., Q. YANG, M. WANG, 1997: Predictability in limited area and global models.-Meteor. Atmos. Phys. 63, 53-69.. (Pubitemid 127721411)
49. ROBERTS, N.M., H.W. LEAN, 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events.-Mon. Wea. Rev. 136, 78-97.. (Pubitemid 351308459)
50. RODWELL, M.J., D.S. RICHARDSON, T.D. HEWSON, T. HAIDEN, 2010: A new equitable score suitable for verifying precipitation in numerical weather prediction.-Quart. J. Roy. Meteor. Soc. 136, 1344-1363..
51. ROTACH, M.W., P. AMBROSETTI, C. APPENZELLER, M. ARPAGAUS, L. FONTANNAZ, F. FUNDEL, U. GERMANN, A. HERING, M.A. LINIGER, M. STOLL, A. WALSER, F. AMENT, H.S. BAUER, A. BEHRENDT, V. WULFMEYER, F. BOUTTIER, Y. SEITY, A. BUZZI, S. DAVOLIO, M. CORAZZA, M. DENHARD, M. DORNINGER, T. GORGAS, J. FRICK, C. HEGG, M. ZAPPA, C. KEIL, H. VOLKERT, C. MARSIGLI, A. MONTANI, R. MCTAGGART-COWAN, K. MYLNE, R. RANZI, E. RICHARD, A. ROSSA, D. SANTOS-MUNOZ, C. SCHA R, M. STAUDINGER, Y. WANG, J. WERHAHN, 2009: MAP D-PHASE: Real-Time Demonstration of Weather Forecast Quality in the Alpine Region.-Bull. Amer. Meteor. Soc. 90, 1321-1336..
52. RO PNACK, A., A. HENSE, C. GEBHARDT, 2013: Bayesian Model Verification of NWP Ensemble Forecasts.-Mon. Wea. Rev. 141, 375-387..
53. SCHRAFF, C., 1997: Mesoscale data assimilation and prediction of low stratus in the Alpine region.-Meteor. Atmos. Phys. 64, 21-50..
54. SEITY, Y., 2009: Dphase-arome: AROME +30hours forecasts run by Meteo-France CNRM/GAME for the MAP DPHASE.-World Data Center for Climate, DOI: 10.1594/WDCC/dphase-arome, http://dx.doi.org/10.1594/WDCC/dphase-arome..
55. SEITY, Y., P. BROUSSEAU, S. MALARDEL, G. HELLO, P. BÉ NARD, F. BOUTTIER, C. LAC, V. MASSON, 2011: The AROME-France Convective-Scale Operational Model.-Mon. Wea. Rev. 139, 976-991..
56. STEINACKER, R., M. RATHEISER, B. BICA, B. CHIMANI, M. DORNINGER, W. GEPP, C. LOTTERANER, S. SCHNEIDER, S. TSCHANNETT, 2006: A Mesoscale Data Analysis and Downscaling Method over Complex Terrain.-Mon. Wea. Rev. 134, 2578-2771..
57. STEINACKER, R., D. MAYER, A. STEINER, 2011: Data Quality Control based on Self-Consistency.-Mon. Wea. Rev. 139, 3974-3991..
58. STEPPELER, J., G. DOMS, U. SCHATTLER, H. BITZER, A. GASSMANN, U. DAMRATH, 2003: Meso-gamma scale forecasts using the nonhydrostatic model LM.-Meteor. Atmos. Phys. 82, 75-96.. (Pubitemid 37450346)
59. WANG, Y., S. TASCU, F. WEIDLE, K. SCHMEISSER, 2012: Evaluation of the Added Value of Regional Ensemble Forecasts on Global Ensemble Forecasts.-Wea. Forecast. 27, 972-987..
60. WERNLI, H., M. PAULAT, M. HAGEN, C. FREI, 2008: SAL-A Novel Quality Measure for the Verification of Quantitative Precipitation Forecasts.-Mon. Wea. Rev. 136, 4470-4487..
61. WEUSTHOFF, T., F. AMENT, M. ARPAGAUS, M.W. ROTACH, 2010: Assessing the Benefits of Convection-Permitting Models by Neighborhood Verification: Examples from MAP D-PHASE.-Mon. Wea. Rev. 138, 3418-3433..
62. WGNE, 2011: 27th session of the CAS/JSC Working Group on Numerical Experimentation (WGNE-27).-NCAR, Boulder, CO, USA, 17-21 October 2011, http://www.wcrp-climate.org/documents/wgne-27-report-final. pdf, 39 pp..
63. WHITE, B.G., J. PAEGLE, W.J. STEERBURGH, J.D. WOREL, R.T. SWANSON, L.K. COOK, D.J. ONTON, J.G. MYLES, 1999: Short-term forecast validation of six models.-Wea. Forecast. 14, 84-108.. (Pubitemid 29335050)
64. WILKS, D.S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd Edition-Elsevier, 627 pp.
65. WITTMANN, C., T. HAIDEN, A. KANN, 2010: Evaluating multi-scale precipitation forecasts using high resolution analysis.-Advan. Sci. Res. 4, 89-98..
66. WULFMEYER, V., A. BEHRENDT, H.-S. BAUER, C. KOTTMEIER, U. CORSMEIER, A. BLYTH, G. CRAIG, U. SCHUMANN, M. HAGEN, S. CREWELL, P. DI GIROLAMO, C. FLAMANT, M. MILLER, A. MONTANI, S. MOBBS, E. RICHARD, M.W. ROTACH,M.ARPAGAUS,H. RUSSCHENBERG, P. SCHLU SSEL, M. KO NIG, V. GA RTNER, R. STEINACKER, M. DORNINGER, D.D. TURNER, T. WECKWERTH, A. HENSE, C. SIMMER, 2008: The convective and orographically induced precipitation study.-Bull. Amer. Meteor. Soc. 89, 1477-1486. DOI: 10.1175/2008BAMS2367.1..
67. WULFMEYER, V., A. BEHRENDT, C. KOTTMEIER, U. CORSMEIER, C. BARTHLOTT, G.C. CRAIG, M. HAGEN, D. ALTHAUSEN, F. AOSHIMA, M. ARPAGAUS, H.S. BAUER, L. BENNETT, A. BLYTH, C. BRANDAU, C. CHAMPOLLION, S. CREWELL, G. DICK, P.D. GIROLAMO, M. DORNINGER, Y. DUFOURNET, R. EIGENMANN, R. ENGELMANN, C. FLAMANT, T. FOKEN, T. GORGAS, M. GRZESCHIK, J. HANDWERKER, C. HAUCK, H. HO LLER, W. JUNKERMANN, N. KALTHOFF, C. KIEMLE, S. KLINK, M. KO NIG, L. KRAUSS, C.N. LONG, F. MADONNA, S. MOBBS, B. NEININGER, S. PAL, G. PETERS, G. PIGEON, E. RICHARD, M.W. ROTACH, H. RUSSCHENBERG, T. SCHWITALLA, V. SMITH, R. STEINACKER, J. TRENTMANN, D.D. TURNER, J. VAN BAELEN, S. VOGT, H. VOLKERT, T. WECKWERTH, H. WERNLI, A. WIESER, M. WIRTH, 2011: The Convective and Orographically-induced Precipitation Study (COPS): The scientific strategy, the field phase, and research highlights.-Quart. J. Roy. Meteo. Soc. 137, 3-30..