The setup of the MesoVICT project

Bulletin of the American Meteorological Society

Volumn 99, Issue 9, 2018, Pages 1887-1906

  Dorninger, Manfred ^a   Gilleland, Eric ^b   Casati, Barbara ^c   Mittermaier, Marion P ^d   Ebert, Elizabeth E ^e   Brown, Barbara G ^b   Wilson, Laurence J ^c  

^a UNIVERSITY OF VIENNA   (Austria)

^b NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^c ENVIRONMENT CANADA   (Canada)

^d MET OFFICE   (United Kingdom)

^e BUREAU OF METEOROLOGY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

METEOROLOGY;

COMPLEX TERRAINS; ENSEMBLE FORECASTS; OBSERVATION UNCERTAINTIES; SPATIAL VERIFICATIONS;

EARTH ATMOSPHERE;

EID: 85052510155     PISSN: 00030007     EISSN: None     Source Type: Journal    
DOI: 10.1175/BAMS-D-17-0164.1     Document Type: Article

References (103)

1. Ahijevych, D., E. Gilleland, B. Brown, E. Ebert, 2009: Application of spatial forecast verification methods to gridded precipitation forecasts. Wea. Forecasting, 24, 1485-1497, https://doi.org/10.1175/2009WAF2222298.1.
2. Alt, H., M. Godau, 1995: Computing the Fréchet distance between two polygonal curves. Int. J. Comput. Geom. Appl., 5, 75-91, https://doi.org/10.1142/S0218195995000064.
3. Ament, F., M. Arpagaus, 2009: Dphase-cosmoch2: COSMO model forecasts (2.2 km) run by MeteoSwiss for the MAP D-PHASE project. World Data Center for Climate, accessed 11 July 2013, https://doi.org/10.1594/WDCC/dphase-cosmoch2.
4. Arpagaus, M., Coauthors, 2009: MAP D-PHASE: Demonstrating forecast capabilities for flood events in the Alpine region. Veröffentlichungen MeteoSchweiz 78, 79 pp., www.meteoswiss.admin.ch/content/dam/meteoswiss/en/Ungebundene-Seiten/Publikationen/Scientific-Reports/doc/veroeff78.pdf.
5. Baddeley, A. J., 1992a: Errors in binary images and an Lp version of the Hausdorff metric. Nieuw Arch. Wiskunde, 10, 157-183.
6. -., 1992b: An error metric for binary images. Robust Computer Vision: Quality of Visions Algorithms, W. Förstner and S. Ruwiedel, Eds., Wichmann-Verlag, 59-78.
7. Baldauf, M., A. Seifert, J. Förstner, D. Majewski, M. Raschendorfer, T. Reinhardt, 2011: Operational convective-scale numerical weather prediction with the COSMO model: Description and sensitivities. Mon. Wea. Rev., 139, 3887-3905, https://doi.org/10.1175/MWR-D-10-05013.1.
8. Ben Bouallègue, Z., S. E. Theis, 2014: Spatial techniques applied to precipitation ensemble forecasts: From verification results to probabilistic products. Meteor. Appl., 21, 922-929, https://doi.org/10.1002/met.1435.
9. Bica, B., Coauthors, 2007: Thermally and dynamically induced pressure features over complex terrain from high-resolution analyses. J. Appl. Meteor. Climatol., 46, 50-65, https://doi.org/10.1175/JAM2418.1.
10. Brill, K. F., F. Mesinger, 2009: Applying a general analytic method for assessing bias sensitivity to bias-adjusted threat and equitable threat scores. Wea. Forecasting, 24, 1748-1754, https://doi.org/10.1175/2009WAF2222272.1.
11. Buehner, M., Coauthors, 2015: Implementation of deterministic weather forecasting systems based on ensemble variational data assimilation at Environment Canada. Part I: The global system. Mon. Wea. Rev., 143, 2532-2559, https://doi.org/10.1175/MWR-D-14-00354.1.
12. Caron, J.-F., T. Milewski, M. Buehner, L. Fillion, M. Reszka, S. Macpherson, J. St-James, 2015: Implementation of deterministic weather forecasting systems based on ensemble variational data assimilation at Environment Canada. Part II: The regional system. Mon. Wea. Rev., 143, 2560-2580, https://doi.org/10.1175/MWR-D-14-00353.1.
13. Casaioli, M., F. Catini, R. Inghilesi, P. Lanucara, P. Malguzzi, S. Mariani, A. Orasi, 2014: An operational forecasting system for the meteorological and marine conditions in Mediterranean regional and coastal areas. Adv. Sci. Res., 11, 11-23, https://doi.org/10.5194/asr-11-11-2014.
14. Casati, B., 2010: New developments of the intensity-scale technique within the Spatial Verification Methods Intercomparison Project. Wea. Forecasting, 25, 113-143, https://doi.org/10.1175/2009WAF2222257.1.
15. -., G. Ross, D. Stephenson, 2004: A new intensity-scale approach for the verification of spatial precipitation forecasts. Meteor. Appl, 11, 141-154, https://doi.org/10.1017/S1350482704001239.
16. Côté, J., S. Gravel, A. Méthot, A. Patoine, M. Roch, A. Staniforth, 1998: The operational CMC-MRB Global Environmental Multiscale (GEM) model: Part I. Design considerations and formulation. Mon. Wea. Rev., 126, 1373-1395, https://doi.org/10.1175/1520-0493(1998)1261373:TOCMGE2.0.CO;2.
17. Cressman, G. P., 1959: An operational objective analysis system. Mon. Wea. Rev., 87, 367-374, https://doi.org/10.1175/1520-0493(1959)0870367:AOOAS2.0.CO;2.
18. Crocker, R., M. P. Mittermaier, 2013: Exploratory use of a satellite cloud mask to verify NWP models. Meteor. Appl., 20, 197-205, https://doi.org/10.1002/met.1384.
19. Davies, T., M. J. P. Cullen, A. J. Malcolm, M. H. Mawson, A. Staniforth, A. A. White, N. Wood, 2005: A new dynamical core for the Met Office's global and regional modelling of the atmosphere. Quart. J. Roy. Meteor. Soc., 131, 1759-1782, https://doi.org/10.1256/qj.04.101.
20. Davis, C., B. Brown, R. Bullock, 2006: Object-based verification of precipitation forecasts. Part I: Methods and application to mesoscale rain areas. Mon. Wea. Rev., 134, 1772-1784, https://doi.org/10.1175/MWR3145.1
21. -., J. Halley-Gotway, 2009: The method for object-based diagnostic evaluation (MODE) applied to numerical forecasts from the 2005 NSSL/SPC spring program. Wea. Forecasting, 24, 1252-1267, https://doi.org/10.1175/2009WAF2222241.1.
22. Demaria, E. M. C., D. A. Rodriguez, E. E. Ebert, P. Salio, F. Su, J. B. Valdes, 2011: Evaluation of mesoscale convective systems in South America using multiple satellite products and an object-based approach. J. Geophys. Res., 116, D08103, https://doi.org/10.1029/2010JD015157.
23. De Sales, F., Y. Xue, 2011: Assessing the dynamic-downscaling ability over South America using the intensity-scale verification technique. Int. J. Climatol., 31, 1205-1221, https://doi.org/10.1002/joc.2139.
24. Dorninger, M., T. Gorgas, 2013: Comparison of NWP-model chains by using novel verification methods. Meteor. Z., 22, 373-393, https://doi.org/10.1127/0941-2948/2013/0488
25. -., S. Schneider, R. Steinacker, 2008: On the interpolation of precipitation data over complex terrain. Meteor. Atmos. Phys., 101, 175-189, https://doi.org/10.1007/s00703-008-0287-6
26. -., T. Gorgas, T. Schwitalla, M. Arpagaus, M. Rotach, V. Wulfmeyer, 2009: Joint D-PHASE-COPS data set (JDC data set). Tech. Doc., 8 pp., https://ral.ucar.edu/projects/icp/Data/JDC/Description-of-JDC-data.pdf
27. -., M. P. Mittermaier, E. Gilleland, E. E. Ebert, B. G. Brown, L. J. Wilson, 2013: MesoVICT: Mesoscale Verification Intercomparison over Complex Terrain. NCAR Tech. Note NCAR/TN-505+STR, 23 pp., https://doi.org/10.5065/D6416V21.
28. Dubuisson, M.-P., A. K. Jain, 1994: A modified Hausdorff distance for object matching. Proc 12th IAPR Int. Conf. on Pattern Recognition, Jerusalem, Israel, IEEE, 566-568.
29. Duc, L., K. Saito, H. Seko, 2013: Spatial-temporal fractions verification for high-resolution ensemble forecasts. Tellus, 65A, 18171, https://doi.org/10.3402/tellusa.v65i0.18171.
30. Dukhovskoy, D. S., J. Ubnoske, E. Blanchard-Wrigglesworth, H. R. Hiester, A. Proshutinsky, 2015: Skill metrics for evaluation and comparison of sea ice models. J. Geophys. Res. Oceans, 120, 5910-5931, https://doi.org/10.1002/2015JC010989.
31. Ebert, E. E., 2009: Neighborhood verification: A strategy for rewarding close forecasts. Wea. Forecasting, 24, 1498-1510, https://doi.org/10.1175/2009WAF2222251.1
32. -., J. L. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol., 239, 179-202, https://doi.org/10.1016/S0022-1694(00)00343-7
33. -., W. A. Gallus Jr., 2009: Toward better understanding of the contiguous rain area (CRA) method for spatial forecast verification. Wea. Forecasting, 24, 1401-1415, https://doi.org/10.1175/2009WAF2222252.1.
34. Eiter, T., H. Mannila, 1994: Computing discrete Fréchet distance. Christian Doppler Laboratory Tech. Rep. CD-TR 94/64, Vienna University of Technology, 8 pp., www.kr.tuwien.ac.at/staff/eiter/et-archive/cdtr9464.pdf.
35. Ferretti, R., Coauthors, 2014: Overview of the first HyMeX Special Observation Period over Italy: Observations and model results. Hydrol. Earth Syst. Sci., 18, 1953-1977, https://doi.org/10.5194/hess-18-1953-2014.
36. Geiß, S., 2015: Comparison of spatial verification methods. Bachelor thesis, Meteorological Institute Munich, Ludwig-Maximilians-University Munich, 55 pp.
37. Gilleland, E., 2011: Spatial forecast verification: Baddeley's delta metric applied to ICP test cases. Wea. Forecasting, 26, 409-415, https://doi.org/10.1175/WAF-D-10-05061.1
38. -., 2017: A new characterization in the spatial verification framework for false alarms, misses, overall patterns. Wea. Forecasting, 32, 187-198, https://doi.org/10.1175/WAF-D-16-0134.1.
39. -., T. C. M. Lee, J. H. Gotway, R. G. Bullock, B. G. Brown, 2008: Computationally efficient spatial forecast verification using Braddeley's D image metric. Mon. Wea. Rev., 136, 1747-1757, https://doi.org/10.1175/2007MWR2274.1
40. -., D. A. Ahijevych, B. G. Brown, B. Casati, E. E. Ebert, 2009: Intercomparison of spatial forecast verification methods. Wea. Forecasting, 24, 1416-1430, https://doi.org/10.1175/2009WAF2222269.1
41. -., E. E. Ebert, 2010a: Verifying forecasts spatially. Bull. Amer. Meteor. Soc., 91, 1365-1373, https://doi.org/10.1175/2010BAMS2819.1
42. -., J. Lindström, F. Lindgren, 2010b: Analyzing the image warp forecast verification method on precipitation fields from the ICP. Wea. Forecasting, 25, 1249-1262, https://doi.org/10.1175/2010WAF2222365.1.
43. Girard, C., Coauthors, 2014: Staggered vertical discretization of the Canadian environmental multiscale (GEM) model using a coordinate of the log-hydrostatic-pressure type. Mon. Wea. Rev., 142, 1183-1196, https://doi.org/10.1175/MWR-D-13-00255.1.
44. Gorgas, T., M. Dorninger, 2012a: Concepts for a pattern-oriented analysis ensemble based on observational uncertainties. Quart. J. Roy. Meteor. Soc., 138, 769-784, https://doi.org/10.1002/qj.949.
45. -., 2012b: Quantifying verification uncertainty by reference data variation. Meteor. Z., 21, 259-277, https://doi.org/10.1127/0941-2948/2012/0325
46. -., R. Steinacker, 2009: High resolution analyses based on the D-PHASE & COPS GTS and non-GTS data set. Ann. Meteor., 44, 94-95.
47. Harris, D., E. Foufoula-Georgiou, K. K. Droegemeier, J. J. Levit, 2001: Multiscale statistical properties of a high-resolution precipitation forecast. J. Hydrometeor., 2, 406-418, https://doi.org/10.1175/1525-7541(2001)0020406:MSPOAH2.0.CO;2.
48. Hartung, D. C., J. A. Otkin, R. A. Petersen, D. D. Turner, W. F. Feltz, 2011: Assimilation of surface-based boundary layer profiler observations during a cool-season weather event using an observing system simulation experiment. Part II: Forecast assessment. Mon. Wea. Rev., 139, 2327-2346, https://doi.org/10.1175/2011MWR3623.1.
49. Hebert, D. A., R. A. Allard, E. J. Metzger, P. G. Posey, R. H. Preller, A. J. Wallcraft, M. W. Phelps, O. M. Smedstad, 2015: Short-term sea ice forecasting: An assessment of ice concentration and ice drift forecasts using the U.S. Navy's Arctic Cap Nowcast/Forecast System. J. Geophys. Res. Oceans, 120, 8327-8345, https://doi.org/10.1002/2015JC011283.
50. Heinrichs, J. F., D. J. Cavalieri, T. Markus, 2006: Assessment of the AMSR-E sea ice concentration product at the ice edge using RADARSAT-1 and MODIS imagery. IEEE Trans. Geosci. Remote Sens., 44, 3070-3080, https://doi.org/10.1109/TGRS.2006.880622.
51. Hersbach, H., 2000: Distortion representation of forecast errors. Wea. Forecasting, 15, 559-570, https://doi.org/10.1175/1520-0434(2000)0150559:DOTCRP2.0.CO;2.
52. Johnson, A., X. Wang, F. Kong, M. Xue, 2011: Hierarchical cluster analysis of a convection-allowing ensemble during the Hazardous Weather Testbed 2009 Spring Experiment. Part I: Development of the object-oriented cluster analysis method for precipitation fields. Mon. Wea. Rev., 139, 3673-3693, https://doi.org/10.1175/MWR-D-11-00015.1.
53. Keil, C., G. C. Craig, 2007: A displacement-based error measure applied in a regional ensemble forecasting system. Mon. Wea. Rev., 135, 3248-3259, https://doi.org/10.1175/MWR3457.1.
54. -., 2009: A displacement and amplitude score employing an optical flow technique. Wea. Forecasting, 24, 1297-1308, https://doi.org/10.1175/2009WAF2222247.1.
55. Kloiber, S., 2017: Verification in complex terrain with ensemble-analysis. M.S. thesis, Dept. of Meteorology and Geophysics, University of Vienna, 74 pp.
56. Lack, S. A., G. L. Limpert, N. I. Fox, 2010: An object-oriented multiscale verification scheme. Wea. Forecasting, 25, 79-92, https://doi.org/10.1175/2009WAF2222245.1.
57. Lakshmanan, V., J. S. Kain, 2010: A Gaussian mixture model approach to forecast verification. Wea. Forecasting, 25, 908-920, https://doi.org/10.1175/2010WAF2222355.1.
58. Liu, Y., J. Brown, J. Demargne, D.-J. Seo, 2011: A wavelet-based approach to assessing timing errors in hydrologic predictions. J. Hydrol., 397, 210-224, https://doi.org/10.1016/j.jhydrol.2010.11.040.
59. Mailhot, J., S. Bélair, B. Bilodeau, Y. Delage, L. Fillion, L. Garand, C. Girard, A. Tremblay, 1998: Scientific description of RPN Physics Library, version 3.6. Recherche en prévision numérique, 188 pp. [Available from RPN, 2121 Trans-Canada Highway, Dorval, PQ H9P 1J3, Canada.]
60. Mariani, S., M. Casaioli, E. Coraci, P. Malguzzi, 2015a: A new high-resolution BOLAM-MOLOCH suite for the SIMM forecasting system: Assessment over two HyMeX intense observation periods. Nat. Hazards Earth Syst. Sci., 15, 1-24, https://doi.org/10.5194/nhess-15-1-2015.
61. -., A. Lanciani, S. Flavoni, C. Accadia, 2015b: QPF performance of the updated SIMM forecasting system using reforecasts. Meteor. Appl., 22, 256-272, https://doi.org/10.1002/met.1453.
62. Marsigli, C., A. Montani, T. Paccagnella, 2008: A spatial verification method applied to the evaluation of high-resolution ensemble forecasts. Meteor. Appl., 15, 125-143, https://doi.org/10.1002/met.65.
63. Marzban, C., S. Sandgathe, H. Lyons, N. Lederer, 2009: Three spatial verification techniques: Cluster analysis, variogram, optical flow. Wea. Forecasting, 24, 1457-1471, https://doi.org/10.1175/2009WAF2222261.1.
64. Mass, C. F., D. Ovens, K. Westrick, B. A. Colle, 2002: Does increasing horizontal resolution produce more skillful forecasts Bull. Amer. Meteor. Soc., 83, 407-430, https://doi.org/10.1175/1520-0477(2002)0830407:DIHRPM2.3.CO;2.
65. McTaggart-Cowan, R., 2009: Dphase-cmcgemh: Regional GEM model high resolution forecast run by CMC for the MAP D-PHASE project. World Data Center for Climate, accessed 11 July 2013, https://doi.org/10.1594/WDCC/dphase-cmcgemh.
66. Milbrandt, J. A., S. Bélair, M. Faucher, M. Valleé, M. Carrera, A. Glazer, 2016: The Pan-Canadian High Resolution (2.5 km) Deterministic Prediction System. Wea. Forecasting, 31, 1791-1816, https://doi.org/10.1175/WAF-D-16-0035.1.
67. Mittermaier, M. P., 2014: A strategy for verifying near-convection-resolving forecasts at observing sites. Wea. Forecasting, 29, 185-204, https://doi.org/10.1175/WAF-D-12-00075.1.
68. -., N. Roberts, 2010: Intercomparison of spatial forecast verification methods: Identifying skillful spatial scales using the fractions skill score. Wea. Forecasting, 25, 343-354, https://doi.org/10.1175/2009WAF2222260.1.
69. -., R. Bullock 2013: Using MODE to explore the spatial and temporal characteristics of cloud cover forecasts from high-resolution NWP models. Meteor. Appl 20, 187-196, https://doi.org/10.1002/met.1393.
70. -., G. Csima 2017: Ensemble versus deterministic performance at the kilometer scale. Wea. Forecasting, 32, 1697-1709, https://doi.org/10.1175/WAF-D-16-0164.1
71. -., N. Roberts, S. A. Thompson, 2013: A long-term assessment of precipitation forecast skill using the fractions skill score. Meteor. Appl., 20, 176-186, https://doi.org/10.1002/met.296
72. -., R. North, A. Semple, R. Bullock, 2016: Feature-based diagnostic evaluation of global NWP forecasts. Mon. Wea. Rev., 144, 3871-3893, https://doi.org/10.1175/MWR-D-15-0167.1.
73. Montani, A., C. Marsigli, T. Paccagnella, 2009: Dphase-cleps: COSMO-LEPS forecasts run by ARPA-SIM for the MAP D-PHASE project. World Data Center for Climate, accessed 11 July 2013. https://doi.org/10.1594/WDCC/dphase-cleps
74. -., D. Cesari, C. Marsigli, T. Paccagnella, 2011: Seven years of activity in the field of mesoscale ensemble forecasting by the COSMO-LEPS system: Main achievements and open challenges. Tellus, 63A, 605-624, https://doi.org/10.1111/j.1600-0870.2010.00499.x
75. -., D. Alferov, E. Astakhova, C. Marsigli, T. Paccagnella, 2014: Ensemble forecasting for Sochi-2014 Olympics: The COSMO-based ensemble prediction systems. COSMO Newsletter, No. 14, Consortium for Small-Scale Modeling, Offenbach, Germany, 88-94, www.cosmo-model.org/content/model/documentation/newsLetters/newsLetter16/cnl16-06.pdf.
76. Nachamkin, J. E., 2004: Mesoscale verification using meteorological composites. Mon. Wea. Rev., 132, 941-955, https://doi.org/10.1175/1520-0493(2004)1320941:MVUMC2.0.CO;2.
77. -., 2009: Application of the composite method to the Spatial Forecast Verification Methods Intercomparison dataset. Wea. Forecasting, 24, 1390-1400, https://doi.org/10.1175/2009WAF2222225.1.
78. Nan, Z., S. Wang, X. Liang, T. Adams, W. Teng, Y. Liang, 2010: Analysis of spatial similarities between NEXRAD and NLDAS precipitation data products. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 3, 371-385, https://doi.org/10.1109/JSTARS.2010.2048418.
79. Peli, T., D. Malah, 1982: A study of edge detection algorithms. Comput. Graphics Image Process., 20, 1-21, https://doi.org/10.1016/0146-664X(82)90070-3.
80. Pratt, W. K., 1978: Digital Image Processing. Wiley, 750 pp.
81. Roberts, N. M., H. W. Lean, 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Mon. Wea. Rev., 136, 78-97, https://doi.org/10.1175/2007MWR2123.1.
82. Rotach, M. W., Coauthors, 2009: MAP D-PHASE: Real-time demonstration of weather forecast quality in the alpine region. Bull. Amer. Meteor. Soc., 90, 1321-1336, https://doi.org/10.1175/2009BAMS2776.1.
83. Schaffer, C. J., W. A. Gallus Jr., M. Segal, 2011: Improving probabilistic ensemble forecasts of convection through the application of QPF-POP relationships. Wea. Forecasting, 26, 319-336, https://doi.org/10.1175/2010WAF2222447.1.
84. Schwedler, B. R. J., M. E. Baldwin, 2011: Diagnosing the sensitivity of binary image measures to bias, location, event frequency within a forecast verification framework. Wea. Forecasting, 26, 1032-1044, https://doi.org/10.1175/WAF-D-11-00032.1.
85. Skamarock, W. C., Coauthors, 2008: A description of the Advanced Research WRF version 3. NCAR Tech. Note NCAR/TN-475+STR, 113 pp., https://doi.org/10.5065/D68S4MVH.
86. Skok, G., N. Roberts, 2016: Analysis of fractions skill score properties for random precipitation fields and ECMWF forecasts. Quart. J. Roy. Meteor. Soc., 142, 2599-2610, https://doi.org/10.1002/qj.2849
87. -., V. Hladnik, 2018: Verification of gridded wind forecasts in complex alpine terrain: A new wind verification methodology based on the neighborhood approach. Mon. Wea. Rev., 146, 63-75, https://doi.org/10.1175/MWR-D-16-0471.1.
88. Sobash, R. A., J. S. Kain, D. R. Bright, A. R. Dean, M. C. Coniglio, S. J. Weiss, 2011: Probabilistic forecast guidance for severe thunderstorms based on the identification of extreme phenomena in convection-allowing model forecasts. Wea. Forecasting, 26, 714-728, https://doi.org/10.1175/WAF-D-10-05046.1.
89. Steinacker, R., C. Häberli, W. Pöttschacher, 2000: A transparent method for the analysis and quality evaluation of irregularly distributed and noisy observational data. Mon. Wea. Rev., 128, 2303-2316, https://doi.org/10.1175/1520-0493(2000)1282303:ATMFTA2.0.CO;2
90. -., Coauthors, 2006: A mesoscale data analysis and downscaling method over complex terrain. Mon. Wea. Rev., 134, 2758-2771, https://doi.org/10.1175/MWR3196.1
91. -., D. Mayer, A. Steiner, 2011: Data quality control based on self-consistency. Mon. Wea. Rev., 139, 3974-3991, https://doi.org/10.1175/MWR-D-10-05024.1.
92. Steppeler, J., G. Doms, U. Schättler, H. Bitzer, A. Gassmann, U. Damrath, 2003: Meso-gamma scale forecasts using the nonhydrostatic model LM. Meteor. Atmos. Phys., 82, 75-96, https://doi.org/10.1007/s00703-001-0592-9.
93. Tang, Y., H. W. Lean, J. Bornemann, 2013: The benefits of the Met Office variable resolution NWP model for forecasting convection. Meteor. Appl., 20, 417-426, https://doi.org/10.1002/met.1300.
94. Taylor, K. E., R. J. Stouffer, G. A. Meehl, 2002: An overview of CMIP5 and the experiment design. Bull. Amer. Meteor. Soc., 93, 485-498, https://doi.org/10.1175/BAMS-D-11-00094.1.
95. Theis, S. E., A. Hense, U. Damrath, 2005: Probabilistic precipitation forecasts from a deterministic model: A pragmatic approach. Meteor. Appl., 12, 257-268, https://doi.org/10.1017/S1350482705001763.
96. Venugopal, V., S. Basu, E. Foufoula-Georgiou, 2005: A new metric for comparing precipitation patterns with an application to ensemble forecasts. J. Geophys. Res., 110, D08111, https://doi.org/10.1029/2004JD005395.
97. Wapler, K., M. Goeber, S. Trepte, 2012: Comparative verification of different nowcasting systems to support optimisation of thunderstorm warnings. Adv. Sci. Res., 8, 121-127, https://doi.org/10.5194/asr-8-121-2012.
98. Weniger, M., P. Friederichs, 2016: Using the SAL technique for spatial verification of cloud processes: A sensitivity analysis. J. Appl. Meteor. Climatol., 55, 2091-2108, https://doi.org/10.1175/JAMC-D-15-0311.1.
99. Wernli, H., C. Hofmann, M. Zimmer, 2009: Spatial Forecast Verification Methods Intercomparison Project: Application of the SAL technique. Wea. Forecasting, 24, 1472-1484, https://doi.org/10.1175/2009WAF2222271.1.
100. Weusthoff, T., F. Ament, M. Arpagaus, M. W. Rotach, 2010: Assessing the benefits of convection-permitting models by neighborhood verification: Examples from MAP D-PHASE. Mon. Wea. Rev., 138, 3418-3433, https://doi.org/10.1175/2010MWR3380.1.
101. Wood, N., Coauthors, 2014: An inherently mass-conserving semi-implicit semi-Lagrangian discretization of the deep-atmosphere global non-hydrostatic equations. Quart. J. Roy. Meteor. Soc., 140, 1505-1520, https://doi.org/10.1002/qj.2235.
102. Wulfmeyer, V., Coauthors, 2008: The Convective and Orographically Induced Precipitation Study: A research and development project of the World Weather Research Program for improving quantitative precipitation forecasting in low-mountain regions. Bull. Amer. Meteor. Soc., 89, 1477-1486, https://doi.org/10.1175/2008BAMS2367.1.
103. Zhu, M., V. Lakshmanan, P. Zhang, Y. Hong, K. Cheng, S. Chen, 2011: Spatial verification using a true metric. Atmos. Res., 102, 408-419, https://doi.org/10.1016/j.atmosres.2011.09.004.