Quantifying verification uncertainty by reference data variation

Meteorologische Zeitschrift

Volumn 21, Issue 3, 2012, Pages 259-277

  Gorgas, Theresa ^a   Dorninger, Manfred ^a  

^a UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS METHOD; ANALYSIS TOOLS; GRID RESOLUTION; HORIZONTAL RESOLUTION; INTERPOLATION METHOD; OBSERVATION DATA; OBSERVATION NETWORKS; RANDOM PERTURBATIONS; RE-SAMPLING APPROACH; REFERENCE DATA; REGULAR GRIDS; UNCERTAINTY ESTIMATION;

UNCERTAINTY ANALYSIS;

EXPERIMENTAL STUDY; MODEL TEST; MODEL VALIDATION; OBSERVATIONAL METHOD; PERFORMANCE ASSESSMENT; PERTURBATION; QUANTITATIVE ANALYSIS; TWO-DIMENSIONAL MODELING; UNCERTAINTY ANALYSIS; WAVELET ANALYSIS; WEATHER FORECASTING;

EID: 84874597825     PISSN: 09412948     EISSN: 16101227     Source Type: Journal    
DOI: 10.1127/0941-2948/2012/0325     Document Type: Conference Paper

References (60)

1. ACCADIA, C., S. MARIANI, A. LAVAGNINI, A. SPERANZA, 2003: Sensitivity of precipitation forecast skill scores to bilinear interpolation and a simple nearest-neighbour average method on high-resolution verification grids. - Wea. Forecast. 18, 918-932. (Pubitemid 37450301)
2. AHIJEVYCH, D., E. GILLELAND, B. BROWN, E. EBERT, 2009: Application of spatial forecast verification methods to gridded precipitation forecasts. - Wea. Forecast. 24, 1485-1497.
3. AHRENS, B., A. BECK, 2008: On upscaling of rain-gauge data for evaluating numerical weather forecasts. - Meteor. Atmos. Phys. 99, 155-167.
4. ALVERA-AZCÁRATE, A., A. BARTH, Z. B. BOUALLEGUE, M. RIXEN, J. M. BECKERS, 2007: Forecast verification of a 3D model of the Mediterranean Sea. The use of discrete wavelet transforms and EOFs in the skill assessment of spatial forecasts. - J. Marine. Syst. 65, 460-483. (Pubitemid 46241823)
5. AMENT, F., M. ARPAGAUS, 2009a: dphase-cosmoch2: COSMO model forecasts (2.2 km) run by MeteoSwiss for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-cosmoch2, DOI:10.1594/WDCC/dphase-cosmoch2.
6. AMENT, F., M. ARPAGAUS, 2009b: dphase-cosmoch7: COSMO model forecasts (7 km) run by MeteoSwiss for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-cosmoch7, DOI:10.1594/WDCC/dphase-cosmoch7.
7. AMENT, F., T. WEUSTHOFF, M. ARPAGAUS, 2010: Evaluation of MAP D-PHASE heavy precipitation alerts in Switzerland during summer 2007. - Atmos. Res. 100, 178-189.
8. AMODEI, M., J. STEIN, 2009: Deterministic and fuzzy verification methods for a hierarchy of numerical models. - Meteor. Appl. 16, 191-203.
9. BALDAUF, M., K. STEPHAN, S. KLINK, C. SCHRAFF, A. SEIFERT, J. FOERSTNER, T. REINHARDT, C.-J. LENZ, M. DENHARD, 2009: dphase-lmk: LMK (COSMO-DE) high resolution model forecasts run by DWD for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-lmk, DOI:10.1594/WDCC/dphase-lmk
10. BARNES, S.L., 1964: A technique for maximizing details in numerical weather map analysis. - J. Appl. Meteor. 3, 396-409.
11. BARNES, S.L., 1973: Mesoscale objective analysis using weighted time-series observations. - NOAA Tech. Memo. ERL NSSL, National Severe Storms Laboratory, Norman, OK 73069, [NTIS COM-73-10781] 62, 60 pp.
12. BICA, B., T. KNABL, R. STEINACKER, M. RATHEISER, M. DORNINGER, C. LOTTERANER, S. SCHNEIDER, B. CHIMANI, W. GEPP, S. TSCHANNETT, 2007: Thermally and dynamically induced pressure features over complex terrain from high-resolution analyses. - J. Appl. Meteor. Climatol. 46, 50-65. (Pubitemid 46210652)
13. BOWLER, N. E., 2006: Explicitly accounting for observation error in categorical verification of forecasts. - Mon. Wea. Rev. 134, 1600-1606. (Pubitemid 43950929)
14. BOWLER, N. E., A. ARRIBAS, K. R. MYLNE, 2008: The benefits of multianalysis and poor man's ensembles. - Mon.Wea. Rev. 136, 4113-4129.
15. BRIGGS, W., R. LEVINE, 1997: Wavelets and field forecast verification. - Mon. Wea. Rev. 125, 199-206.
16. CANDILLE, G., O. TALAGRAND, 2008: Impact of observational error on the validation of ensemble prediction systems. - Quart. J. Roy. Meteor. Soc. 134, 959-971.
17. CASATI, B., 2010: New developments of the intensityscale technique within the Spatial Verification Methods Intercomparison Project. - Wea. Forecast. 25, 113-143.
18. CASATI, B., G. ROSS, D. STEPHENSON, 2004: A new intensity-scale approach for the verification of spatial precipitation forecasts. - Meteor. Appl. 11, 141-154. (Pubitemid 38990949)
19. CASATI, B., L. J. WILSON, D. B. STEPHENSON, P. NURMI, A. GHELLI, M. POCERNICH, U. DAMRATH, E. E. EBERT, B. G. BROWN, S. MASON, 2008: Review forecast verification: current status and future directions. - Meteor. Appl. 15, 3-18.
20. CHERUBINI, T., A. GHELLI, F. LALAURETTE, 2002: Verification of precipitation forecasts over the Alpine region using a high-density observing network. - Wea. Forecast. 17, 238-249.
21. CSIMA, G., A. GHELLI, 2008: On the use of the intensityscale verification technique to assess operational precipitation forecasts. - Meteor. Appl. 15, 145-154.
22. DAUBECHIES, I., 1992: Ten Lectures on Wavelets. Chapter 1: The Why, What and How of Wavelets. - Society for Industrial and Applied Mathematics. Philadelphia. Pensylvania.
23. DAVISON, A.C., D.V. HINKLEY, 1997: Bootstrap Methods and their applications - Cambridge University Press, Cambridge, UK, 193.
24. DEUTSCH, C.V., 2002: Geostatistical Reservoir Modeling - Oxford University Press, Oxford, 162-166.
25. DORNINGER, M., S. SCHNEIDER, R. STEINACKER, 2008: On the interpolation of precipitation data over complex terrain. - Meteor. Atmos. Phys. 101, 175-189.
26. DORNINGER, M., T. GORGAS, T. SCHWITALLA, M. ARPAGAUS, M. ROTACH, V. WULFMEYER, 2009: Joint D-PHASE-COPS data set (JDC data set). Technical report. - http://cerawww.dkrz.de/WDCC/ui/BrowseExperiments.jsp?proj=JDC
27. EBERT, E. E., U. DAMRATH, W. WERGEN, M. E. BALDWIN, 2003: The WGNE assessment of short-term quantitative precipitation forecasts. - Bull. Amer. Meteor. Soc. 84, 481-492.
28. FERRO, C.A.T., 2007: A probability model for verifying deterministic forecasts of extreme events. -Wea. Forecast. 22, 1089-1100. (Pubitemid 350066120)
29. FREHLICH, R., 2011: The definition of truth for numerical weather prediction error statistics. - Quart. J. Roy. Meteor. Soc. 137, 84-98.
30. GERMANN, U., M. BERENGUER, D. SEMPERE-TORRES, M. ZAPPA, 2009: REAL - Ensemble radar precipitation estimation for hydrology in a mountainous region. - Quart. J. Roy. Meteor. Soc. 135, 445-456.
31. GHELLI, A., F. LALAURETTE, 2000: Verifying precipitation forecasts using upscaled observations. - ECMWF Newsletter 87, 9-17.
32. GILLELAND, E., D.A. AHIJEVYCH, B.G. BROWN, E.E. EBERT, 2010: Verifying forecasts spatially. - Bull. Amer. Meteor. Soc. 47, 1365-1373.
33. GÖBER, M., E. ZSÓTÉ R, D. S. RICHARDSON, 2008: Could a perfectmodel ever satisfy a naive forecaster? On grid box mean versus point verification. - Meteor. Appl. 15, 359-365.
34. GOOVAERTS, P., 1997: Geostatistics for Natural Resources Evaluation - Oxford University Press, Oxford, 59-63, 125-258, 266-271, 380-385.
35. GORGAS, T., M. DORNINGER, 2012: Concepts for a pattern-oriented analysis ensemble based on observational uncertainties. - Quart. J. Roy. Meteor. Soc. 138, 769-784, DOI:10.1002/qj.949
36. GORGAS, T.,M. DORNINGER, R. STEINACKER, 2009: High resolution analyses based on the D-PHASE & COPS GTS and non-GTS data set. - Ann. Meteor. 44, 94-95.
37. GOTWAY, C.A., B.M. RUTHERFORD, 1994: Stochastic simulation for imaging spatial uncertainty: Comparison and evaluation of available algorithms. - In: ARMSTRONG M., P. A. DOWD (Eds.): Geostatistical Simulations. - Proceedings of the Geostatistical Simulation Workshop, Fontainebleau, France, 27-28 May 1993, Kluwer Academic Publishers, Dordrecht, 1-22.
38. HAGEDORN, R., 2010: On the relative benefits of TIGGE multi-model forecasts and reforcast-calibrated EPS forecasts. - ECMWF Newsletter - Summer 2010 124, 17-23.
39. HARTKAMP, A. D., K. D. BEURS, A. STEIN, J. W. WHITE, 1999: Interpolation techniques for climate variables. - NRG-GIS Series. Mexico, D.F.: CIMMYT 99/01.
40. JOLLIFFE, I., 2007: Uncertainty and inference for verification measures. - Wea. Forecast. 22, 637-650. (Pubitemid 47086708)
41. JOLLIFFE, I.T., D.B. STEPHENSON (Eds.), 2003: Forecast Verification: A Practitioner's Guide in Atmospheric Sciences - Wiley.
42. KOCH, S.E., M. DESJARDIN, P.J. KOCIN, 1983: An interactive barnes objective map analysis scheme for use with satellite and conventional data. - J. Climate Appl. Meteor. 22, 1487-1503.
43. KRIGE, D.G., 1951: A statistical approach to some mine valuations problems at Witwatersrand. - Chem. Metal Mining Soc. South Afr. 52, 119-138.
44. MCTAGGART-COWAN, R., 2009a: dphase-cmcgemh: regional GEM model high resolution forecast run by CMC for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-cmcgemh, DOI:10.1594/WDCC/dphase-cmcgemh.
45. MCTAGGART-COWAN, R., 2009b: dphase-cmcgeml: regional GEM model high resolution forecast run by CMC for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-cmcgeml, DOI:10.1594/WDCC/dphase-cmcgeml.
46. MITTERMAIER, M., 2006: Using an intensity-scale technique to assess the added benefit of high resolution model precipitation forecasts. - Atmos. Sci. Lett. 7, 36-42. (Pubitemid 43905383)
47. NASH, J., J. SUTCLIFFE, 1970: River flow forecasting through conceptual models part I - A discussion of principles. - J. Hydrol. 10, 282-290.
48. OSBORN, T. J., M. HULME, 1997: Development of a relationship between station and grid-box rainday frequencies for climate model evaluation. - J. Climate 10, 1885-1908.
49. ROTACH, M. W., P. AMBROSETTI, C. APPENZELLER, M. ARPAGAUS, L. FONTANNAZ, F. FUNDEL, U. GERMANN, A. HERING, M. A. LINIGER, M. STOLL, A. WALSER, F. AMENT, H. S. BAUER, A. BEHRENDT, V. WULFMEYER, F. BOUTTIER, Y. SEITY, A. BUZZI,S. DAVOLIO, M. CORAZZA, M. DENHARD, M. DORNINGER, T. GORGAS, J. FRICK, C. HEGG, M. ZAPPA, C. KEIL, H. VOLKERT, C. MARSIGLI, A. MONTANI, R. MCTAGGART-COWAN, K. MYLNE, R. RANZI, E. RICHARD, A. ROSSA, D. SANTOSMUNOZ, C. SCHÄR, M. STAUDINGER, Y. WANG, J. WERHAHN, 2009a: MAP D-PHASE: Real-Time Demonstration of Weather Forecast Quality in the Alpine Region. - Bull. Amer. Meteor. Soc. 90, 1321-1336.
50. ROTACH, M. W., P. AMBROSETTI, C. APPENZELLER, M. ARPAGAUS, L. FONTANNAZ, F. FUNDEL, U. GERMANN, A. HERING, M. A. LINIGER, M. STOLL, A. WALSER, F. AMENT, H. S. BAUER, A. BEHRENDT, V. WULFMEYER, F. BOUTTIER, Y. SEITY, A. BUZZI, S. DAVOLIO, M. CORAZZA, M. DENHARD, M. DORNINGER, T. GORGAS, J. FRICK, C. HEGG, M. ZAPPA, C. KEIL, H. VOLKERT, C. MARSIGLI, A. MONTANI, R. MCTAGGART-COWAN, K. MYLNE, R. RANZI, E. RICHARD, A. ROSSA, D. SANTOSMUNOZ, C. SCHÄR, M. STAUDINGER, Y. WANG, J. WERHAHN, 2009b: Supplement to MAP D-PHASE: Real-Time Demonstration of Weather Forecast Quality in the Alpine Region: Additional Applications of the D-Phase Datasets. - Bull. Amer. Meteor. Soc. 90, 28-32.
51. SCHULZ, J.-P., M. DENHARD, 2009: dphase-lme: LME (COSMO-EU) model forecasts run by DWD for the MAP D-PHASE project. - World Data Center for Climate, http://dx.doi.org/DOI:10.1594/WDCC/dphase-lme, DOI:10.1594/WDCC/dphase- lme.
52. SIMMONS, A.J., A. HOLLINGSWORTH, 2002: Some aspects of the improvement in skill of numerical weather prediction. - Quart. J. Roy. Meteor. Soc. 128, 647-677.
53. STEINACKER, R., C. HÄBERLI, W. PÖTTSCHACHER, 2000: A transparent method for the analysis and quality evaluation of irregularly distributed ans noisy observational data. - Mon.Wea. Rev. 128, 2303-2316.
54. STEINACKER, R., M. RATHEISER, B. BICA, B. CHIMANI, M. DORNINGER, W. GEPP, C. LOTTERANER, S. SCHNEIDER, S. TSCHANNETT, 2006: A mesoscale data analysis and downscaling method over complex terrain. - Mon.Wea. Rev. 134, 2578-2771.
55. STEINACKER, R., D. MAYER, A. STEINER, 2011: Data quality control based on self-consistency. - Mon. Wea. Rev. 139, 3974-3991, Doi:10.1175/MWR-D-10-05024.1
56. TUSTISON, B., D. HARRIS, E. FOUFOULA-GEORGIOU, 2001: Scale issues in verification of precipitation forecasts. - J. Geo. Res. 106, 11775-11784.
57. WACKERNAGEL, H., 1998: Multivariate Geostatistics. An Introduction with Applications, 2nd, completely revised edition. - Springer Verlag, Heidelberg, Germany, 83ff.
58. WAHBA, G., J. WENDELBERGER, 1980: Some new mathematical methods for variational objective analysis using splines and cross validation. - Mon.Wea. Rev. 108, 1122-1143.
59. WILKS, D.S., 1995: Statistical Methods in the Atmospheric Sciences - Academic Press, 118 and other pages.
60. WULFMEYER, V., A. BEHRENDT, C. KOTTMEIER, U. CORSMEIER, C. BARTHLOTT, G. C. CRAIG, M. HAGEN, D. ALTHAUSEN, F. AOSHIMA, M. ARPAGAUS, H. S. BAUER, L. BENNETT, A. BLYTH, C. BRANDAU, C. CHAMPOLLION, S. CREWELL, G. DICK, P. D. GIROLAMO, M. DORNINGER, Y. DUFOURNET, R. EIGENMANN, R. ENGELMANN, C. FLAMANT, T. FOKEN, T. GORGAS, M. GRZESCHIK, J. HANDWERKER, C. HAUCK, H. HÖLLER, W. JUNKERMANN, N. KALTHOFF, C. KIEMLE, S. KLINK, M.. KÖNIG, L. KRAUSS, C. N. LONG, F. MADONNA, S. MOBBS, B. NEININGER, S. PAL, G. PETERS, G. PIGEON, E. RICHARD, M. W. ROTACH, H. RUSSCHENBERG, T. SCHWITALLA, V. SMITH, R. STEINACKER, J. TRENTMANN, D. D. TURNER, VAN J. BAELEN, S. VOGT, H. VOLKERT, T. WECKWERTH, H. WERNLI, A. WIESER, M. WIRTH, 2011: The Convective and Orographically-induced Precipitation Study (COPS): the scientific strategy, the field phase, and research highlights. - Quart. J. Roy. Meteor. Soc. 137, 3-30.