A probabilistic verification score for contours: Methodology and application to Arctic ice-edge forecasts

Quarterly Journal of the Royal Meteorological Society

Volumn 144, Issue 712, 2018, Pages 735-743

  Goessling, H F ^a   Jung, T ^a,b  

^a ALFRED WEGENER INSTITUTE FOR POLAR AND MARINE RESEARCH   (Germany)

^b UNIVERSITY OF BREMEN   (Germany)

Author keywords

Arctic sea ice edge; contour forecast; ensemble prediction; probabilistic score; spatial verification

Indexed keywords

CLIMATE MODELS; SEA ICE;

ARCTIC SEA ICE; CONTINUOUS RANKED PROBABILITY SCORES; COUPLED CLIMATE MODEL; ENSEMBLE PREDICTION; PROBABILISTIC FORECASTS; PROBABILISTIC SCORES; PROBABILISTIC VERIFICATION; SPATIAL VERIFICATIONS;

FORECASTING;

CLIMATE MODELING; ENSEMBLE FORECASTING; PREDICTION; PROBABILITY; SEA ICE; SPATIAL VARIATION;

ARCTIC OCEAN;

EID: 85051764925     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.3242     Document Type: Article

References (27)

1. Bauer, P., Magnusson, L., Thépaut, J.-N. and Hamill, T.M. (2016) Aspects of ECMWF model performance in polar areas. Quarterly Journal of the Royal Meteorological Society, 142(695), 583–596. https://doi.org/10.1002/qj.2449
2. Brier, G.W. (1950) Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78(1), 1–3
3. Casati, B., Wilson, L., Stephenson, D., Nurmi, P., Ghelli, A., Pocernich, M., Damrath, U., Ebert, E., Brown, B. and Mason, S. (2008) Forecast verification: current status and future directions. Meteorological Applications, 15(1), 3–18
4. Day, J.J., Tietsche, S., Collins, M., Goessling, H.F., Guemas, V., Guillory, A., Hurlin, W.J., Ishii, M., Keeley, S.P.E., Matei, D., Msadek, R., Sigmond, M., Tatebe, H. and Hawkins, E. (2016) The Arctic predictability and prediction on seasonal-to-interannual timescales (APPOSITE) data set version 1. Geoscientific Model Development, 9(6), 2255. https://doi.org/10.5194/gmd-9-2255-2016
5. Dorninger, M., Gilleland, E., Casati, B., Mittermaier, M., Ebert, E., Brown, B. and Wilson, L. (2018) The set-up of the Mesoscale Verification Inter-Comparison over Complex Terrain (MesoVICT) project. Bulletin of the American Meteorological Society. https://doi.org/10.1175/BAMS-D-17-0164.1. in press
6. Dukhovskoy, D.S., Ubnoske, J., Blanchard-Wrigglesworth, E., Hiester, H.R. and Proshutinsky, A. (2015) Skill metrics for evaluation and comparison of sea ice models. Journal of Geophysical Research: Oceans, 120(9), 5910–5931
7. Emmerson, C. and Lahn, G. (2012) Arctic Opening: Opportunity and Risk in the High North. London: Lloyd's and Chatham House
8. Ferro, C.A., Richardson, D.S. and Weigel, A.P. (2008) On the effect of ensemble size on the discrete and continuous ranked probability scores. Meteorological Applications, 15(1), 19–24. https://doi.org/10.1002/met.45
9. Gilleland, E., Ahijevych, D., Brown, B.G., Casati, B. and Ebert, E.E. (2009) Intercomparison of spatial forecast verification methods. Weather and Forecasting, 24(5), 1416–1430
10. Gneiting, T., Balabdaoui, F. and Raftery, A.E. (2007) Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society: Series B (Statistical Methodology, 69(2), 243–268. https://doi.org/10.1111/j.1467-9868.2007.00587.x
11. Gneiting, T. and Raftery, A.E. (2005) Weather forecasting with ensemble methods. Science, 310(5746), 248–249
12. Goessling, H.F., Tietsche, S., Day, J.J., Hawkins, E. and Jung, T. (2016) Predictability of the Arctic sea ice edge. Geophysical Research Letters, 43(4), 1642–1650. https://doi.org/10.1002/2015GL067232
13. Hersbach, H. (2000) Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather and Forecasting, 15(5), 559–570. https://doi.org/10.1175/1520-0434(2000)015<0559:dotcrp>2.0.CO;2
14. Jung, T., Gordon, N.D., Bauer, P., Bromwich, D.H., Chevallier, M., Day, J.J., Dawson, J., Doblas-Reyes, F., Fairall, C. and Goessling, H.F. (2016) Advancing polar prediction capabilities on daily to seasonal time scales. Bulletin of the American Meteorological Society, 97(9), 1631–1647. https://doi.org/10.1175/BAMS-D-14-00246.1
15. Matheson, J. and Winkler, R. (1976) Scoring rules for continuous probability distributions. Management Science, 22(10), 1087–1096
16. Mittermaier, M. and Roberts, N. (2010) Intercomparison of spatial forecast verification methods: identifying skilful spatial scales using the fractions skill score. Weather and Forecasting, 25(1), 343–354
17. Murphy, A.H. (1973) A new vector partition of the probability score. Journal of Applied Meteorology, 12(4), 595–600
18. Palmer, T.N. (2000) Predicting uncertainty in forecasts of weather and climate. Reports on Progress in Physics, 63(2), 71. https://doi.org/10.1088/0034-4885/63/2/201
19. Rackow, T., Goessling, H.F., Jung, T., Sidorenko, D., Semmler, T., Barbi, D. and Handorf, D. (2016) Towards multi-resolution global climate modeling with ECHAM6-FESOM. Part II: climate variability. Climate Dynamics, 50(7Ű8), 2369Ű2394. https://doi.org/10.1007/s00382-016-3192-6
20. Rickard, G.J., Lunnon, R.W. and Tenenbaum, J. (2001) The Met Office upper air winds: prediction and verification in the context of commercial aviation data. Meteorological Applications, 8(3), 351–360
21. Saetra, Ø., Hersbach, H., Bidlot, J.R. and Richardson, D.S. (2004) Effects of observation errors on the statistics for ensemble spread and reliability. Monthly Weather Review, 132(6), 1487–1501. https://doi.org/10.1175/1520-0493(2004)132<1487:eooeot>2.0.CO;2
22. Sidorenko, D., Rackow, T., Jung, T., Semmler, T., Barbi, D., Danilov, S., Dethloff, K., Dorn, W., Fieg, K., Gössling, H.F., Handorf, D., Harig, S., Hiller, W., Juricke, S., Losch, M., Schröter, J., Sein, D.V. and Wang, Q. (2015) Towards multi-resolution global climate modeling with ECHAM6–FESOM. Part I: model formulation and mean climate. Climate Dynamics, 44(3-4), 757–780. https://doi.org/10.1007/s00382-014-2290-6
23. Smith, L.C. and Stephenson, S.R. (2013) New Trans-Arctic shipping routes navigable by midcentury. Proceedings of the National Academy of Sciences of United States of America, 110(13), 4871–4872
24. Tietsche, S., Day, J.J., Guemas, V., Hurlin, W.J., Keeley, S.P.E., Matei, D., Msadek, R., Collins, M. and Hawkins, E. (2014) Seasonal to interannual Arctic sea ice predictability in current global climate models. Geophysical Research Letters, 41(3), 1035–1043. https://doi.org/10.1002/2013GL058755
25. Venugopal, V., Basu, S. and Foufoula-Georgiou, E. (2005) A new metric for comparing precipitation patterns with an application to ensemble forecasts. Journal of Geophysical Research: Atmospheres, 110(D8). https://doi.org/10.1029/2004JD005395
26. Vitart, F., Ardilouze, C., Bonet, A., Brookshaw, A., Chen, M., Codorean, C., Déqué, M., Ferranti, L., Fucile, E. and Fuentes, M. (2017) The Subseasonal to Seasonal (S2S) Prediction Project Database. Bulletin of the American Meteorological Society, 98(1), 163–173. https://doi.org/10.1175/BAMS-D-16-0017.1
27. Wilks, D. (2011) Statistical Methods in the Atmospheric Sciences Vol. 100. Cambridge, MA: Academic Press