Object-based evaluation of a numerical weather prediction model's performance through forecast storm characteristic analysis

Weather and Forecasting

Volumn 30, Issue 6, 2015, Pages 1451-1468

  Cai, Huaqing ^a   Dumais, Robert E ^b  

^a NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^b U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASPECT RATIO; FORECASTING; FUNCTION EVALUATION; NUMERICAL METHODS; NUMERICAL MODELS; PIXELS; STORMS;

CHARACTERISTIC ANALYSIS; CONVECTIVE STORMS; FORECAST EVALUATION; FRONTAL SYSTEM; FUNCTION OF TIME; HIGH RESOLUTION; NUMERICAL WEATHER PREDICTION MODELS; PRECIPITATION FORECAST;

WEATHER FORECASTING;

ATMOSPHERIC CONVECTION; NUMERICAL MODEL; PRECIPITATION ASSESSMENT; STORM; WEATHER FORECASTING;

UNITED STATES;

EID: 84953382865     PISSN: 08828156     EISSN: 15200434     Source Type: Journal    
DOI: 10.1175/WAF-D-15-0008.1     Document Type: Article

References (34)

1. Benjamin, S., S. S. Weygandt, J. M. Brown, and G. DiMego, 2011: Beyond the 2011 Rapid Refresh: Hourly updated numerical weather prediction guidance from NOAA for aviation from 2012-2020. Preprints, 15th Conf. on Aviation, Range, and Aerospace Meteorology, Los Angeles, CA, Amer. Meteor. Soc., 11.1. [Available online at https://ams.confex.com/ams/14Meso15ARAM/techprogram/paper_191236.htm.]
2. Burghardt, B. J., C. Evans, and P. J. Roebber, 2014: Assessing the predictability of convection initiation in the high plains using an object-based approach. Wea. Forecasting, 29, 403-418, doi:10.1175/WAF-D-13-00089.1.
3. Cai, H., M. Steiner, J. Pinto, P. He, S. Dettling, D. Albo, J. H. Gotway, and B. Brown, 2009: Scientific assessment and diagnostic evaluation of CoSPA 0-8 hour blended forecasts. The World Weather Research Program Symposium on Nowcasting and Very Short Range Forecasting, Whistler, BC, Canada, WMO,7.2. [Available online at https://www.wmo.int/pages/prog/arep/wwrp/new/documents/WSN09_program_booklet.pdf.]
4. Cai, H., M. Steiner, J. Pinto, P. He, B. G. Brown, and P. He, 2011: Assessment of numerical weather prediction model storm forecasts using an object-based approach. Preprints, 24th Conf. on Weather Analysis and Forecasting/20th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., 8A.5 [Available online at http://ams.confex.com/ams/91Annual/webprogram/Paper182479.html.]
5. Carbone, R. E., J. D. Tuttle, D. Ahijevych, and S. B. Trier, 2002: Inferences of predictability associated with warm season precipitation episodes. J. Atmos. Sci., 59, 2033-2056, doi:10.1175/1520-0469(2002)059,2033:IOPAWW.2.0.CO;2.
6. Casati, B., G.Ross, and D. B. Stephenson, 2004:Anew intensity-scale approach for the verification of spatial precipitation forecasts. Meteor. Appl., 11, 141-154, doi:10.1017/S1350482704001239.
7. Case, J. L., S. V. Kumar, J. Srikishen, and G. J. Jedlovec, 2011: Improving numerical weather predictions of summertime precipitation over the southeastern United States through a high-resolution initialization of the surface state. Wea. Forecasting, 26, 785-807, doi:10.1175/2011WAF2222455.1.
8. Clark, A. J., R. G. Bullock, T. L. Jensen, M. Xue, and F. Kong, 2014: Application of object-based time-domain diagnostics for tracking precipitation systems in convection-allowingmodels. Wea. Forecasting, 29, 517-542, doi:10.1175/WAF-D-13-00098.1.
9. Curtis, R. A., S. S. Weygandt, T. G. Smirnova, S. Benjamin, P. Hofmann, E. P. James, and D. A. Koch, 2010: High Resolution Rapid Refresh (HRRR): Recent enhancements and evaluation during the 2010 convective season. Preprints, 25th Conf. on Severe Local Storms, Denver, CO, Amer. Meteor. Soc., 9.2 [Available online at https://ams.confex.com/ams/25SLS/techprogram/paper_175722.htm.]
10. Davis, C., B. G. Brown, and R. Bullock, 2006a: Object-based verification of precipitation forecasts. Part I: Methods and application to mesoscale rain areas. Mon. Wea. Rev., 134, 1772-1784, doi:10.1175/MWR3145.1.
11. Davis, C., B. G. Brown, and R. Bullock, 2006b: Object-based verification of precipitation forecasts. Part II: Application to convective rain systems. Mon. Wea. Rev., 134, 1785-1795, doi:10.1175/ MWR3146.1.
12. Davis, C., B. G. Brown, and R. Bullock, and J. Halley-Gotway, 2009: The method for object-based diagnostic evaluation (MODE) applied to numerical forecasts from the 2005 NSSL/SPC Spring Program. Wea. Forecasting, 24, 1252-1267, doi:10.1175/2009WAF2222241.1.
13. Dixon, M., and G. Wiener, 1993: TITAN: Thunderstorm Identification, Tracking, Analysis and Nowcasting-A radar-based methodology. J. Atmos. Oceanic Technol., 10, 785-797, doi:10.1175/1520-0426(1993)010,0785:TTITAA.2.0.CO;2.
14. Dupree, W., D. Morse, M. Chan, X. Tao, C. Reiche, H. Iskenderian, and M. Wolfson, 2009: The 2008 CoSPA forecast demonstration. Preprints, Aviation, Range, and Aerospace Meteorology Special Symp. on Weather-Air Traffic Management Integration, Phoenix, AZ, Amer. Meteor. Soc., P1.1. [Available online at https://ams.confex.com/ams/pdfpapers/151488.pdf.]
15. Ebert, E. E., 2008: Fuzzy verification of high resolution gridded forecasts: A review and proposed framework. Meteor. Appl., 15, 51-64, doi:10.1002/met.25.
16. Ebert, E. E., and J. L. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol., 239, 179-202, doi:10.1016/S0022-1694(00)00343-7.
17. Gilleland, E., D. Ahijevych, B. G. Brown, B. Casati, and E. E. Ebert, 2009: Intercomparison of spatial forecast verification methods. Wea. Forecasting, 24, 1416-1430, doi:10.1175/ 2009WAF2222269.1.
18. Greene, D. R., and R. A. Clark, 1972: Vertically integrated liquid water-A new analysis tool. Mon. Wea. Rev., 100, 548-552, doi:10.1175/1520-0493(1972)100,0548:VILWNA.2.3.CO;2.
19. Huang, L., and Z. Meng, 2014: Quality of the target area for metrics with different nonlinearities in a mesoscale convective system. Mon. Wea. Rev., 142, 2379-2397, doi:10.1175/MWR-D-13-00244.1.
20. Johnson, A., and X. Wang, 2013: Object-based evaluation of a storm-scale ensemble during the 2009 NOAA Hazardous Weather Testbed Spring Experiment. Mon. Wea. Rev., 141, 1079-1098, doi:10.1175/MWR-D-12-00140.1.
21. Johnson, A., and X. Wang, F. Kong, and M. Xue, 2013: Object-based evaluation of the impact of horizontal grid spacing on convection-allowing forecasts. Mon. Wea. Rev., 141, 3413-3425, doi:10.1175/ MWR-D-13-00027.1.
22. Phillips, C., J. Pinto, M. Steiner, R. Rasmussen, N. Oien, and R. Bateman, 2008: Statistical assessment of explicit model forecasts of convection using a new object-based approach. Preprints, 13th Conf. on Aviation, Range, and Aerospace Meteorology, New Orleans, LA, Amer. Meteor. Soc., 11.5. [Available online at https://ams.confex.com/ams/pdfpapers/134547.pdf.]
23. Pinto, J., W. Dupree, S. Weygandt, M. Wolfson, S. Benjamin, and M. Steiner, 2010: Advances in the Consolidated Storm Prediction for Aviation (CoSPA). Preprints, 14th Conf. on Aviation, Range, and Aerospace Meteorology, Atlanta, GA, Amer. Meteor. Soc., J11.2. [Available online at https://ams.confex.com/ams/pdfpapers/163811.pdf.]
24. Pinto, J., J. Grim, and M. Steiner, 2015: Assessment of the High- Resolution Rapid Refresh model's ability to predict mesoscale convective systems using object-based evaluation. Wea. Forecasting, 30, 892-913, doi:10.1175/WAF-D-14-00118.1.
25. Roberts, N. M., and H. W. Lean, 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Mon. Wea. Rev., 136, 78-97, doi:10.1175/2007MWR2123.1.
26. Skamarock,W. C., 2004: Evaluating mesoscale NWP models using kinetic energy spectra. Mon. Wea. Rev., 132, 3019-3032, doi:10.1175/MWR2830.1.
27. Skamarock,W. C., J. B. Klemp, J. Dudhia, D. O. Gill, D. M. Barker, W. Wang, and J. G. Powers, 2005: A description of the Advanced Research WRF version 2. NCAR Tech. Note NCAR/TN- 4681STR, 88 pp. [Available online at http://www2.mmm.ucar.edu/wrf/users/docs/arw_v2_070111.pdf.]
28. Skok, G., J. Tribbia, and J. Rakovec, 2010: Object-based analysis and verification of WRF Model precipitation in the low- and midlatitude Pacific Ocean. Mon. Wea. Rev., 138, 4561-4575, doi:10.1175/2010MWR3472.1.
29. Thompson, G., R. Rasmussen, and K. Manning, 2004: Explicit forecasts ofwinter precipitation using an improvedmicrophysics scheme. Part I: Description and sensitivity analysis. Mon. Wea. Rev., 132, 519-542, doi:10.1175/1520-0493(2004)132,0519: EFOWPU.2.0.CO;2.
30. Weygandt, S. S., T. G. Smirnova, S. G. Benjamin, K. J. Brundage, S. R. Sahm, C. R. Alexander, and B. E. Schwartz, 2009: The High Resolution Rapid Refresh (HRRR): An hourly updated convection resolving model utilizing radar reflectivity assimilation from the RUC/RR. Preprints, 23rd Conf. on Weather Analysis and Forecasting/19th Conf. on Numerical Weather Prediction, Omaha, NE, Amer. Meteor. Soc., 15A.6. [Available online at https://ams.confex.com/ams/23WAF19NWP/techprogram/paper_154317.htm.]
31. Wilks, D. S., 2006: StatisticalMethods in Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.
32. Wolff, J. K., M. Harrold, T. Fowler, J. H. Gotway, L. Nance, and B. G. Brown, 2014: Beyond the basics: Evaluating modelbased precipitation forecasts using traditional, spatial, and object-based methods. Wea. Forecasting, 29, 1451-1472, doi:10.1175/WAF-D-13-00135.1.
33. Wolfson, M. M., and Coauthors, 2008: Consolidated Storm Prediction for Aviation (CoSPA). Integrated Communications, Navigation and Surveillance Conf., Bethesda, MD, IEEE, 1- 19, doi:10.1109/ICNSURV.2008.4559190.
34. Xiao, Q., and J. Sun, 2007: Multiple-radar data assimilation and short-range quantitative precipitation forecasting of a squall line observed during IHOP 2002. Mon. Wea. Rev., 135, 3381- 2404, doi:10.1175/MWR3471.1.