Evaluation of a probabilistic forecasting methodology for severe convective weather in the 2014 hazardous weather testbed

Weather and Forecasting

Volumn 30, Issue 6, 2015, Pages 1551-1570

  Karstens, Christopher D ^a,b   Stumpf, Greg ^a,c   Ling, Chen ^d   Hua, Lesheng ^e   Kingfield, Darrel ^a,b   Smith, Travis M ^a,b   Correia , James ^a,f   Calhoun, Kristin ^a,b   Ortega, Kiel ^a,b   Melick, Chris ^a,f   Rothfusz, Lans P ^b  

^a UNIVERSITY OF OKLAHOMA   (United States)

^b NATIONAL SEVERE STORMS LABORATORY   (United States)

^c NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

^d The University of Akron   (United States)

^e University of Oklahoma   (United States)

^f UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING; HAZARDS; METEOROLOGICAL PROBLEMS; PRECIPITATION (METEOROLOGY); PROBABILITY; STORMS; TESTBEDS;

EXCEEDANCE PROBABILITY; HAZARD IDENTIFICATION; NATIONAL OCEANIC AND ATMOSPHERIC ADMINISTRATION; NATIONAL WEATHER SERVICES; PROBABILISTIC FORECASTING; PROBABILISTIC FORECASTS; PROBABILITY THRESHOLD; VERIFICATION METHODOLOGY;

WEATHER FORECASTING;

PROBABILITY; SEVERE WEATHER; THUNDERSTORM; TORNADO; WARNING SYSTEM; WEATHER FORECASTING;

EID: 84953373321     PISSN: 08828156     EISSN: 15200434     Source Type: Journal    
DOI: 10.1175/WAF-D-14-00163.1     Document Type: Article

References (49)

1. Andra, D. L., Jr., E. M. Quoetone, and W. F. Bunting, 2002:Warning decision making: The relative roles of conceptualmodels, technology, strategy, and forecaster expertise on3 May 1999. Wea. Forecasting, 17, 559-566, doi:10.1175/1520-0434(2002)017,0559:WDMTRR.2.0.CO;2.
2. Ash, K. D., R. L. Schumann III, and G. C. Bowser, 2014: Tornadowarning trade-offs: Evaluating choices for visually communicatingrisk. Wea. Climate Soc., 6, 104-118, doi:10.1175/WCAS-D-13-00021.1.
3. Atkins, N. T., K. M. Butler, K. R. Flynn, and R. M. Wakimoto,2014: An integrated damage, visual, and radar analysis of the2013 Moore, Oklahoma, EF5 tornado. Bull. Amer. Meteor.Soc., 95, 1549-1561, doi:10.1175/BAMS-D-14-00033.1.
4. Boustead, J. M., and B. E. Mayes, 2014: The role of the human inissuing severe weather warnings. Proc. 27th Conf. on SevereLocal Storms, Madison, WI, Amer. Meteor. Soc., 4B.2. [Availableonline at https://ams.confex.com/ams/27SLS/webprogram/Paper254547.html.]
5. Brotzge, J., and W. Donner, 2013: The tornado warning process: A reviewof current research, challenges, and opportunities. Bull.Amer.Meteor. Soc., 94, 1715-1733, doi:10.1175/BAMS-D-12-00147.1.
6. Burgess, D., and Coauthors, 2014: 20 May 2013 Moore, Oklahoma,tornado: Damage survey and analysis. Wea. Forecasting, 29,1229-1237, doi:10.1175/WAF-D-14-00039.1.
7. Calhoun, K. M., T. M. Smith, D. M. Kingfield, J. Gao, and D. J.Stensrud, 2014: Forecaster use and evaluation of real-time3DVAR analyses during severe thunderstorm and tornadowarning operations in the Hazardous Weather Testbed. Wea.Forecasting, 29, 601-613, doi:10.1175/WAF-D-13-00107.1.
8. Cintineo, J. L., T. M. Smith, V. Lakshmanan, and S. Ansari, 2011:An automated system for processing the Multi-Year Reanalysisof Remotely Sensed Storms (MYRORSS). Proc. 27thConf. on Interactive Information Processing Systems, Seattle,WA, Amer. Meteor. Soc., J9.3. [Available online at https://ams.confex.com/ams/91Annual/webprogram/Paper182332.html.]
9. Cintineo, J. L., M. J. Pavolonis, J. M. Sieglaff, and D. T. Lindsey, 2014: Anempirical model for assessing the severe weather potential ofdeveloping convection. Wea. Forecasting, 29, 639-653,doi:10.1175/WAF-D-13-00113.1.
10. Clark, A. J., and Coauthors, 2012: An overview of the 2010 HazardousWeather Testbed Experimental Forecast ProgramSpring Experiment. Bull. Amer. Meteor. Soc., 93, 55-74,doi:10.1175/BAMS-D-11-00040.1.
11. Coleman, T. A., K. R. Knupp, J. Spann, J. B. Elliott, and B. E.Peters, 2011: The history (and future) of tornado warningdissemination in the United States. Bull. Amer. Meteor. Soc.,92, 567-582, doi:10.1175/2010BAMS3062.1.
12. Crum, T. D., and R. L. Alberty, 1993: The WSR-88D and theWSR-88D Operational Support Facility. Bull. Amer. Meteor.Soc., 74, 1669-1687, doi:10.1175/1520-0477(1993)074,1669:TWATWO.2.0.CO;2.
13. Davis, C., and F. Carr, 2000: Summary of the 1998 Workshopon Mesoscale Model Verification. Bull. Amer. MeteorSoc., 81, 809-819, doi:10.1175/1520-0477(2000)081,0809:SOTWOM.2.3.CO;2.
14. Doswell, C. A., III, 2004: Weather forecasting by humans-Heuristics and decision making. Wea. Forecasting, 19, 1115-1126, doi:10.1175/WAF-821.1.
15. Ferree, J., 2006: NOAA/National Weather Service's storm-basedwarnings. Preprints, 23rd Conf. Severe Local Storms, St. Louis,MO, Amer. Meteor. Soc., P11.6. [Available online at https://ams.confex.com/ams/pdfpapers/115513.pdf.]
16. Hansen, T. L., and Coauthors, 2010: Hazard information servicesvision. Preprints, 26th Conf. on Interactive Information andProcessing Systems (IIPS) for Meteorology, Oceanography,and Hydrology, Atlanta, GA, Amer. Meteor. Soc., 6B.4.[Available online at https://ams.confex.com/ams/90annual/techprogram/paper_159734.htm.]
17. Heinselman, P. L., D. S. LaDue, and H. Lazrus, 2012: Exploringimpacts of rapid-scan radar data on NWS warning decisions.Wea. Forecasting, 27, 1031-1044, doi:10.1175/WAF-D-11-00145.1.
18. Heinselman, P. L., D. S. LaDue, D. M. Kingfield, and R. Hoffman, 2015: Tornadowarning decisions using phased-array radar data. Wea. Forecasting,30, 57-78, doi:10.1175/WAF-D-14-00042.1.
19. Hitchens, N. M., H. E. Brooks, and M. P. Kay, 2013: Objectivelimits on forecasting skill of rare events. Wea. Forecasting, 28,525-534, doi:10.1175/WAF-D-12-00113.1.
20. Hoekstra, S., K. Klockow, R. Riley, J. Brotzge, H. Brooks, andS. Erickson, 2011: A preliminary look at the social perspectiveof Warn-on-Forecast: Preferred tornado warning lead timeand the general public's perceptions of weather risks. Wea.Climate Soc., 3, 128-140, doi:10.1175/2011WCAS1076.1.
21. Humphrey, T. W.,V. Lakshmanan, T.M. Smith, K. L. Ortega, B. T.Smith, and R. L. Thompson, 2014: Automated storm classificationfor the development of probabilistic hazard information.Proc. 26th Conf. on Weather Analysis andForecasting, Atlanta, GA, Amer. Meteor. Soc., J3.4.[Available online at https://ams.confex.com/ams/94Annual/webprogram/Paper239857.html.]
22. Karstens, C. D., T.M. Smith, K.M. Calhoun, A. J. Clark, C. Ling,G. J. Stumpf, and L. P. Rothfusz, 2014: Prototype tool development for creating probabilistic hazard information for severeconvective weather. Second Symp. onBuilding a Weather-ReadyNation: EnhancingOurNation's Readiness, Responsiveness, andResilience to High Impact Weather Events, Atlanta, GA, Amer.Meteor. Soc., 2.2. [Available online at https://ams.confex.com/ams/94Annual/webprogram/Paper241549.html.]
23. Kirschenbaum, S. S., J. G. Trafton, C. D. Schunn, and S. B.Trickett, 2014: Visualizing uncertainty: The impact on performance.Hum. Factors: J. Hum. Factors Ergon. Soc., 56, 509-520, doi:10.1177/0018720813498093.
24. Kuhlman, K. M., T. M. Smith, G. J. Stumpf, K. L. Ortega, and K. L.Manross, 2008: Experimental probabilistic hazard informationin practice: Results from the 2008 EWP Spring Program.Preprints, 24th Conf. on Severe Local Storms, Savannah, GA,Amer. Meteor. Soc., 8A.2. [Available online at https://ams.confex.com/ams/pdfpapers/142027.pdf.]
25. Lakshmanan, V., I. Adrianto, T. Smith, and G. Stumpf, 2005: Aspatiotemporal approach to tornado prediction. Proc. Int.Joint Conf. on Neural Networks, Montreal, QC, Canada,IEEE, doi:10.1109/IJCNN.2005.1556125.
26. Lakshmanan, V., K. Hondl, and R. Rabin, 2009: An efficient, general-purposetechnique for identifying storm cells in geospatial images. J. Atmos.Oceanic Technol., 26, 523-537, doi:10.1175/2008JTECHA1153.1.
27. Lee, B. D., andR. B. Wilhelmson, 1997: The numerical simulationof non-supercell tornadogenesis. Part I: Initiation and evolutionof pretornadic misocyclone circulations along a dryoutflow boundary. J. Atmos. Sci., 54, 32-60, doi:10.1175/1520-0469(1997)054,0032:TNSONS.2.0.CO;2.
28. Markowski, P., andY. Richardson, 2014:What we know and don'tknow about tornado formation. Phys. Today, 67, 26-31,doi:10.1063/PT.3.2514.
29. Markowski, P., E. N. Rasmussen, and J. M. Straka, 1998: The occurrence oftornadoes in supercells interacting with boundaries duringVORTEX-95. Wea. Forecasting, 13, 852-859, doi:10.1175/1520-0434(1998)013,0852:TOOTIS.2.0.CO;2.
30. Murphy, A. H., 1993: What is a good forecast? An essay onnature of goodness in weather forecasting. Wea. Forecasting,8, 281-293, doi:10.1175/1520-0434(1993)008,0281:WIAGFA.2.0.CO;2.
31. NOAA, 2005: NOAA remembers the Midwest's deadly 1965 PalmSunday tornado outbreak. [Available online at www.noaanews.noaa.gov/stories2005/s2418.htm.]
32. NOAA, 2007: Storm-based warnings team report.NOAATech. Rep.,45 pp. [Available online at www.nws.noaa.gov/sbwarnings/docs/Polygon_Report_Final.pdf.]
33. NOAA, 2011: NWS Central Region service assessment: Joplin,Missouri, tornado. National Weather Service, 35 pp.[Available online at www.nws.noaa.gov/om/assessments/pdfs/Joplin_tornado.pdf.]
34. NOAA, 2012: The historic tornadoes of April 2011. NWS ServiceAssessment, 76 pp. [Available online at www.nws.noaa.gov/os/assessments/pdfs/historic_tornadoes.pdf.]
35. NOAA, 2014a: May 2013 Oklahoma tornadoes and flash flooding.NWS ServiceAssessment, 63 pp. [Available online atwww.nws.noaa.gov/os/assessments/pdfs/13oklahoma_tornadoes.pdf.]
36. NOAA, 2014b: NOAA 5 year research and developmentplan 2013-2018. [Available online at http://nrc.noaa.gov/CouncilProducts/ResearchPlans/5YearRDPlan/ NOAA5YRPHome/StrategicApproachtoRD/Goals,Questions,Objectives,Targets/WeatherReadyNation/WeatherQ1.aspx.]
37. NOAA, 2015: NWS performance management-StormGen reports.[Available online at https://verification.nws.noaa.gov/stormdat/stormgen/index.aspx.]
38. Ortega, K. L., 2008: Severe weather warnings and warning verificationusing threat areas. M.S. thesis, School of Meteorology,University of Oklahoma, 50 pp.
39. Ortega, K. L., T. M. Smith, K. L. Manross, A. G. Kolodziej, K. A.Scharfenberg, A. Witt, and J. J. Gourley, 2009: The SevereHazards Analysis and Verification Experiment. Bull. Amer.Meteor. Soc., 90, 1519-1530, doi:10.1175/2009BAMS2815.1.
40. Ortega, K. L., T. M. Smith, J. Zhang, C. Langston, Y. Qi, S. E. Stevens, and J. E.Tate, 2012: The Multi-Year Reanalysis of Remotely SensedStorms (MYRORSS) project. Proc. 26th Conf. on SevereLocal Storms, Nashville, TN, Amer. Meteor. Soc., P4.74.[Available online at https://ams.confex.com/ams/26SLS/webprogram/Paper211413.html.]
41. Rothfusz,L., C. D. Karstens, andD.Hilderbrand, 2014: Forecasting acontinuum of environmental threats: Exploring next-generationforecasting of high impact weather. Eos, Trans.Amer.Geophys.Union, 95, 325-326, doi:10.1002/2014EO360001.
42. Simmons, K. M., and D. Sutter, 2005: WSR-88D radar, tornadowarnings, and tornado casualties. Wea. Forecasting, 20, 301-310, doi:10.1175/WAF857.1.
43. Stensrud, D. J., and Coauthors, 2009: Convective-scale warn-onforecastsystem: A vision for 2020. Bull. Amer. Meteor. Soc.,90, 1487-1499, doi:10.1175/2009BAMS2795.1.
44. Stensrud, D. J., and Coauthors, 2013: Progress and challenges withwarn-on-forecast. Atmos. Res., 123, 2-16, doi:10.1016/j.atmosres.2012.04.004.
45. Stumpf, G. J., 2012: The Experimental Warning Program at theNOAA Hazardous Weather Testbed: Experimenting withnew warning verification and service techniques. NWA ProfessionalDevelopment Committee Feature Article 2012-1, 5pp. [Available online at http://www.nwas.org/committees/professionaldevelopment/NWAPD-2012-1-Stumpf.pdf.]
46. Stumpf, G. J, T. M. Smith, K. Manross, and D. L. Andra, 2008: The ExperimentalWarning Program 2008 Spring Experiment at theNOAA Hazardous Weather Testbed. Extended Abstracts,24th Conf. on Severe Local Storms, Savannah, GA, Amer.Meteor. Soc., 8A.1. [Available online at https://ams.confex.com/ams/pdfpapers/141712.pdf.]
47. Sutter, D., and S. Erickson, 2010: The time cost of tornado warningsand the savings with storm-based warnings. Wea. Climate Soc.,2, 103-112, doi:10.1175/2009WCAS1011.1.
48. Thompson, R. L., R. Edwards, J. A. Hart, K. L. Elmore, andP. Markowski, 2003: Close proximity soundings within supercellenvironments obtained from the Rapid UpdateCycle. Wea. Forecasting, 18, 1243-1261, doi:10.1175/1520-0434(2003)018,1243:CPSWSE.2.0.CO;2.
49. Torres, S. M., and C. D. Curtis, 2007: Initial implementation ofsuper-resolution data on the NEXRAD network. Preprints,23rd Conf. on International Interactive Information and ProcessingSystems (IIPS) for Meteorology, Oceanography, andHydrology, San Antonio, TX, Amer. Meteor. Soc., 5B.10.[Available online at https://ams.confex.com/ams/pdfpapers/116240.pdf.]