Operational forecaster uncertainty needs and future roles

Weather and Forecasting

Volumn 23, Issue 6, 2008, Pages 1069-1084

  Novak, David R ^a   Bright, David R ^b   Brennan, Michael J ^c  

^a NOAA/National Weather Service   (United States)

^b UNIVERSITY OF OKLAHOMA   (United States)

^c NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADDED VALUES; COLLABORATIVE EFFORTS; CONCEPTUAL UNDERSTANDING; END PRODUCTS; FORECAST UNCERTAINTIES; IMPACT EVENTS; LIMITED DATUM; NATIONAL WEATHER SERVICES; NEW PRODUCTS; OPERATIONAL FORECASTERS; OPERATIONAL FORECASTS; TRAINING MATERIALS;

DISTRIBUTED COMPUTER SYSTEMS; FORECASTING; MANAGERS; SURVEYS;

UNCERTAINTY ANALYSIS;

COMMUNICATION; FORECASTING METHOD; INFORMATION; UNCERTAINTY ANALYSIS; WEATHER FORECASTING;

NORTH AMERICA; UNITED STATES;

EID: 65549083289     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/2008WAF2222142.1     Document Type: Article

References (86)

1. AMS, 2002: Enhancing weather information with probability forecasts. Bull. Amer. Meteor. Soc., 83, 450-452.
2. AMS, cited 2007: Ad hoc committee on uncertainty in forecasts charter. [Available online at http://www.ametsoc.org/boardpges/cwce/docs/BEC/ACUF/ Charter.pdf.]
3. Appenzeller, C., and H. C. Davies, 1992: Structure of stratospheric intrusions into the troposphere. Nature, 358, 570-572.
4. Arribas, A., K. B. Robertson, and K. R. Mylne, 2005: Test of a poor man's ensemble prediction system for short-range probability forecasting. Mon. Wea. Rev., 133, 1825-1839.
5. Baars, J. A., and C. F. Mass, 2005: Performance of National Weather Service forecasts compared to operational, consensus, and weighted model output statistics. Wea. Forecasting, 20, 1034-1047.
6. Bosart, L. F., 2003: Whither the weather analysis and forecasting process? Wea. Forecasting, 18, 520-529.
7. Bowler, N. E., A. Arribas, K. R. Mylne, K. B. Robertson, and S. E. Beare, 2008: The MOGREPS short-range ensemble prediction system. Quart. J. Roy. Meteor. Soc., 134, 703-722.
8. Bright, D. R., and P. A. Nutter, 2004: On the challenges of identifying the "best" ensemble member in operational forecasting. Preprints, 16th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., J11.3. [Available online at http://ams.confex.com/ams/pdfpapers/69092.pdf.]
9. Broad, K., A. Leiserowitz, J. Weinkle, and M. Steketee, 2007: Misinterpretations of the "cone of uncertainty" in Florida during the 2004 hurricane season. Bull. Amer. Meteor. Soc., 88, 651-667.
10. Brooks, H. E., M. S. Tracton, D. J. Stensrud, G. DiMego, and Z. Toth, 1995: Short-range ensemble forecasting: Report from a workshop, 25-27 July 1995. Bull. Amer. Meteor. Soc., 76, 1617-1624.
11. Bua, W. R., 2005: COMET ensemble prediction training. Preprints, 21st Conf. on Weather Analysis and Forecasting/17th Conf. on Numerical Weather Prediction, Washington, DC, Amer. Meteor. Soc., J2.7. [Available online at http://ams.confex.com/ams/pdfpapers/94545.pdf.]
12. Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. Mon. Wea. Rev., 125, 99-119.
13. Buizza, R., P. L. Houtekamer, Z. Toth, G. Pellerin, M. Wei, and Y. Zhu, 2005: A comparison of the ECMWF, MSC, and NCEP global ensemble prediction systems. Mon. Wea. Rev., 133, 1076-1097.
14. Carroll, E. B., and T. D. Hewson, 2005: NWP grid editing at the Met Office. Wea. Forecasting, 20, 1021-1033.
15. Cheng, W. Y. Y., and W. J. Steenburgh, 2007: Strengths and weaknesses of MOS, running-mean bias removal, and Kalman filter techniques for improving model forecasts over the western United States. Wea. Forecasting, 22, 1304-1318.
16. Colle, B. A., and M. Charles, 2007: Verification of extratropical cyclones within NCEP forecast models using an automated tracking algorithm. Preprints, 22nd Conf. on Weather Analysis and Forecasting/ 18th Conf. on Numerical Weather Prediction, Park City, UT, Amer. Meteor. Soc., 6B.3. [Available online at http://ams.confex.com/ams/ pdfpapers/124612.pdf.]
17. Davis, C. A., B. Brown, and R. Bullock, 2006a: Object-based verification of precipitation forecasts. Part I: Methodology and application to mesoscale rain areas. Mon. Wea. Rev., 134, 1772-1784.
18. Davis, C. A., B. Brown, and R. Bullock, 2006b: Object-based verification of precipitation forecasts. Part II: Application to convective rain systems. Mon. Wea. Rev., 134, 1785-1795.
19. Demirtas, M., and A. J. Thorpe, 1999: Sensitivity of short-range weather forecasts to local potential vorticity modifications. Mon. Wea. Rev., 127, 922-939.
20. Doswell, C. A., 2004: Weather forecasting by humans - heuristics and decision making. Wea. Forecasting, 19, 1115-1126.
21. Du, J., G. DiMego, M. S. Tracton, and B. Zhou, 2003: NCEP short-range ensemble forecasting (SREF) system: Multi-IC, multi-model and multi-physics approach. Research activities in atmospheric and oceanic modeling, J. Cote, Ed., CAS/JSC Working Group Numerical Experimentation Rep. 23, WMO/TD 1161, 5.09-5.10.
22. Durante, A. V., R. E. Hart, A. Watson, R. H. Grumm, and W. Drag, 2005: The development of forecast confidence measures using NCEP ensembles and their real-time implementation within NWS web-based graphical forecasts. Preprints, 18th Conf. on Probability and Statistics in the Atmospheric Sciences, Atlanta, GA, Amer. Meteor. Soc., 5.1. [Available online at http://ams.confex.com/ams/pdfpapers/100178.pdf.]
23. Ebert, E. E., 2001: Ability of a poor man's ensemble to predict the probability and distribution of precipitation. Mon. Wea. Rev., 129, 2461-2479.
24. Ebert, E. E., and J. L. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol., 239, 179-202.
25. Eckel, F. A., and C. F. Mass, 2005: Aspects of effective shortrange ensemble forecasting. Wea. Forecasting, 20, 328-350.
26. Friday, E. W., Jr., 1994: The modernization and associated restructuring of the National Weather Service: An overview. Bull. Amer. Meteor. Soc., 75, 43-52.
27. Fowle, M. A., and P. J. Roebber, 2003: Short-range (0-48 h) numerical prediction of convective occurrence, mode, and location. Wea. Forecasting, 18, 782-794.
28. Glahn, H. R., 2003: Comments on "IFPS and the future of the National Weather Service." Wea. Forecasting, 18, 1299-1304.
29. Glahn, H. R., and D. A. Lowry, 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11, 1203-1211.
30. Glahn, H. R., and D. P. Ruth, 2003: The new digital forecast database of the National Weather Service. Bull. Amer. Meteor. Soc., 84, 195-201.
31. Grumm, R. H., and R. Hart, 2001: Standardized anomalies applied to significant cold season weather events: Preliminary findings. Wea. Forecasting, 16, 736-754.
32. Guerin, R., G. Desroziers, and P. Arbogast, 2006: 4D-Var analysis of potential vorticity pseudo-observations. Quart. J. Roy. Meteor. Soc., 132, 1283-1298.
33. Hamill, T. M., and S. J. Colucci, 1997: Verification of Eta-RSM short-range ensemble forecasts. Mon. Wea. Rev., 125, 1312-1327.
34. Hamill, T. M., and J. S. Whitaker, 2006: Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Wea. Rev., 134, 3209-3229.
35. Hamill, T. M., J. S. Whitaker, and X. Wei, 2004: Ensemble reforecasting: Improving medium-range forecast skill using retrospective forecasts. Mon. Wea. Rev., 132, 1434-1447.
36. Hewson, T. D., 2002: A comparison of cyclone spectra in forecasts from the operational (G1) and new dynamics trial (NT) versions of the unified model - Aug to Dec 2001. Forecasting Research Tech. Rep. 376, Met Office, 15 pp. [Available online at http://www.metoffice.gov.uk/research/ nwp/publications/papers/technical_reports/2002/FRTR376/FRTR376.pdf.]
37. Homar, V., D. J. Stensrud, J. J. Levit, and D. R. Bright, 2006: Value of human-generated perturbations in short-range ensemble forecasts of severe weather. Wea. Forecasting, 21, 347-363.
38. Hoskins, B. J., M. E. McIntyre, and A. Q. Robertson, 1985: On the use and significance of isentropic potential vorticity maps. Quart. J. Roy. Meteor. Soc., 111, 877-946.
39. Houtekamer, P. L., and J. Derome, 1995: Methods for ensemble prediction. Mon. Wea. Rev., 123, 2181-2196.
40. Houtekamer, P. L., J. Derome, H. Ritchie, and H. L. Mitchell, 1996: A system simulation approach to ensemble prediction. Mon. Wea. Rev., 124, 1225-1242.
41. Jones, M. S., and B. A. Colle, 2007: Evaluation of a mesoscale short-range ensemble forecast system over the northeast United States. Wea. Forecasting, 22, 36-55.
42. Joslyn, S., K. Pak, D. Jones, J. Pyles, and E. Hunt, 2007: The effect of probabilistic information on threshold forecasts. Wea. Forecasting, 22, 804-812.
43. Kain, J. S., M. E. Baldwin, P. R. Janish, S. J. Weiss, M. P. Kay, and G. W. Carbin, 2003a: Subjective verification of numerical models as a component of a broader interaction between research and operations. Wea. Forecasting, 18, 847-860.
44. Kain, J. S., P. R. Janish, S. J. Weiss, M. E. Baldwin, R. Schneider, and H. E. Brooks, 2003b: Collaboration between forecasters and research scientists at the NSSL and SPC: The Spring Program. Bull. Amer. Meteor. Soc., 84, 1797-1806.
45. Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation, and Predictability. Cambridge University Press, 341 pp.
46. Katz, R. W., and A. H. Murphy, 1997: Economic Value of Weather and Climate Forecasts. Cambridge University Press, 238 pp.
47. Keith, R., 2003: Optimization of value of aerodrome forecasts. Wea. Forecasting, 18, 808-824.
48. Lawson, J. D., J. P. Tuell, F. P. Griffith, and R. K. Henry, 2007: Overview of the AWIPS SOA. Preprints, 23rd Int. Conf. on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, San Antonio, TX, Amer. Meteor. Soc., P2.2.
49. Legg, T. P., and K. R. Mylne, 2004: Early warnings of severe weather from ensemble forecast information. Wea. Forecasting, 19, 891-906; Corrigendum, 22, 216-219.
50. Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev., 102, 409-418.
51. Leutbecher, M., 2005: On ensemble prediction using singular vectors started from forecasts. Mon. Wea. Rev., 133, 3038-3046.
52. Magsig, M. A., and E. M. Page, 2003: Weather event simulator implementation and future development. Preprints, 20th Int. Conf. on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, Long Beach, CA, Amer. Meteor. Soc., 12.9.
53. Marsigli, C., F. Boccanera, A. Montani, and T. Paccagnella, 2005: The COSMO-LEPS mesoscale ensemble system: Validation of the methodology and verification. Nonlinear Processes Geophys., 12, 527-536.
54. Mass, C. F., 2003: IFPS and the future of the National Weather Service. Wea. Forecasting, 18, 75-79.
55. Mass, C. F., and Coauthors, 2003: Regional environmental prediction over the Pacific Northwest. Bull. Amer. Meteor. Soc., 84, 1353-1366.
56. Matthieu, P., and P. Arbogast, 2005: A cyclogenesis evolving into two distinct scenarios and its implications for short-term ensemble forecasting. Mon. Wea. Rev., 133, 2016-2029.
57. McEnery, J., J. Ingram, Q. Duan, T. Adams, and L. Anderson, 2005: NOAA's advanced hydrologic prediction service: Building pathways for better science in water forecasting. Bull. Amer. Meteor. Soc., 86, 375-385.
58. Morss, R. E., and F. M. Ralph, 2007: Use of information by National Weather Service forecasters and emergency managers during CALJET and PACJET-2001. Wea. Forecasting, 22, 539-555.
59. Morss, R. E., J. L. Demuth, and J. K. Lazo, 2008: Communicating uncertainty in weather forecasts: A survey of the U.S. public. Wea. Forecasting, 23, 974-991.
60. Molteni, F., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The ECMWF Ensemble Prediction System: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73-119.
61. NRC, 2006: Completing the Forecast: Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts. National Academies Press, 124 pp.
62. Palmer, T., and R. Hagedorn, 2006: Predictability of Weather and Climate. Cambridge University Press, 718 pp.
63. Payne, K. A., R. L. Elsberry, and M. A. Boothe, 2007: Assessment of western North Pacific 96- and 120-h track guidance and present forecastability. Wea. Forecasting, 22, 1003-1015.
64. Pielke, R. A., Jr., 1999: Who decides? Forecasts and responsibilities in the 1997 Red River floods. Appl. Behav. Sci. Rev., 7, 83-101.
65. Raftery, A. E., T. Gneiting, F. Balabdaoui, and M. Polakowski, 2005: Using Bayesian model averaging to calibrate forecast ensembles. Mon. Wea. Rev., 133, 1155-1174.
66. Roebber, P. J., D. M. Schultz, and R. Romero, 2002: Synoptic regulation of the 3 May 1999 tornado outbreak. Wea. Forecasting, 17, 399-429.
67. Roebber, P. J., D. M. Schultz, B. A. Colle, and D. J. Stensrud, 2004: Toward improved prediction: High-resolution and ensemble modeling systems in operations. Wea. Forecasting, 19, 936-949.
68. Roulston, M. S., and T. R. Kaplan, 2008: A laboratory-based study of understanding of uncertainty in 5-day site-specific temperature forecasts. Meteor. Appl., in press.
69. Rutledge, G. K., J. Alpert, and W. Ebisuzaki, 2006: NOMADS: A climate and weather model archive at the National Oceanic and Atmospheric Administration. Bull. Amer. Meteor. Soc., 87, 327-341.
70. Santurette, P., and C. G. Georgiev, 2005: Weather Analysis and Forecasting. Academic Press, 200 pp.
71. Sivillo, J. K., J. E. Ahlquist, and Z. Toth, 1997: An ensemble forecasting primer. Wea. Forecasting, 12, 809-818.
72. Stensrud, D. J., and N. Yussouf, 2003: Short-range ensemble predictions of 2-m temperature and dewpoint temperature over New England. Mon. Wea. Rev., 131, 2510-2524.
73. Stuart, N. A., and R. H. Grumm, 2006: Using wind anomalies to forecast East Coast winter storms. Wea. Forecasting, 21, 952-968.
74. Stuart, N. A., and Coauthors, 2006: The future of humans in an increasingly automated forecast process. Bull. Amer. Meteor. Soc., 87, 1497-1502.
75. Stuart, N. A., D. M. Schultz, and G. Klein, 2007: Maintaining the role of humans in the forecast process: Analyzing the psyche of expert forecasters. Bull. Amer. Meteor. Soc., 88, 1893-1898.
76. Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74, 2317-2330.
77. Toth, Z., and S. J. Majumdar, 2007: NOAA THORPEX science workshop. Bull. Amer. Meteor. Soc., 88, 717-719.
78. Walser, A., M. Arpagaus, C. Appenzeller, and M. Leutbecher, 2006: The impact of moist singular vectors and horizontal resolution on short-range limited-area ensemble forecasts for two European winter storms. Mon. Wea. Rev., 134, 2877-2887.
79. Watkin, H., and T. Hewson, 2006: The development of featurebased diagnostics to assess TIGGE handling of high-impact extratropical cyclones. Preprints, Second THORPEX Int. Science Symp., Landshut, Germany, WMO, 258-259.
80. Weiss, S. J., D. R. Bright, J. S. Kain, J. J. Levit, M. E. Pyle, Z. I. Janjic, B. S. Ferrier, and J. Du, 2006: Complementary use of short-range ensemble and 4.5 km WRF-NMM model guidance for severe weather forecasting at the Storm Prediction Center. Preprints, 23rd Conf. on Severe Local Storms, St. Louis, MO, Amer. Meteor. Soc., 8.5. [Available online at http://ams.confex.com/ams/pdfpapers/115386.pdf.]
81. WMO, 2003: 21st status report on the implementation of the World Weather Watch - 2003. WMO 957, 61 pp.
82. WMO, cited 2007: The Observing System Research and Predictability Experiment (THORPEX) programme. [Available online at http://www.wmo.ch/ pages/prog/arep/thorpex/.]
83. Woodcock, F., and C. Engel, 2005: Operational consensus forecasts. Wea. Forecasting, 20, 101-111.
84. Yuan, H., X. Gao, S. Mullen, S. Sorooshian, J. Du, and H.-M. H. Juang, 2007: Calibration of probabilistic quantitative precipitation forecasts with an artificial neural network. Wea. Forecasting, 20, 1287-1303.
85. Yussouf, N., and D. J. Stensrud, 2007: Bias-corrected short-range ensemble forecasts of near-surface variables during the 2005/06 cool season. Wea. Forecasting, 22, 1274-1286.
86. Yussouf, N., D. J. Stensrud, and S. Lakshmivarahan, 2004: Cluster analysis of multimodel ensemble data over New England. Mon. Wea. Rev., 132, 2452-2462.