Automation and human expertise in operational river forecasting

Wiley Interdisciplinary Reviews: Water

Volumn 3, Issue 5, 2016, Pages 692-705

  Pagano, Thomas C ^a   Pappenberger, Florian ^b   Wood, Andrew W ^c   Ramos, Maria Helena ^d   Persson, Anders ^e   Anderson, Brett ^a  

^a BUREAU OF METEOROLOGY   (Australia)

^b EUROPEAN CENTRE FOR MEDIUM RANGE WEATHER FORECASTS   (United Kingdom)

^c NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^d CEMAGREF   (France)

^e UPPSALA UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85026653771     PISSN: None     EISSN: 20491948     Source Type: Journal    
DOI: 10.1002/wat2.1163     Document Type: Review

References (71)

1. Cloke HL, Pappenberger F. Ensemble flood forecasting: a review. J Hydrol 2009, 375:613–626.
2. Liu Y, Weerts A, Clark M, Hendricks Franssen H, Kumar S, Moradkhani H, Seo D, Schwanenberg D, Smith P, van Dijk A. Advancing data assimilation in operational hydrologic forecasting: progresses, challenges, and emerging opportunities. Hydrol Earth Syst Sci Discuss 2012, 9:3415–3472.
3. Demargne J, Wu L, Regonda S, Brown J, Lee H, He M, Seo D-J, Hartman R, Herr HD, Fresch M. The science of NOAA's operational hydrologic ensemble forecast service. Bull Am Meteorol Soc 2013, 95:79–98.
4. Kahneman D, Klein G. Conditions for intuitive expertise: a failure to disagree. Am Psychol 2009, 64:515–526.
5. Nicholls N. Cognitive illusions, heuristics, and climate prediction. Bull Am Meteorol Soc 1999, 80:1385–1398.
6. Skitka LJ, Mosier KL, Burdick M. Does automation bias decision-making? Int J Hum-Comput Stud 1999, 51:991.
7. Bureau d'Enquetes et d'Analyses. Final report on the accident on 1st June 2009 to the Airbus A330-203 registered F-GZCP operated by Air France flight AF 447 Rio de Janeiro–Paris. BEA; 2012. Available at: https://www.bea.aero/docspa/2009/f-cp090601.en/pdf/f-cp090601.en.pdf. Accessed 3 June 2016
8. IAEA. The role of automation and humans in nuclear power plants International Atomic Energy Agency; 1997. Available at: http://www-pub.iaea.org/books/IAEABooks/930/The-Role-of-Automation-and-Humans-in-Nuclear-Power-Plants-Report-Prepared-Within-the-Framework-of-the-International-Working-Group-on-Nuclear-Power-Plant-Control-and-Instrumentation. Accessed 3 June 2016
9. Doswell CA III. Weather forecasting by humans-Heuristics and decision making. Weather Forecast 2004, 19:1115–1126.
10. Sills DML. On the MSC forecasters forums and the future role of the human forecaster. Bull Am Meteorol Soc 2009, 90:619–627.
11. Novak DR, Bright DR, Brennan MJ. Operational forecaster uncertainty needs and future roles. Weather Forecast 2008, 23:1069–1084.
12. Stuart NA, Market PS, Telfeyan B, Lackmann GM, Carey K, Brooks HE, Nietfeld D, Motta BC, Reeves K. The future of humans in an increasingly automated forecast process. Bull Am Meteorol Soc 2006, 87:1497–1502.
13. Stuart NA, Schultz DM, Klein G. Maintaining the role of humans in the forecast process. Bull Am Meteorol Soc 2007, 88:1893–1898.
14. Sene K. Hydrometeorology: Forecasting and Applications. New York: Springer; 2010.
15. Fine GA. Authors of the Storm: Meteorologists and the Culture of Prediction. Chicago, IL: University of Chicago Press; 2007.
16. Persson A, Grazzini F. User guide to ECMWF forecast products. Meteorol Bull 2005, 3:153–154.
17. Pappenberger F, Cloke HL, Persson A, Demeritt D. HESS opinions "on forecast (in) consistency in a hydro-meteorological chain: curse or blessing?". Hydrol Earth Syst Sci 2011, 15:2391–2400.
18. Pappenberger F, Stephens E, Thielen J, Salamon P, Demeritt D, Andel SJ, Wetterhall F, Alfieri L. Visualizing probabilistic flood forecast information: expert preferences and perceptions of best practice in uncertainty communication. Hydrol Process 2012, 27:132–146.
19. Pagano TC. Evaluation of Mekong River Commission operational flood forecasts, 2000–2012. Hydrol Earth Syst Sci Discuss 2013, 10:14433–14461.
20. Welles E, Sorooshian S, Carter G, Olsen B. Hydrologic verification: a call for action and collaboration. Bull Am Meteorol Soc 2007, 88:503–511.
21. Pielke RA Jr. Who decides? Forecasts and responsibilities in the 1997 Red River flood. Appl Behav Sci Rev 1999, 7:83–101.
22. Pagano TC, Wood AW, Ramos M-H, Cloke HL, Pappenberger F, Clark MP, Cranston M, Kavetski D, Mathevet T, Sorooshian S, et al. Challenges of operational river forecasting. J Hydrometeorol 2014, 15:1692–1707.
23. Pagano TC. International review of the role of automation in river forecasting systems. Bureau of Meteorology; 2013. Available at: https://www.researchgate.net/publication/255738177_International_Review_of_the_Role_of_Automation_in_River_Forecasting_Systems. Accessed 3 June 2016
24. Practical Action. Early warning saving lives. Available at: http://practicalaction.org/docs/region_nepal/early-warning-saving-lives.pdf. Accessed 3 June 2016
25. Wood AW, Schaake JC. Correcting errors in streamflow forecast ensemble mean and spread. J Hydrometeorol 2008, 9:132–148.
26. Franz KJ, Hogue TS, Sorooshian S. Operational snow modeling: addressing the challenges of an energy balance model for National Weather Service forecasts. J Hydrol 2008, 360:48–66.
27. Pagano TC, Wood AW, Werner K, Tama-Sweet R. Western U.S. water supply forecasting: a tradition evolves. EOS Trans Am Geophys Union 2014, 95:28–29.
28. Pagano TC, Garen DC, Perkins TR, Pasteris PA. Daily updating of operational statistical seasonal water supply forecasts for the western U.S. J Am Water Resour Assoc 2009, 45:767–778.
29. Adams T, Ostrowski J. Short lead-time hydrologic ensemble forecasts from numerical weather prediction model ensembles. In: World Environmental and Water Resources Congress. Providence, RI: American Society of Civil Engineers; 2010.
30. Price D, Hudson K, Boyce G, Schellekens J, Moore RJ, Clark P, Harrison T, Connolly E, Pilling C. Operational use of a grid-based model for flood forecasting. Proc ICE-Water Manage 2012, 165:65–77.
31. Werner M, Cranston M, Harrison T, Whitfield D, Schellekens J. Recent developments in operational flood forecasting in England, Wales and Scotland. Meteorol Appl 2009, 16:13–22.
32. Thielen J, Bartholmes J, Ramos M-H, De Roo A. The European flood alert system—part 1: concept and development. Hydrol Earth Syst Sci 2009, 13:125.
33. Alfieri L, Burek P, Dutra E, Krzeminski B, Muraro D, Thielen J, Pappenberger F. GloFAS—global ensemble streamflow forecasting and flood early warning. Hydrol Earth Syst Sci Discuss 2012, 9:12293–12332.
34. Bogner K, Pappenberger F. Multiscale error analysis, correction, and predictive uncertainty estimation in a flood forecasting system. Water Resour Res 2011, 47:W07524.
35. Hong Y, Adler RF, Hossain F, Curtis S, Huffman GJ. A first approach to global runoff simulation using satellite rainfall estimation. Water Resour Res 2007, 43:W08502, doi: 10.1029/2006WR005739
36. de Winter J, Dodou D. Why the Fitts list has persisted throughout the history of function allocation. Cogn Technol Work 2011, 16:1–11.
37. Sheridan TB. Task analysis, task allocation and supervisory control. In: Helander M, ed. Handbook of Human–Computer Interaction. Amsterdam: Elsevier; 1997, 87–105.
38. Ayton P, Fischer I. The hot hand fallacy and the gambler's fallacy: two faces of subjective randomness? Mem Cognit 2004, 32:1369–1378.
39. Stewart TR. Improving reliability of judgmental forecasts. In: Armstrong JS, ed. Principles of Forecasting: A Handbook for Researchers and Practitioners. New York: Springer Science & Business Media; 2001, 81–106.
40. McKenzie CR, Liersch MJ, Yaniv I. Overconfidence in interval estimates: what does expertise buy you? Organ Behav Hum Decis Process 2008, 107:179–191.
41. Mannes AE, Moore DA. A behavioral demonstration of overconfidence in judgment. Psychol Sci 2013, 24:1190–1197.
42. Murphy AH. What is a good forecast? An essay on the nature of goodness in weather forecasting. Weather Forecast 1993, 8:281–293.
43. Parasuraman R, Sheridan TB, Wickens CD. A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern A: Syst Hum 2000, 30:286.
44. Dawes RM. The robust beauty of improper linear models in decision making. Am Psychol 1979, 34:571–582.
45. Doswell CA III. Is there a role for humans in the NWS of the future? (Is there an NWS in our future at all?). Available at: http://www.flame.org/~cdoswell/forecasting/human_role/future_forecasters.html Accessed 3 June 2016.
46. Mosier KL, Palmer EA, Degani A. Electronic checklists: implications for decision making. In: Human Factors and Ergonomics Society Annual Meeting. Atlanta, GA: SAGE Publications; 1992.
47. Parasuraman R, Riley V. Humans and automation: use, misuse, disuse, abuse. Hum Factors 1997, 39:230.
48. Muir BM, Moray N. Trust in automation. Part II: experimental studies of trust and human intervention in a process control simulation. Ergonomics 1996, 39:429–460.
49. Lee JD, See KA. Trust in automation: designing for appropriate reliance. Hum Factors 2004, 46:50–80.
50. Pappenberger F, Ramos M-H, Cloke HL, Wetterhall F, Alfieri L, Bogner K, Mueller A, Salamon P. How do I know if my forecasts are better? Using benchmarks in hydrological ensemble prediction. J Hydrol 2015, 522:697–713.
51. Rose B, Eck D, Brown L, Tupaj A, Lidrbauch J, Bayer P, Merritt L, Winn D. A human over the loop forecast paradigm at The Weather Company (TWC). In: 27th Conference on Weather Analysis and Forecasting/23rd Conference on Numerical Weather Prediction; 2015. Available at: https://ams.confex.com/ams/27WAF23NWP/webprogram/Paper273492.html. Accessed 3 June 2016
52. Craven JP, Wiedenfeld J, Gagan J, Browning P, Just A, Greif C. The NWS central region extended forecast process. In: 38th National Weather Association Annual Meeting. Charleston, SC: National Weather Association; 2013.
53. Snellman LW. Operational forecasting using automated guidance. Bull Am Meteorol Soc 1977, 58:1036–1044.
54. Pliske RM, Crandall B, Klein G. Competence in weather forecasting. In: Smith K, Shanteau J, Johnson P, eds. Psychological Investigations of Competence in Decision Making. Cambridge: Cambridge University Press; 2004, 40–70.
55. Daipha P. Visual perception at work: lessons from the world of meteorology. Poetics 2010, 38:151–165.
56. Ruth D. Interactive forecast preparation—the future has come. Preprints. In: Interactive Symposium on the Advanced Weather Interactive Processing System (AWIPS). Orlando, FL: American Meteorological Society; 2002.
57. Doswell CA III, Maddox RA. The role of diagnosis in weather forecasting. In: 11th Conf. on Weather Forecasting and Analysis. Kansas City, MO: American Meteorological Society; 1986.
58. Roebber PJ, Schultz DM, Colle BA, Stensrud DJ. Toward improved prediction: high-resolution and ensemble modeling systems in operations. Weather Forecast 2004, 19:936–949.
59. McCarthy PJ, Ball D, Purcell W. Project Phoenix: optimizing the machine–person mix in high-impact weather forecasting. In: 22nd Conference on Weather Analysis and Forecasting/18th Conference on Numerical Weather Prediction. Park City, UT: American Meteorological Society; 2007.
60. Doswell CA III. The human element in weather forecasting. Natl Weather Dig 1986, 11:6–17.
61. Pagano TC, Garen D, Sorooshian S. Evaluation of official western U.S. seasonal water supply outlooks, 1922–2002. J Hydrometeorol 2004, 5:896–909.
62. Hapuarachchi HAP, Wang QJ, Pagano TC. A review of advances in flash flood forecasting. Hydrol Process 2011, 25:2771–2784.
63. Verkade J, Brown J, Reggiani P, Weerts A. Post-processing ECMWF precipitation and temperature ensemble reforecasts for operational hydrologic forecasting at various spatial scales. J Hydrol 2013, 501:73–91.
64. Zalachori I, Ramos M, Garçon R, Mathevet T, Gailhard J. Statistical processing of forecasts for hydrological ensemble prediction: a comparative study of different bias correction strategies. Adv Sci Res 2012, 8:135–141.
65. Schaake JC, Hamill TM, Buizza R, Clark M. HEPEX: the hydrological ensemble prediction experiment. Bull Am Meteorol Soc 2007, 88:1541–1547.
66. Pagano TC, Shrestha DL, Wang Q, Robertson D, Hapuarachchi P. Ensemble dressing for hydrological applications. Hydrol Process 2012, 27:106–116.
67. Rossa A, Haase G, Keil C, Alberoni P, Ballard S, Bech J, Germann U, Pfeifer M, Salonen K. Propagation of uncertainty from observing systems into NWP: COST-731 Working Group 1. Atmos Sci Lett 2010, 11:145–152.
68. Waser J, Ribicic H, Fuchs R, Hirsch C, Schindler B, Bloschl G, Groller M. Nodes on ropes: A comprehensive data and control flow for steering ensemble simulations. IEEE Trans Vis Comput Graph 2011, 17:1872–1881.
69. Blöschl G. Flood warning-on the value of local information. Int J River Basin Manage 2008, 6:41–50.
70. Cuo L, Pagano TC, Wang Q. A review of quantitative precipitation forecasts and their use in short-to medium-range streamflow forecasting. J Hydrometeorol 2011, 12:713–728.
71. Ramos M-H, Mathevet T, Thielen J, Pappenberger F. Communicating uncertainty in hydro-meteorological forecasts: mission impossible? Meteorol Appl 2010, 17:223–235.