Sequential streamflow assimilation for short-term hydrological ensemble forecasting

Journal of Hydrology

Volumn 519, Issue PD, 2014, Pages 2692-2706

  Abaza, Mabrouk ^a   Anctil, François ^a   Fortin, Vincent ^b   Turcotte, Richard ^c  

^a UNIVERSITÉ LAVAL   (Canada)

^b ENVIRONMENT CANADA   (Canada)

^c Centre d'Expertise Hydrique du Québec   (Canada)

Author keywords

Economic value; Ensemble Kalman filter; Ensemble streamflow forecasting; Performance; Reliability; Streamflow assimilation

Indexed keywords

KALMAN FILTERS; RELIABILITY; SOIL MOISTURE; STREAM FLOW;

DISTRIBUTED HYDROLOGICAL MODEL; ECONOMIC VALUES; ENSEMBLE KALMAN FILTER; ENSEMBLE PREDICTION SYSTEMS; HYDROLOGICAL FORECASTING; PERFORMANCE; PERFORMANCE AND RELIABILITIES; STREAMFLOW FORECASTING;

FORECASTING;

ENSEMBLE FORECASTING; HYDROLOGICAL MODELING; KALMAN FILTER; METEOROLOGY; PERFORMANCE ASSESSMENT; PREDICTION; RELIABILITY ANALYSIS; SOIL MOISTURE; STREAMFLOW;

EID: 84919880460     PISSN: 00221694     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jhydrol.2014.08.038     Document Type: Article

References (101)

1. Abaza M., Anctil F., Fortin V., Turcotte R. A comparison of the Canadian global and regional meteorological ensemble prediction systems for short-term hydrological forecasting. Mon. Weather Rev. 2013, 141:3462-3476.
2. Anderson J.L. An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 2001, 129:2884-2903.
3. Andreadis K.M., Lettenmaier D.P. Assimilating remotely sensed snow observations into a macroscale hydrology model. Adv. Water Resour. 2006, 29:872-886.
4. Boucher M.A., Tremblay D., Delorme L., Perreault L., Anctil F. Hydro-economic assessment of hydrological forecasting systems. J. Hydrol. 2012, 416-417:133-144.
5. Brocca L., Melone F., Moramarco T., Wagner W., Naeimi V., Bartalis Z., Hasenauer S. Improving runoff prediction through the assimilation of the ASCAT soil moisture product. Hydrol. Earth Syst. Sci. 2010, 14:1881-1893.
6. Burgers G., Van Leeuwen P.J., Evensen G. Analysis scheme in the ensemble kalman filter. Mon. Weather Rev. 1998, 126:1719-1724.
7. Camporese M., Paniconi C., Putti M., Salandin P. Ensemble Kalman filter data assimilation for a process-based catchment scale model of surface and subsurface flow. Water Resour. Res. 2009, 45:W10421. 10.1029/2008WR007031.
8. Candille G., Talagrand O. Evaluation of probabilistic prediction systems for a scalar variable. Q. J. Roy. Meteorol. Soc. 2005, 131:2131-2150.
9. Charron M., Pellerin G., Spacek L., Houtekamer P.L., Gagnon N., Mitchell H.L., Michelin L. Toward random sampling of model error in the Canadian ensemble prediction system. Mon. Weather Rev. 2010, 138:1877-1901.
10. Clark M.P., Rupp D.E., Woods R.A., Zheng X., Ibbitt R.P., Slater A.G., Schmidt J., Uddstrom M.J. Hydrological data assimilation with the ensemble Kalman filter: use of streamflow observations to update states in a distributed hydrological model. Adv. Water Res. 2008, 31:1309-1324.
11. CÔté, J., Bélair, S., Vaillancourt, P. A., Erfani, A., Gramann, U., 2003. The Canadian global environmental multiscale model: development and applications. In: Proceedings of the International Workshop on NWP Models for Heavy Precipitation in Asia and Pacific Areas, Tokyo, Japan, 18-24.
12. Crow W.T., Ryu D. A new data assimilation approach for improving runoff prediction using remotely-sensed soil moisture retrievals. Hydrol. Earth Syst. Sci. 2009, 13:1-16.
13. Daget, N., 2007. Revue des méthodes d'assimilation. Technical Report TR/CMGC/07/113 GLOBC - CERFACS, Montpellier.
14. De Lannoy G.J.M., Reichle R.H., Houser P.R., Pauwels V.R., Verhoest N.E. Correcting for forecast bias in soil moisture assimilation with the ensemble Kalman filter. Water Resour. Res. 2007, 43:W09410.
15. De Lannoy G.J.M., Reichle R.H., Arsenault K.R., Houser P.R., Kumar S., Verhoest N.E.C., Pauwels V.R.N. Multiscale assimilation of advanced microwave scanning radiometer. EOS snow water equivalent and moderate resolution imaging spectroradiometer snow cover fraction observations in northern Colorado. Water Resour. Res. 2012, 48:W01522.
16. DeChant C.M., Moradkhani H. Radiance data assimilation for operational snow and streamflow forecasting. Adv. Water Resour. Res. 2011, 34:351-364.
17. DeChant C., Moradkhani H. Improving the characterization of initial condition for ensemble streamflow prediction using data assimilation. Hydrol. Earth Syst. Sci. 2011, 15:3399-3410. 10.5194/hess-15-3399.
18. Dechant C.M., Moradkhani H. Examining the effectiveness and robustness of sequential data assimilation methods for quantification of uncertainty in hydrologic forecasting. Water Resour. Res. 2012, 48(4):W04518.
19. Dumedah G. Formulation of the evolutionary-based data assimilation, and its practical implementation. Water Resour. Manage. 2012, 26(13):3853-3870.
20. Dumedah G., Coulibaly P. Integration of an evolutionary algorithm into the ensemble Kalman filter, and the particle filter for hydrologic data assimilation. J. Hydroinform. 2013, 10.2166/hydro.2013.088.
21. Dumedah G., Coulibaly P. Evaluating forecasting performance for data assimilation methods: the Ensemble Kalman Filter, the particle filter, and the evolutionary-based assimilation. Adv. Water Resour. 2013, 60:47-63.
22. Durand M., Kim E.J., Margulis S.A. Radiance assimilation shows promise for snowpack characterization. Geophys. Res. Lett. 2009, 36:L02503.
23. Ehrendorfer M. Predicting the uncertainty of numerical weather forecasts: a review. Meteorol. Z. 1997, 6:147-183.
24. Evensen G. Sequential data assimilation with non-linear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 1994, 99:10143-10162.
25. Evensen G. Advanced data assimilation for strongly nonlinear dynamics. Mon. Weather Rev. 1997, 125:1342-1354.
26. Evensen G. The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 2003, 53:343-367.
27. Fillion L., Tanguay M., Lapalme E., Denis B., Desgagne M., Lee V., Ek N., Liu Z., Lajoie M., Caron J.F., Pagé C. The Canadian regional data assimilation and forecasting system. Weather Forecast. 2010, 25:1645-1669.
28. Fortin J.P., Moussa R., Bocquillon C., Villeneuve J.P. Hydrotel, un modèle hydrologique distribué pouvant bénéficier des données fournies par la télédétection et les systèmes d'information géographique. Water Sci. Rev. 1995, 8:97-124.
29. Fortin J.-P., Turcotte R., Massicotte S., Moussa R., Fitzback J. A distributed watershed model compatible with remote sensing and GIS data, part I: Description of the model. J. Hydrol. Eng. - Am. Soc. Civil Eng. 2001, 6(2):91-99.
30. Fortin V., Abaza M., Anctil F., Turcotte R. Why should ensemble spread match the RMSE of the ensemble mean?. J. Hydrometeorol. 2014, 15:1708-1713.
31. Franssen H.J., Kinzelbach W. Real-time groundwater flow modeling with the ensemble Kalman Filter: joint estimation of states and parameters and the filter inbreeding problem. Water Resour. Res. 2008, 44:W09408. 10.1029/2007WR006505.
32. Franssen H.J., Kaiser H.P., Kuhlmann U., Bauser G., Stauffer F., Muller R., Kinzelbach W. Operational real-time modeling with ensemble Kalman filter of variably saturated subsurface flow including stream-aquifer interaction and parameter updating. Water Resour. Res. 2011, 47:W02532. 10.1029/2010WR009480.
33. Franz K.J., Hogue T.S. Evaluating uncertainty estimates in hydrologic models: borrowing measures from the forecast verification community. Hydrol. Earth Syst. Sci. 2011, 15(11):3367-3382.
34. Franz K.J., Hartmann H.C., Sorooshian S., Bales R. Verification of national weather service ensemble streamflow predictions for water supply forecasting in the Colorado River basin. J. Hydrometeorol. 2003, 4:1105-1118.
35. Franz K.J., Hogue T.S., Sorooshian S. Snow model verification using ensemble prediction and operational benchmarks. J. Hydrometeorol. 2008, 9(6):1402-1415.
36. Gagnon, N., Coauthors, 2013. Improvements to the Global Ensemble Prediction System (GEPS) from version 2.0.3 to version 3.0.0. Tech. Note, Environment Canada, p. 88. http://collaboration.cmc.ec.gc.ca/cmc/cmoi/product_guide/docs/lib/op_systems/doc_opchanges/technote_geps300_20130213_e.pdf.
37. Gauthier P., Tanguay M., Laroche S., Pellerin S., Morneau J. Extension of 3DVAR to 4DVAR: implementation of 4DVAR at the Meteorological Service of Canada. Mon. Weather Rev. 2007, 135:2339-2354.
38. Hamill T.M. Interpretation of rank histograms for verifying ensemble forecasts. Mon. Weather Rev. 2001, 129:550-560.
39. Hersbach H. Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast. 2000, 15(5):559-570.
40. Holt H., Pullen J., Bishop C. Urban and ocean ensembles for improved meteorological and dispersion modeling of the coastal zone. Tellus 2009, 61A:232-249.
41. Kalman R.E. A new approach to linear filtering and prediction problem. J. Basic Eng. 1960, 82D:35-45.
42. Kolberg S., Gottschalk L. Interannual stability of grid cell snow depletion curves as estimated from MODIS images. Water Resour. Res. 2010, 46:W11555.
43. Komma J., Bloschl G., Reszler C. Soil moisture updating by Ensemble Kalman Filtering in real-time flood forecasting. J. Hydrol. 2008, 357:228-242.
44. Kuchment L.S., Romanov P., Gelfan A.N., Demidov V.N. Use of satellite-derived data for characterization of snow cover and simulation of snowmelt runoff through a distributed physically based model of runoff generation. Hydrol. Earth Syst. Sci. 2010, 14:339-350.
45. Kumar S.V., Reichle R.H., Koster R.D., Crow W.T., Peters-Lidard C.D. Role of subsurface physics in the assimilation of surface soil moisture observations. J. Hydrometeorol. 2009, 10:1534-1547.
46. Lee S., Klein A.G., Over T.M. A comparison of MODIS and NOHRSC snow-cover products for simulating streamflow using the Snowmelt Runoff Model. Hydrol. Process. 2005, 19:2951-2972.
47. Lee H., Seo D.-J., Koren V. Assimilation of streamflow and in situ soil moisture data into operational distributed hydrologic models: effects of uncertainties in the data and initial model soil moisture states. Adv. Water Resour. 2011, 34:1597-1615.
48. Lee H., Seo D.-J., Liu Y., Koren V., McKee P., Corby R. Variational assimilation of streamflow into operational distributed hydrologic model: effect of spatiotemporal adjustment scale. Hydrol. Earth Syst. Sci. 2012, 9:93-138.
49. Leisenring M., Moradkhani H. Snow water equivalent prediction using Bayesian data assimilation methods. Stoch. Environ. Res. Risk A 2011, 25:1-18.
50. Li Y., Ryu D., Western A.W., Wang Q.J. Assimilation of stream discharge for flood forecasting: the benefits of accounting for routing time lags. Water Resour. Res. 2013, 49(4):1887-1900.
51. Liston G.E., Hiemstra C.A. A simple data assimilation system for complex snow distributions (SnowAssim). J. Hydrometeorol. 2008, 9:989-1004.
52. Liu Y., Gupta H.V. Uncertainty in hydrologic modeling: toward an integrated data assimilation framework. Water Resour. Res. 2007, 43:1-18.
53. Liu Y., Weerts A.H., Clark M., Hendricks Franssen H.-J., Kumar S., Moradkhani H., Seo D.-J., Schwanenberg D., Smith P., van Dijk A.I.J.M., van Velzen N., He M., Lee H., Noh S.J., Rakovec O., Restrepo P. Advancing data assimilation in operational hydrologic forecasting: progresses, challenges, and emerging opportunities. Hydrol. Earth Syst. Sci. 2012, 16:3863-3887.
54. Lu H., Yu Z., Zhu Y., Drake S., Hao Z., Sudicky E.A. Dual state-parameter estimation of root zone soil moisture by optimal parameter estimation and extended Kalman filter data assimilation. Adv. Water Resour. 2011, 34:395-406.
55. Mandel, J., 2006. Efficient implementation of the ensemble Kalman filter (CCM Report 231, University of Colorado at Denver and Health Sciences Center).
56. Martin E., Thirel G., Regimbeau F., Noilhan J., Franchistéguy L., Soubeyroux J.M., Habets F. Vers une prévision d'ensemble des débits à l'échelle des grands bassins français. La houille blanche 2009, 5:88-94.
57. McMillan H.K., Hreinsson E.O., Clark M.P., Singh S.K., Zammit C., Uddstrom M.J. Operational hydrological data assimilation with the recursive ensemble Kalman filter. Hydrol. Earth Syst. Sci. 2013, 17:21-38.
58. Montzka C., Moradkhani H., Weihermuller L., Franssen H.J.H., Canty M., Vereecken H. Hydraulic parameter estimation by remotely-sensed top soil moisture observations with the particle filter. J. Hydrol. 2011, 399:410-421.
59. Moradkhani H., Sorooshian S. General review of rainfall runoff modeling: model calibration, data assimilation, and uncertainty analysis. Hydrological Modeling and Water Cycle, Coupling of the Atmospheric and Hydrological Models 2008, vol. 63:1-24. Springer, Water Science and Technology Library.
60. Moradkhani H., Sorooshian S., Gupta H.V., Houser P. Dual state parameter estimation of hydrologic models using ensemble Kalman filter. Adv. Water Resour. 2005, 28:135-147.
61. Moradkhani H., Hsu K.-L., Gupta H., Sorooshian S. Uncertainty assessment of hydrologic model states and parameters: sequential data assimilation using the particle filter. Water Resour. Res. 2005, 41(5):1-17.
62. Moradkhani H., DeChant C.M., Sorooshian S. Evolution of ensemble data assimilation for uncertainty quantification using the particle filter-Markov chain Monte Carlo method. Water Resour. Res. 2012, 48(12).
63. Nash J.E., Sutcliffe J.V. River flow forecasting through conceptual models: part I-a discussion of principles. J. Hydrol. 1970, 10:282-290.
64. Nie S., Zhu J., Luo Y. Simultaneous estimation of land surface scheme states and parameters using the ensemble Kalman filter: identical twin experiments. Hydrol. Earth Syst. Sci. 2011, 15:2437-2457.
65. Palmer T.N. The economic value of ensemble forecasts as a tool for risk assessment: from days to decades. Q. J. Roy. Meteorol. Soc. 2002, 128:147-174.
66. Pauwels V.R.N., De Lannoy G.J.M. Ensemble-based assimilation of discharge into rainfall-runoff models: a comparison of approaches to mapping observational information to state space. Water Resour. Res. 2009, 45:1-17.
67. Pauwels V.R., Hoeben R., Verhoest N.E., De Troch F.P. The importance of the spatial patterns of remotely sensed soil moisture in the improvement of discharge predictions for smallscale basins through data assimilation. J. Hydrol. 2001, 251:88-102.
68. Pellenq, J., Boulet, G., Chaponniere, A., Kerr, Y., 2003. Soil moisture assimilation in a coupled water/energy scheme in a semiarid region. In: Servat, E., Najem, W., Leduc, C., Shakeel, A., (Eds.), Conference on Hydrology of the Mediterranean and Semiarid Regions, Montpellier, France, 9-14.
69. Peters-Lidard C.D., Kumar S.V., Mocko D.M., Tian Y. Estimating evapotranspiration with land data assimilation systems. Hydrol. Process. 2011, 25:3979-3992.
70. Pham D.T. Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Weather Rev. 2001, 129:1194-1207.
71. Rabier F., Järvinen H., Kilnder E., Mahfouf J.-F., Simmons A. The ECMWF operational implementation of four-dimensional variational assimilation. Part I: Experimental results with simplified physics. Q. J. Roy. Meteorol. Soc. 2000, 126:1143-1170.
72. Rakovec O., Weerts A.H., Hazenberg P., Torfs P.J.J.F., Uijlenhoet R. State updating of a distributed hydrological model with ensemble Kalman filtering: effects of updating frequency and observation network density on forecast accuracy. Hydrol. Earth Syst. Sci. 2012, 16(9):3435-3449.
73. Rawlins F., Ballard S.P., Bovis K.J., Clayton M., Li D., Inverarity W., Lorenc A.C., Payne T.J. The met office global four-dimensional variational data assimilation scheme. Q. J. Roy. Meteorol. Soc. 2007, 133:347-362.
74. Reichle R.H. Data assimilation methods in the earth sciences. Adv. Water Resour. 2008, 31:1411-1418.
75. Reichle R., Walker J.P., Koster R.D., Houser P.-R. Extended versus ensemble Kalman filtering for land data assimilation. J. Hydrometeorol. 2002, 3:728-740.
76. Reichle R.H., Crow W.T., Keppenne C.L. An adaptive ensemble Kalman filter for soil moisture data assimilation. Water Resour. Res. 2008, 44:W03423.
77. Richardson D.S. Skill and relative economic value of ECMWF ensemble prediction system. Q. J. Roy. Meteorol. Soc. 2000, 126:649-667.
78. Rodell M., Houser P.R. Updating a land surface model with MODIS-derived snow cover. J. Hydrometeorol. 2004, 5:1064-1075.
79. Schaake J.C., Hamill T.M., Buizza R., Clark M. The hydrological ensemble prediction experiment. Bull. Am. Meteorol. Soc. 2007, 88:1541-1547.
80. Seiller G., Anctil F., Perrin C. Multimodel evaluation of twenty lumped hydrological models under contrasted climate conditions. Hydrol. Earth Syst. Sci. 2012, 16:1171-1189.
81. Senbeta D.A., Shamseldin A.Y., O'Connor K.M. Modification of the probability distributed interacting storage capacity model. J. Hydrol. 1999, 224:149-168.
82. Seo D.J., Koren V., Cajina N. Real-time variational assimilation of hydrologic and hydrometeorological data into operational hydrologic forecasting. J. Hydrometeorol. 2003, 4(3):627-641.
83. Seo D.J., Cajina L., Corby R., Howieson T. Automatic state updating for operational streamflow forecasting via variational data assimilation. J. Hydrol. 2009, 367(3-4):255-275.
84. Stanski, H.R., Wilson, L.J., Burrows, W.R., 1989. Survey of common verification methods in meteorology. WMO World Weather Watch Tech. Rep. 8, WMO TD 358, p. 114.
85. Stroud J.R., Lesht B.M., Schwab D.J., Beletsky D., Stein M.L. Assimilation of satellite images into a sediment transport model of Lake Michigan. Water Resour. Res. 2009, 45:W02419. 10.1029/2007WR006747.
86. Talagrand, O., Vautard, R., Strauss, B., 1999. Evaluation of probabilistic prediction systems. In: Proceedings, ECMWF Workshop on Predictability, Shinfield Park, Reading, Berkshire ECMWF. Shinfield Park, Reading, pp. 1-25.
87. Tanguay M., Fillion L., Lapalme E., Lajoie M. Four-dimensional variational data assimilation for the Canadian regional deterministic prediction system. Mon. Weather Rev. 2012, 140(5):1517-1538.
88. Thirel G., Martin E., Mahfouf J.-F., Massart S., Ricci S., Habets F. A past discharges assimilation system for ensemble streamflow forecasts over France - Part 1: Description and validation of the assimilation system. Hydrol. Earth Syst. Sci. 2010, 14:1623-1637.
89. Thirel G., Salamon P., Burek P., Kalas M. Assimilation of MODIS snow cover area data in a distributed hydrological model using the particle filter. Remote Sens. 2013, 5:5825-5850.
90. Tippett M.K., Anderson J.L., Bishop C.H., Hamill T.M., Whitaker J.S. Ensemble square root filters. Mon. Weather Rev. 2003, 131:1485-1490.
91. Toth, G., Gultepe, I., Milbrandt, J., Hansen, B., Pearson, G., Fogarty, C., Burrows, W., 2010. Manuel sur le brouillard et la prévision du brouillard. Environment Canada, p. 135.
92. Turcotte R., Lacombe P., Dimnik C., Villeneuve J.P. Prévision hydrologique distribuée pour la gestion de barrages publics du Québec. Can. J. Civil Eng. 2004, 31:308-320.
93. Valstar J.R., McLaughlin D.B., Te Stroet C.B.M., Van Geer F.C. A representer-based inverse method for groundwater flow and transport applications. Water Resour. Res. 2004, 40:W05116.
94. Velázquez J.A., Petit T., Lavoie A., Boucher M.A., Turcotte R., Fortin V., Anctil F. An evaluation of the Canadian global meteorological ensemble prediction system for short term hydrological forecasting. Hydrol. Earth Syst. Sci. 2009, 13:2221-2231.
95. Vrugt J.A., Diks C.G.H., Gupta H.V., Bouten W., Verstraten J.M. Improved treatment of uncertainty in hydrologic modeling: combining the strengths of global optimization and data assimilation. Water Resour. Res. 2005, 41:W01017. 10.1029/2004WR003059.
96. Vrugt J.A., ter Brakk C.J.F., Diks C.G.H., Schoups G. Hydrologic data assimilation using particle Markov chain Monte Carlo simulation: theory, concepts and applications. Adv. Water Resour. 2013, 51:457-478.
97. Warrach-Sagi K., Wulfmeyer V. Streamflow data ass imilation for soil moisture analysis. Geosci. Model Dev. 2010, 3:1-12.
98. Weerts A.H., El Serafy G.Y.H. Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall-runoff models. Water Resour. Res. 2006, 42:W09403.
99. Weerts A.H., Seo D.-J., Werner M., Schaake J. Operational hydrologic ensemble forecasting. Applied Uncertainty Analysis for Flood Risk Management 2014, 387-406. Imperial College Press, London.
100. Wilks D. Statistical Methods in the Atmospheric Sciences 1995, Academic Press, p. 467.
101. Zaitchik B.F., Rodell M., Reichle R.H. Assimilation of GRACE terrestrial water storage data into a land surface model: results for the Mississippi river basin. J. Hydrometeorol. 2008, 9:535-548.