Real-time data assimilation for operational ensemble streamflow forecasting

Journal of Hydrometeorology

Volumn 7, Issue 3, 2006, Pages 548-565

  Vrugt, Jasper A ^a   Gupta, Hoshin V ^b   Nualláin, Breanndán Ó ^c   Bouten, Willem ^c  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

FLOOD FORECASTING; OPTIMIZATION; STOCHASTICITY; STREAMFLOW;

MISSISSIPPI; NORTH AMERICA; UNITED STATES;

EID: 33746200035     PISSN: 1525755X     EISSN: None     Source Type: Journal    
DOI: 10.1175/JHM504.1     Document Type: Article

References (72)

1. Anderson, H., 2001: An ensemble adjustment filter for data assimilation. Mon. Wea. Rev., 129, 2884-2903.
2. Arulampalam, M. S., S. Maskell, N. Gordon, and T. Clapp, 2002: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process., 50 (2), 174-188.
3. Awwad, H. M., and J. B. Valdés, 1992: Adaptive parameter estimation for multi-site hydrologic forecasting. J. Hydraul. Eng., 118, 1201-1221.
4. Awwad, H. M., J. B. Valdés, and P. J. Restrepo, 1994: Streamflow forecasting for Han River basin, Korea. J. Water Resour. Plann. Manage., 120, 651-673.
5. Beven, K. J., and A. M. Binley, 1992: The future of distributed models: Model calibration and predictive uncertainty. Hydrol. Processes, 6, 279-298.
6. Box, G. E. P., and G. C. Tiao, 1973: Bayesian Inference in Statistical Analyses. Addison-Wesley-Longman, 585 pp.
7. Boyle, D. P., H. V. Gupta, and S. Sorooshian, 2000: Towards improved calibration of hydrologic models: Combining the strengths of manual and automatic methods. Water Resour. Res., 36, 3663-3674.
8. Boyle, D. P., H. V. Gupta, and S. Sorooshian, 2001: Towards improved streamflow forecasts: The value of semi-distributed modeling. Water Resour. Res., 37, 2749-2759.
9. Bras, R. L., and P. Restrepo-Posada, 1980: Real time automatic parameter calibration in conceptual runoff forecasting models. Proc. Third Int. Symp. on Stochastic Hydraulics, 61-70.
10. Bras, R. L., and I. Rodriguez-Iturbe, 1985: Random Functions and Hydrology. Addison-Wesley, 545 pp.
11. Brazil, L. E., and M. D. Hudlow, 1981: Calibration procedures used with the National Weather Service Forecast System. Water and Related Land Resources, Y. Y. Haimes and J. Kindler, Eds., Pergamon Press, 457-466.
12. Burnash, R. J. C., R. L. Ferral, and R. A. McGuire, 1973: A generalized streamflow simulation system: Conceptual models for digital computers. National Weather Service, NOAA, and the State of California Department of Water Resources Tech. Rep., Joint Federal-State River Forecast Center, Sacramento, CA, 68 pp.
13. Cañizares, R., H. Madsen, H. R. Jensen, and H. J. Vested, 2001: Developments in operational shelf sea modeling in Danish waters. Estuarine Coastal Shelf Sci., 53, 595-605.
14. Clark, M. P., and J. A. Vrugt, 2006: Unraveling uncertainties in hydrologic model calibration: Addressing the problem of compensatory parameters. Geophys. Res. Lett., 33, L06406, doi:10.1029/2005GL025604.
15. Dette, H., A. Munk, and T. Wagner, 1998: Estimating the variance in nonparametric regression - What is a reasonable choice? J. Roy. Stat. Soc., 60B, 751-764.
16. Duan, Q., V. K. Gupta, and S. Sorooshian, 1992: Effective and efficient global optimization for conceptual rainfall-runoff models. Water Resour. Res., 28, 1015-1031.
17. Duan, Q., S. Sorooshian, and V. K. Gupta, 1994: Optimal use of the SCE-UA global optimization method for calibrating watershed models. J. Hydrol., 158, 265-284.
18. Eaton, J. W., 1998: Octave Version 1. Department of Chemical Engineering, University of Wisconsin. [Available online at http:// www.octave.org.]
19. Eaton, J. W., 2001: Octave: Past, Present and Future. Proc. Second Int. Workshop on Distributed Statistical Computing, Vienna, Austria, Technical University of Vienna, 1-17.
20. Evensen, G., 1992: Using the extended Kalman filter with a multilayer quasi-geostrophic ocean model. J. Geophys. Res., 97 (C11), 17 905-17 924.
21. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99, 10 143-10 162.
22. Fernández, J., A. Cañas, A. F. Díaz, J. González, J. Ortega, and A. Prieto, 2003: Performance of message-passing MATLAB toolboxes. Lect. Notes Comput. Sci., 2565, 228-241.
23. Fernández, J., M. Anguita, S. Mota, A. Cañas, E. Ortigosa, and F. J. Rojas, 2004: MPI toolbox for Octave. Proc. Sixth Int. Conf. on High Performance Computing for Computational Science, Valencia, Spain, Polytechnic University of Valencia, 1-6.
24. Freer, J., K. J. Beven, and B. Ambroise, 1996: Bayesian estimation of uncertainty in runoff prediction and the value of data: An application of the GLUE approach. Water Resour. Res., 32, 2161-2173.
25. Georgakakos, H., and J. A. Sperflage, 1995: Hydrologic forecast system-HFS: A user's manual. HRC Tech. Note 1, Hydrologic Research Center, San Diego, CA, 17 pp.
26. Georgakakos, H., H. Rajaram, and S. G. Li, 1988: On improved operational hydrologic forecasting of streamflows. Iowa Institute of Hydraulic Research Rep. 325, 162 pp.
27. Gordon, N. D., D. Salmond, and A. F. M. Smith, 1993: Novel approach to nonlinear and non-Gaussian Bayesian state estimation. Proc. Inst. Electr. Eng., Part F, 140, 107-113.
28. Gupta, H. V., S. Sorooshian, and P. O. Yapo, 1998: Towards improved calibration of hydrologic models: Multiple and non-commensurable measures of information. Water Resour. Res., 34, 751-763.
29. Gupta, H. V., S. Sorooshian, T. S. Hogue, and D. P. Boyle, 2003: Advances in automatic calibration of watershed models. Calibration of Watershed Models, Q. Duan et al., Eds., Water Science Applications Series, Vol. 6, Amer. Geophys. Union, 113-124.
30. Gupta, V. K., and S. Sorooshian, 1985: The relationship between data and the precision of estimated parameters. J. Hydrol., 81, 57-77.
31. Hall, P., J. W. Kay, and D. M. Titterington, 1990: Asymptotically optimal difference-based estimation of variance in nonparametric regression. Biometrika, 77, 521-528.
32. Hogue, T. S., S. Sorooshian, H. V. Gupta, A. Holz, and D. Braatz, 2000: A multi-step automatic calibration scheme (MACS) for river forecasting models. J. Hydrometeor., 1, 524-542.
33. Hogue, T. S., H. V. Gupta, and S. Sorooshian, 2005: A "user-friendly" approach to parameter estimation in hydrologic models. J. Hydrol., 320, 202-217.
34. Hsu, K., H. V. Gupta, X. Gao, S. Sorooshian, and B. Imam, 2002: Self-organizing linear output map (SOLO): An artificial neural network suitable for hydrologic modeling and analysis. Water Resour. Res., 38, 1302, doi:10.1029/2001WR000795.
35. Jakeman, A., and G. M. Hornberger, 1993: How much complexity is warranted in a rainfall-runoff model? Water Resour. Res., 29, 2637-2649.
36. Kalman, R., 1960: New approach to linear filtering and prediction problems. J. Basic Eng., 82D, 35-45.
37. Kavetski, D., S. W. Franks, and G. Kuczera, 2003: Confronting input uncertainty in environmental modeling. Calibration of Watershed Models, Q. Duan et al., Eds., Water Science Applications Series, Vol. 6, Amer. Geophys. Union, 49-68.
38. Keesman, K. J., 1990: Set theoretic parameter estimation using random scanning and principal component analysis. Math. Comput. Simul., 32, 535-543.
39. Kitanidis, P. K., and R. L. Bras, 1980a: Real time forecasting with a conceptual hydrologic model, 1, Analysis of uncertainty. Water Resour. Res., 16, 1025-1033.
40. Kitanidis, P. K., and R. L. Bras, 1980b: Real time forecasting with a conceptual hydrologic model, 2, Applications and results. Water Resour. Res., 16, 1034-1044.
41. Klepper, O., H. Scholten, and J. P. G. van de Kamer, 1991: Prediction uncertainty in an ecological model of the Oosterschelde Estuary. J. Forecasting, 10, 191-209.
42. Kuczera, G., 1983a: Improved parameter inference in catchment models: 1. Evaluating parameter uncertainty. Water Resour. Res., 19, 1151-1162.
43. Kuczera, G., 1983b: Improved parameter inference in catchment models: 2. Combining different kinds of hydrologic data and testing their compatibility. Water Resour. Res., 19, 1163-1172.
44. Kuczera, G., 1997: Efficient subspace probabilistic parameter optimization for catchment models. Water Resour. Res., 33, 177-185.
45. Madsen, H., 2000: Automatic calibration of a conceptual rainfall-runoff model using multiple objectives. J. Hydrol., 235, 276-288.
46. Madsen, H., and C. Skotner, 2005: Adaptive state-updating in real-time river flow forecasting - A combined filtering and error forecasting procedure. J. Hydrol., 308, 302-312.
47. Miller, R. N., M. Ghil, and F. Ghautiez, 1994: Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci., 51, 1037-1055.
48. Misirli, F., 2003: Improving efficiency and effectiveness of Bayesian recursive parameter estimation for hydrologic models. Ph.D. dissertation, The University of Arizona.
49. Moradkhani, H., S. Sorooshian, H. V. Gupta, and P. R. Hauser, 2005a: Dual state-parameter estimation of hydrological models using ensemble Kalman filter. Adv. Water Res., 28, 135-147.
50. Moradkhani, H., K. Hsu, H. V. Gupta, and S. Sorooshian, 2005b: Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter. Water Resour. Res., 41, W05012, doi:10.1029/2004WR003604.
51. Refsgaard, J. C., 1998: Validation and intercomparison of different updating procedures for real-time forecasting. Nord. Hydrol., 28, 65-84.
52. Reichle, R. H., D. Entekhabi, and D. B. McLaughlin, 2001: Downscaling radio brightness measurements for soil moisture estimation: A four dimensional variational data assimilation approach. Water Resour. Res., 37, 2353-2364.
53. Rice, J., 1984: Bandwidth choice for nonparametric kernel regression. Ann. Stat., 12, 1215-1230.
54. Seifert, B., T. Gasser, and A. Wolf, 1993: Nonparametric estimation of residual variance revisited. Biometrika, 80, 373-383.
55. Seo, D. J., V. Koren, and N. Cajina, 2003: Real-time variational assimilation of hydrologic and hydrometeorological data into operational hydrologic forecasting. J. Hydrometeor., 4, 627-641.
56. Sorooshian, S., and J. A. Dracup, 1980: Stochastic parameter estimation procedures for hydrologic rainfall-runoff models: Correlated and heteroscedastic error cases. Water Resour. Res., 16, 430-442.
57. Sorooshian, S., and V. K. Gupta, 1983: Automatic calibration of conceptual rainfall-runoff models: The question of parameter observability and uniqueness. Water Resour. Res., 19, 260-268.
58. Sorooshian, S., Q. Duan, and V. K. Gupta, 1993: Calibration of rainfall-runoff models: Application of global optimization to the Sacramento soil moisture accounting model. Water Resour. Res., 29, 1185-1194.
59. Thiemann, M., M. W. Trosset, H. V. Gupta, and S. Sorooshian, 2001: Bayesian recursive parameter estimation for hydrologic models. Water Resour. Res., 37, 2521-2535.
60. Todini, E., A. Szollosi-Nagy, and E. F. Wood, 1976: Adaptive state-parameter estimation algorithm for real time hydrologic forecasting: A case study. Proc. IIASA/WMO Workshop on the Recent Developments in Real Time Forecasting/Control of Water Resources Systems, Laxenburg, Austria, IIASA-Laxenburg.
61. van Straten, G., and K. J. Keesman, 1991: Uncertainty propagation and speculation in projective forecasts of environmental change: A lake eutrophication example. J. Forecasting, 10, 163-190.
62. Vrugt, J. A., W. Bouten, H. V. Gupta, and S. Sorooshian, 2002: Toward improved identifiability of hydrologic model parameters: The information content of experimental data. Water Resour. Res., 38, 1312, doi:10.1029/ 2001WR001118.
63. Vrugt, J. A., H. V. Gupta, L. Bastidas, W. Bouten, and S. Sorooshian, 2003a: Effective and efficient algorithm for multiobjective optimization of hydrologic models. Water Resour. Res., 39, 1214, doi:10.1029/ 2002WR001746.
64. Vrugt, J. A., H. V. Gupta, W. Bouten, and S. Sorooshian, 2003b: A shuffled complex evolution metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour. Res., 39, 1201, doi:10.1029/2002WR001642.
65. Vrugt, J. A., C. G. H. Diks, H. V. Gupta, W. Bouten, and J. M. Verstraten, 2005: Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation. Water Resour. Res., 41, W01017, doi:10.1029/2004WR003059.
66. Vrugt, J. A., H. V. Gupta, S. C. Dekker, S. Sorooshian, T. Wagener, and W. Bouten, 2006a: Application of stochastic parameter optimization to the Sacramento Soil Moisture Accounting model. J. Hydrol., in press.
67. Vrugt, J. A., B. Ó. Nualláin, B. A. Robinson, W. Bouten, S. C. Dekker, and P. M. A. Sloot, 2006b: Application of parallel computing to stochastic parameter estimation in environmental models. Comput. Geosci., in press.
68. Wagener, T., N. McIntyre, M. J. Lees, H. S. Wheater, and H. V. Gupta, 2003: Towards reduced uncertainty in conceptual rainfall-runoff modeling: Dynamic identifiability analysis. Hydrol. Processes, 17, 455-476.
69. Wood, E. F., and P. E. O'Connell, 1985: Real-time forecasting. Hydrological Forecasting, M. G. Anderson and T. P. Burt, Eds., John Wiley and Sons.
70. Yapo, P., H. V. Gupta, and S. Sorooshian, 1996: Automatic calibration of conceptual rainfall-runoff models: Sensitivity to calibration data. J. Hydrol., 181, 23-48.
71. Young, P. C., 2001: Data-based mechanistic modeling and validation of rainfall-flow processes. Model Validation, M. G. Anderson and P. G. Bates, Eds., John Wiley and Sons, 117-161.
72. Young, P. C., 2002: Advances in real-time flood forecasting. Philos. Trans. Roy. Soc. London, 360, 1433-1450.