Integration of an evolutionary algorithm into the ensemble kalman filter and the particle filter for hydrologic data assimilationl

Journal of Hydroinformatics

Volumn 16, Issue 1, 2014, Pages 74-94

  Dumedah, Gift ^a   Coulibaly, Paulin ^b  

^a MONASH UNIVERSITY   (Australia)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

Data assimilation; Ensemble Kalman filter; Multi objective evolutionary algorithms; Pareto optimality; Particle filter; Streamflow forecasting

Indexed keywords

EID: 84894068220     PISSN: 14647141     EISSN: None     Source Type: Journal    
DOI: 10.2166/hydro.2013.088     Document Type: Article

References (47)

1. Bengtsson, T., Snyder, C. & Nychka, D. 2003 Toward a nonlinear ensemble filter for high-dimensional systems. Journal of Geophysical Research 108 (D24), 8775.
2. Burgers, T., van Leeuwen, J. P. & Evensen, G. 1998 Analysis scheme in the ensemble Kalman filter. American Meteorological Society Monthly Weather Review 126 (6), 1719-1724.
3. Caparrini, F., Castelli, F. & Entekhabi, D. 2003 Mapping of land- atmosphere heat fluxes and surface parameters with remote sensing data. Boundary-layer Meteorology 107 (3), 605-633.
4. Caparrini, F., Castelli, F. & Entekhabi, D. 2004 Variational estimation of soil and vegetation turbulent transfer and heat flux parameters from sequences of multisensor imagery. Water Resources Research 40 (12), W12515.
5. Chemin, Y. & Honda, K. 2006 Spatiotemporal fusion of rice actual evapotranspiration with genetic algorithms and an agrohydrological model. IEEE Transactions on Geoscience and Remote Sensing 44 (11), 3462-3469.
6. Chen, Z. 2003 Bayesian Filtering: From Kalman Filters to Particle Filters, and Beyond. Technical report, McMaster University, Adaptive System Laboratory, Hamilton, ON, Canada.
7. Clark, M., Rupp, D., Woods, R., Zheng, X., Ibbitt, R., Slater, A., Schmidt, J. & Uddstrom, M. 2008 Hydrological data assimilation with the ensemble Kalman filter: use of streamflow observations to update states in a distributed hydrological model. Advances in Water Resources 31 (10), 1309-1324.
8. Coello Coello, C. A., van Veldhuizen, D. A. & Lamont, G. B. 2002 Evolutionary Algorithms for Solving Multi-ObjectiveProblems. Kluwer Academic/Plenum Publishers, New York, NY.
9. Confesor, R. B. & Whittaker, G. W. 2007 Automatic calibration of hydrologic models with multi-objective evolutionary algorithm and Pareto optimization. Journal of American Water Resources Association 43 (4), 981-989.
10. Deb, K. 2001 Multi-objective Optimization using Evolutionary Algorithms. John Wiley and Sons, Chichester, UK.
11. Deb, K. & Goel, T. 2001 Controlled elitist non-dominated sorting genetic algorithms for better convergence. In: Evolutionary Multi-criterion Optimization, 1st International Conference, EMO 2001, Swiss Federal Institute of Technology, Springer, Zurich, Switzerland, vol. 1993, pp. 67-81.
12. Deb, K., Agrawal, S., Pratap, A. & Meyarivan, T. 2000 A fast elitist non-dominated sorting genetic algorithms for multi-objective optimization: NSGA-II. In: Parallel Problem Solving from Nature VI (PPSN-VI), Springer Lecture Notes in Computer Science, No. 1917, Springer, Paris, France, pp. 849-858.
13. Deb, K., Pratap, A., Agrawal, S. & Meyarivan, T. 2002 A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6 (2), 182-197.
14. Dumedah, G. 2012 Formulation of the evolutionary-based data assimilation, and its practical implementation. Water Resources Management 26, 3853-3870.
15. Dumedah, G. & Coulibaly, P. 2012 Evolutionary assimilation of streamflow in distributed hydrologic modeling using in-situ soil moisture data. Advances in Water Resources 53, 231-241.
16. Dumedah, G., Berg, A. A., Wineberg, M. & Collier, R. 2010 Selecting model parameter sets from a trade-off surface generated from the Non-dominated Sorting Genetic Algorithm-II. Water Resources Management 24 (15), 4469-4489.
17. Dumedah, G., Berg, A. A. & Wineberg, M. 2011 An integrated framework for a joint assimilation of brightness temperature and soil moisture using the Non-dominated Sorting Genetic Algorithm-II. Journal of Hydrometeorology 12 (2), 1596-1609.
18. Dumedah, G., Berg, A. A. & Wineberg, M. 2012a Evaluating auto- selection methods used for choosing solutions from Pareto- optimal set: does non-dominance persist from calibration to validation phase? Journal of Hydrologic Engineering 17 (1), 150-159.
19. Dumedah, G., Berg, A. A. & Wineberg, M. 2012b Pareto-optimality and a search for robustness: choosing solutions with desired properties in objective space and parameter space. Journal of Hydroinformatics 14 (2), 270-285.
20. Eiben, A. E. & Smith, J. E. 2003 Introduction to Evolutionary Computing. Springer.
21. Evensen, G. 1994a Inverse methods and data assimilation in nonlinear ocean models. Physica D 77 (1-3), 108-129.
22. Evensen, G. 1994b Sequential data assimilation with a non-linear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. Journal of Geophysical Research 99 (C5), 10,143-10,162.
23. Evensen, G. 2003 The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dynamics 53 (4), 343-367.
24. Gordon, N., Salmond, D. & Smith, A. 1993 Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEEE Proceedings on Radar and Signal Processing 140 (2), 107-113.
25. Houtekamer, P. L. & Mitchell, H. L. 1998 Data assimilation using an ensemble Kalman filter technique. Monthly Weather Review 126 (3), 796-811.
26. Ines, A. & Mohanty, B. 2008 Near-surface soil moisture assimilation for quantifying effective soil hydraulic properties using genetic algorithm: 1. Conceptual modeling. Water Resources Research 44 (6), W06422
27. Ines, A. & Mohanty, B. 2009 Near-surface soil moisture assimilation for quantifying effective soil hydraulic properties using genetic algorithms: 2. Using airborne remote sensing during SGP97 and SMEX02. Water Resources Research 45, W01408.
28. Komma, J., Bloschl, G. & Reszler, C. 2008 Soil moisture updating by ensemble Kalman filtering in real-time flood forecasting. Journal of Hydrology 357 (3-4), 228-242
29. Liu, Y. & Gupta, H. V. 2007 Uncertainty in hydrologic modeling: toward an integrated data assimilation framework. Water Resources Research 43,1-18.
30. Lui, J. S. & Chen, R. 1998 Sequential Monte-Carlo methods for dynamical systems. Journal of the American Statistical Association 93 (443), 1032-1044.
31. Moradkhani, H. & Hsu, K. 2005 Uncertainty assessment of hydrologic model states and parameters: sequential data assimilation using the particle filter. Water Resources Research 41, W05012
32. Moradkhani, H., Sorooshian, S., Gupta, H. V. & Paul Houser, R. 2005 Dual state parameter estimation of hydrological models using ensemble Kalman filter. Advances in Water Resources 28 (2), 135-147
33. Nazemi, A., Yao, X. & Chan, A. 2006 Extracting a set of robust Pareto-optimal parameters for hydrologic models using NSGA-II and SCEM. In: IEEE Congress on Evolutionary Computation, Vancouver, BC, 2006, pp. 1901-1908, doi: 10.1109/CEC.2006.1688539.
34. Reichle, R., McLaughlin, D. & Entekhabi, D. 2001 Variational data assimilation of microwave radiobrightness observations for land surface hydrology applications. IEEE Transactions on Geoscience and Remote Sensing 39 (8), 1708-1718.
35. Snyder, C., Bengtsson, T., Bickel, P. & Anderson, J. 2008 Obstacles to high-dimensional particle filtering. Monthly Weather Review 136, 4629-4640.
36. Tang, Y., Reed, P. & Wagener, T. 2006 How effective and efficient are multiobjective evolutionary algorithms at hydrologic model calibration? Hydrology and Earth System Sciences 10, 289-307.
37. Thirel, G., Martin, E., Mahfouf, J.-F., Massart, S., Ricci, S. & Habets, F. 2010 A past discharges assimilation system for ensemble streamflow forecasts over France. Part 1: description and validation of the assimilation system. Hydrology and Earth System Sciences 14 (8), 1623-1637.
38. Thorndike, R. L. 1953 Who belong in the family? Psychometrika 18,4.
39. van Leeuwen, P. J. 2009 Particle filtering in geophysical systems. Monthly Weather Review 137 (12), 4089-4114.
40. Vossepoel, F. C. & van Leeuwen, P. J. 2007 Parameter estimation using a particle method: inferring mixing coefficients from sea level observations. Monthly Weather Review 135 (3), 1006-1020.
41. Vrugt, J. A. & Robinson, B. A. 2007 Treatment of uncertainty using ensemble methods: comparison of sequential data assimilation and Bayesian model averaging. Water Resources Research 43 (1), W01201-W01701.
42. Vrugt, J. A., Gupta, H. V., Dekker, S. C., Sorooshian, S., Wagener, T. & Bouten, W. 2006a Application of stochastic parameter optimization to the Sacramento soil moisture accounting model. Journal of Hydrology 325 (1-4), 288-307.
43. Vrugt, J. A., Gupta, H. V., Nuallain, B. O. & Bouten, W. 2006b Real-time data assimilation for operational ensemble streamflow forecasting. Journal of Hydrometeorology 7 (3), 548-565.
44. Weerts, A. H. & El Serafy, G. Y. 2006 Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall-runoff models. Water Resources Research 42, W09301-W09602.
45. Weerts, A. H., El Serafy, G. Y., Hummel, S., Dhondia, J. & Gerritsen, H. 2010 Application of generic data assimilation tools(datools) for flood forecasting purposes. Computers & Geosciences 36 (4), 453-463.
46. Wohling, T., Vrugt, J. A. & Barkle, G. F. 2008 Comparison of three multiobjective optimization algorithms for inverse modeling of vadose zone hydraulic properties. Soil Science Society of America Journal 72 (2), 305-319.
47. Xie, X. & Zhang, D. 2010 Data assimilation for distributed hydrological catchment modeling via ensemble Kalman filter. Advances in Water Resources 33 (6), 678-690.