Improving particle filters in rainfall-runoff models: Application of the resample-move step and the ensemble Gaussian particle filter

Water Resources Research

Volumn 49, Issue 7, 2013, Pages 4005-4021

  Plaza Guingla, Douglas A ^a   De Keyser, Robin ^a   De Lannoy, Gabriëlle J M ^a,b,c   Giustarini, Laura ^d   Matgen, Patrick ^d   Pauwels, Valentijn R N ^e  

^a GHENT UNIVERSITY   (Belgium)

^b NASA GODDARD SPACE FLIGHT CENTER   (United States)

^c UNIVERSITIES SPACE RESEARCH ASSOCIATION   (United States)

^d LUXEMBOURG INSTITUTE OF SCIENCE AND TECHNOLOGY   (Luxembourg)

^e MONASH UNIVERSITY   (Australia)

Author keywords

data assimilation; ensemble Kalman filter; Gaussian particle filter; particle filter; rainfall runoff models

Indexed keywords

GAUSSIAN DISTRIBUTION; MARKOV CHAINS; MONTE CARLO METHODS; RAIN; RUNOFF;

DATA ASSIMILATION; ENSEMBLE KALMAN FILTER; GAUSSIAN PARTICLE FILTER; PARTICLE FILTER; RAINFALL-RUNOFF MODELS;

KALMAN FILTERS;

EID: 84879867134     PISSN: 00431397     EISSN: 19447973     Source Type: Journal    
DOI: 10.1002/wrcr.20291     Document Type: Article

References (52)

1. Andreas, S., H. A. Karlsen, G. Naevdal, H. J. Skaug, and, B. Valles, (2011), Bridging the ensemble Kalman filter and particle filters: The adaptive Gaussian mixture filter, Comput. Geosci., 15 (2), 293-305, doi: 10.1007/s10596-010-9207-1.
2. Andrieu, C., A. Doucet, and, R. Holenstein, (2010), Particle Markov chain Monte Carlo methods, J. R. Stat. Soc. B, 72 (3), 269-342, doi: 10.1111/j.1467-9868.2009.00736.x.
3. Arulampalam, M. S., S. Maskell, and, N. Gordon, (2002), A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, IEEE Trans. Signal Process., 50, 174-188, doi: 10.1109/78.978374. (Pubitemid 34291500)
4. Burgers, G., P. J. van Leeuwen, and, G. Evensen, (1998), On the analysis scheme in the ensemble Kalman filter, Mon. Weather Rev., 126, 1719-1724, doi: 10.1175/1520-0493(1998)126<1719:ASITEK>2.0.CO;2. (Pubitemid 128597660)
5. Carpenter, J., P. Clifford, and, P. Fearnhead, (1999), An improved particle filter for non-linear problems, IEE Proc. Radar, Sonar Navig., 146 (1), 2-7.
6. De Lannoy, G. J. M., P. R. Houser, V. R. N. Pauwels, and, N. E. C. Verhoest, (2006), Assessment of model uncertainty for soil moisture through ensemble verification, J. Geophys. Res., 111, D10101, doi: 10.1029/2005JD006367.
7. DeChant, C. M., and, H. Moradkhani, (2012), Examining the effectiveness and robustness of sequential data assimilation methods for quantification of uncertainty in hydrologic forecasting, Water Resour. Res., 48, W04518, doi: 10.1029/2011WR011011.
8. Douc, R., O. Cappe, and, E. Moulines, (2005), Comparison of resampling schemes for particle filtering, ISPA 2005: Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, Zagreb, Croatia, doi: 10.1109/ISPA.2005.195385.
9. Doucet, A., and, A. M. Johansen, (2009), A tutorial on particle filtering and smoothing: Fifteen years later, in Handbook of Nonlinear Filtering, Oxford Univ. Press, Oxford, U. K.
10. Doucet, A., S. Godsill, and, C. Andrieu, (2000), On sequential Monte Carlo sampling methods for Bayesian filtering, Stat. Comput., 10 (3), 197-208, doi: 10.1023/A:1008935410038.
11. Doucet, A., N. Gordon, and, V. Krishnamurthy, (2001), Particle filters for state estimation of jump Markov linear systems, IEEE Trans. Signal Process., 49 (3), 613-624, doi: 10.1109/78.905890. (Pubitemid 32583163)
12. Duan, Q. Y., V. K. Gupta, and, S. Sorooshian, (1993), Shuffled complex evolution approach for effective and efficient global minimization, J. Optim. Theory Appl., 76 (3), 501-521, doi: 10.1007/BF00939380. (Pubitemid 23643003)
13. Evensen, G., (1994), Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics, J. Geophys. Res, 99 (C5), 10,143-10,162, doi: 10.1029/94JC00572.
14. Fearnhead, P., (2002), Markov chain Monte Carlo, sufficient statistics, and particle filters, J. Comput. Graph. Stat., 11 (4), 848-862, doi: 10.1198/106186002835. (Pubitemid 36047109)
15. Gilks, W. R., and, C. Berzuini, (2001), Following a moving target-Monte Carlo inference for dynamic Bayesian models, J. R. Stat. Soc., 63 (1), pp. 127-146, doi: 10.1111/1467-9868.00280. (Pubitemid 33392467)
16. Giustarini, L., P. Matgen, R. Hostache, M. Montanari, D. Plaza, V. R. N. Pauwels, G. J. M. De Lannoy, R. De Keyser, L. Pfister, L. Hoffmann, and, H. H. G. Savenije, (2011), Assimilating SAR-derived water level data into a hydraulic model: A case study, Hydrol. Earth Syst. Sci., 15 (7), 2349-2365, doi: 10.5194/hess-15-2349-2011.
17. Gordon, N., D. Salmond, and, A. Smith, (1993), Novel approach to nonlinear/non-Gaussian Bayesian state estimation, IEE Proc. Radar Signal Proc, 140 (2), 107-113.
18. Higuchi, T., (1997), Monte Carlo filter using the genetic algorithm operators, J. Stat. Comput. Simul., 59 (1), 1 - 23, doi: 10.1080/ 00949659708811843.
19. Hoeben, R., and, P. A. Troch, (2000), Assimilation of active microwave observation data for soil moisture profile estimation, Water Resour. Res., 36 (10), 2805-2819, doi: 10.1029/2000WR900100.
20. Hoteit, I., D. T. Pham, G. Triantafyllou, and, G. Korres, (2008), A new approximate solution of the optimal nonlinear filter for data assimilation in meteorology and oceanography, Mon. Weather Rev., 136 (1), 317-334, doi: 10.1175/2007MWR1927.1. (Pubitemid 351308471)
21. Hoteit, I., X. Luo, and, D.-T. Pham, (2012), Particle Kalman filtering: A nonlinear Bayesian framework for ensemble Kalman filters, Mon. Weather Rev., 140 (2), 528-542, doi: 10.1175/2011MWR3640.1.
22. Houtekamer, P., and, H. Mitchell, (2001), A sequential ensemble Kalman filter for atmospheric data assimilation, Mon. Weather Rev., 129 (1), 123-137, doi: 10.1175/1520-0493(2001)129<0123:ASEKFF>2.0.CO;2. (Pubitemid 32180439)
23. Kalman, R. E., (1960), A new approach to linear filtering and prediction problems, J. Basic Eng. Trans. ASME, 82 (Series D), 35-45.
24. Kavetski, D., G. Kuczera, and, S. W. Franks, (2006), Calibration of conceptual hydrological models revisited: 1. Overcoming numerical artefacts, J. Hydrol., 320, 173-186, doi: 10.1016/j.jhydrol.2005.07.012.
25. Kitagawa, G., (1996), Monte Carlo filter and smoother for non-Gaussian nonlinear state space models, J. Comput. Graph. Stat., 5 (1), 1-25.
26. Kotecha, J., and, P. Djuric, (2003a), Gaussian particle filtering, IEEE Trans. Signal Process., 51 (10), 2592-2601, doi: 10.1109/TSP.2003.816758.
27. Kotecha, J., and, P. Djuric, (2003b), Gaussian sum particle filtering, IEEE Trans. Signal Proces., 51 (10), 2602-2612, doi: 10.1109/TSP.2003.816754.
28. Leisenring, M., and, H. Moradkhani, (2011), Snow water equivalent prediction using Bayesian data assimilation methods, Stochastic Environ. Res. Risk Assess., 25 (2), 253-270, doi: 10.1007/s00477-010-0445-5.
29. Leisenring, M., and, H. Moradkhani, (2012), Analyzing the uncertainty of suspended sediment load prediction using sequential data assimilation, J. Hydrol., 468-469, 268-282, doi: 10.1016/j.jhydrol.2012.08.049.
30. Lindström, G., B. Johansson, M. Persson, M. Gardelin, and, S. Bergström, (1997), Development and test of the distributed HBV-96 hydrological model, J. Hydrol., 201 (1-4), 272-288, doi: 10.1016/S0022-1694(97) 00041-3. (Pubitemid 28037764)
31. Liu, J. S., and, R. Chen, (1998), Sequential Monte Carlo methods for dynamic systems, J. Am. Stat. Assoc., 93, 1032-1044, doi: 10.2307/2669847.
32. Liu, Y., et al. (2012), Advancing data assimilation in operational hydrologic forecasting: Progresses, challenges, and emerging opportunities, Hydrol. Earth Syst. Sci., 16 (10), 3863-3887, doi: 10.5194/hess-16-3863-2012.
33. Matgen, P., J. Henry, L. Hoffmann, and, L. Pfister, (2006), Assimilation of remotely sensed soil saturation levels in conceptual rainfall-runoff models, in IAHS Book, Prediction in Ungauged Basins: Promise and Progress, IAHS Publ. 303, pp. 226-234, IAHS Press, Oxfordshire, U. K.
34. Matgen, P., M. Montanari, R. Hostache, L. Pfister, L. Hoffmann, D. Plaza, V. R. N. Pauwels, G. J. M. D. Lannoy, R. D. Keyser, and, H. H. G. Savenije, (2010), Towards the sequential assimilation of SAR-derived water stages into hydraulic models using the particle filter: Proof of concept, Hydrol. Earth Syst. Sci., 14, 1773-1785, doi: 10.5194/hess-14-1773-2010.
35. Montzka, C., H. Moradkhani, L. Weihermller, H.-J. H. Franssen, M. Canty, and, H. Vereecken, (2011), Hydraulic parameter estimation by remotely-sensed top soil moisture observations with the particle filter, J. Hydrol., 399, 410-421, doi: 10.1016/j.jhydrol.2011.01.020.
36. Moore, R. J., (2007), The PDM rainfall-runoff model, Hydrol. Earth Syst. Sci., 11 (1), 483-499, doi: 10.5194/hess-11-483-2007. (Pubitemid 46134785)
37. Moradkhani, H., and, S. Sorooshian, (2008), General review of rainfall-runoff modeling: Model calibration, data assimilation, and uncertainty analysis, in Hydrological Modelling and the Water Cycle, Water Science and Technology Library, vol. 63, edited by, S. Sorooshian, et al., pp. 1-24, Springer, Berlin, doi: 10.1007/978-3-540-77843-1-1.
38. Moradkhani, H., K.-L. Hsu, H. Gupta, and, S. Sorooshian, (2005), Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter, Water Resour. Res., 41, W05012, doi: 10.1029/2004WR003604.
39. Moradkhani, H., C. M. DeChant, and, S. Sorooshian, (2012), Evolution of ensemble data assimilation for uncertainty quantification using the particle filter-Markov chain Monte Carlo method, Water Resour. Res., 48, doi: 10.1029/2012WR012144.
40. Musso, C., N. Oudjane, and, F. Le Gland, (2001), Improving regularised particle filters, in Sequential Monte Carlo Methods in Practice, edited by, A. Doucet, N. D. Freitas, and, N. Gordon, pp. 247-271, Springer, New York.
41. Nagarajan, K., J. Judge, W. D. Graham, and, A. Monsivais-Huertero, (2010), Particle filter-based assimilation algorithms for improved estimation of root-zone soil moisture under dynamic vegetation conditions, Adv. Water Resour., 34 (4), 433-477, doi: 10.1016/j.advwatres.2010.09.019.
42. Papadakis, N., E. Memin, A. Cuzol, and, N. Gengembre, (2010), Data assimilation with the weighted ensemble Kalman filter, Tellus A, 62 (5), 673-697, doi: 10.1111/j.1600-0870.2010.00461.x.
43. Parrish, M. A., H. Moradkhani, and, C. M. DeChant, (2012), Toward reduction of model uncertainty: Integration of Bayesian model averaging and data assimilation, Water Resour. Res., 48, W03519, doi: 10.1029/2011WR011116.
44. Pitt, M., and, N. Shephard, (1999), Filtering via simulation: Auxiliary particle filters, J. Am. Stat. Assoc., 94 (446), 590-599, doi: 10.2307/2670179.
45. Plaza, D. A., R. De Keyser, G. J. M. De Lannoy, L. Giustarini, P. Matgen, and, V. R. N. Pauwels, (2012), The importance of parameter resampling for soil moisture data assimilation into hydrologic models using the particle filter, Hydrol. Earth Syst. Sci., 16 (2), 375-390, doi: 10.5194/hess-16-375-2012.
46. Reichle, R., D. McLaughlin, and, D. Entekhabi, (2002), Hydrologic data assimilation with the ensemble Kalman filter, Mon. Weather Rev., 130 (1), 103-114, doi: 10.1175/1520-0493(2002)130<0103:HDAWTE>2.0.CO;2. (Pubitemid 34838242)
47. Rings, J., J. A. Vrugt, G. Schoups, J. A. Huisman, and, H. Vereecken, (2012), Bayesian model averaging using particle filtering and Gaussian mixture modeling: Theory, concepts, and simulation experiments, Water Resour. Res., 48, W05520, doi: 10.1029/2011WR011607.
48. Van Der Merwe, R., A. Doucet, N. De Freitas, and, E. Wan, (2001), The unscented particle filter, in Advances in Neural Information Processing Systems, MIT, Cambridge, Mass.
49. Vrugt, J., H. Gupta, and, B. Nuallain, (2006), Real-time data assimilation for operational ensemble streamflow forecasting, J. Hydrometeorol., 7 (3), 548-565, doi: 10.1175/JHM504.1. (Pubitemid 44087847)
50. Vrugt, J. A., C. J. ter Braak, C. G. Diks, and, G. Schoups, (2012), Hydrologic data assimilation using particle Markov chain Monte Carlo simulation: Theory, concepts and applications, Adv. Water Resour., 51, 457 - 478, doi: 10.1016/j.advwatres.2012.04.002.
51. Wan, E. A., and, R. Van Der Merwe, (2000), The unscented Kalman filter for nonlinear estimation, in paper presented at IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium, Lake Louise, Alberta, Canada.
52. Weerts, A. H., and, G. Y. H. El Serafy, (2006), Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall-runoff models, Water Resour. Res., 42, W09403, doi: 10.1029/2005WR004093.