Efficient hydrological model parameter optimization with Sequential Monte Carlo sampling

Environmental Modelling and Software

Volumn 38, Issue , 2012, Pages 283-295

  Jeremiah, Erwin ^a   Sisson, Scott A ^a   Sharma, Ashish ^a   Marshall, Lucy ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b MONTANA STATE UNIVERSITY   (United States)

Author keywords

Bayesian; Data assimilation; Hydrological models; Monte Carlo; Parameter optimisation; Parameter uncertainty

Indexed keywords

BAYESIAN; DATA ASSIMILATION; HYDROLOGICAL MODELS; MONTE CARLO; PARAMETER OPTIMISATION; PARAMETER UNCERTAINTY;

BAYESIAN NETWORKS; CLIMATE MODELS; DATA PROCESSING; HYDROLOGY; INFERENCE ENGINES; MODELS; MONTE CARLO METHODS; OPTIMIZATION; UNCERTAINTY ANALYSIS;

SAMPLING;

BAYESIAN ANALYSIS; DATA ASSIMILATION; HYDROLOGICAL MODELING; IMPLEMENTATION PROCESS; MONTE CARLO ANALYSIS; NONLINEARITY; OPTIMIZATION; SAMPLER; SAMPLING; UNCERTAINTY ANALYSIS;

EID: 84864349544     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2012.07.001     Document Type: Article

References (63)

1. Arulampalam M.S., Maskell S., Gordon N., Clapp T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing 2002, 50(2):174-188.
2. Bates B.C., Campbell E.P. A Markov chain Monte Carlo scheme for parameter estimation and inference in conceptual rainfall-runoff modeling. Water Resources Research 2001, 37(4):937-947.
3. Boughton W.C. A Hydrograph-Based Model for Estimating the Water Yield of Ungauged Catchments 1993, Inst Engineers Australia, Barton, pp.317-324.
4. Bulygina N., Gupta H. Estimating the uncertain mathematical structure of a water balance model via Bayesian data assimilation. Water Resources Research 2009, 45.
5. Celeux G., Hurn M., Robert C.P. Computational and inferential difficulties with mixture posterior distributions. Journal of the American Statistical Association 2000, 95(451):957-970.
6. Chopin N. A sequential particle filter method for static models. Biometrika 2002, 89(3):539-552.
7. Clark M.P., Slater A.G., Barrett A.P., Hay L.E., McCabe G.J., Rajagopalan B., Leavesley G.H. Assimilation of snow covered area information into hydrologic and land-surface models. Advances in Water Resources 2006, 29(8):1209-1221.
8. Clark M.P., Slater A.G., Rupp D.E., Woods R.A., Vrugt J.A., Gupta H.V., Wagener T., Hay L.E. Framework for Understanding Structural Errors (FUSE): a modular framework to diagnose differences between hydrological models. Water Resources Research 2008, 44.
9. Del Moral P., Doucet A., Jasra A. Sequential Monte Carlo samplers. Journal of the Royal Statistical Society Series B-Statistical Methodology 2006, 68:411-436.
10. Del Moral P., Doucet A., Jasra A. Sequential Monte Carlo for Bayesian computation. Bayesian Statistics 2007, 115-148. Oxford University Press, Oxford. J.M. Bernardo, M.J. Bayarri, J.O. Berger, A.P. Dawid, D. Heckerman, A.F.M. Smith, M. West (Eds.).
11. Dotto C.B.S., Kleidorfer M., Deletic A., Rauch W., McCarthy D.T., Fletcher T.D. Performance and sensitivity analysis of stormwater models using a Bayesian approach and long-term high resolution data. Environmental Modelling & Software 2011, 26(10):1225-1239.
12. Doucet A., De Freitas N., Gordon N. Sequential Monte Carlo Methods in Practice 2001, Springer, New York; London, 581 pp.
13. Drovandi C.C., Pettitt A.N. Estimation of parameters for microparasite population evolution using approximate Bayesian computation. Biometrics 2011, 67(1):225-233.
14. Duan Q.Y., Sorooshian S., Gupta V. Effective and efficient global optimization for conceptual rainfall-runoff models. Water Resources Research 1992, 28(4):1015-1031.
15. Fan Y., Leslie D.S., Wand M.P. Generalised linear mixed model analysis via sequential Monte Carlo sampling. Electronic Journal of Statistics 2008, 2:916-938.
16. Freer J., Beven K., Ambroise B. Bayesian estimation of uncertainty in runoff prediction and the value of data: an application of the GLUE approach. Water Resources Research 1996, 32(7):2161-2173.
17. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. Bayesian Data Analysis 1995, Chapman & Hall, London, UK.
18. Gordon N.J., Salmond D.J., Smith A.F.M. Novel-Approach to nonlinear non-Gaussian Bayesian state estimation. IEE Proceedings-F Radar and Signal Processing 1993, 140(2):107-113.
19. 2 particles. Environmental Modelling & Software 2010, 25(3):320-332.
20. Haario H., Saksman E., Tamminen J. Adaptive proposal distribution for random walk Metropolis algorithm. Computational Statistics 1999, 14(3):375-395.
21. Hsu K.-l., Moradkhani H., Sorooshian S. A sequential Bayesian approach for hydrologic model selection and prediction. Water Resources Research 2009, 45(12):W00B12.
22. Jean-Baptiste N., Malaterre P.-O., Dorée C., Sau J. Data assimilation for real-time estimation of hydraulic states and unmeasured perturbations in a 1D hydrodynamic model. Mathematics and Computers in Simulation 2011, 81(10):2201-2214.
23. Jeremiah E., Sisson S., Marshall L., Mehrotra R., Sharma A. Bayesian calibration and uncertainty analysis of hydrological models: a comparison of adaptive metropolis and sequential Monte Carlo samplers. Water Resources Research 2011, 47(7):W07547.
24. Keats A., Yee E., Lien F.S. Information-driven receptor placement for contaminant source determination. Environmental Modelling & Software 2010, 25(9):1000-1013.
25. Kitagawa G. Monte Carlo filter and smoother for non-Gaussian nonlinear state space models. Journal of Computational and Graphical Statistics 1996, 5(1):1-25.
26. Kuczera G., Mroczkowski M. Assessment of hydrologic parameter uncertainty and the worth of multiresponse data. Water Resources Research 1998, 34(6):1481-1489.
27. Kuczera G., Parent E. Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the metropolis algorithm. Journal of Hydrology 1998, 211(1-4):69-85.
28. Kuczera G. Improved parameter inference in catchment models: 1. Evaluating parameter uncertainty. Water Resources Research 1983, 19(5):1151-1162.
29. Lee J., McVinish R., Mengersen K. Population Monte Carlo algorithm in high dimensions. Methodology and Computing in Applied Probability 2009, 1-21.
30. Leisenring M., Moradkhani H. Snow water equivalent prediction using Bayesian data assimilation methods. Stochastic Environmental Research and Risk Assessment 2011, 25(2):253-270.
31. Liu J.S., Chen R. Sequential Monte Carlo methods for dynamic systems. Journal of the American Statistical Association 1998, 93(443):1032-1044.
32. Liu J.S. Monte Carlo Strategies in Scientific Computing 2001, Springer-Verlag, New York.
33. Marshall L., Nott D., Sharma A. A comparative study of Markov chain Monte Carlo methods for conceptual rainfall-runoff modeling. Water Resources Research 2004, 40(2).
34. Marshall L., Sharma A., Nott D. Modeling the catchment via mixtures: issues of model specification and validation. Water Resources Research 2006, 42(11).
35. Marshall L., Nott D., Sharma A. Towards dynamic catchment modelling: a Bayesian hierarchical mixtures of experts framework. Hydrological Processes 2007, 21(7):847-861.
36. Micevski T., Kuczera G. Combining site and regional flood information using a Bayesian Monte Carlo approach. Water Resources Research 2009, 45.
37. Montzka C., Moradkhani H., Weihermüller L., Franssen H.-J.H., Canty M., Vereecken H. Hydraulic parameter estimation by remotely-sensed top soil moisture observations with the particle filter. Journal of Hydrology 2011, 399(3-4):410-421.
38. Moore R.J. The PDM rainfall-runoff model. Hydrology and Earth System Sciences Discussions 2007, 11(1):483-499.
39. Moradkhani H., Sorooshian S. General review of rainfall-runoff modeling: model calibration, data assimilation, and uncertainty analysis. Hydrological Modelling and the Water Cycle: Coupling the Atmospheric and Hydrological Models 2008, 1-24. Springer-Verlag Berlin, Berlin. S. Sorooshian, K.L. Hsu, E. Coppola, B. Tomassetti, M. Verdecchia, G. Visconti (Eds.).
40. Moradkhani H., Hsu K.L., Gupta H., Sorooshian S. Uncertainty assessment of hydrologic model states and parameters: sequential data assimilation using the particle filter. Water Resources Research 2005, 41(5).
41. Muleta M.K., Nicklow J.W. Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model. Journal of Hydrology 2005, 306(1-4):127-145.
42. Nagarajan K., Judge J., Graham W.D., Monsivais-Huertero A. Particle Filter-based assimilation algorithms for improved estimation of root-zone soil moisture under dynamic vegetation conditions. Advances in Water Resources 2011, 34(4):433-447.
43. Noh S.J., Tachikawa Y., Shiiba M., Kim S. Applying sequential Monte Carlo methods into a distributed hydrologic model: lagged particle filtering approach with regularization. Hydrology and Earth System Sciences Discussion 2011, 8(2):3383-3420.
44. Oakley J.E., O'Hagan A. Probabilistic sensitivity analysis of complex models: a Bayesian approach. Journal of the Royal Statistical Society Series B 2004, 66(3):751-769.
45. Salamon P., Feyen L. Disentangling uncertainties in distributed hydrological modeling using multiplicative error models and sequential data assimilation. Water Resources Research 2010, 46(12):W12501.
46. Seibert J., McDonnell J.J. On the dialog between experimentalist and modeler in catchment hydrology: use of soft data for multicriteria model calibration. Water Resources Research 2002, 38(11):1241.
47. Sisson S.A., Fan Y. Towards automating model selection for a mark-recapture-recovery analysis. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2009, 58(2):247-266.
48. Sisson S.A., Fan Y. Likelihood-free Markov Chain Monte Carlo 2011, Chapman and Hall/CRC Press.
49. Smith T., Marshall L.A. Bayesian methods in hydrologic modeling: a study of recent advancements in Markov chain Monte Carlo techniques. Water Resources Research 2008, 44.
50. Smith T., Marshall L.A. Exploring uncertainty and model predictive performance concepts via a modular snowmelt-runoff modeling framework. Environmental Modelling & Software 2010, 25(6):691-701.
51. Smith P.J., Beven K.J., Tawn J.A. Detection of structural inadequacy in process-based hydrological models: a particle-filtering approach. Water Resources Research 2008, 44(1).
52. Smith T., Sharma A., Marshall L., Mehrotra R., Sisson S. Development of a formal likelihood function for improved Bayesian inference of ephemeral catchments. Water Resources Research 2010, 46(12):W12551.
53. Snyder C., Bengtsson T., Bickel P., Anderson J. Obstacles to high-dimensional particle filtering. Monthly Weather Review 2008, 136(12):4629-4640.
54. Sorooshian S., Gupta V.K. Automatic calibration of conceptual rainfall-runoff models - the question of parameter observability and uniqueness. Water Resources Research 1983, 19(1):260-268.
55. Spiller E.T., Budhiraja A., Ide K., Jones C.K.R.T. Modified particle filter methods for assimilating Lagrangian data into a point-vortex model. Physica D: Nonlinear Phenomena 2008, 237(10-12):1498-1506.
56. Tarantola A. Inverse Problem Theory. Methods for Data Fitting and Model Parameter Estimation 1987, Elsevier, Amstredam.
57. Thyer M., Renard B., Kavetski D., Kuczera G., Franks S.W., Srikanthan S. Critical evaluation of parameter consistency and predictive uncertainty in hydrological modeling: a case study using Bayesian total error analysis. Water Resources Research 2009, 45.
58. van Leeuwen P.J. Particle filtering in geophysical systems. Monthly Weather Review 2009, 137(12):4089-4114.
59. Vrugt J.A., Robinson B.A. Treatment of uncertainty using ensemble methods: comparison of sequential data assimilation and Bayesian model averaging. Water Resources Research 2007, 43(1).
60. Vrugt J.A., Gupta H.V., Bouten W., Sorooshian S. A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resources Research 2003, 39(8).
61. Vrugt J.A., ter Braak C.J.F., Diks C.G.H., Robinson B.A., Hyman J.M., Higdon D. Accelerating Markov chain Monte Carlo simulation by differential evolution with self-adaptive randomized subspace sampling. International Journal of Nonlinear Sciences and Numerical Simulation 2009, 10(3):273-290.
62. Wagener T., McIntyre N., Lees M.J., Wheater H.S., Gupta H.V. Towards reduced uncertainty in conceptual rainfall-runoff modelling: dynamic identifiability analysis. Hydrological Processes 2003, 17(2):455-476.
63. Weerts A.H., El Serafy G.Y.H. Particle filtering and ensemble Kalman filtering for state updating with hydrological conceptual rainfall-runoff models. Water Resources Research 2006, 42(9).