Numerical and visual evaluation of hydrological and environmental models using the Monte Carlo analysis toolbox

Environmental Modelling and Software

Volumn 22, Issue 7, 2007, Pages 1021-1033

  Wagener, Thorsten ^a   Kollat, Joshua ^a  

^a The Pennsylvania State University   (United States)

Author keywords

Evaluation; Hypothesis testing; Identifiability; Matlab; Model diagnostics; Sensitivity analysis; Uncertainty analysis; Visualization

Indexed keywords

DECISION MAKING; HYDROLOGY; MATHEMATICAL MODELS; MONTE CARLO METHODS; SENSITIVITY ANALYSIS; UNCERTAIN SYSTEMS; VISUALIZATION;

EVALUATED MODELS; HYPOTHESIS TESTING; IDENTIFIABILITY; MATLAB LIBRARY; MODEL DIAGNOSTICS; UNCERTAINTY ANALYSIS;

ENVIRONMENTAL ENGINEERING;

ENVIRONMENTAL MODELING; HYDROLOGICAL MODELING; HYPOTHESIS TESTING; MONTE CARLO ANALYSIS; NUMERICAL METHOD; PERFORMANCE ASSESSMENT; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS; VISUAL ANALYSIS; VISUALIZATION;

EID: 33846799316     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2006.06.017     Document Type: Article

References (76)

1. Anctil F., Perrin C., and Andréassian V. Impact of the length of observed records on the performance of ANN and of conceptual parsimonious rainfall-runoff forecasting models. Environmental Modelling & Software 19 4 (2004) 357-368
2. Andres T.H. Sampling methods and sensitivity analysis for large parameter sets. Journal of Stochastic Computation and Simulation 57 (1997) 75-110
3. ASCE. Criteria for evaluation of watershed models. Journal of Irrigation and Drainage Engineering 119 3 (1993) 429-442
4. Beck M.B. Structures, failures, inference and prediction. In: Barker M.A., and Young P.C. (Eds). Identification and System Parameter Estimation. Proceedings 7th Symposium vol. 2, July 1985 (1985), IFAC/IFORS, York, UK 1443-1448
5. Beck M.B. Water quality modeling: A review of the analysis of uncertainty. Water Resources Research 23 8 (1987) 1393-1442
6. Beck M.B. Environmental foresight and structural change. Environmental Modelling & Software 20 6 (2005) 651-670
7. Beven K.J. Rainfall-Runoff Modeling: The Primer (2000), John Wiley & Sons, Chichester, UK
8. Beven, K.J., 2002. Towards a coherent philosophy for environmental modeling. In: Proceedings of the Royal Society of London A 458, 2465-2484.
9. Beven K.J. A manifesto for the equifinality thesis. Journal of Hydrology 320 1-2 (2006) 18-36
10. Beven K.J., and Binley A.M. The future of distributed models: model calibration and uncertainty prediction. Hydrological Processes 6 (1992) 279-298
11. Beven K.J., and Freer J. Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology. Journal of Hydrology 249 1-4 (2001) 11-29
12. Boyle D.P., Gupta H.V., and Sorooshian S. Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods. Water Resources Research 36 12 (2000) 3663-3674 10.1029/2000WR900207
13. Chankong V., and Haimes Y.Y. Multi-objective optimization: Pareto optimality. In: Young P.C. (Ed). Concise Encyclopedia of Environmental Systems (1993), Pergamon Press, UK 387-396
14. Croke B.F.W., and Jakeman A.J. A catchment moisture deficit module for the IHACRES rainfall-runoff model. Environmental Modelling & Software 19 1 (2004) 1-5
15. Dessai S., Lu X., and Hulme M. Limited sensitivity analysis of regional climate change probabilities for the 21st century. Journal of Geophysical Research 110 (2005) D19108 10.1029/2005JD005919
16. Dingman S.L. Physical Hydrology (2002), Prentice Hall, Upper Saddle River, NJ
17. Diskin M.H., and Simon E. A procedure for the selection of objective functions for hydrologic simulation models. Journal of Hydrology 34 (1977) 129-149
18. Dooge, J.C., 1972. Mathematical models of hydrologic systems. In: Proceedings of the International Symposium on Modeling Techniques in Water Resources Systems, Ottawa, Canada, vol. 1, 171-189.
19. Duan Q., Gupta V.K., and Sorooshian S. A shuffled complex evolution approach for effective and efficient global minimization. Optimization Theory and Applications 76 3 (1993) 501-521
20. Freer J., Beven K.J., and Ambroise B. Bayesian estimation of uncertainty in runoff prediction and the value of data: An application of the GLUE approach. Water Resources Research 32 (1996) 2161-2173
21. Frey H.C., and Patil S.R. Identification and review of sensitivity analysis methods. Risk Analysis 22 3 (2002) 553-578
22. Funtowicz S.O., and Ravetz J.R. Uncertainty and Quality in Science for Policy (1990), Kluwer, Dordrecht, NL 229 pp
23. Gooseff M.N., Bencala K.E., Scott D.T., Runkel R.L., and McKnight D.M. Sensitivity analysis of conservative and reactive stream transient storage models applied to field data from multiple-reach experiments. Advances in Water Resources 28 5 (2005) 479-492 10.1016/j.advwatres.2004.11.012
24. Grayson R.B., Moore I.D., and McMahon T.A. Physically based hydrologic modelling: II. Is the concept realistic?. Water Resources Research 26 10 (1992) 2659-2666
25. Gupta H.V., Sorooshian S., and Yapo P.O. Toward improved calibration of hydrologic models: Multiple and non-commensurable measures of information. Water Resources Research 39 5 (1998) 751-763
26. Gupta H.V., Beven K.J., and Wagener T. Model calibration and uncertainty estimation. In: Anderson M.G. (Ed). Encyclopedia of Hydrological Sciences (2006), John Wiley & Sons Ltd., Chichester, UK pp. 1-17
27. Hamby D.M. A review of techniques for sensitivity analysis of environmental models. Environmental Modelling and Assessment 32 2 (1994) 135-154
28. Helton J.C. Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty. Journal of Stochastic Computation and Simulation 57 1-4 (1997) 3-76
29. Helton J.C., and Davis F.J. Illustration of sampling-based methods for uncertainty and sensitivity analysis. Risk Analysis 22 3 (2002) 622-691
30. Helton J.C., and Davis F.J. Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems. Reliability Engineering and System Safety 81 1 (2003) 23-69
31. Hornberger G.M., and Spear R.C. An approach to the preliminary analysis of environmental systems. Journal of Environmental Management 12 (1981) 7-18
32. Hornberger G.M., Beven K.J., Cosby B.J., and Sappington D.E. Shenandoah watershed study: Calibration of a topography-based, variable contributing area hydrological model to a small forested catchment. Water Resources Research 21 (1985) 1841-1859
33. Jakeman A.J., and Hornberger G.M. How much complexity is warranted in a rainfall-runoff model?. Water Resources Research 29 8 (1993) 2637-2649
34. Jakeman A.J., Letcher R.A., and Norton J.P. Ten iterative steps in development and evaluation of environmental models. Environmental Modelling & Software 21 5 (2006) 602-614
35. Johnston P.R., and Pilgrim D.H. Parameter optimisation for watershed models. Water Resources Research 12 3 (1976) 477-486
36. Jolma A., and Norton J. Methods of uncertainty treatment in environmental models. Environmental Modelling & Software 20 8 (2005) 979-980
37. Kavetski D., Franks S., and Kuczera G. Confronting input uncertainty in environmental modelling. In: Duan Q., Gupta H.V., Sorooshian S., Rousseau A.N., and Turcotte R. (Eds). Calibration of Watershed Models. Water Science and Application 6 (2002), American Geophysical Union 49-68 10/1029/006WS04
38. Keim, D.A., 1996. Pixel-Oriented Database Visualizations. Sigmond Record, Special Issue on Information Visualization.
39. Kottegoda N.T., and Rosso R. Statistics, Probability, and Reliability for Civil and Environmental Engineers (1997), McGraw-Hill, New York, USA
40. Lee H., McIntyre N., Wheater H.S., and Young A. Selection of conceptual models for regionalisation of the rainfall-runoff relationship. Journal of Hydrology 312 (2005) 125-147
41. Lence B.J., and Takyi A.K. Data requirements for seasonal discharge programs: an application of a regionalized sensitivity analysis. Water Resources Research 28 7 (1992) 1781-1789
42. Letcher R.A., Croke B.F.W., and Jakeman A.J. Integrated assessment modeling for water resource allocation and management: A generalized conceptual framework. Environmental Modelling & Software 22 5 (2007) 733-742
43. Martinec J., and Rango A. Merits of statistical criteria for the performance of hydrological models. Water Resources Bulletin 25 2 (1989) 421-432
44. McIntyre N.R., and Wheater H.S. A tool for risk-based management of surface water quality. Environmental Modelling & Software 19 12 (2004) 1131-1140
45. McKay M.D., Beckman R.J., and Conover W.J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 2 (1979) 239-245
46. Merritt W.S., Croke B.F.W., and Jakeman A.J. Sensitivity testing of a model for exploring water resources utilization and management options. Environmental Modelling & Software 20 (2005) 1013-1030
47. Moore R.J., and Clarke R.T. A distribution function approach to rainfall runoff modeling. Water Resources Research 17 5 (1981) 1367-1382
48. Osidele O.O., and Beck M.B. Identification of model structure for aquatic ecosystems using regionalized sensitivity analysis. Water Science and Technology 43 7 (2001) 271-278
49. Pappenberger F., Iorgulescu I., and Beven K.J. Sensitivity analysis based on regional splits and regression trees (SARS-RT). Environmental Modelling & Software 21 (2006) 976-990
50. Pareto V. Manual of Political Economy. 1971 translation (1906), Augustus M. Kelley, New York
51. Patil S.R., and Frey H.C. Comparison of sensitivity analysis methods based upon applications to a food safety risk model. Risk Analysis 23 3 (2004) 573-585
52. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical Recipes in C. second ed. (1992), Cambridge University Press, Cambridge, UK
53. Refsgaard J.C., and Henriksen H.J. Modelling guidelines - terminology and guiding principles. Advances in Water Resources 27 1 (2004) 71-82
54. Saltelli A., Tarantola S., Campolongo F., and Ratto M. Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models (2004), Wiley. 0-470-87093-1
55. Sieber A., and Uhlenbrook S. Sensitivity analyses of a distributed catchment model to verify the model structure. Journal of Hydrology 310 1-4 (2005) 216-235
56. Sincock A.M., Wheater H.S., and Whitehead P.G. Calibration and sensitivity analysis of a river water quality model under unsteady flow conditions. Journal of Hydrology 277 3-4 (2003) 214-229
57. Singh V.P. Hydrologic Systems - Rainfall-Runoff Modeling vol. 1 (1988), Prentice Hall, Englewood Cliffs, New Jersey
58. Singh V.P., and Woolhiser D.A. Mathematical modeling of watershed hydrology. Journal of Hydrologic Engineering 7 4 (2002) 270-292
59. Smith R.M.S., and Wheater H.S. Multiple objective evaluation of a simple phosphorus transfer model. Hydrological Processes 18 9 (2004) 1703-1720
60. Smith R.M.S., Evans D.J., and Wheater H.S. Evaluation of two hybrid metric-conceptual models for simulating phosphorus transfer from agricultural land in the river Enborne, a lowland UK catchment. Journal of Hydrology 304 1-4 (2005) 366-380
61. Spear R.C. Regional sensitivity analysis in environmental systems. In: Young P.C. (Ed). Concise Encyclopedia of Environmental Systems (1993), Pergamon Press, Oxford, UK 476-479
62. Spear R.C., and Hornberger G.M. Eutrophication in Peel Inlet - II. Identification of critical uncertainties via generalized sensitivity analysis. Water Research 14 (1980) 43-49
63. Uhlenbrook S., Seibert J., Leibundgut C., and Rohde A. Prediction uncertainty of conceptual rainfall-runoff models caused by problems in identifying model parameters and structures. Hydrological Sciences Bulletin 44 5 (1999) 779-797
64. Van Asselt M.B.A., and Rotmans J. Uncertainty in perspective. Global Environmental Change 6 2 (1996) 121-157
65. Vrugt J.A., Gupta H.V., Bouten W., and Sorooshian S. A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resources Research 39 8 (2003) 1201 10.1029/2002WR001642
66. Wagener T. Evaluation of catchment models. Hydrological Processes 17 (2003) 3375-3378
67. Wagener, T., Gupta, H.V. Model identification for hydrological forecasting under uncertainty. Stochastic Environmental Research and Risk Assessment 19, 378-387, doi:10.1007/s00477-005-0006-5.
68. Wagener T., and McIntyre N. Identification of hydrologic models for operational purposes. Hydrological Sciences Journal 50 5 (2005) 735-751
69. Wagener T., and Wheater H.S. Parameter estimation and regionalization for continuous rainfall-runoff models including uncertainty. Journal of Hydrology 320 1-2 (2006) 132-154
70. Wagener T., Boyle D.P., Lees M.J., Wheater H.S., Gupta H.V., and Sorooshian S. A framework for development and application of hydrological models. Hydrology and Earth System Sciences 5 1 (2001) 13-26
71. Wagener T., Lees M.J., and Wheater H.S. A toolkit for the development and application of parsimonious hydrologic models. In: Singh V.P., and Frevert D.K. (Eds). Mathematical Models of Large Watersheds Hydrology (2002), Water Resources Publications LLC, USA 91-140
72. Wagener T., Gupta H.V., Carpenter K., James B., Vázquez R., Sorooshian S., and Shuttleworth J. A hydroarchive for the free exchange of hydrological software Website. Hydrological Processes 18 2 (2003) 389-391
73. Wagener T., Wheater H.S., and Gupta H.V. Rainfall-Runoff Modelling in Gauged and Ungauged Catchments (2004), Imperial College Press, London, UK
74. Ye W., Jakeman A.J., and Young P.C. Identification of improved rainfall-runoff models for an ephemeral low-yielding Australian catchment. Environmental Modelling & Software 13 1 (1998) 59-74
75. Young P.C. Data-based mechanistic modelling of environmental, ecological, economic and engineering systems. Environmental Modelling & Software 13 2 (1998) 105-122
76. Young P.C. Data-based mechanistic modelling and validation of rainfall-flow processes. In: Anderson M.G., and Bates P.D. (Eds). Model Validation: Perspectives in Hydrological Sciences (2001), John Wiley & Sons, Ltd.