Uncertainty in the environmental modelling process - A framework and guidance

Environmental Modelling and Software

Volumn 22, Issue 11, 2007, Pages 1543-1556

  Refsgaard, Jens Christian ^a   van der Sluijs, Jeroen P ^b   Højberg, Anker Lajer ^a   Vanrolleghem, Peter A ^c,d  

^a GEOLOGICAL SURVEY OF DENMARK AND GREENLAND   (Denmark)

^b UTRECHT UNIVERSITY   (Netherlands)

^c GHENT UNIVERSITY   (Belgium)

^d UNIVERSITÉ LAVAL   (Canada)

Author keywords

Catchment modelling; Integrated water resources management; Uncertainty; Water framework directive

Indexed keywords

COMPUTER SIMULATION; MONTE CARLO METHODS; PARAMETER ESTIMATION; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS; WATER MANAGEMENT;

CATCHMENT MODELING; DATA UNCERTAINTY ENGINE (DUE); INTEGRATED WATER RESOURCES MANAGEMENT; INVERSE MODELING; WATER FRAMEWORK DIRECTIVE;

ENVIRONMENTAL ENGINEERING;

ENVIRONMENTAL MODELING; MONTE CARLO ANALYSIS; TYPOLOGY; UNCERTAINTY ANALYSIS; WATER MANAGEMENT; WATER RESOURCE;

EID: 34250709596     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2007.02.004     Document Type: Article

References (52)

1. Alcamo J. Scenarios as Tools for International Environmental Assessments (2001), European Environment Agency, Copenhagen Environmental Issues Report. Experts Corner Report. Prospects and Scenarios No. 5
2. Beck M.B. Water quality modelling: a review of the analysis of uncertainty. Water Resources Research 23 8 (1987) 1393-1442
3. Beven K., and Binley A.M. The future of distributed models, model calibration and uncertainty predictions. Hydrological Processes 6 (1992) 279-298
4. Beven K. Towards a coherent philosophy for modelling the environment. Proceedings of the Royal Society of London, A 458 2026 (2002) 2465-2484
5. Brown J.D. Knowledge, uncertainty and physical geography: towards the development of methodologies for questioning belief. Transactions of the Institute of British Geographers 29 3 (2004) 367-381
6. Brown J.D., Heuvelink G.B.M., and Refsgaard J.C. An integrated framework for assessing and recording uncertainties about environmental data. Water Science and Technology 52 6 (2005) 153-160
7. Butts M.B., Payne J.T., Kristensen M., and Madsen M. An evaluation of the impact of model structure on hydrological modelling uncertainty for streamflow simulation. Journal of Hydrology 298 (2004) 242-266
8. Crystal Ball. User Manual (2000), Decision Engineering Inc, Denver
9. De Marchi B. Public participation and risk governance. Science and Public Policy 30 3 (2003) 171-176
10. Doherty J. Ground water model calibration using pilot points and regularization. Ground Water 41 2 (2003) 170-177. http://www.sspa.com/pest (See also http://www.sspa.com/pest for further information/download of PEST).
11. Duan Q., Sorooshian S., and Gupta V.K. Optimal use of the SCE-UA global optimization method for calibrating watershed models. Journal of Hydrology 158 (1994) 265-284
12. EC. Directive 2000/60/EC of the European Parliament and of the Council of October 23 2000 Establishing a Framework for Community Action in the Field of Water Policy. Official Journal of the European Communities (2000) L327/1-L327/72 22.12.2000
13. EC. Common Implementation Strategy for the Water Framework Directive (2000/60/EC). Guidance Document No. 11. Planning Processes. Working Group 2.9 (2003), Office for the Official Publications of the European Communities, Luxembourg
14. EPA. Risk Assessment Forum, Guiding Principles for Monte Carlo Analysis, EPA/630/R-97/001 (1997). (http://www.epa.gov/NCEA/pdfs/montcarl.pdf)
15. Funtowicz S.O., and Ravetz J. Uncertainty and Quality in Science for Policy (1990), Kluwer Academic Publishers, Dordrecht
16. GWP. Integrated Water Resources Management. TAC Background Papers No. 4 (2000), Global Water Partnership, Stockholm
17. Helton J.C., and Davis F.J. Latin Hypercube sampling and the propagation of uncertainty analysis of complex systems. Reality Engineering and System Safety 81 (2003) 23-69
18. Henriksen, H.J., Refsgaard, J.C., Højberg, A.L., Ferrand, N., Gijsbers, P., Scholten, H., Public participation in relation to quality assurance of water resources modelling (HarmoniQuA). (submitted for publication).
19. Hora S.C. Acquisition of expert judgement: examples from risk assessment. Journal of Energy Engineering 118 (1992) 136-148
20. Højberg A.L., and Refsgaard J.C. Model Uncertainty - parameter uncertainty versus conceptual models. Water Science and Technology 52 6 (2005) 177-186
21. Jakeman A.J., and Letcher R.A. Integrated assessment and modelling: features, principles and examples for catchment management. Environmental Modelling & Software 18 (2003) 491-501
22. Janssen P.H.M., Petersen A.C., van der Sluijs J.P., Risbey J.S., and Ravetz J.R. RIVM/MNP Guidance for Uncertainty Assessment and Communication: Quickscan Hints & Actions List (2003-2003), RIVM/MNP. 90-6960-105-2. Available from www.nusap.net
23. Jønch-Clausen, T., 2004. Integrated Water Resources Management (IWRM) and Water Efficiency Plans by 2005. Why, What and How? Global Water Partnership, TEC Background Papers No. 10, Stockholm.
24. Klauer B., and Brown J.D. Conceptualising imperfect knowledge in public decision making: ignorance, uncertainty, error and 'risk situations'. Environmental Research, Engineering and Management 27 1 (2004) 124-128
25. Linkov I., and Burmistrov D. Model uncertainty and choices made by the modelers: lessons learned from the international atomic energy agency model intercomparisons. Risk Analysis 23 6 (2003) 1297-1308
26. Kloprogge P., and van der Sluijs J. The inclusion of stakeholder knowledge and perspectives in integrated assessment of climate change. Climatic Change 75 3 (2006) 259-389
27. Mandel J. The Statistical Analysis of Experimental Data (1984), Dover Publications, New York, USA 410 pp.
28. Maurel, P., (Ed.), 2003. Public participation and the European Water Framework Directive. Role of Information and Communication Tools. Cemagref, Montpellier, Workpackage 3 Report of the HarmoniCOP Project. www.harmonicop.info.
29. Middlemis H. Murray-Darling Basin Commission. Groundwater Flow Modelling Guideline (2000), Aquaterra Consulting Pty Ltd, South Perth, Western Australia Project no. 125
30. Pahl-Wostl C. Towards sustainability in the water sector - the importance of human actors and processes of social learning. Aquatic Sciences 64 (2002) 394-411
31. Pahl-Wostl C. The implications of complexity for integrated resources management. Environmental Modelling & Software 22 (2007) 561-569
32. Palisade Corporation, 2000. Guide to Using @RISK - Risk Analysis and Simulation Add-in for Microsoft Excel, Version 4, March 2000.
33. Pascual P., Steiber N., and Sunderland E. Draft Guidance on Development, Evaluation and Application of Regulatory Environmental Models (2003), The Council for Regulatory Environmental Modeling. Office of Science Policy, Office of Research and Development. US Environmental Protection Agency, Washington DC 60 pp.
34. Poeter, E.P., Hill, M.C., 1998. Documentation of UCODE, A Computer Code for Universal Inverse Modelling. U.S. Geological Survey, Water-Resources Investigations Report 98-4080. (Available from www.usgs.gov/software/code/ground_water/ucode).
35. Refsgaard J.C., and Henriksen H.J. Modelling guidelines - terminology and guiding principles. Advances in Water Resources 27 (2004) 71-82
36. Refsgaard J.C., Henriksen H.J., Harrar W.G., Scholten H., and Kassahun A. Quality assurance in model based water management - review of existing practice and outline of new approaches. Environmental Modelling & Software 20 (2005) 1201-1215
37. Refsgaard, J.C., van der Sluijs, J.P., Højberg, A.L., Vanrolleghem, P.A., 2005b. Uncertainty Analysis. Harmoni-CA Guidance No. 1, 46 pp. Downloadable from www.harmoni-ca.info.
38. Refsgaard J.C., Nilsson B., Brown J., Klauer B., Moore R., Bech T., Vurro M., Blind M., Castilla G., Tsanis I., and Biza P. Harmonised techniques and representative river basin data for assessment and use of uncertainty information in integrated water management (HarmoniRiB). Environmental Science and Policy 8 (2005) 267-277
39. Refsgaard J.C., van der Sluijs J.P., Brown J., and van der Keur P. A framework for dealing with uncertainty due to model structure error. Advances in Water Resources 29 (2006) 1586-1597
40. Saltelli A., Chan K., and Scott M. Sensitivity Analysis (2000), John Wiley & Sons publishers Probability and Statistics Series
41. Saltelli A., Tarantola S., Campolongo F., and Ratto M. Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models (2004), John Wiley & Sons Publishers
42. Scholten H., Kassahun A., Refsgaard J.C., Kargas T., Gavardinas C., and Beulens A.J.M. A methodology to support multidisciplinary model-based water management. Environmental Modelling & Software 22 (2007) 743-759
43. Selroos J.O., Walker D.D., Strom A., Gylling B., and Follin S. Comparison of alternative modelling approaches for groundwater flow in fractured rock. Journal of Hydrology 257 (2001) 174-188
44. Spetzler C.S., and von Holstein S. Probability encoding in decision analysis. Management Science 22 3 (1975) 340-358
45. Vandenberghe V., Bauwens W., and Vanrolleghem P.A. Evaluation of uncertainty propagation into river water quality predictions to guide future monitoring campaigns. Environmental Modelling & Software 22 (2007) 725-732
46. Van Der Heijden K. Scenarios: The Art of Strategic Conversation (1996), John Wiley & Sons. 0471966398
47. Van der Sluijs J.P., Janssen P.H.M., Petersen A.C., Kloprogge P., Risbey J.S., Tuinstra W., and Ravetz J.R. RIVM/MNP Guidance for Uncertainty Assessment and Communication Tool Catalogue for Uncertainty Assessment (2004), Utrecht University. (Downloadable from http://www.nusap.net/sections.php?op=viewarticle&;artid=17 )
48. Van der Sluijs J.P., Craye M., Funtowicz S., Kloprogge P., Ravetz J., and Risbey J. Combining quantitative and qualitative measures of uncertainty in model based environmental assessment: the NUSAP System. Risk Analysis 25 2 (2005) 481-492
49. In: Van Loon E., and Refsgaard J.C. (Eds). Guidelines for Assessing Data Uncertainty in River Basin Management Studies (2005), Geological Survey of Denmark and Greenland, Copenhagen 182. http://www.harmonirib.com Available on
50. Van Waveren R.H., Groot S., Scholten H., Van Geer F., Wösten H., Koeze R., and Noort J. Good Modelling Practice Handbook, STOWA (1999), Utrecht, The Netherlands (in Dutch). http://www.landandwater.tudelft.nl/Downloads/GMP-uk.pdf English version from
51. Walker W.E., Harremoës P., Rotmans J., Van der Sluijs J.P., Van Asselt M.B.A., Janssen P., and Krayer von Krauss M.P. Defining uncertainty a conceptual basis for uncertainty management in model-based decision support. Integrated Assessment 4 1 (2003) 5-17
52. Weiss C. Expressing scientific uncertainty. Law, Probability and Risk 2 (2003) 25-46