What do we mean by sensitivity analysis? the need for comprehensive characterization of "global" sensitivity in Earth and Environmental systems models

Water Resources Research

Volumn 51, Issue 5, 2015, Pages 3070-3092

  Razavi, Saman ^a   Gupta, Hoshin V ^b  

^a UNIVERSITY OF SASKATCHEWAN   (Canada)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Earth and Environmental system models; interaction effect; Morris; response surface; sensitivity analysis; Sobol

Indexed keywords

PHILOSOPHICAL ASPECTS; SURFACE PROPERTIES;

ENVIRONMENTAL SYSTEMS; INTERACTION EFFECT; MORRIS; RESPONSE SURFACE; SOBOL;

SENSITIVITY ANALYSIS;

ENVIRONMENTAL MONITORING; GLOBAL CLIMATE; GLOBAL ENVIRONMENT FACILITY; OPTIMIZATION; SENSITIVITY ANALYSIS;

EID: 85027950072     PISSN: 00431397     EISSN: 19447973     Source Type: Journal    
DOI: 10.1002/2014WR016527     Document Type: Article

References (53)

1. Bard, Y., (1974), Nonlinear Parameter Estimation, Academic, N. Y.
2. Bastidas, L. A., T. S. Hogue, S. Sorooshian, H. V. Gupta, and, W. J. Shuttleworth, (2006), Parameter sensitivity analysis for different complexity land surface models using multicriteria methods, J. Geophys. Res., 111, D20101, doi: 10.1029/2005JD006377.
3. Campolongo, F., J. Cariboni, and, A. Saltelli, (2007), An effective screening design for sensitivity analysis of large models, Environ. Modell. Software, 22 (10), 1509-1518.
4. Chu-Agor, M. L., R. Muñoz-Carpena, G. Kiker, A. Emanuelsson, and, I. Linkov, (2011), Exploring vulnerability of coastal habitats to sea level rise through global sensitivity and uncertainty analyses, Environ. Modell. Software, 26 (5), 593-604.
5. Clark, M. P., D. Kavetski, and, F. Fenicia, (2011), Pursuing the method of multiple working hypotheses for hydrological modeling, Water Resour. Res., 47, W09301, doi: 10.1029/2010WR009827.
6. Crosetto, M., S. Tarantola, and, A. Saltelli, (2000), Sensitivity and uncertainty analysis in spatial modelling based on GIS, Agric. Ecosyst. Environ., 81 (1), 71-79.
7. Cukier, R. I., C. M. Fortuin, K. E. Shuler, A. G. Petschek, and, J. H. Schaibly, (1973), Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory, J. Chem. Phys., 59 (8), 3873-3878.
8. Degenring, D., C. Froemel, G. Dikta, and, R. Takors, (2004), Sensitivity analysis for the reduction of complex metabolism models, J. Process Control, 14 (7), 729-745.
9. Duan, Q., S. Sorooshian, and, V. Gupta, (1992), Effective and efficient global optimization for conceptual rainfall-runoff models, Water Resour. Res., 28 (4), 1015-1031.
10. Edwards, A. W. F., (1972), Likelihood: An Account of the Statistical Concept of Likelihood and Its Application to Scientific Inference, Cambridge Univ. Press, Cambridge, U. K.
11. Fisher, R. A., (1951), The Design of Experiments. Edinburgh: Oliver & Boyd.
12. Gupta, H. V., S. Sorooshian, and, P. O. Yapo, (1998), Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information, Water Resour. Res., 34 (4), 751-763.
13. Gupta, H. V., L. A. Bastidas, S. Sorooshian, W. J. Shuttleworth, and, Z. L. Yang, (1999), Parameter estimation of a land surface scheme using multicriteria methods, J. Geophys. Res., 104 (D16), 19,491-19,503.
14. Gupta, H. V., T. Wagener, and, Y. Q. Liu, (2008), Reconciling theory with observations: Elements of a diagnostic approach to model evaluation, Hydrol. Processes, 22 (18), 3802-3813.
15. Gupta, H. V., H. Kling, K. K. Yilmaz, and, G. F. Martinez, (2009), Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377 (1-2), 80-91.
16. Hamby, D., (1994), A review of techniques for parameter sensitivity analysis of environmental models, Environ. Monit. Assess., 32 (2), 135-154.
17. Homma, T., and, A. Saltelli, (1996), Importance measures in global sensitivity analysis of nonlinear models, Reliability Eng. Syst. Safety, 52 (1), 1-17.
18. Iman, R. L., and, W. J. Conover, (1979), The use of the rank transform in regression, Technometrics, 21 (4), 499-509.
19. Kavetski, D., and, M. P. Clark, (2010), Ancient numerical daemons of conceptual hydrological modeling: 2. Impact of time stepping schemes on model analysis and prediction, Water Resour. Res., 46, W10511, doi: 10.1029/2009WR008896.
20. Kleijnen, J. P. C., (1995), Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments, Syst. Dyn. Rev., 11 (4), 275-288.
21. Kleijnen, J. P. C., (2005), An overview of the design and analysis of simulation experiments for sensitivity analysis, Eur. J. Oper. Res., 164 (2), 287-300.
22. Krzykacz-Hausmann, B., (2001), Epistemic sensitivity analysis based on the concept of entropy, in Proceedings of SAMO2001, edited by P. Prado and R. Bolado, pp. 31-35, CIEMAT, Madrid.
23. Kuczera, G., and, E. Parent, (1998), Monte Carlo assessment of parameter uncertainty in conceptual catchment models: The Metropolis algorithm, J. Hydrol., 211 (1), 69-85.
24. Lidén, R., and, J. Harlin, (2000), Analysis of conceptual rainfall-runoff modelling performance in different climates, J. Hydrol., 238 (3-4), 231-247.
25. Liu, H., W. Chen, and, A. Sudjianto, (2006), Relative entropy based method for probabilistic sensitivity analysis in engineering design, J. Mech. Design, 128 (2), 326-336.
26. Montgomery, D. C., (2008), Design and Analysis of Experiments, John Wiley & Sons, Inc., Hoboken, N. J.
27. Morris, M. D., (1991), Factorial sampling plans for preliminary computational experiments, Technometrics, 33 (2), 161-174.
28. Muleta, M. K., and, J. W. Nicklow, (2005), Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model, J. Hydrol., 306 (1-4), 127-145.
29. Myers, R. H., D. C. Montgomery, and, C. M. Anderson-Cook, (2011), Response Surface Methodology: Process and Product Optimization Using Designed Experiments, John Wiley & Sons. Hoboken, N. J.
30. Nossent, J., P. Elsen, and, W. Bauwens, (2011), Sobol' sensitivity analysis of a complex environmental model, Environ. Modell. Software, 26 (12), 1515-1525.
31. Pappenberger, F., K. J. Beven, M. Ratto, and, P. Matgen, (2008), Multi-method global sensitivity analysis of flood inundation models, Adv. Water Resour., 31 (1), 1-14.
32. Pietroniro, A., V. Fortin, N. Kouwen, C. Neal, R. Turcotte, B. Davison, D. Verseghy, E. Soulis, R. Caldwell, and, N. Evora, (2007), Development of the MESH modelling system for hydrological ensemble forecasting of the Laurentian Great Lakes at the regional scale, Hydrol. Earth Syst. Sci., 11 (4), 1279-1294.
33. Rabitz, H., M. Kramer, and, D. Dacol, (1983), Sensitivity analysis in chemical-kinetics, Annu. Rev. Phys. Chem., 34, 419-461.
34. Rakovec, O., M. C. Hill, M. P. Clark, A. H. Weerts, A. J. Teuling, and, R. Uijlenhoet, (2014), Distributed Evaluation of Local Sensitivity Analysis (DELSA), with application to hydrologic models, Water Resour. Res., 50, 409-426, doi: 10.1002/2013WR014063.
35. Ratto, M., S. Tarantola, and, A. Saltelli, (2001), Sensitivity analysis in model calibration: GSA-GLUE approach, Comput. Phys. Commun., 136 (3), 212-224.
36. Razavi, S., B. A. Tolson, and, D. H. Burn, (2012a), Review of surrogate modeling in water resources, Water Resour. Res., 48, W07401, doi: 10.1029/2011WR011527.
37. Razavi, S., B. A. Tolson, and, D. H. Burn, (2012b), Numerical assessment of metamodelling strategies in computationally intensive optimization, Environ. Modell. Software, 34, 67-86.
38. Rosolem, R., H. V. Gupta, W. J. Shuttleworth, X. Zeng, and, L. G. G. Gonçalves, (2012), A fully multiple-criteria implementation of the Sobol′ method for parameter sensitivity analysis, J. Geophys. Res., 117, D07103, doi: 10.1029/2011JD016355.
39. Ruano, M. V., J. Ribes, A. Seco, and, J. Ferrer, (2012), An improved sampling strategy based on trajectory design for application of the Morris method to systems with many input factors, Environ. Modell. Software, 37, 103-109.
40. Sacks, J., W. J. Welch, T. J. Mitchell, and, H. P. Wynn, (1989), Design and analysis of computer experiments, Stat. Sci., 4 (4), 409-435.
41. Saltelli, A., and, P. Annoni, (2010), How to avoid a perfunctory sensitivity analysis, Environ. Modell. Software, 25 (12), 1508-1517.
42. Saltelli, A., and, R. Bolado, (1998), An alternative way to compute Fourier amplitude sensitivity test (FAST), Comput. Stat. Data Anal., 26 (4), 445-460.
43. Saltelli, A., S. Tarantola, and, K.-S. Chan, (1999), A quantitative model-independent method for global sensitivity analysis of model output, Technometrics, 41 (1), 39-56.
44. Saltelli, A., S. Tarantola, F. Campolongo, and, M. Ratto, (2004), Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models, John Wiley.
45. Saltelli, A., M. Ratto, T. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and, S. Tarantola, (2008), Global Sensitivity Analysis: The Primer, John Wiley & Sons.
46. Shin, M.-J., J. H. Guillaume, B. F. Croke, and, A. J. Jakeman, (2013), Addressing ten questions about conceptual rainfall-runoff models with global sensitivity analyses in R, J. Hydrol., 503, 135-152.
47. Sobol, I. M., (2001), Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simul., 55 (1-3), 271-280.
48. Sobol, I. M., and, S. Kucherenko, (2009), Derivative based global sensitivity measures and their link with global sensitivity indices, Math. Comput. Simul., 79 (10), 3009-3017.
49. Sobol, I. M., (1990), Sensitivity estimates for nonlinear mathematical models [in Russian], Mat. Modelirovanie, 2 (1), 112-118.
50. Spear, R. C., and, G. M. Hornberger, (1980), Eutrophication in peel inlet-II. Identification of critical uncertainties via generalized sensitivity analysis, Water Res., 14 (1), 43-49.
51. Spear, R. C., T. M. Grieb, and, N. Shang, (1994), Parameter uncertainty and interaction in complex environmental models, Water Resour. Res., 30 (11), 3159-3169.
52. van Griensven, A., T. Meixner, S. Grunwald, T. Bishop, M. Diluzio, and, R. Srinivasan, (2006), A global sensitivity analysis tool for the parameters of multi-variable catchment models, J. Hydrol., 324 (1-4), 10-23.
53. Vrugt, J. A., H. V. Gupta, W. Bouten, and, S. Sorooshian, (2003), A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters, Water Resour. Res., 39 (8), 1201, doi: 10.1029/2002WR001642.