Sensitivity analysis as an ingredient of modeling

Statistical Science

Volumn 15, Issue 4, 2000, Pages 377-395

  Saltelli, A ^a   Tarantola, S ^a   Campolongo, F ^a  

^a JOINT RESEARCH CENTRE   (Italy)

Author keywords

Global sensitivity analysis; Model transparency; Numerical experiments; Predictive uncertainty; Quantitative sensitivity measure; Reliability and dependability of models; Screening

Indexed keywords

EID: 0001244976     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1009213004     Document Type: Article

References (58)

1. Adriaanse, A. (1993). Environmental Policy Performance Indicators. Sdu Uitgeverij Koninginnegracht, The Hague.
2. Archer, G., Saltelli, A. and Sobol’, I. M. (1997). Sensitivity measures, ANOVA like techniques and the use of bootstrap. J. Statist. Comput. Simul. 58 99-120.
3. Bates, T. s., Calhoun, J. A. and Quinn, P. K. (1992). Variations in the methanesulfonate to sulfate molar ratio in submicrometer marine areosol particles over the South Pacific Ocean. J. Geophys. Res. 97 9859-9865.
4. Beck, M. B., Ravetz, J. R., Mulkey, L. A. and Barnwell, T. O. (1997). On the problem of model validation for predictive exposure assessments. Stochastic Hydrology and Hydraulics 11 229-254.
5. Bedford, T. (1998). Sensitivity indices for (tree-) dependent variables. In Proceedings of the Second International Symposium on Sensitivity Analysis of Model Output (SAMO98) (K. Chan, S. Tarantola and F. Campolongo, eds.) 17-20. EUR Report 17758 EN, Luxembourg.
6. Box, G. E. P., Hunter, W. G. and Hunter, J. S. (1978). Statistics for Experimenters. Wiley, New York.
7. Campolongo, F., Saltelli, a., Jensen, N. R., Wilson, J. and Hjorth, J. (1999). The role of multiphase chemistry in the oxidation of dimethylsulphide (DMS). A latitude dependent analysis. J. Atmospheric Chem. 32 327-356.
8. Campolongo, F., Tarantola, S. and Saltelli, A. (1999). Tackling quantitatively large dimensionality problems. Comput. Phys. Comm. 117 75-85.
9. Cawlfield, J. D. and Wu, M.-C. (1993). Probabilistic sensitivity analysis for one-dimensional reactive transport in porous media. Water Resources Research 29, 661-672.
10. Charlson, R. j., Schwartz, S. E., Hales, J. M., Cess, R. D., Coakley, J. A. Jr., Hansen, J. E. and Hofmann, D. J. (1992). Climate forcing by anthropogenic aerosols. Science 255 423-430.
11. Cukier, R. I., Fortuin, C. M., Shuler, K. E., Petschek A. G. and Schaibly, J. H. (1973). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I. Theory. J. Chem. Phys. 59 3873-3878.
12. Cukier, R. I., Levine, H. B. and Shuler, K. E. (1978). Nonlinear sensitivity analysis of multiparameter model systems. J. Comput. Phys. 26 1-42.
13. Cukier, R.I., Schaibly, J. H. and Shuler, K. E. (1975). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. III. Analysis of the approximations. J. Chem. Phys. 63 1140-1149.
14. Draper, D., Pereira, a., Prado, p., Saltelli, a., Cheal, R., Eguilior, s., Mendes, B. and Tarantola, S. (1999). Scenario and parametric uncertainty in GESAMAC: a methodological study in nuclear waste disposal risk assessment. Comput. Phys. Comm. 117 142-155.
15. Draper, D., Saltelli, a., Tarantola, S. and Prado, P. (2000). Scenario and parametric sensitivity and uncertainty analyses in nuclear waste disposal risk assessment: the case of GESAMAC. In Sensitivity Analysis (A. Saltelli, K. Chan and M. Scott, eds.) 275-292. Wiley, New York.
16. Draper, N. R., and Smith, H. (1981). Applied Regression Analysis. Wiley, New York.
17. European Environment Agency (EEA) (1996). Atmospheric Emission Inventory Guidebook by EMEP/CORINAIR. European Environment Agency, Copenhagen.
18. EUROSTAT (1999). Towards Environmental Pressure Indicators for the EU. EUROSTAT, Luxembourg.
19. Friedman, J. and Stuetzle, W. (1981). Projection pursuit regression. J. Amer. Statist. Assoc. 76 580-619.
20. Hardouin Duparc, O., Sanz Velasco, E. and Velasco, V. R. (1984). Elastic surface waves in crystals with overlayers: cubic symmetry. Phys. Rev. B 30 2042-2048.
21. Helton, J. C. (1993). Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliability Engrg. System Safety 42 327-367.
22. Helton, J. C., Iman, R. L., Johnson, J. D. and Leigh, C. D. (1989). Uncertainty and sensitivity analysis of a dry containment test problem for the MAEROS aerosol model. Nuclear Sci. Engrg. 102 22-42.
23. HENRION, M. and FISCHHOFF, B. (1986). Assessing uncertainty in physical constants. Amer. J. Phys. 54 791-799.
24. HOMMA, T. and SALTELLI, A. (1996). Importance measures in global sensitivity analysis of model output. Reliability Engrg. System Safety 52 1-17.
25. HORNBERGER, G. M. and SPEAR, R. C. (1981). An approach to the preliminary analysis of environmental systems. J. Environ. Management 12 7-18.
26. Houghton, J. T., MeiraFilho, L. G., Callander, B. A., Harris, N., Kattenberg, A. and MASKELL, K., eds. (1996). Climate Change 1995. The Science of Climate Change. Contribution of WGI to the Second Assessment Report of the Intergovernmental Panel on Climate Change. IPCC, Cambridge.
27. IMAN, R. L. and HELTON, J. C. (1988). An investigation of uncertainty and sensitivity analysis techniques for computer models. Risk Anal. 8 71-90.
28. IMAN, R. L. and HORA, S. C. (1990). A robust measure of uncertainty importance for use in fault tree system analysis. Risk Anal. 10 401-406.
29. JANSEN, M. J. W., ROSSING, W. A. H. and DAAMEN, R. A. (1994). Monte Carlo estimation of uncertainty contributions from several independent multivariate sources. In Predictability and Nonlinear Modeling in Natural Sciences and Economics (Gasman and van Straten eds.) 334-343.
30. KLEIJNEN, J. P. C. (1998). Experimental design for sensitivity analysis, optimization, and validation of simulation models. In Handbook of Simulation (J. Banks, ed.) 173-224. Wiley, New York.
31. Koda, M., McRae, G. J. and Seinfeld, J. H. M. (1979). Automatic sensitivity analysis of kinetic mechanisms. Internat. J. Chem. Kinetics 11 427-444.
32. LIEPMANN, D. and STEPHANOPOULOS, G. (1985). Development and global sensitivity analysis of a closed ecosystem model. Ecological Modeling 30 13-47.
33. McKay, M. D. (1995). Evaluating prediction uncertainty. Los Alamos National Laboratories Report NUREG/CR-6311, LA-12915-MS.
34. McKay, M. D. (1996). Variance-based methods for assessing uncertainty importance in NUREG-1150 analyses. LA-UR-96-2695.
35. MORRIS, M. D. (1991). Factorial sampling plans for preliminary computational experiments. Technometrics 33 161-174.
36. OECD/NEA PSAC User Group (1989). PSACOIN Level E intercomparison. An international code intercomparison exercise on a hypothetical safety assessment case study for radioactive waste disposal systems (prepared by B. W. Goodwin, J. M. Laurens, J. E. Sinclair, D. A. Galson and E. Sartori). OECD-NEA, Paris.
37. OECD/NEA PSAG User Group (1993). PSACOIN Level S intercomparison. An international code intercomparison exercise on a hypothetical safety assessment case study for radioactive waste disposal systems. OECD-NEA, Paris.
38. O’Hagan, A., Kennedy, M. C. and Oakley, J. E. (1999). Uncertainty analysis and other inference tools for complex computer codes (with discussion). Bayesian Statist. 6 503-524.
39. ORESKES, N., Shrader-Frechette, K. and Belitz, K. (1994). Verification, validation, and confirmation of numerical models in the earth sciences. Science 263 641-646.
40. PLANAS, C. and DEPOUTOT, R. (2000). Sensitivity analysis as a tool for time series modeling. In Sensitivity Analysis (A. Saltelli, K. Chan and M. Scott, eds.) 293-310. Wiley, New York.
41. PUOLAMAA, M., KAPLAS, M. and REINIKAINEN, T. (1996). Index of Environmental Friendliness—A Methodological Study. Statistics Finland, Helsinki.
42. RABITZ, H. (1989). System analysis at molecular scale. Science 246 221-226.
43. RABITZ, H., AII, O. F., SHORTER, J. and SHIM, K. (1999). Efficient input-output model representations. Comput. Phys. Comm. 117 11-20.
44. RIOS INSUA, D. (1990). Sensitivity Analysis in Multi-Objective Decision Making. Springer, Berlin.
45. Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P. (1989). Design and analysis of computer experiments. Statist. Sci. 4 409-435.
46. SALTELLI, A. and BOLADO, R. (1998). An alternative way to compute Fourier amplitude sensitivity test (FAST). Comput. Statist. Data Anal. 26 445-460.
47. Saltelli, A., Chan, K. and Scott, M., eds. (2000). Sensitivity Analysis. Wiley, New York.
48. SALTELLI, A. and Hjorth, J. (1995). Uncertainty and sensitivity analyses of OH-initiated dimethylsulphide (DMS) oxidation kinetics. J. Atmospheric Chem. 21 187-221.
49. SALTELLI, A. and SOBOL’, I. M. (1995). About the use of rank transformation in sensitivity analysis of model output. Reliability Engrg. System Safety 50 225-239.
50. Saltelli, A., Tarantola, S. and Chan, K. (1999). A quantitative, model independent method for global sensitivity analysis of model output. Technometrics 41 39-56.
51. ScHAIBLY, J. H. and SHULER, K. E. (1973). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. Part II. Applications. J. Chem. Phys. 59 3879-3888.
52. SMIDTS, O. F. and DEVOOGHT, J. (1997). A variational method for determining uncertain parameters and geometry in hydrogeology. Reliability Engrg. System Safely 57 5-19.
53. SOBOL’, I. M. (1990). Sensitivity estimates for nonlinear mathematical models. Mathematicheskoe Modelirovanie. 2 112-118. [Translated as Sensitivity analysis for nonlinear mathematical models. Math. Modeling Comput. Experiment 1 (1993) 407-414.]
54. Tarantola, S., Jesinghaus, J. and Puolamaa, M. (2000). Global sensitivity analysis: a quality assurance tool in environmental policy modeling. In Sensitivity Analysis (A. Saltelli, K. Chan and M. Scott, eds.) 385-397. Wiley, New York.
55. Tarantola, S., Pastorelli, R., Beghi, M. G. and Bottani, C. E. (2000). A dataless pre-calibration analysis in solid state physics. In Sensitivity Analysis (A. Saltelli, K. Chan and M. Scott, eds.) 311-316. Wiley, New York.
56. TURANYI, T. (1990). Sensitivity analysis of complex kinetic systems. Tools and applications. J. Math. Chem. 5 203-248.
57. YOUNG, P. (1999). Data-based mechanistic modeling, generalised sensitivity and dominant mode analysis. Comput. Phys. Comm. 117 113-129.
58. Welch, W. J., Buck, R. J., Sacks, J., Wynn, H. P., Mitchell, T. J. and MORRIS, M. D. (1992). Screening, predicting, and computer experiments. Technometrics 34 15-47.