Global sensitivity analysis: The primer

Global Sensitivity Analysis: The Primer

Volumn , Issue , 2008, Pages 1-292

  Saltelli, Andrea ^a   Ratto, Marco ^a   Andres, Terry ^b   Campolongo, Francesca ^a   Cariboni, Jessica ^a   Gatelli, Debora ^a   Saisana, Michaela ^a   Tarantola, Stefano ^a  

^a JOINT RESEARCH CENTRE   (Italy)

^b UNIVERSITY OF MANITOBA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84889461919     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470725184     Document Type: Book

References (135)

1. Bakshi, G., C. Cao and Z. Chen (1997). Empirical performance of alternative option pricing models. The Journal of Finance LII(5), 2003–2049.
2. Bard, Y. (1974). Nonlinear Parameter Estimation. New York: Academic Press.
3. Beck, B. (1987). Water quality modelling: a review of the analysis of uncertainty. Water Resources Research 23, 1393–1442.
4. Beck, M., J. Ravetz, L. Mulkey and T. Barnwell (1997). Stochastic Hydrology and Hydraulics 11, 229–254.
5. Bell, D., H. Raiffa and A. Tversky (eds) (1988). Decision Making: Descriptive, Normative and Prescriptive Interactions. Cambridge University Press.
6. Beven, K. (1993). Prophecy, reality and uncertainty in distributed hydrological modelling. Advances in Water Resources 16, 41–51.
7. Beven, K. (2001). Rainfall-Runoff Modelling: The Primer. Chichester: John Wiley & Sons, Ltd. See also Saltelli et al. (2000), pp. 151–192.
8. Black, F. and M. Scholes (1973). The pricing of options and corporate liabilities. Journal of Political Economy 81, 637–654.
9. Borgonovo, E. (2006). Measuring uncertainty importance: investigation and comparison of alternative approaches. Risk Analysis 26, 1349–1361.
10. Borgonovo, E. and G. Apostolakis (2001). A new importance measure for risk-informed decision making. Reliability Engineering and System Safety 72, 193–212.
11. Box, G., W. Hunter and J. Hunter (1978). In Statistics for Experimenters. New York: John Wiley & Sons.
12. Bryson, A. and Y. Ho (1969). Applied Optimal Control. Blaisdell, Waltham, Mass.
13. Cacuci, D. (2003). Sensitivity and Uncertainty Analysis, Volume 1: Theory. Chapman and Hall.
14. Campolongo, F., J. Cariboni and A. Saltelli (2007). An effective screening design for sensitivity analysis of large models. Environmental Modelling and Software 22, 1509–1518.
15. Campolongo, F., J. Kleijnen and T. Andres (2000). Screening methods. In A. Saltelli, K. Chan and M. Scott (eds), Sensitivity Analysis, pp. 65–80. New York: John Wiley & Sons, Ltd.
16. Campolongo, F. and A. Saltelli (1997). Sensitivity analysis of an environmental model: a worked application of different analysis methods. Reliability Engineering and System Safety 52, 49–69.
17. Campolongo, F., A. Saltelli, N. R. Jensen, J. Wilson and J. Hjorth (1999a). The role of multiphase chemistry in the oxidation of dimethylsulphide (dms): a latitude dependent analysis. Journal of Atmospheric Chemistry 32, 327–356.
18. Campolongo, F., S. Tarantola and A. Saltelli (1999b). Tackling quantitatively large dimensionality problems. Computer Physics Communications 117, 75–85.
19. Carr, P. and D. Madan (1998). Option valuation using the fast Fourier transform. Journal of Computational Finance 2, 61–73.
20. Chatfield, C. (1993). Model uncertainty, data mining and statistical inference. Journal of the Royal Statistical Society A 158(3), 419–466.
21. Colbourn, C. and J. Dinitz (eds) (1996). CRC Handbook of Combinatorial Designs. CRC Press.
22. Craye, M., S. Funtowicz, P. Kloprogge, J. Ravetz and J. Risbey (2005). Combining quantitative and qualitative measures of uncertainty in model based environmental assessment: the nusap system. Risk Analysis 25(2), 481–492.
23. Crichton, M. (2004). State of Fear. New York: HarperCollins.
24. Cukier, R. I., C. M. Fortuin, K. E. Schuler, A. G. Petschek and J. H. Schaibly (1973). Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. i theory. The Journal of Chemical Physics 59, 3873–3878.
25. Cukier, R., H. Levine and K. Shuler (1978). Nonlinear sensitivity analysis of multiparameter model systems. Journal of Computational Physics 26, 1–42.
26. Doksum, K. and A. Samarov (1995). Nonparametric estimation of global functionals and a measure of the explanatory power of covariates in regression. The Annals of Statistics 23(5), 1443–1473.
27. EPA (2001). Draft guidance on the development, evaluation, and application of regulatory environmental models. Environmental Protection Agency (EPA), Council for Regulatory Environmental Modeling (CREM). http://cfpub.epa.gov/crem/cremlib.cfm whitepapers.
28. Esty, D., M. Levy, T. Srebotnjak, A. de Sherbinin, C. Kim and B. Anderson (2006). Pilot 2006 environmental performance index. New Haven: Yale Center for Environmental Law and Policy.
29. Farrell, K. N. (2007). Steering into the skid: the challenge of operationalising type II error avoidance in science for policy. Paper in progress.
30. Fixx, J. F. (1972). Games for the Super Intelligent. Garden City, NY: Doubleday & Co. Inc.
31. Funtowicz, S. (2004). Models of science and policy: from expert demonstration to post normal science. In ViewInternational Symposium: Uncertainty and Precaution in Environmental Management, Copenhagen. http://upem.er.dtu.dk/programme.htm.
32. Funtowicz, S., M. O’Connor, S. Faucheux, G. Froger and G. Munda (1996). Emergent complexity and procedural rationality: post-normal science for sustainability. In R. Costanza, J. Martinez-Alier and O. Segura (eds), Getting Down to Earth: Practical Applications of Ecological Economics. Washington, DC: Island Press/ISEE, pp. 223–248.
33. Funtowicz, S. O. and J. R. Ravetz (1990). Uncertainty and Quality in Science for Policy. Dordrecht: Kluwer Academic Publishers.
34. Funtowicz, S. O. and J. R. Ravetz (1993). Science for the post-normal age. Futures 25, 735–755.
35. Giona, M. and O. Paladino (1994). Bifurcation analysis and stability of controlled CSTR. Computers and Chemical Engineering 18, 877–887.
36. Grieb, T., N. Shang, R. C. Spear, S. A. Gherini and R. A. Goldstein (1999). Examination of model uncertainty and parameter interaction in the global carbon cycling model. Environment International 25, 787–803.
37. Grievank, A. (2000). Evaluating Derivatives, Principles and Techniques of Algorithmic Differentiation. SIAM.
38. Hankinson, S. E. Sc.D., J. E. Manson, F. E. Speizer and G. A. Colditz (eds) (2001). Healthy Women, Healthy Lives: A Guide to Preventing Disease, from the Landmark Nurses’ Health Study. Free Press.
39. Hastie, T. and R. Tibshirani (1990). Generalized Additive Models. Chapman and Hall.
40. Helton, J., J. Johnson, C. Sallaberry and C. Storlie (2006). Survey of sampling-based methods for uncertainty and sensitivity analysis. Reliability Engineering and System Safety 91 (10–11), 1175–1209.
41. Heston, S. (1993). A closed-form solution for options with stochastic volatility with applications to bond and currency options. Review of Financial Studies 6, 327–343.
42. Hodrick, T. and E. Prescott (1980). Post-war US business cycles: an empirical investigation. Manuscript, Carnegie Mellon University.
43. Høeg, P. (1995). Borderliners. Seal Books Publisher.
44. Hoeting, J. A., D. Madigan, A. E. Raftery and C. T. Volinsky (1999). Bayesian model averaging: a tutorial. Statistical Science 14(4), 382–417.
45. Homma, T. and A. Saltelli (1996). Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering and System Safety 52, 1–17.
46. Hora, S. and R. Iman (1986). A comparison of maximum/bounding and Bayesian/Monte Carlo for fault tree uncertainty analysis. Report SAND85-2839, Sandia Laboratories.
47. Hornberger, G. and R. Spear (1981). An approach to the preliminary analysis of environmental systems. Journal of Environmental Management 7, 7–18.
48. Hull, J. (1997). Options, Futures and Other Derivatives. Prentice-Hall Inc.
49. Iman, R. and S. Hora (1990). A robust measure of uncertainty importance for use in fault tree system analysis. Risk Analysis 10(3), 401–403.
50. In ’t Veld, R. J. (2000). Willingly and Knowingly. The Hague: LEMMA Publishers.
51. IPCC (1999). IPCC expert meetings on good practice guidance and uncertainty management in national greenhouse gas inventories. Background papers. http://www.ipcc-nggip.iges. or.jp/public/gp/gpg-bgp.htm.
52. IPCC (2000). Good practice guidance and uncertainty management in national greenhouse gas inventories. http://www.ipcc-nggip.iges.or.jp/public/gp/gpgaum.htm.
53. Ishigami, T. and T. Homma (1996, December 3–5). An importance qualification technique in uncertainty analysis for computer models. Proceedings of the isuma ’90, First International Symposium on Uncertainty Modelling and Analysis, University of Maryland.
54. Jakeman, A. J. and P. C. Young (1984). Recursive filtering and the inversion of ill-posed causal problems. Utilitas Mathematica 35, 351–376.
55. Kalman, R. (1960). A new approach to linear filtering and prediction problems. ASME Transactions, Journal of Basic Engineering 82D, 35–45.
56. Kass, R. E. and A. E. Raftery (1995). Bayes factors. Journal of the American Statistical Association 90(430), 773–795.
57. Kennedy, P. (2007). A Guide to Econometrics, 5th edn. Blackwell Publishing.
58. Kioutsioukis, I., D. Melas, C. Zerefos and I. Ziomas (2005). Efficient sensitivity computations in 3d air quality models. Computer Physics Communications 167, 23–33.
59. Kleijnen, J. (2007a). DASE: Design and Analysis of Simulation Experiments. Springer Science + Business Media (forthcoming).
60. Kleijnen, J. (2007b). Kriging metamodeling in simulation: a review. CentER discussion paper.
61. Konikov, L. and J. Bredehoeft (1992). Groundwater models cannot be validated. Advances in Water Resources 15(1), 75–83.
62. Krzykacz-Hausmann, B. (1990). Gesellschaft fuer Reaktor Sicherheit (GRS) MbH. Technical Report GRS-A-1700, Garching.
63. Leamer, E. (1978). Specification Searches: Ad Hoc Inferences with Nonexperimental Data. John Wiley & Sons, Ltd.
64. Leamer, E. (1990). Let’s take the con out of econometrics, and sensitivity analysis would help. In C. Granger (ed.), Modelling Economic Series. Oxford: Clarendon Press.
65. Le Dimet, F.-X., I. Navon and D. Daescu (2002). Second order information in data assimilation. Monthly Weather Review 130, 629–648.
66. l’Ecuyer, P. and T. Andres (1997). A random number generator based on the combination of four LCGs. Mathematics and Computers in Simulation 44, 99–107.
67. Li, G., J. Hu, S.-W. Wang, P. Georgopoulos, J. Schoendorf and H. Rabitz (2006). Random Sampling-High Dimensional Model Representation (RS-HDMR) and orthogonality of its different order component functions. Journal of Physical Chemistry A 110, 2474–2485.
68. Li, G., S.-W. Wang and H. Rabitz (2002). Practical approaches to construct RS-HDMR component functions. Journal of Physical Chemistry 106, 8721–8733.
69. Little, R. J. A. and D. Rubin (2002). Statistical Analysis with Missing Data. Hoboken, New Jersey: J. Wiley & Sons, Ltd.
70. McKay, M. (1996). Variance-based methods for assessing uncertainty importance in nureg-1150 analysis. Technical Report LA-UR-96-2695, 1, Los Alamos Laboratories.
71. Mac Lane, S. (1988). Science, Letters 241, 1144. Science, Letters 242, 1623, 1624.
72. Mallet, V. and B. Sportisse (2004). 3-D chemistry-transport model Polair: numerical issues, validation and automatic-differentiation strategy. Atmospheric Chemistry and Physics Discussions 4, 1371–1392.
73. Michaels, D. (2005, June). Doubt is their product. Scientific American 292(6).
74. Morbidelli, M. and A. Varma (1988). A generalized criterion for parametric sensitivity: application to thermal explosion theory. Chemical Engineering Science 43, 91–102.
75. Morris, M. D. (1991). Factorial sampling plans for preliminary computational experiments. Technometrics 33, 161–174.
76. Nardo, M., M. Saisana, A. Saltelli, S. Tarantola, A. Hoffman and E. Giovannini (2005). Handbook on constructing composite indicators: methodology and user guide. OECD statistics working paper. www.olis.oecd.org/olis/2005doc.nsf/LinkTo/std-doc (2005)3.
77. NIH (2002). Framingham Heart Study: 50 Years of Research Success. National Institutes of Health, National Heart, Lung and Blood Institute. www.nhlbi.nih.gov/about/framingham.
78. Oakley, J. and A. O’Hagan (2004). Probabilistic sensitivity analysis of complex models: a Bayesian approach. Journal of the Royal Statistical Society B 66, 751–769.
79. Oreskes, N., K. Shrader-Frechette and K. Belitz (1994). Verification, validation, and confirmation of numerical models in the earth sciences. Science 263, 641–646.
80. Paladino, O. and M. Ratto (2000). Robust stability and sensitivity of real controlled CSTRs. Chemical Engineering Science 55, 321–330.
81. Paladino, O., M. Ratto and P. Costa (1995). Chaos and chemical reactor models: sensitivity of dynamics on parameters uncertainty. Chemical Engineering Science 50, 3829–3833.
82. Pandis, S. N. and J. H. Seinfeld (1989). Sensitivity analysis of a chemical mechanism for aqueous phase atmospheric chemistry. Journal of Geophysical Research 94, 1105–1126.
83. Pappenberger, F., I. Iorgulescu and K. J. Beven (2006). Sensitivity analysis based on regional splits and regression trees (SARS-RT). Environmental Modelling and Software 21(7), 976–990.
84. Pappenberger, F. and V. Stauch (2007). Estimating Sobol’ sensitivity with cubic splines. Journal of Hydrology (submitted).
85. Pellegrini, L. and G. Biardi (1990). Chaotic behaviour of a controlled CSTR. Computers and Chemical Engineering 14, 1237–1247.
86. Pilkey, O. H. and L. Pilkey-Jarvis (2007). Useless Arithmetic. Why Environmental Scientists Can’t Predict the Future. New York: Columbia University Press.
87. Press, W. H., S. Teukolsky, W. T. Vetterling and B. P. Flannery (1997). Numerical Recipes in Fortran 77: The Art of Scientific Computing (Second ed.), Volume 1. New York: Cambridge University Press.
88. Rabitz, H. (1989). System analysis at molecular scale. Science 246, 221–226.
89. Ratto, M., A. Pagano and P. C. Young (2007). State dependent parameter meta-modelling and sensitivity analysis. Computer Physics Communications 177, 863–876.
90. Ratto, M., S. Tarantola, A. Saltelli and P. C. Young (2004). Accelerated estimation of sensitivity indices using State Dependent Parameter models. In K. M. Hanson and F. M. Hemez (eds), Sensitivity Analysis of Model Output, Proceedings of the 4th International Conference on Sensitivity Analysis of Model Output (SAMO 2004) Santa Fe, New Mexico, 8–11 March 2004, pp. 61–70. http://library.lanl.gov/ccw/samo2004/.
91. Ravetz, J. (2006). Models as metaphors. In B. e. a. Kasemir (ed.), Public Participation in Sustainability Science. Cambridge University Press.
92. Rosen, R. (1991). Life Itself – a Comprehensive Inquiry into Nature, Origin, and Fabrication of Life. Columbia University Press.
93. Sacks, J., W. J. Welch, T. J. Mitchell and H. P. Wynn (1989). Design and analysis of computer experiments. Statistical Science 4, 409–435.
94. Saisana, M., A. Saltelli and S. Tarantola (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society A 168(2), 307–323.
95. Saltelli, A. (2002). Making best use of model valuations to compute sensitivity indices. Computer Physics Communications 145, 280–297.
96. Saltelli, A. (2006). Composite indicators between analysis and advocacy. Social Indicators Research. DOI 10.1007/s11205-006-0024-9.
97. Saltelli, A., T. Andres and T. Homma (1993). Sensitivity analysis of model output: an investigation of new techniques. Computational Statistics and Data Analysis 15, 211–238.
98. Saltelli, A., K. Chan and M. Scott (eds) (2000). Sensitivity Analysis. Wiley Series in Probability and Statistics. New York: John Wiley & Sons, Ltd.
99. Saltelli, A. and J. Hjorth (1995). Uncertainty and sensitivity analyses of OH-initiated dimethyl sulphide (DMS) oxidation kinetics. Journal of Atmospheric Chemistry 21, 187–221.
100. Saltelli, A., M. Ratto, S. Tarantola and F. Campolongo (2005). Sensitivity analysis for chemical models. Chemical Reviews 105, 2811–2828.
101. Saltelli, A. and S. Tarantola (2002). On the relative importance of input factors in mathematical models: safety assessment for nuclear waste disposal. Journal of the American Statistical Association 97, 702–709.
102. Saltelli, A., S. Tarantola, F. Campolongo and M. Ratto (2004). Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models. John Wiley & Sons, Ltd.
103. Saltelli, A., S. Tarantola and K. Chan (1999). Quantitative model-independent method for global sensitivity analysis of model output. Technometrics 41(1), 39–56.
104. Schulze, N. and D. Baur (2006, May). Economic impact study on clearing and settlement – annex ii. Technical report, European Commission, DG-JRC. available at http://ec.europa. eu/internal_market/financial-markets/clearing/index_en.htm.
105. Schweppe, F. (1965). Evaluation of likelihood functions for Gaussian signals. IEEE Transactions on Information Theory 11, 61–70.
106. SIMLAB (2007). Ver 3.0. http://sensitivity-analysis.jrc.cec.eu.int/, European Commission, Joint Research Centre, Ispra.
107. Sobol’, I. M. (1967). On the distribution of points in a cube and the approximate evaluation of integrals. USSR Computational Mathematics and Mathematical Physics 7, 86–112.
108. Sobol’, I. M. (1976). Uniformly distributed sequences with additional uniformity properties. USSR Computational Mathematics and Mathematical Physics 16(5), 236–242.
109. Sobol’, I. M. (1990). Sensitivity estimates for nonlinear mathematical models. Matematich-eskoe Modelirovanie 2, 112–118. in Russian, translated in English in Sobol’ (1993).
110. Sobol’, I. M. (1993). Sensitivity analysis for non-linear mathematical models. Mathematical Modelling and Computational Experiment 1, 407–414. English translation of Russian original paper Sobol’ (1990).
111. Sobol’, I. M. (1996). On ‘freezing’ unessential variables. Vestnik Moskovskogo Universiteta, Serija Matematika 6, 92–94.
112. Sobol’, I. M., S. Tarantola, D. Gatelli, S. Kucherenko and W. Mauntz (2007). Estimating the approximation error when fixing unessential factors in global sensitivity analysis. Reliability Engineering and System Safety 92, 957–960.
113. Spear, R. (1997). Large simulation models: calibration, uniqueness and goodness of fit. Environmental Modelling and Software 12, 219–228.
114. Spear, R., T. Grieb and N. Shang (1994). Factor uncertainty and interaction in complex environmental models. Water Resources Research 30, 3159–3169.
115. Storlie, C. and J. Helton (2008). Multiple predictor smoothing methods for sensitivity analysis: description of techniques. Reliability Engineering and System Safety 93, 28–54.
116. Taleb, N. N., (2007), The Black Swan. Penguin. London.
117. Tarantola, S., D. Gatelli and T. Mara (2006). Random balance designs for the estimation of first order global sensitivity indices. Reliability Engineering and System Safety 91(6), 717–727.
118. Tarantola, S., R. Pastorelli, M. G. Beghi and C. E. Bottani (2000). A dataless pre-calibration analysis in solid state physics. In A. Saltelli, K. Chan and M. Scott (eds), Sensitivity Analysis, pp. 311–327. John Wiley & Sons, Ltd.
119. Turanyi, T. (1990). Sensitivity analysis of complex kinetic systems. Tools and applications. Journal of Mathematical Chemistry 5, 203–248.
120. Van der Sluijs, J. P. (2002). A way out of the credibility crisis of models used in integrated environmental assessment. Futures 34, 133–146.
121. Van der Sluijs, J., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J. and Risbey J. (2005). Experiences with the NUSAP system for multidimensional uncertainty assessment in model based foresight studies. Water Science and Technology 52(6), 133–144.
122. Varma, A., M. Morbidelli and H. Wu (1999). Parametric Sensitivity in Chemical Systems. Cambridge University Press.
123. Vuilleumier, L., R. Harley and N. Brown (1997). First-and second-order sensitivity analysis of a photochemically reactive system (a Green’s function approach). Environmental Science and Technology 31, 1206–1217.
124. Wichman, B. and I. Hill (1982). Algorithm AS 183: an efficient and portable pseudo-random number generator. Applied Statistics 31, 188–190.
125. Young, P. C. (1999a). Data-based mechanistic modelling, generalised sensitivity and dominant mode analysis. Computer Physics Communications 117, 113–129.
126. Young, P. C. (1999b). Nonstationary time series analysis and forecasting. Progress in Environmental Science 1, 3–48.
127. Young, P. C. (2000). Stochastic, dynamic modelling and signal processing: time variable and state dependent parameter estimation. In W. J. Fitzgerald. et al. (eds), Nonlinear and Nonstationary Signal Processing, pp. 74–114. Cambridge: Cambridge University Press.
128. Young, P. C. (2001). The identification and estimation of nonlinear stochastic systems. In A. I. Mees (ed.), Nonlinear Dynamics and Statistics. Boston: Birkhäuser.
129. Young, P. C. (2002). Advances in real-time flood forecasting. Philosophical Trans. Royal Society, Physical and Engineering Sciences 360, 1433–1450.
130. Young, P. C., P. McKenna, and J. Bruun (2001). Identification of nonlinear stochastic systems by state dependent parameter estimation. International Journal of Control 74, 1837–1857.
131. Young, P. C. and C. N. Ng (1989). Variance intervention. Journal of Forecasting 8, 399–416.
132. Young, P. C., S. Parkinson and M. Lees (1996). Simplicity out of complexity: Occam’s razor revisited. Journal of Applied Statistics 23, 165–210.
133. Young, P. C. and D. J. Pedregal (1996). Recursive fixed interval smoothing and the evaluation of Lidar measurements. Environmetrics 7, 417–427.
134. Young, P. C. and D. J. Pedregal (1999). Recursive and en-bloc approaches to signal extraction. Journal of Applied Statistics 26, 103–128.
135. Young, P. C., R. C. Spear and G. M. Hornberger (1978). Modeling badly defined systems: some further thoughts. In Proceedings SIMSIG Conference, Canberra, pp. 24–32.