Analysis of computationally demanding models with continuous and categorical inputs

Reliability Engineering and System Safety

Volumn 113, Issue 1, 2013, Pages 30-41

  Storlie, Curtis B ^a   Reich, Brian J ^b   Helton, Jon C ^c   Swiler, Laura P ^d   Sallaberry, Cedric J ^d  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

^c ARIZONA STATE UNIVERSITY   (United States)

^d SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

Categorical inputs; Emulator; Gaussian process; Meta model; Non parametric regression; Sensitivity analysis; Surrogate model; Uncertainty analysis

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SIMULATION; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS;

CATEGORICAL INPUTS; EMULATOR; GAUSSIAN PROCESSES; META MODEL; NON-PARAMETRIC REGRESSION; SURROGATE MODEL;

MATHEMATICAL MODELS;

EID: 84872698560     PISSN: 09518320     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ress.2012.11.018     Document Type: Article

References (61)

1. J. Sacks, W.J. Welch, T.J. Mitchel, and H.P. Wynn Design and analysis of computer experiments Statistical Science 4 1989 409 435
2. M.C. Kennedy, and A. O'Hagan Bayesian calibration of computer models (with discussion) Journal of the Royal Statistical Society B 63 2001 425 464 (Pubitemid 33305774)
3. C.B. Storlie, and J.C. Helton Multiple predictor smoothing methods for sensitivity analysis description of techniques Reliability Engineering and System Safety 93 2008 28 54 (Pubitemid 47391224)
4. C.B. Storlie, L.P. Swiler, J.C. Helton, and C.J. Sallaberry Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models Reliability Engineering and System Safety 94 2009 1735 1763
5. V.R. Joseph, and J.D. Delaney Functionally induced priors for the analysis of experiments Technometrics 49 2007 1 11 (Pubitemid 46373229)
6. P. Qian, H. Wu, and C.F.J. Wu Gaussian process models for computer experiments with qualitative and quantitative factors Technometrics 50 2008 383 396
7. R.B. Gramacy, and H.K. Lee Bayesian treed Gaussian process models with an application to computer modeling Journal of the American Statistical Association 103 2008 1119 1130
8. D. Higdon, J. Gattiker, B. Williams, and M. Rightley Computer model validation using high-dimensional output Journal of the American Statistical Association 103 2008 570 583
9. M.J. Bayarri, J.O. Berger, J. Cafeo, G. Garcia-Donato, F. Liu, and J. Palomo Computer model validation with functional output Annals of Statistics 35 2007 1874 1906
10. J.C. Helton, and R.J. Breeding Calculation of reactor accident safety goals Reliability Engineering and System Safety 39 1993 129 158
11. Helton JC, Marietta MG, editors. Special issue: the 1996 performance assessment for the waste isolation pilot plant. Reliability Engineering and System Safety 2000;69:1-451.
12. A. Saltelli, K. Chan, and E.M. Scott Sensitivity Analysis 2000 Wiley New York, NY
13. J.C. Helton, J.D. Johnson, C.J. Sallaberry, and C.B. Storlie Survey of sampling-based methods for uncertainty and sensitivity analysis Reliability Engineering and System Safety 91 2006 1175 1209
14. D. Higdon, M. Kennedy, J.C. Cavendish, J.A. Cafeo, and R.D. Ryne Combining field data and computer simulations for calibration and prediction SIAM Journal on Scientific Computing 26 2004 448 466
15. R.L. Iman, and J.C. Helton An investigation of uncertainty and sensitivity analysis techniques for computer models Risk Analysis 8 1988 71 90
16. Sandia National Laboratories. Total system performance assessment model/analysis for the license application. US Department of Energy Office of Civilian Radioactive Waste Management, MDL-WIS-PA-000005 Rev 00, AD 01. Las Vegas, NV, 2008.
17. Helton JC, Hansen CW, Sallaberry CJ. Uncertainty and sensitivity analysis in performance assessment for the proposed repository for high-level radioactive waste at Yucca Mountain, Nevada. Reliability Engineering and System Safety, 2012;107;44-63.
18. C.B. Storlie, H.D. Bondell, B.J. Reich, and H.H. Zhang Surface estimation, variable selection, and the nonparametric oracle property Statistica Sinica 21 2010 679 705
19. B.J. Reich, C.B. Storlie, and H.D. Bondell Variable selection in Bayesian smoothing spline ANOVA models application to deterministic computer codes Technometrics 51 2009 110 120
20. T. Santner, B. Williams, and W. Notz The design and analysis of computer experiments 2003 Springer New York, NY
21. J.E. Oakley, and A. O'Hagan Probabilistic sensitivity analysis of complex models a Bayesian approach Journal of the Royal Statistical Society B 66 2004 751 769 (Pubitemid 39015911)
22. G. Han, T.J. Santner, and W.I. Notz Prediction for computer experiments having quantitative and qualitative input variables Technometrics 51 3 2009 278 288
23. G. Matheron Principles of geostatistics Economic Geology 58 1963 1246 1266
24. R.A. Johnson, and D.W. Wichern Applied multivariate statistical analysis 6th ed. 2007 Pearson Prentice Hall Upper Saddle River, NJ
25. M.L. Stein Interpolation of spatial data 1999 Springer-Verlag New York, NY
26. C. Linkletter, D. Bingham, N. Hengartner, D. Higdon, and K. Ye Variable selection for Gaussian process models in computer experiments Technometrics 48 2006 478 490 (Pubitemid 44865389)
27. W.J. Welch, R.J. Buck, J. Sacks, H.P. Wynn, T.J. Mitchell, and M.D. Morris Screening, predicting, and computer experiments Technometrics 34 1992 15 25
28. Dancik G. Mlegp: an R package for Gaussian process modeling and sensitivity analysis. 〈 http://cran.r-project.org/web/packages/mlegp/ vignettes/gp.pdf 〉, 2007.
29. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin Bayesian data analysis 2nd ed. 2004 Chapman & Hall London
30. N.A.C. Cressie Statistics for spatial data 1993 John Wiley & Sons New York, NY
31. J.H. Friedman Multivariate adaptive regression splines (with discussion) Annals of Statistics 19 1991 1 141
32. D.G.T. Denison, B.K. Mallick, and A.F.M. Smith Bayesian MARS Statistics and Computing 8 1998 337 346
33. C.B. Storlie, H.D. Bondell, and B.J. Reich A locally adaptive penalty for estimation of functions with varying roughness Journal of Computational and Graphical Statistics 19 2010 569 589
34. P. Craven, and G. Wahba Smoothing noisy data with spline functions estimating the correct degree of smoothing by the method of generalized cross-validation Numerical Mathematics 31 1979 377 403
35. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the fourteenth international joint conference on artificial intelligence, vol. 2; 1995. p. 1137-43.
36. R.L. Eubank Nonparametric regression and spline smoothing 1999 CRC Press
37. T. Hastie, and R.J. Tibshirani Generalized additive models 1990 Chapman & Hall/CRC
38. A. Berlinet, and C. Thomas-Agnan Reproducing Kernel Hilbert spaces in probability and statistics 2004 Kluwer Academic Publishers Norwell, MA
39. Wahba G. Spline models for observational data. CBMS-NSF regional conference series in applied mathematics; 1990.
40. M. Schimek Smoothing and regression approaches, computation, and application 2000 John Wiley New York
41. C. Gu Smoothing spline ANOVA models 2002 Springer-Verlag New York
42. Y. Lin, and H. Zhang Component selection and smoothing in smoothing spline analysis of variance models Annals of Statistics 34 2006 2272 2297
43. R.J. Tibshirani Regression shrinkage and selection via the lasso Journal of the Royal Statistical Society B 58 1996 267 288
44. M. Yuan, and Y. Lin Model selection and estimation in regression with grouped variables Journal of the Royal Statistical Society B 68 2006 49 67 (Pubitemid 43415335)
45. A. Marrel, B. Iooss, F. Van Dorpe, and E. Volkova An efficient methodology for modelling complex computer codes with Gaussian processes Computational Statistics and Data Analysis 52 2008 4731 4744
46. M. Barbieri, and J. Berger Optimal predictive model selection Annals of Statistics 32 2004 870 897 (Pubitemid 41250287)
47. E.I. George, and R.E. McCulloch Variable selection via Gibbs sampling Journal of the American Statistical Association 88 1993 881 889
48. H. Chipman Bayesian variable selection and related predictors Canadian Journal of Statistics 24 1996 17 36
49. E.I. George, and R.E. McCulloch Approaches for Bayesian variable selection Statistica Sinica 7 1997 339 373 (Pubitemid 127473668)
50. A. Saltelli, S. Tarantola, and K. Chan A quantitative model-independent method for global sensitivity analysis of model output Technometrics 41 1999 39 56
51. A. Saltelli, M. Ratto, T. Andres, F. Campolongo, J. Cariboni, and D. Gatelli Global sensitivity analysis the primer 2008 Wiley West Sussex, England
52. F. Campolongo, A. Saltelli, T. Sorensen, and S. Tarantola Hitchhiker's guide to sensitivity analysis A. Saltelli, K. Chan, M. Scott, Sensitivity analysis 2000 John Wiley & Sons New York, NY 15 47
53. J.C. Helton, and F.J. Davis Illustration of sampling-based methods for uncertainty and sensitivity analysis Risk Analysis 22 2002 591 622 (Pubitemid 34657259)
54. C.B. Storlie, and J.C. Helton Multiple predictor smoothing methods for sensitivity analysis example results Reliability Engineering and System Safety 93 2008 55 77 (Pubitemid 47391225)
55. P. Vaughn, J.E. Bean, J.C. Helton, M.E. Lord, R.J. MacKinnon, and J.D. Schreiber Representation of two-phase flow in the vicinity of the repository in the 1996 performance assessment for the waste isolation pilot plant Reliability Engineering and System Safety 69 2000 205 226
56. J.E. Oakley, and A. O'Hagan Bayesian inference for the uncertainty distribution of computer model outputs Biometrika 89 2002 769 784 (Pubitemid 41311943)
57. M.D. McKay, R.J. Beckman, and W.J. Conover A comparison of three methods for selecting values of input variables in the analysis of output from a computer code Technometrics 21 1979 239 245 (Pubitemid 9452235)
58. J.C. Helton, and F.J. Davis Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems Reliability Engineering and System Safety 81 2003 23 69
59. S.C. Hora, and J.C. Helton A distribution-free test for the relationship between model input and output when using Latin hypercube sampling Reliability Engineering and System Safety 79 1996 333 339
60. D. Higdon, J. Swall, and J. Kern Non-stationary spatial modeling J.M. Bernardo, J.O. Berger, A.P. Dawid, A.F.M. Smith, Bayesian Statistics vol. 6 1999 Oxford University Press Oxford, UK 761 768
61. M. Fuentes Spectral methods for nonstationary spatial processes Biometrika 89 2002 197 210 (Pubitemid 41312011)