Categorical inputs, sensitivity analysis, optimization and importance tempering with tgp version 2, an R package for treed gaussian process models

Journal of Statistical Software

Volumn 33, Issue 6, 2010, Pages 1-48

  Gramacy, Robert B ^a   Taddy, Matthew ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Bayesian model averaging; Categorical inputs; Experiment design; Importance sampling; Optimization; R; Sensitivity analysis; Simulated tempering; Treed Gaussian process

Indexed keywords

EID: 77953149906     PISSN: 15487660     EISSN: 15487660     Source Type: Journal    
DOI: 10.18637/jss.v033.i06     Document Type: Article

References (39)

1. Breiman L, Friedman JH, Olshen R, Stone C (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
2. Chipman HA, George EI, McCulloch RE (1998). Bayesian CART Model Search. Journal of the American Statistical Association, 93, 935-960.
3. Chipman HA, George EI, McCulloch RE (2002). Bayesian Treed Models. Machine Learning, 48,303-324.
4. Da Veiga S, Wahl F, Gamboa F (2009). Local Polynomial Estimation for Sensitivity Analysis on Models With Correlated Inputs. Technometrics, 51, 452-463.
5. Douc R, Guillin A, Marin JM, Robert CP (2007). "Minimum Variance Importance Sampling via Population Monte Carlo." Technical report, CEREMADE, Université Paris Dauphine, and CREST, INSEE, Paris. URL http://www.ceremade.dauphine.fr/~xian/dgmr05.pdf.
6. Friedman JH (1991). Multivariate Adaptive Regression Splines. The Annals of Statistics, 19(1),1-67.
7. Geman S, Geman D (1984). Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6,721-741.
8. Geyer CJ (1991). Markov Chain Monte Carlo Maximum Likelihood. In Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, pp. 156-163.
9. Geyer CJ, Thompson EA (1995). Annealing Markov Chain Monte Carlo with Applications to Ancenstral Inference. Journal of the American Statistical Association, 90, 909-920.
10. Ginsbourger D, Le Riche R, Carraro L (2009). "A Multi-Points Criterion for Deterministic Parallel Global Optimization based on Gaussian Processes." HAL: hal-00260579, URL http://hal.archives-ouvertes.fr/hal-00260579/en/.
11. Gramacy RB (2007). "Tgp: An R Package for Bayesian Nonstationary, Semiparametric Non- linear Regression and Design by Treed Gaussian Process Models." Journal of Statistical Software, 19(9), 1-46. URL http://www.jstatsoft.org/v19/i09/.
12. Gramacy RB, Samworth RJ, King R (2010). "Importance Tempering." Statistics and Computing, 20(1). Forthcoming.
13. Hastings WK (1970). Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika, 57, 97-109.
14. Homma T, Saltelli A (1996).Importance Measures in Global Sensitivity Analysis of Nonlinear Models. Reliability Engineering and System Safety, 52, 1-17.
15. Jennison C (1993). Discussion on the Meeting on the Gibbs Sampler and Other Markov Chain Monte Carlo Methods. Journal of the Royal Statistical Society B, 55, 54-56.
16. Jones DR, Schonlau M, Welch WJ (1998). Efficient Global Optimization of Expensive BlackBox Functions. Journal of Global Optimization, 13, 455-492.
17. Kass RE, Carlin BP, Gelman A, Neal RM (1998). Markov Chain Monte Carlo in Practice: A Roundtable Discussion. The American Statistician, 52(2), 93-100.
18. Leisch F (2002). Dynamic Generation of Statistical Reports Using Literate Data Analysis. In W Härdle, B Rönz (eds.), COMPSTAT 2002 - Proceedings in Computational Statistics, pp. 575-580. Physica-Verlag, Heidelberg.
19. Liu JS (2001). Monte Carlo Strategies in Scientific Computing. Springer-Verlag, New York.
20. Marrel A, Iooss B, Laurent B, Roustant O (2009). Calculations of Sobol Indices for the Gaussian Process Metamodel. Reliability Engineering & System Safety, 94, 742-751.
21. Metropolis N, Rosenbluth AW, Rosenbluth MN, Teller AH, Teller R (1953). Equations of State Calculations by Fast Computing Machine. Journal of Chemical Physics, 21, 1087-1091.
22. Morris RD, Kottas A, Taddy M, Furfaro R, Ganapol B (2008). "A Statistical Framework for the Sensitivity Analysis of Radiative Transfer Models." IEEE Transactions on Geoscience and Remote Sensing. To appear.
23. Neal RM (1996). Sampling from Multimodal Distributions Using Tempered Transitions. Statistics and Computing, 6, 353-366.
24. Neal RM (2001). Annealed Importance Sampling. Statistics and Computing, 11, 125-129.
25. Oakley JE, O'Hagan A (2004). Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach. Journal of the Royal Statistical Society B, 66, 751-769.
26. Owen A, Zhou Y (2000). Safe and Effective Importance Sampling. Journal of the American Statstical Association, 95(449), 135-143.
27. Plummer M, Best N, Cowles K, Vines K (2008). Coda: Output Analysis and Diagnostics for MCMC. R package version 0.13-3, URL http://CRAN.R-project.org/package=coda.
28. Qian ZG, Wu H, Wu CFJ (2009). Gaussian Process Models for Computer Experiments with Qualitative and Quantitative Factors. Technometrics, 50, 383-396.
29. Regis RG, Shoemaker CA (2007). Improved Strategies for Radial basis Function Methods for Global Optimization. Journal of Global Optimization, 37(1), 113-135.
30. Saltelli A (2002). Making Best Use of Model Evaluations to Compute Sensitivity Indices. Computer Physics Communications, 145, 280-297.
31. Saltelli A, Chan K, Scott EM (eds.) (2000). Sensitivity Analysis. John Wiley & Sons, Hoboken, NJ.
32. Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M, Tarantola S (2008). Global Sensitivity Analysis: The Primer. John Wiley & Sons, Hoboken, NJ.
33. Saltelli A, Tarantola S (2002). "On the Relative Importance of Input Factors in Mathematical Models: Safety Assessment for Nuclear Waste Disposal."Journal of the American Statistical Association, 97, 702-709.
34. Schonlau M, Jones DR, Welch WJ (1998). "Global Versus Local Search in Constrained Optimization of Computer Models." In New Developments and Applications in Experimental Design, 34, pp. 11-25. IMS.
35. Storlie CB, Helton JC (2008). Multiple Predictor Smoothing Methods for Sensitivity Analysis: Description of Techniques. Reliability Engineering & System Safety, 93, 28-54.
36. Storlie CB, Swiler LP, Helton JC, Sallaberry CJ (2009). Implementation and Evaluation of Nonparametric Regression Procedures for Sensitivity Analysis of Computationally Demanding Models. Reliability Engineering & System Safety, 94, 1735-1763.
37. Taddy MA, Lee HKH, Gray GA, Griffin JD (2009). Bayesian Guided Pattern Search for Robust Local Optimization. Technometrics, 51, 389-401.
38. Veach E, Guibas LJ (1995). Optimally Combining Sampling Techniques for Monte Carlo Rendering. In SIGGRAPH'95 Conference Proceedings, pp. 419-428. Addison-Wesley, Reading, MA.
39. Welch WJ, Buck RJ, Sacks J, Wynn HP, Mitchell TJ, Morris MD (1992). Screening, Predicting, and Computer Experiment. Technometrics, 34, 15-25.