Gaussian process single-index models as emulators for computer experiments

Technometrics

Volumn 54, Issue 1, 2012, Pages 30-41

  Gramacy, Robert B ^a   Lian, Heng ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Nonparametric regression; Projection pursuit; Surrogate model

Indexed keywords

COMPUTER EXPERIMENT; GAUSSIAN PROCESS; GAUSSIAN PROCESSES; NON-LINEAR REGRESSION; NON-PARAMETRIC; NON-PARAMETRIC REGRESSION; PROJECTION PURSUITS; REGRESSION MODEL; SINGLE INDEX MODELS; SURROGATE MODEL; SYNTHETIC DATA; UNIVARIATE;

GAUSSIAN DISTRIBUTION; REGRESSION ANALYSIS;

GAUSSIAN NOISE (ELECTRONIC);

EID: 84859478896     PISSN: 00401706     EISSN: None     Source Type: Journal    
DOI: 10.1080/00401706.2012.650527     Document Type: Article

References (33)

1. Antoniadis, A., Grégorie, G., and McKeague, I. (2004), "Bayesian Estimation of Single-Index Models, " Statistica Sinica, 14, 1147-1164.
2. Bastos, L., and O'Hagan, A. (2009), "Diagnostics for Gaussian Process Emulators, " Technometrics, 51(4), 425-438.
3. Brillinger, D. (1977), "The Identification of a Particular Nonlinear Time Series System, " Biometrika, 64, 509-515. (Pubitemid 8238528)
4. -(1982), "A Generalized Linear Model With 'Gaussian' Regressor Variables, " in A Festscrift for Erich L. Lehman, eds. P. Bickel, K. Doksum, and J. Hodges, New York: Wadsworth, pp. 97-114.
5. Broderick, T., and Gramacy, R. B. (2011), "Classification and Categorical Inputs With Treed Gaussian Process Models, " Journal of Classification, 28, 244-270.
6. Chipman, H., George, E., and McCulloch, R. (2002), "Bayesian Treed Models, " Machine Learning, 48, 303-324.
7. Choi, T., Shi, J., and Wang, B. (2011), "A Gaussian Process Regression Approach to a Single-Index Model, " Journal of Nonparametric Statistics, 23, 21-36.
8. Craig, P. (2008), "A New Reconstruction of Multivariate Normal Orthant Probabilities, " Journal of the Royal Statistical Society, Series B 70, 227-243.
9. Friedman, J., and Stuetzle, W. (1981), "Projection Pursuit Regression, " Journal of the American Statistical Association, 76, 817-823.
10. Gramacy, R. B. (2005), "Bayesian Treed Gaussian Process Models, " Ph.D. dissertation, University of California, Santa Cruz.
11. -(2007), "tgp: An R Package for Bayesian Nonstationary, Semiparamet-ric Nonlinear Regression and Design by Treed Gaussian Process Models, " Journal of Statistical Software, 19, 9.
12. Gramacy, R. B., and Lee, H. K. H. (2008), "Bayesian Treed Gaussian Process Models With an Application to Computer Modeling, " Journal of the American Statistical Association, 103, 1119-1130.
13. -(2009), "Adaptive Design and Analysis of Supercomputer Experiment, " Technometrics, 51(2), 130-145.
14. -(2011), "Optimization Under Unknown Constraints, " in Proceedings of the Ninth Valencia International Meetings on Bayesian Statistics, eds. J. Bernardo, S. Bayarri, J. Berger, A. Dawid, D. Heckerman, A. Smith, and M. West, New York: Oxford University Press, pp. 229-256.
15. -(in press), "Cases for the Nugget in Modeling Computer Experiments, " Statistics and Computing. DOI: 10.1007/s11222-010-9224-x.
16. Gramacy, R.B., and Polson, N. (2010), "Particle Learning of Gaussian Process Models for Sequential Design and Optimization, " Technical Report, University of Cambridge. Available at http://arxiv.org/abs/0909.5262
17. Gramacy, R. B., and Taddy, M. A. (2010), "Categorical Inputs, Sensitivity Analysis, Optimization and Importance Tempering With tgp Version 2, an R Package for Treed Gaussian Process Models, " Journal of Statistical Software, 33(6), 1-48.
18. Green, P. (1995), "Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination, " Biometrika, 82, 711-732.
19. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference, and Prediction, New York: Springer.
20. Higdon, D., Kennedy, M., Cavendish, J., Cafeo, J., and Ryne, R. (2004), "Combining Field Data and Computer Simulations for Calibration and Prediction, " SIAM Journal of Scientific Computing, 26, 448-466.
21. Ichimura, H. (1993), "Semiparametric Least-Squares (SLS) and Weighted SLS Estimation of Single-Index Models, " Journal of Econometrics, 58, 71-120.
22. Jones, D., Schonlau, M., and Welch, W.J. (1998), "Efficient Global Optimization of Expensive Black Box Functions, " Journal of Global Optimization, 13, 455-492. (Pubitemid 128507405)
23. Kass, R. E., Carlin, B. P., Gelman, A., and Neal, R. M. (1998), "Markov Chain Monte Carlo in Practice: A Roundtable Discussion, " The American Statistician, 52(2), 93-100.
24. Kennedy, M., and O'Hagan, A. (2001), "Bayesian Calibration of Computer Models (With Discussion), " Journal of the Royal Statistical Society, Series B, 63, 425-464. (Pubitemid 33305774)
25. Miwa, T., Hayter, A. J., and Kuriki, S. (2003), "The Evaluation of General Non-Centred Orthant Probabilities, " Journal of the Royal Statistical Society, Series B, 65, 223-234. (Pubitemid 37155346)
26. Morris, D., Mitchell, T., and Ylvisaker, D. (1993), "Bayesian Design and Analysis of Computer Experiments: Use of Derivatives in Surface Prediction, " Technometrics, 35(3), 243-255.
27. Neal, R. M. (1998), "Regression and Classification Using Gaussian Process Priors" (with discussion), in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, New York: Oxford University Press, pp. 476-501.
28. Santner, T. J., Williams, B. J., and Notz, W. I. (2003), The Design and Analysis of Computer Experiments, New York: Springer-Verlag.
29. Seo, S., Wallat, M., Graepel, T., and Obermayer, K. (2000), "Gaussian Process Regression: Active Data Selection and Test Point Rejection, " in Proceedings of the International Joint Conference on Neural Networks, Vol. 3, New York: IEEE, pp. 241-246.
30. R Development Core Team (2009), R: A Language and Environment for Statistical Computing, Vienna: R Foundation for Statistical Computing.
31. Wang, H. (2009), "Bayesian Estimation and Variable Selection of Single-Index Models, " Computational Statistics and Data Analysis, 53, 2617-2627.
32. Worley, B. (1987), "Deterministic Uncertainty Analysis, " Technical Report No. ORN-0628, Springfield, VA: National Technical Information Service.
33. Xia, Y. (2008), "A Multiple-Index Model and Dimension Reduction, " Journal of the American Statistical Association, 103, 1631-1640.