Bayesian treed Gaussian process models with an application to computer modeling

Journal of the American Statistical Association

Volumn 103, Issue 483, 2008, Pages 1119-1130

  Gramacy, Robert B ^a   Lee, Herbert K H ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b University of California Santa Cruz   (United States)

Author keywords

Computer simulator; Heteroscedasticity; Nonparametric regression; Nonstationary spatial model; Recursive partitioning

Indexed keywords

EID: 54949111733     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214508000000689     Document Type: Article

References (32)

1. Abrahamsen, P. (1997), "A Review of Gaussian Random Fields and Correlation Functions," Technical Report 917, Norwegian Computing Center.
2. Berger, J. O., de Oliveira, V., and Sansó, B. (2001), "Objective Bayesian Analysis of Spatially Correlated Data," Journal of the American Statistical Association, 96, 1361-1374.
3. Breiman, L., Friedman, J. H., Olshen, R., and Stone, C. (1984), Classification and Regression Trees, Belmont, CA: Wadsworth.
4. Chipman, H., George, E., and McCulloch, R. (1998), "Bayesian CART Model Search" (with discussion), Journal of the American Statistical Association, 93, 935-960.
5. _ (2002), "Bayesian Treed Models," Machine Learning, 48, 303-324.
6. Cormen, T. H., Leiserson, C. E., and Rivest, R. L. (1990), Introduction to Algorithms, Cambridge, MA/New York: MIT Press/McGraw-Hill.
7. Damian, D., Sampson, P. D., and Guttorp, P. (2001), "Bayesian Estimation of Semiparametric Nonstationary Spatial Covariance Structure," Environmetrics, 12, 161-178.
8. Denison, D., Adams, N., Holmes, C., and Hand, D. (2002), "Bayesian Partition Modelling," Computational Statistics and Data Analysis, 38, 475-485.
9. Denison, D., Mallick, B., and Smith, A. (1998), "A Bayesian CART Algorithm," Biometrika, 85, 363-377.
10. Fuentes, M. (2002), "Spectral Methods for Nonstationary Spatial Processes," Biometrika, 89, 197-210.
11. Gelfand, A. (1995), "Model Determination Using Sampling-Based Methods," in Markov Chain Monte Carlo in Practice, eds. S. R. W. Gilks and D. Spiegelhalter, London: Chapman & Hall, pp. 145-161.
12. Gilks, W., Richardson, S., and Spiegelhalter, D. (1996), Markov Chain Monte Carlo in Practice, London: Chapman & Hall.
13. Gramacy, R. B. (2005), "Bayesian Treed Gaussian Process Models," unpublished doctoral thesis, University of California Santa Cruz, Dept. of Applied Mathematics and Statistics.
14. Gramacy, R. B., and Lee, H. K. H. (2008), "Gaussian Processes and Limiting Linear Models," Computational Statistics & Data Analysis, in press, available at http://www.sciencedirect.com/science/ article/B6V8V-4SW143G-1/2/5a5f2056b983c22d48a17375cbfa3bb4.
15. Gramacy, R. B., Lee, H. K. H., and Macready, W. (2004), "Parameter Space Exploration With Gaussian Process Trees," in ICML, Omnipress & ACM Digital Library, pp. 353-360.
16. Higdon, D., Swall, J., and Kern, J. (1999), "Non-Stationary Spatial Modeling," in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U.K.: Oxford University Press, pp. 761-768.
17. Hjort, N. L., and Omre, H. (1994), "Topics in Spatial Statistics," Scandinavian Journal of Statistics, 21, 289-357.
18. Kennedy, M., and O'Hagan, A. (2001), "Bayesian Calibration of Computer Models" (with discussion), Journal of the Royal Statistical Society, Ser. B, 63, 425-464.
19. Kim, H.-M., Mallick, B. K., and Holmes, C. C. (2005), "Analyzing Nonstationary Spatial Data Using Piecewise Gaussian Processes," Journal of the American Statistical Association, 100, 653-668.
20. Matérn, B. (1986), Spatial Variation (2nd ed.), New York: Springer-Verlag.
21. Paciorek, C. (2003), "Nonstationary Gaussian Processes for Regression and Spatial Modelling," unpublished doctoral thesis, Carnegie Mellon University, Dept. of Statistics.
22. R Development Core Team (2004), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
23. Rasmussen, C., and Ghahramani, Z. (2002), "Infinite Mixtures of Gaussian Process Experts," in Advances in Neural Information Processing Systems, Vol. 14, eds. T. G. Dietterich, S. Becker, and Z. Ghahramani, Cambridge, MA: MIT Press, pp. 881-888.
24. Richardson, S., and Green, P. J. (1997), "On Bayesian Analysis of Mixtures With an Unknown Number of Components," Journal of the Royal Statistical Society, Ser. B, 59, 731-758.
25. Rogers, S. E., Aftosmis, M. J., Pandya, S. A., N. M. Chaderjian, E. T. T., and Ahmad, J. U. (2003), "Automated CFD Parameter Studies on Distributed Parallel Computers," AIAA Paper 2003-4229, presented at the 16th AIAA Computational Fluid Dynamics Conference.
26. Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P. (1989), "Design and Analysis of Computer Experiments," Statistical Science, 4, 409-435.
27. Sampson, P. D., and Guttorp, P. (1992), "Nonparametric Estimation of Nonstationary Spatial Covariance Structure," Journal of the American Statistical Association, 87, 108-119.
28. Santner, T. J., Williams, B. J., and Notz, W. I. (2003), The Design and Analysis of Computer Experiments, New York: Springer-Verlag.
29. Schmidt, A. M., and O'Hagan, A. (2003), "Bayesian Inference for Nonstationary Spatial Covariance Structure via Spatial Deformations," Journal of the Royal Statistical Society, Ser. B, 65, 745-758.
30. Silverman, B. W. (1985), "Some Aspects of the Spline Smoothing Approach to Non-Parametric Curve Fitting," Journal of the Royal Statistical Society, Ser. B, 47, 1-52.
31. Stein, M. L. (1999), Interpolation of Spatial Data, New York: Springer.
32. Whaley, R. C., and Petitet, A. (2004), ATLAS (Automatically Tuned Linear Algebra Software), available at http://math-atlas.sourceforge.net/ .