Multi-output local Gaussian process regression: Applications to uncertainty quantification

Journal of Computational Physics

Volumn 231, Issue 17, 2012, Pages 5718-5746

  Bilionis, Ilias ^a,b   Zabaras, Nicholas ^a,b  

^a Cornell University ^*  (United States)

^b School of Operations Research and Industrial Engineering   (United States)

Author keywords

Adaptivity; Bayesian; Gaussian process; Multi element; Multi output; Stochastic partial differential equations; Uncertainty quantification

Indexed keywords

ERROR STATISTICS; GAUSSIAN DISTRIBUTION; STOCHASTIC SYSTEMS; TREES (MATHEMATICS); UNCERTAINTY ANALYSIS;

ADAPTIVITY; BAYESIAN; GAUSSIAN PROCESS MODELS; GAUSSIAN PROCESS REGRESSION; GAUSSIAN PROCESSES; MULTI-OUTPUT; MULTIELEMENTS; REGRESSION APPLICATIONS; STOCHASTIC PARTIAL DIFFERENTIAL EQUATION; UNCERTAINTY QUANTIFICATIONS;

GAUSSIAN NOISE (ELECTRONIC);

EID: 84862859211     PISSN: 00219991     EISSN: 10902716     Source Type: Journal    
DOI: 10.1016/j.jcp.2012.04.047     Document Type: Article

References (46)

1. Iman R.L., Conover W.J. Small sample sensitivity analysis techniques for computer models with an application to risk assessment. Communications in Statistics - Theory and Methods 1980, 9(17):1749-1842.
2. M.B. Giles, Multilevel Monte Carlo path simulation, Tech. rep., Oxford University Computing Laboratory, 2006.
3. M.B. Giles, Improved multilevel Monte Carlo convergence using the Milstein scheme, in: A. Keller, S. Heinrich, H. Niederreiter (Eds.), Monte Carlo and Quasi-Monte Carlo Methods 2006, Springer, 2008, pp. 343-358.
4. Ghanem R.G., Spanos P.D. Stochastic Finite Elements: A Spectral Approach 2003, Dover, Publications.
5. Xiu D., Karniadakis G.E. The Wiener-Askey polynomial chaos for stochastic differential equations. Journal of Scientific Computing 2002, (24):619-644.
6. Wan X., Karniadakis G.E. An adaptive multi-element generalized polynomial chaos method for stochastic differential equations. Journal of Computaional Physics 2005, 209:617-642.
7. Wan X., Karniadakis G.E. Multi-element generalized polynomial chaos for arbitrary probability measures. SIAM Journall of Scientific Computing 2006, 28(3):901-928.
8. BabuŠka I., Nobile F., Tempone R. A stochastic collocation method for elliptic partial differential equations with random input data. SIAM Journal of Numerical Analysis 2007, 45(3):1005-1034.
9. S.A. Smolyak, Quadrature and interpolation formulas for tensor products of certain classes of functions, in: Dokl. Akad. Nauk SSSR, vol. 4, 1963, p. 123.
10. Xiu D., Hesthaven J.S. High-order collocation methods for differential equations with random inputs. SIAM Journal on Scientific Computing 2005, 27(3):1118-1139.
11. Xiu D. Efficient collocational approach for parametric uncertainty analysis. Communications in Computational Physics 2007, 2(2):293-309.
12. Nobile F., Tempone R., Webster C.G. A sparse grid stochastic collocation method for partial differential equations with random input data. SIAM Journal of Numerical Analysis 2008, 46(5):2309-2345.
13. Ma X., Zabaras N. An adaptive hierarchical sparse Grid Collocation algorithm for the solution of stochastic differential equations. Journal of Computaional Physics 2009, 228(8):3084-3113.
14. Sacks J., Welch W.J., Mitchell T.J., Wynn H.P. Design and analysis of computer experiments. Statistical Science 1989, 4(4):409-435.
15. Santer T.J., Williams B.J., Notz W.I. The Design and Analysis of Computer Experiments 2003, Springer, New York.
16. MacKay D.J.C. Information-based objective functions for active data selection. Neural Computation 1992, 4(4):590-604.
17. Gramacy R.B., Lee H.K.H. Bayesian treed Gaussian Process models with an application to computer modeling. Journal of the American Statistical Association 2008, 103(483):1119-1130.
18. Chipman H.A., George E.I., McCulloch R.E. Bayesian CART model search. Journal of the American Statistical Association 1998, 93(443):935-948.
19. Chipman H.A., George E.I., McCulloch R.E. Bayesian treed models. Machine Learning 2002, 48(1):299-320.
20. Taddy M.A., Gramacy R.B., Polson N.G. Dynamic trees for learning and dsign. Journal of the American Statistical Association 2011, 106(493):109-123.
21. D.J.C. MacKay, Gaussian processes, Tutorial at Neural Information Processing Systems 10.
22. Rasmussen C.E., Williams C. Gaussian Processes for Machine Learning 2006, MIT Press.
23. Cressie N.A.C. Statistics for Spatial Data 1991, Vol. 4. Wiley, New York.
24. P. Boyle, M. Frean, Dependent Gaussian processes, in: Neural Information Processing Systems 18, 2005, pp. 217-224.
25. Y.W. Teh, M. Seeger, M.I. Jordan, Semiparametric latent factor models, in: R.G. Cowell, Z. Ghahramani (Eds.), 10th International Workshop on Artificial Intelligence and Statistics, Society for Artificial Intelligence and Statistics, 2005, pp. 333-340.
26. Micchelli C.A., Pontil M. Kernels for multi-task learning 2005, 921-928. Advance in Neural Information Processing 17, MIT Press. L.K. Saul, Y. Weiss, L. Bottou (Eds.).
27. Higdon D., Gattiker J., Williams B., Rightley M. Computer model calibration using high-dimensional output. Journal of the American Statistical Association 2008, 103(482):570-583.
28. Conti S., OHagan A. Bayesian emulation of complex multi-output and dynamic computer models. Journal of Statistical Planning and Inference 2010, 140(3):640-651.
29. MacKay D.J.C. Bayesian interpolation. Neural Computation 1992, 4(3):415-447.
30. Press W.H., Teukolsky S.A., Vetterling W.T., Flannery B.P. Numerical Recipes: The Art of Scientific Computing. third ed. 2007, Cambridge University Press.
31. Foo J., Wan X., Karniadakis G.E. The Multi-Element probabilistic collocation method (ME-PCM): error analysis and applications. Journal of Computational Physics 2008, 227(22):9572-9595.
32. Abramowitz M., Stegun I.A. Handbook of Mathematical Functions with Formulas Graphs, and Mathematical Tables 1964, vol. 55. Dover, Publications.
33. Neal R.M. Bayesian Learning for Neural Networks 1996, Springer, New York.
34. C.K.I. Williams, C.E. Rasmussen, Gaussian processes for regression, in: D.S. Touretzky, M.C. Mozer, M.E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, vol. 8, MIT Press, 1996, pp. 514-520.
35. Chaloner K., Verdinelli I. Bayesian experimental design: a review. Statistical Science 1995, 10(3):273-304.
36. D.A. Cohn, Neural network exploration using optimal experiment design, Neural Networks 9 (6).
37. Seo S., Wallat M., Graepel T., Obermayer K. Gaussian process regression: active data selection and test point rejection. International Joint Conference on Neural Networks 2000, vol. 3:241-246. IEEE Press, Los Alamitos, CA.
38. Gramacy R.B., Lee H.K.H. Adaptive design and analysis of supercomputer experiments. Technometrics 2009, 51(2):130-145.
39. M.A. Heroux, J.M. Willenbring, Trilinos Users Guide, Tech. rep., Sandia National Laboratories, 2003.
40. M. Galassi, J. Davies, J. Theiler, B. Gough, G. Jungman, P. Alken, M. Booth, F. Rossi, GNU Scientific Library Reference Manual, 2009.
41. Nobile F., Tempone R., Webster C. A sparse grid collocation method for elliptic partial differential equations with random input data. SIAM Journal of Numerical Analysis 2008, 45:2309-2345.
42. Xiu D. Numerical Methods for Stochastic Computations: A Spectral Method Approach 2010, Princeton University Press.
43. Nektar, Suite of simulation codes, . http://www.cfm.brown.edu/people/tcew/nektar.html.
44. R.M. Neal, Monte Carlo implementation of Gaussian process models for bayesian regression and classification, Tech. Rep. 9702, Departement of Statistics, University of Toronto, Toronto, 1997.
45. Gramacy R.B., Lee H.K.H. Cases for the nugget in modeling computer experiments. Statistics and Computing 2012, 22(3):713-722.
46. Fletcher R. Practical Methods of Optimization. second ed. 1987, Wiley.