Bayesian calibration of computer models

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 63, Issue 3, 2001, Pages 425-464

  Kennedy, Marc C ^b   O'Hagan, Anthony ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b NONE

Author keywords

Calibration; Computer experiments; Deterministic models; Gaussian process; Interpolation; Model inadequacy; Sensitivity analysis; Uncertainty analysis

Indexed keywords

EID: 0035648165     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9868.00294     Document Type: Article

References (72)

1. Aitchison, J. and Dunsmore, I. R. (1975) Statistical Prediction Analysis. Cambridge: Cambridge University Press.
2. Aslett, R., Buck, R. J., Duvall, S. G., Sacks, J. and Welch, W. J. (1998) Circuit optimization via sequential computer experiments: design of an output buffer. Appl. Statist., 47, 31-48.
3. Bates, R. A., Buck, R. J., Riccomagno, E. and Wynn, H. P. (1996) Experimental design and observation for large systems. J. R. Statist. Soc. B, 58, 77-94.
4. Bernardo, M. C., Buck, R. J., Liu, L., Nazaret, W. A., Sacks, J. and Welch, W. J. (1992) Integrated circuit design optimization using a sequential strategy. IEEE Trans. Comput. Aid. Des., 11, 361-372.
5. Chilès, J. and Delfiner, P. (1999) Geostatistics: Modeling Spatial Uncertainty. New York: Wiley.
6. Clarke, R. H. (1979) The First Report of a Working Group on Atmospheric Dispersion: a Model for Short and Medium Range Dispersion of Radionuclides Released to the Atmosphere. London: Her Majesty's Stationery Office.
7. Cox, D. D., Park, J. S., Sacks, J. and Singer, C. E. (1992) Tuning complex computer codes to data. In Proc. 23rd Symp. Interface of Computing Science and Statistics, April 21st-24th, 1991, Seattle, pp. 266-271. Fairfax Station: Interface Foundation.
8. Cox, D. D., Park, J. S. and Singer, C. E. (1996) A statistical method for tuning a computer code to a data base. Technical Report 96-3. Department of Statistics, Rice University, Houston.
9. Craig, P. S., Goldstein, M., Rougier, J. C. and Seheult, A. H. (2001) Bayesian forecasting using large computer models. J. Am. Statist. Ass., 96, in the press.
10. Craig, P. S., Goldstein, M., Seheult, A. H. and Smith, J. A. (1996) Bayes linear strategies for matching hydrocarbon reservoir history. In Bayesian Statistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 69-95. Oxford: Oxford University Press.
11. Cressie, N. A. C. (1991) Statistics for Spatial Data. New York: Wiley.
12. Crick, M. J., Hofer, E., Jones, J. A. and Haywood, S. M. (1988) Uncertainty analysis of the foodchain and atmospheric dispersion modules of MARC. Technical Report NRPB-R184. National Radiological Protection Board, Didcot.
13. Currin, C., Mitchell, T., Morris, M. and Ylvisaker, D. (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J. Am. Statist. Ass., 86, 953-963.
14. Dey, D., Müller, P. and Sinha, D. (eds) (1998) Practical Nonparametric and Semiparametric Bayesian Statistics. New York: Springer.
15. Diaconis, P. (1988) Bayesian numerical analysis. In Statistical Decision Theory and Related Topics IV (eds S. S. Gupta and J. Berger), vol. 1, pp. 163-175. New York: Springer.
16. Draper, D. (1995) Assessment and propagation of model uncertainty (with discussion). J. R. Statist. Soc. B, 57, 45-97.
17. Draper, D., Pereira, A., Prado, P., Saltelli, A., Cheal, R., Eguilior, S., Mendes, B. and Tarantola, S. (1999) Scenario and parametric uncertainty in GESAMAC: a methodological study in nuclear waste disposal risk assessment. Comput. Phys. Communs, 117, 142-155.
18. Evans, M. and Schwartz, T. (1995) Methods for approximating integrals in statistics with special emphasis on Bayesian integration problems (with discussion). Statist. Sci., 10, 254-272.
19. Goldstein, M. (1986) Separating beliefs. In Bayesian Inference and Decision Techniques, Essays in Honour of Bruno de Finetti (eds P. K. Goel and A. Zellner). Amsterdam: North-Holland.
20. -(1988) Adjusting belief structures. J. R. Statist. Soc. B, 50, 133-154.
21. Handcock, M. S. and Stein, M. L. (1993) A Bayesian analysis of kriging. Technometrics, 35, 403-410.
22. Handcock, M. S. and Wallis, J. R. (1994) An approach to statistical spatial-temporal modelling of meteorological fields (with discussion) J. Am. Statist. Ass., 89, 368-390.
23. Haslett, J. and Raftery, A. E. (1989) Space-time modelling with long-memory dependence: assessing Ireland's wind power resource (with discussion). Appl. Statist., 38, 1-50.
24. Haylock, R. (1997) Bayesian inference about outputs of computationally expensive algorithms with uncertainty on the inputs. PhD Thesis. University of Nottingham, Nottingham.
25. Haylock, R. and O'Hagan, A. (1996) On inference for outputs of computationally expensive algorithms with uncertainty on the inputs. In Bayesian Statistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 629-637. Oxford: Oxford University Press.
26. Helton, J. C. (1993) Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliab. Engng Syst. Safty, 42, 327-367.
27. Helton, J. C., Garner, J. W., McCurley, R. D. and Rudeen, D. K. (1991) Sensitivity analysis techniques and results for performance assessment at the waste isolation pilot plant. Technical Report SAND90-7103. Sandia National Laboratories, Albuquerque.
28. Homma, T. and Saltelli, A. (1996) Importance measures in global sensitivity analysis of model output. Reliab. Engng Syst. Safty, 52, 1-17.
29. Iman, R. L. and Conover, W. J. (1980) Small-sample sensitivity analysis techniques for computer models, with an application to risk assessment (with discussion). Communs Statist. Theory Meth., 9, 1749-1874.
30. Jones, J. A. (1981) The Second Report of a Working Group on Atmospheric Dispersion: a Procedure to Include Deposition in the Model for Short and Medium Range Atmospheric Dispersion of Radionuclides. London: Her Majesty's Stationery Office.
31. Kennedy, M. C. and O'Hagan, A. (2000a) Predicting the output from a complex computer code when fast approximations are available. Biometrika, 87, 1-13.
32. -(2000b) Supplementary details on Bayesian calibration of computer codes. University of Sheffield, Sheffield. (Available from http: //www.shef.ac.uk/~st1ao/ps/calsup.ps.)
33. Kimeldorf, G. S. and Wahba, G. (1970) A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. Ann. Math. Statist., 41, 495-502.
34. Liu, L. and Arjas, E. (1998) A Bayesian model for fatigue crack growth. In Practical Nonparametric and Semiparametric Bayesian Statistics (eds D. Dey, P. Müller and D. Sinha), pp. 339-353. New York: Springer.
35. Matheron, G. (1963) Principles of geostatistics. Econ. Geol., 58, 1246-1266.
36. McKay, M. D., Conover, W. J. and Beckman, R. J. (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics, 21, 239-245.
37. Morris, M. D. (1991) Factorial sampling plans for preliminary computational experiments. Technometrics, 33, 161-174.
38. Morris, M. D. and Mitchell, T. J. (1995) Exploratory designs for computational experiments. J. Statist. Planng Inf., 43, 381-402.
39. Morris, M. D., Mitchell, T. J. and Ylvisaker, D. (1993) Bayesian design and analysis of computer experiments: use of derivatives in surface prediction. Technometrics, 35, 243-255.
40. Naylor, J. C. and Smith, A. F. M. (1982) Applications of a method for the efficient computation of posterior distributions. Appl. Statist., 31, 214-225.
41. Neal, R. (1996) Bayesian Learning for Neural Networks. New York: Springer.
42. -(1999) Regression and classification using Gaussian process priors (with discussion). In Bayesian Statistics 6 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 475-501. Oxford: Oxford University Press.
43. Novak, E. (1988) Deterministic and stochastic error bounds in numerical analysis. Lect. Notes Math., 1349.
44. Oakley, J. E. and O'Hagan, A. (1998) Bayesian inference for the uncertainty distribution. Technical Report. Statistics Section, University of Nottingham, Nottingham.
45. Oehlert, G. W. (1993) Regional trends in sulfate wet deposition. J. Am. Statist. Ass., 88, 390-399.
46. O'Hagan, A. (1978) Curve fitting and optimal design for prediction (with discussion). J. R. Statist. Soc. B, 40, 1-42.
47. -(1991) Bayes-Hermite quadrature. J. Statist. Planng Inf., 29, 245-260.
48. -(1992) Some Bayesian numerical analysis (with discussion). In Bayesian Statistics 4 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 345-363. Oxford: Oxford University Press.
49. -(1998) A Markov property for covariance structures. Technical Report 98-13. Statistics Section, University of Nottingham, Nottingham. (Available from http: //www.shef.ac.uk/~st1ao/ps/kron.ps.)
50. O'Hagan, A., Kennedy, M. C. and Oakley, J. E. (1999) Uncertainty analysis and other inference tools for complex computer codes (with discussion). In Bayesian Statistics 6 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 503-524. Oxford: Oxford University Press.
51. Omre, H. (1987) Bayesian kriging - merging observations and qualified guesses in kriging. Math. Geol., 19, 25-39.
52. Owen, A. B. (1992) A central limit for Latin hypercube sampling. J. R. Statist. Soc. B, 54, 541-551.
53. Poole, D. and Raftery, A. E. (1998) Inference for deterministic simulation models: the Bayesian melding approach. Technical Report 346. Department of Statistics, University of Washington, Seattle.
54. Raftery. A. E., Givens, G. H. and Zeh, J. E. (1995) Inference from a deterministic population dynamics model for bowhead whales (with discussion). J. Am. Statist. Ass., 90, 402-430.
55. Rios Insua, D. and Müller, P. (1998) Feedforward neural networks for nonparametric regression. In Practical Nonparametric and Semiparametric Bayesian Statistics (eds D. Dey, P. Müller and D. Sinha), pp. 181-193. New York: Springer.
56. Romanowicz, R., Beven, K. and Tawn, J. A. (1994) Evaluation of predictive uncertainty in nonlinear hydrological models using a Bayesian approach. In Statistics for the Environment 2: Water Related Issues (eds V. Barnett and K. F. Turkman), pp. 297-319. New York: Wiley.
57. Sacks, J., Schiller, S. B. and Welch, W. J. (1989) Designs for computer experiments. Technometrics, 31, 41-47.
58. Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P. (1989) Design and analysis of computer experiments. Statist. Sci., 4, 409-435.
59. Saltelli, A., Chan, K. and Scott, E. M. (2000) (eds) Sensitivity Analysis. New York: Wiley.
60. Saltelli, A. and Sobol', I. M. (1995) About the use of rank transformation in sensitivity analysis of model output. Reliab. Engng Syst. Safty, 50, 225-239.
61. Sampson, P. D. and Guttorp, P. (1992) Nonparametric estimation of nonstationary covariance structure. J. Am. Statist. Ass., 87, 108-119.
62. Schweder, T. and Hjort, N. L. (1996) Bayesian synthesis or likelihood synthesis - what does Borel's paradox say? Rep. Int. Whaling Commissn, 46, 475-480.
63. Shershakov, V. M., Vakulovski, S. M., Borodin, R. V., Vozzhennikov, O. I., Gaziev, Y. L., Kosykh, V. S., Makhonto, V. S., Chumiciev, V. B., Korsakov, A. T., Martynenko, V. P. and Godko, A. (1995) Analysis and prognosis of radiation exposure following the accident at the Siberian chemical combine Tomsk-7. Radian Protectn Dosim., 59, 93-126.
64. Smith, M. and Kohn, R. (1998) Nonparametric estimation of irregular functions with independent or autocorrelated errors. In Practical Nonparametric and Semiparametric Bayesian Statistics (eds D. Dey, P. Müller and D. Sinha), pp. 157-179. New York: Springer.
65. Stein, M. L. (1987) Large sample properties of simulation using latin hypercube sampling. Technometrics, 29, 143-151.
66. -(1999) Interpolation of Spatial Data: Some Theory for Kriging. New York: Springer.
67. Vecchia, A. V. (1988) Estimation and identification for continuous spatial processes. J. R. Statist. Soc. B, 50, 297-312.
68. Vidakovic, B. (1998) Wavelet-based nonparametric Bayes methods. In Practical Nonparametric and Semiparametric Bayesian Statistics (eds D. Dey, P. Müller and D. Sinha), pp. 133-155. New York: Springer.
69. Walker, S. G., Damien, P., Laud, P. W. and Smith, A. F. M. (1999) Bayesian nonparametric inference for random distributions and related functions (with discussion). J. R. Statist. Soc. B, 61, 485-527.
70. Welch, W. J., Buck, R. J., Sacks, J., Wynn, H. P., Mitchell, T. J. and Morris, M. D. (1992) Screening, predicting, and computer experiments. Technometrics, 34, 15-25.
71. Wolpert, R. L. (1995) Comment on the paper by Raftery, Givens and Zeh. J. Am. Statist. Ass., 90, 426-427.
72. Wooff, D. A. (1992) [B/D] works. In Bayesian Statistics 4 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 851-859. Oxford: Oxford University Press.