Batch sequential design to achieve predictive maturity with calibrated computer models

Reliability Engineering and System Safety

Volumn 96, Issue 9, 2011, Pages 1208-1219

  Williams, Brian J ^a   Loeppky, Jason L ^b   Moore, Leslie M ^a   MacKlem, Mason S ^b  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Calibration; Computer experiment; Entropy; Expected improvement; Gaussian process; Maximin distance; Sequential experiment design

Indexed keywords

COMPUTER EXPERIMENT; EXPECTED IMPROVEMENTS; GAUSSIAN PROCESSES; MAXIMIN; SEQUENTIAL EXPERIMENT DESIGN;

CALIBRATION; ENTROPY; EXPERIMENTS; OPTIMIZATION;

DESIGN;

EID: 79959588880     PISSN: 09518320     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ress.2010.04.017     Document Type: Article

References (42)

1. National Research Council. Evaluation of quantification of margins and uncertainties methodology for assessing and certifying the reliability of the nuclear stockpile. Washington, DC: National Academy Press; 2008.
2. M Kennedy, and A. OHagan Bayesian calibration of computer models (with discussion) J R Stat Soc Series B Stat Methodol 68 2001 425 464 (Pubitemid 33305774)
3. M Schonlau, WJ Welch, and DR. Jones Global versus local search in constrained optimization of computer models N Flournoy, WF Rosenberger, WK Wong, New developments and applications in experimental design vol. 34 1998 Institute of Mathematical Statistics Hayward 11 25
4. DR Jones, M Schonlau, and WJ. Welch Efficient global optimization of expensive black-box functions J Glob Optim 13 1998 455 492 (Pubitemid 128507405)
5. BJ Williams, TJ Santner, and WI. Notz Sequential design of computer experiments to minimize integrated response functions Stat Sin 10 2000 1133 1152 (Pubitemid 33209599)
6. JS Lehman, TJ Santner, and WI. Notz Designing computer experiments to determine robust control variables Stat Sin 14 2004 571 590 (Pubitemid 38907077)
7. AJ. Keane Statistical improvement criteria for use in multiobjective design optimization AIAAJ 44 2006 879 891
8. AJ Booker, JE Dennis, PD Frank, DB Serafini, V Torczon, and MW. Trosset A rigorous framework for optimization of expensive functions by surrogates Struct Optim 17 1999 1 13
9. Audet C, Dennis JE, Moore DW, Booker A, Frank PD. A surrogate-model-based method for constrained optimization. AIAA-2000-4891:1-10.
10. RG Regis, and CA. Shoemaker Constrained global optimization of expensive black box functions using radial basis functions J Glob Optim 31 2005 153 171 (Pubitemid 40608865)
11. P Ranjan, D Bingham, and G. Michailidis Sequential experiment design for contour estimation from complex computer codes Technometrics 50 2008 527 541
12. ME Johnson, LM Moore, and D. Ylvisaker Minimax and maximin distance designs J Stat Plan Inference 26 1990 131 148
13. MD Morris, and TJ. Mitchell Exploratory designs for computational experiments J Stat Plan Inference 43 1995 381 402
14. JL Loeppky, LM Moore, and BJ. Williams Batch sequential designs for computer experiments J Stat Plan Inference 140 2010 1452 1464
15. K Chaloner, and I. Verdinelli Bayesian experimental design: a review Stat Sci 10 1995 273 304
16. DR Bingham, and HA. Chipman Incorporating prior information in optimal design for model selection Technometrics 49 2007 155 163 (Pubitemid 46799916)
17. CQ Lam, and WI. Notz Sequential adaptive designs in computer experiments for response surface model fit Stat Appl 6 2008 207 233
18. D Higdon, M Kennedy, J Cavendish, J Cafeo, and RD. Ryne Combining field observations and simulations for calibration and prediction SIAM J Sci Comput 26 2004 448 466
19. B Williams, D Higdon, J Gattiker, L Moore, M McKay, and S. Keller-McNulty Combining experimental data and computer simulations, with an application to flyer plate experiments Bayesian Anal 1 2006 765 792
20. D Higdon, J Gattiker, B Williams, and M. Rightley Computer model calibration using high-dimensional output J Am Stat Assoc 103 2008 570 583
21. Lam CQ. Sequential adaptive designs in computer experiments for response surface model fit. The Ohio State University, Unpublished PhD thesis; 2008.
22. VV. Fedorov Theory of optimal design 1972 Academic New York
23. AC Genz, and AA. Malik Remarks on algorithm 006: an adaptive algorithm for numerical integration over an N-dimensional rectangular region J Comput Appl Math 6 1980 295 302
24. A. OHagan BayesHermite quadrature J Stat Plan Inference 29 1991 245 260
25. Lu W, Ranjan P, Bingham D, Reese CS, Williams BJ. Follow-up experiment designs for computer models and physical processes. Acadia University technical report, unpublished results.
26. J Sacks, and S. Schiller Spatial designs SS Gupta, JO Berger, Statistical decision theory and related topics IV 1988 Springer-Verlag New York 385 399
27. J Sacks, SB Schiller, and WJ. Welch Design for computer experiments Technometrics 31 1989 41 47
28. J Sacks, WJ Welch, TJ Mitchell, and HP. Wynn Design and analysis of computer experiments Stat Sci 4 1989 409 423
29. MC Shewry, and HP. Wynn Maximum entropy sampling J Appl Stat 14 1987 165 170
30. IM Sobol, and YL Levitan On the use of variance reducing multipliers in Monte Carlo computations of a global sensitivity index Comput Phys Commun 117 1999 52 61
31. K Chan, S Tarantola, A Saltelli, and IM Sobol Variance-based methods A Saltelli, K Chan, EM Scott, Sensitivity analysis 2000 J. Wiley & Sons Chichester 167 197
32. JL Loeppky, J Sacks, and WJ. Welch Choosing the sample size of a computer experiment: a practical guide Technometrics 51 2009 366 376
33. K Ye, W Li, and A. Sudjianto Algorithmic construction of optimal symmetric Latin hypercube designs J Stat Plan Inference 90 2000 145 159
34. IM Sobol On the distribution of points in a cube and the approximate evaluation of integrals USSR Computat Math Math Phys 7 1967 86 112
35. J. Matousek On the L2-discrepancy for anchored boxes J Complex 14 1998 527 556
36. MD McKay, RJ Beckman, and WJ. Conover A comparison of three methods for selecting values of input variables in the analysis of output from a computer code Technometrics 21 1979 239 245 (Pubitemid 9452235)
37. B. Tang Orthogonal array-based Latin hypercubes J Am Stat Assoc 88 1993 1392 1397
38. AB. Owen Controlling correlations in Latin hypercube samples J Am Stat Assoc 89 1994 1517 1522
39. Loeppky JL, Moore LM, Williams BJ. Projection array based designs for computer experiments. Los Alamos National Laboratory technical report, unpublished results.
40. JW. Tukey The problem of multiple comparisons HI Braun, The collected works of John W. Tukey, vol. VIII, multiple comparisons: 19481983 1994 Chapman and Hall New York 1 300
41. B Jones, and RT. Johnson Design and analysis for the Gaussian process model (with discussion) Qual Reliab Eng Int 25 2009 515 550
42. G Sfikas, C Constantinopoulos, A Likas, and NP. Galatsanos An analytic distance metric for Gaussian mixture models with application in image retrieval W Duch, J Kacprzyk, E Oja, S Zadrozny, Artificial neural networks: formal models and their applications - ICANN 2005 2005 Springer Berlin 835 840