Calibration and uncertainty analysis for computer simulations with multivariate output

AIAA Journal

Volumn 46, Issue 5, 2008, Pages 1253-1265

  McFarland, John ^a,c   Mahadevan, Sankaran ^a,c   Romero, Vicente ^b,c,d   Swileir, Laura ^b,c,e  

^a VANDERBILT UNIVERSITY   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

^c Department of Mechanical Engineering ^*

^d Technical Staff Model Validation and Uncertainty Quantification Department   (United States)

^e Technical Staff Optimization and Uncertainty Estimation Department

Author keywords

[No Author keywords available]

Indexed keywords

AMERICAN INSTITUTE OF AERONAUTICS AND ASTRONAUTICS (AIAA); BAYESIAN; BAYESIAN INFERENCES; CALIBRATION PARAMETERS; CALIBRATION PROCESSING; FUNCTION OF TIME; GAUSSIAN; GAUSSIAN PROCESS (GP); MODEL CALIBRATION; MODELING PARAMETERS; NON-GAUSSIAN; SURROGATE MODELING; SYSTEM RESPONSES; UNCERTAINTY DISTRIBUTIONS; UNOBSERVABLE;

AVIATION; BAYESIAN NETWORKS; CALIBRATION; COMPUTATIONAL METHODS; COMPUTER NETWORKS; COMPUTER SIMULATION; COMPUTERS; ERROR ANALYSIS; FUEL ADDITIVES; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES; MATHEMATICAL MODELS; MOBILE TELECOMMUNICATION SYSTEMS; MODAL ANALYSIS; PARAMETER ESTIMATION; TRELLIS CODES; VARIATIONAL TECHNIQUES;

UNCERTAINTY ANALYSIS;

EID: 44849090348     PISSN: 00011452     EISSN: None     Source Type: Journal    
DOI: 10.2514/1.35288     Document Type: Article

References (41)

1. Campbell, K., "Statistical Calibration of Computer Simulations," Reliability Engineering and System Safety, Vol. 9.1, Nos. 10-11, 2006, pp. 1358-1363.
2. Trucano, T., Swiler, L., Igusa, T., Oberkampf, W., and Pilch, M., "Calibration, Validation, and Sensitivity Analysis: What's What," Reliability Engineering and System Safety, Vol. 91, Nos. 10-11, 2006, pp. 1331-1357.
3. Vecchia, A., and Cooley, R., "Simultaneous Confidence and Prediction Intervals for Nonlinear Regression. Models, with Application to a Groundwater Flow Model," Water Resources Research, Vol. 23, No. 7, 1987, pp. 1237-1250. doi:10.1029/WR023i007p01237
4. Beven, K., and Binley, A., "The Future of Distributed Models: Model Calibration and Uncertainty Prediction," Hydrological Processes, Vol. 6, 1992, pp. 279-298. doi:10.1002/hyp.336005
5. Stigter, J., and Beck, M., "A New Approach to the Identification of Model Structure," Environmetrics, Vol. 5, No. 3, 1994, pp. 315-333. doi:10.1002/env.3170050310
6. Banks, H., "Remarks on Uncertainty Assessment and Management in Modeling and Computation," Mathematical and Computer Modelling, Vol. 33, Nos. 1-3, 2001, pp. 39-47. doi:10.1016/S0895-177(00)00227-2
7. Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P., "Design and Analysis of Computer Experiments," Statistical Science, Vol. 4, No. 4, 1989, pp. 409-135. doi:10.1214/ss/1177012413
8. Santner, T. J., Williams, B. J., and Noltz, W. I., The Design and Analysis of Computer Experiments, Springer-Verlag, New York, 2003.
9. Martin, J., and Simpson, T., "Use of Kriging Models to Approximate Deterministic Computer Models," AIAA Journal, Vol. 43, No. 4, 2005, pp. 853-863.
10. Kennedy, M. C., and O'Hagan, A., "Bayesian Calibration of Computer Models," Journal of the Royal Statistical Society Series B (Methodological), Vol. 63, No. 3, 2001, pp. 425-464. doi:101111/1467-98680. 00294
11. Currin, C., Mitchell, T., Morris, M., and Ylvisaker, D., "Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments," Journal of the American Statistical Association, Vol. 86, No. 416, 1991, pp. 953-963. doi:10.2307/2290511
12. Morris, M. D., Mitchell, T. J., and Ylvisaker, D., "Bayesian Design and Analysis of Computer Experiments: Use of Derivatives in Surface Prediction," Technometrics, Vol. 35, No. 3, 1.993, pp. 243-255. doi:10.2307/1269517
13. Kennedy, M. C., and O'Hagan, A., "Predicting the Output from a Complex Computer Code When Fast Approximations are Available," Biometrika, Vol. 87, No. 1, 2000, pp. 1-13. doi.:10.1093/biomet/87.1.1
14. Bichon, B. J., Eldred, M, S., Swiler, L. P., Mahadevan, S., and McFarland, J. M., "Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions," AIAA Journal (submitted for publication).
15. Jones, D. R., Schonlau, M., and Welch, W. J., "Efficient Global Optimization of Expensive Black-Box Functions," Journal of Global Optimization, Vol. 13, No. 4, 1998, pp. 455-492. doi:10.1023/A:100830643117
16. Bayarri, M. J., Berger, J. O., Higdon, D., Kennedy, M. C., Kottas, A., Paulo, R., Sacks, J., Cafeo, J. A., Cavendish, J., Lin, C. H., and Tu, J., "A Framework for Validation of Computer Models," National Inst. of Statistical Sciences, TR 128, Research Triangle Park, NC, 2002.
17. Simpson, T. W., Mauery, T. M., Korte, J. J., and Mistree, F., "Kriging Models for Global. Approximation in Simulation-Based Multidisciplinary Design Optimization," AIAA Journal, Vol. 39, No. 12, 2001, pp. 2233-2241.
18. Kaymaz, I., "Application of Kriging Method to Structural Reliability Problems," Structural Safety, Vol. 27, No. 2, 2005, pp. 133-151. doi:10.1016/i.strusafe.2004.09.001
19. Ripley, B., Spatial Statistics, Wiley, New York, 1981.
20. Stein, M. L., Interpolation of Spatial Data: Some Theory for Kriging, Springer Series in Statistics, Springer-Verlag, New York, 1999.
21. Simpson, T., Peplinski, J., Koch, P., and Allen, J., "Metamodels in Computer-Based Engineering Deisgn: Survey and Recommendations," Engineering with Computers, Vol. 17, No. 2, 2001, pp. 129-150. doi:10.1007/PL00007198
22. Rasmussen, C., Evaluation of Gaussian Processes and Other Methods for Nonlinear Regression, Ph.D. Thesis, Univ. of Toronto, Toronto, Ontario, Canada, 1996.
23. Kennedy, M. C., and O'Hagan, A., "Supplementary Details on Bayesian Calibration of Computer Codes," Dept. of Probability and Statistics, Univ. of Sheffield, Sheffield, England, U.K., 2000.
24. Cormen, T. H., Leiserson, C. E., Rivest, R. L., and Stein, C., Introduction to Algorithms, MIT Press, Cambridge, MA, 2001.
25. Marzouk, Y., Najm, H., and Rahn, L., "Stochastic Spectral Methods for Efficient Bayesian Solution of Inverse Problems," Journal of Computational Physics, Vol. 224, No. 2, June 2007, pp. 560-568. doi:10.1016/j.jcp.2006.10.010
26. Hastings, W. K., "Monte Carlo Sampling Methods Using Markov Chains and Their Applications," Biometrika, Vol. 57, No. 1, 1970, pp. 97-109. doi:10.1093/biornet/57.1.97
27. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., and Teller, E., "Equations of State Calculations by Fast-Computing Machines," Journal of Chemical Physics, Vol. 21, No. 6, 1953, pp. 1087-1092. doi:10.1063/1.1699114
28. Chib, S., and Greenberg, E., "Understanding the Metropolis-Hastings Algorithm," American Statistician, Vol. 49, No. 4, 1995, pp. 327-335. doi:10.2307/2684568
29. Seber, G. A. F., and Wild, C. J., Nonlinear Regression, Wiley, New York, 2003
30. Giunta, A. A., McFarland, J. M., Swiler, L. P., and Eldred, M. S., "The Promise and Peril of Uncertainty Quantification Using Response Surface Approximations," Structure and Infrastructure Engineering, Vol. 2, Nos. 3-4, 2006, pp. 175-189. doi:10.1080/157324706003590507
31. Erickson, K. L., Trujillo, S. M., Thompson, K. R., Sun, A. C., Hobbs, M. L., and Dowding, K. J., "Liquefaction and Flow Behavior of a Thermally Decomposing Removable Epoxy Foam," Computational Methods in Materials Characterisation, edited by A. A. Mammoli and C. A. Brebbia, WIT Press, Boston, 2004, pp. 217-242.
32. Romero, V. J., Shelton, J. W., and Sherman, M. P., "Modeling Boundary Conditions and Thermocouple Response in a Thermal Experiment," 2006 International. Mechanical Engineering Congress and Exposition, American Society for Mechanical Engineers, Paper IMECE2006-1.5046, Nov. 2006.
33. CALORE, Software Package, Ver. 4.1, Sandia National Labs., Albuquerque, NM, 2005.
34. Bernardo, M. C., Buck, R. J., Liu, L., Nazaret, W. A., Sacks, J., and Welch, W. J., "Integrated Circuit Design Optimization Using a Sequential Strategy," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol, .11, No. 3, 1992, pp. 361-372. doi:10.1109/43.124423
35. Craig, P. S., Goldstein, M., Seheult, A, H., and Smith, J. A., "Bayes Linear Strategies for Matching Hydrocarbon Reservoir History," Bayesian Statistics 5, edited by J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford Univ. Press, Oxford, 1996, pp. 69-95.
36. Aslett, R., Buck, R. J., Duvall, S. G., Sacks, J., and Welch, W. J., "Circuit Optimization Via Sequential Computer Experiments: Design of an Output Buffer," Journal of the Royal Statistical Society Series C (Applied Statistics), Vol. 47, No. 1,1998, pp. 31-48. doi:10.1111/1467-9876. 00096
37. Eldred, M. S.,Brown, S. L., Adams, B. M., Dunlavy, D. M., Gay, D. M., Swiler, L. P., Giunta, A. A., Hart, W. E., Watson, J. P., Eddy, J. P., Griffin, J. D., Hough, P. D., Kolda, T. G., Martinez-Canales, M. L., and Williams, P. J., "DAKOTA: A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 4.0 Reference Manual," Sandia National Labs., TR SAND2006-4055, Albuquerque, NM, Oct. 2006.
38. Lee, P., Bayesian Statistics: An Introduction, Oxford Univ. Press, New York, 2004.
39. Silverman, B. W., Density Estimation for Statistics and Data Analysis, CRC Press, Boca Raton, FL, 1986.
40. Jones, D., Perttunen, C., and Stuckman, B., "Lipschitzian Optimization Without the Lipschitz Constant," Journal of Optimization Theory and Applications, Vol. 79, No. 1, 1993, pp. 157-181. doi:10.1007/BF00941892
41. Gilks, W. R., Richardson, S., and Spiegelhalter, D. J., Markov Chain Monte Carlo in Practice, CRC Press, Boca Raton, FL, 1996.