Bayesian inference method for model validation and confidence extrapolation

Journal of Applied Statistics

Volumn 36, Issue 6, 2009, Pages 659-677

  Jiang, Xiaomo ^a   Mahadevan, Sankaran ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

Bayes factor; Bayesian statistics; Extrapolation; Hypothesis testing; Model validation

Indexed keywords

EID: 70449380034     PISSN: 02664763     EISSN: 13600532     Source Type: Journal    
DOI: 10.1080/02664760802499295     Document Type: Article

References (39)

1. American Institute of Aeronautics and Astronautics, Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, American Institute of Aeronautics and Astronautics AIAA-G-077-1998, Reston, VA, 1998.
2. American Society of Mechanical Engineers, Guide for Verification and Validation in Computational Solid Mechanics, ASME, ASME V&V 10-2006, 2006.
3. U. Angel, T.L. Paez, D.L. Gregory, and B.R. Resor, Validation of a multi-jointed mechanical system model, Tec. Rep. Sand. No. 2005-2379C, Sandia National Laboratories, Albuquerque, NM, 2005.
4. I. Babuska and J.T. Oden, Verification and validation in computational engineering and science: basic concepts, Comput. Methods Appl. Mech. Eng. 193 (2004), pp. 4057-4066.
5. I. Babuska, F. Nobile, and R. Tempone, Formulation of the static frame problem, Comput. Methods Appl. M Spec. Iss. 197 (2008), pp. 2496-2499.
6. O. Balci, Verification, validation, and accreditation of simulation models, in Proceedings of the 29th Conference on Winter Simulation, Atlanta, Georgia, 1997.
7. J.O. Berger and M. Delampady, Testing precise hypotheses, Stat. Sci. 2 (1987), pp. 317-352.
8. G.E.P. Box and D.R. Cox, An analysis of transformations, J. R. Stat. Soc. Ser. B 26 (1964), pp. 211-52.
9. K. Campbell,A brief survey of statistical model calibration ideas, in International Conference on SensitivityAnalysis of Model Output, Santa Fe, NM, 2004.
10. W. Chen, L. Baghdasaryan, T. Buranathiti, and J. Cao, Model validation via uncertainty propagation and data transformation, AIAA J. 42 (2004), pp. 1406-1415.
11. Department of Defense, Verification, Validation, and Accreditation (VV&A) Recommended Practices Guide, Department of Defense, Alexandria, VA, 1996. Available at http://vva.dmso.mil/.
12. Department of Energy, Advanced Simulation and Computing (ASC) Program Plan, Office of Advanced Simulation and Computing, DOE/NNSA NA-114. Available at http://www.sandia.gov/NNSA/ASC/pdfs/ASC-PP-Final-Jan08.pdf.
13. K.J. Dowding, R.G. Hills, I. Leslie, M. Pilch, B.M. Rutherford, and M.L. Hobbs, Case study for model validation: assessing a model for thermal decomposition of polyurethane foam,Tec. Rep. Sand. No. 2004-3632, Sandia National Laboratories, Albuquerque, NM, 2004.
14. K.J. Dowding, M. Pilch, and R.G. Hills, Formulation of the thermal problem, Comput. Methods Appl. M. Spec. Iss. 197 (2008), pp. 2385-2389.
15. B. Efron and R.J. Tibshirani, An Introduction to the Bootstrap, 2nd ed., Chapman & Hall/CRC, Boca Raton, FL, 1998.
16. R.G. Hills and I. Leslie, Statistical validation of engineering and scientific models: validation experiments to application, Tec. Rep. Sand. No. 2003-0706, Sandia National Laboratories, Albuquerque, NM, 2003.
17. R.G. Hills and T.G. Trucano, Statistical validation of engineering and scientific models: a maximum likelihood based metric, Tec. Rep. Sand. No. 2001-1783, Sandia National Laboratories, Albuquerque, NM, 2002.
18. J.T. Hwang, G. Casella, C. Robert, M.T. Wells, and R.H. Farrell, Estimation of accuracy in testing, Annu. Stat. 20 (1992), pp. 490-509.
19. F.V. Jensen and F.B. Jensen, Bayesian Networks and Decision Graphs, Springer, NewYork, 2001.
20. X. Jiang and S. Mahadevan, Bayesian risk-based decision method for model validation under uncertainty, Reliab. Eng. Syst. Safe. 92 (2007), pp. 707-718.
21. X. Jiang and S. Mahadevan, Bayesian validation assessment of multivariate computational models, J. Appl. Stat. 35(1) (2008), pp. 49-65.
22. R. Kass and A. Raftery, Bayes factors, J. Am. Stat. Assoc. 90 (1995), pp. 773-795.
23. S. Mahadevan and R. Rebba, Validation of reliability computational models using Bayes networks, Reliab. Eng. Syst. Safe. 87 (2005), pp. 223-232.
24. J. McFarland and S. Mahadevan, Error and variability characterization in structural dynamics modeling, Comp. Methods Appl. M Spec. Iss. 197 (2008), pp. 2621-2631.
25. H.S. Migon and D. Gamerman, Statistical Inference - An Integrated Approach. Arnold, a Member of the Holder Headline Group, London, 1999.
26. W.L. Oberkampf and M.F. Barone, Measures of agreement between computation and experiment: validation metrics, J. Comput. Phys. 217 (2006), pp. 5-36.
27. W.L. Oberkampf and T.G. Trucano, Verification and validation in computational fluid dynamics, Progr. Aerosp. Sci. 38 (2002), pp. 209-272.
28. T.G. Trucano, Verification and validation benchmarks,Nucl. Eng. Des. 238(2008),pp.716-743.
29. W.L. Oberkampf, T.G. Trucano, and Ch. Hirsch, Verification, validation, and predictive capabilities in computational engineering and physics, Tech. Rep. Sand. No. 2003-3769, Sandia National Laboratories, Albuquerque, NM, 2003.
30. T.L. Paez and A. Urbina, Validation of mathematical models of complex structural dynamic systems, in Proceedings of the Ninth International Congress on Sound and Vibration, Orlando, FL, 2002.
31. R. Rebba, Model Validation and Design under Uncertainty. Ph.D. diss., Vanderbilt University, Nashville, TN, 2005.
32. R. Rebba and S. Mahadevan, Validation of models with multivariate output, Reliab. Eng. Syst. Safe. 91 (2006), pp. 861-887.
33. J.R. Red-Horse and T.L. Paez, Sandia National Laboratories validation workshop: structural dynamics application, Comput. Methods Appl. M Spec. Iss. 197 (2008), pp. 2578-2584.
34. P.J. Roache, Verification and validation in computational science and engineering, in Science and Engineering, Hermosa Publishers, Albuquerque, NM, 1998.
35. B.M. Rutherford and K. Dowding, An approach to model validation and model-based prediction - polyurethane foam case study, Tec. Rep. Sand. No. 2003-2336, Sandia National Laboratories, Albuquerque, NM, 2003.
36. R. Sargent, Validation and verification of simulation models, in Proceedings of the 2004 Winter Simulation Conference, Washington, DC, 2004.
37. T.G. Trucano, R.G. Easterling, K.J. Dowding, T.L. Paez, A. Urbina, V.J. Romero, B.M. Rutherford, and R.G. Hills, Description of the Sandia validation metrics project, Tec. Rep. Sand. No. 2001-1339, Sandia National Laboratories, Albuquerque, NM, 2001.
38. R. Weiss, Bayesian sample size calculations for hypothesis testing, Statistician 46 (1997), pp. 185-191.
39. R. Zhang and S. Mahadevan, Bayesian methodology for reliability model acceptance, Reliab. Eng. Syst. Safe. 80 (2003), pp. 95-103.