Computational methods for model reliability assessment

Reliability Engineering and System Safety

Volumn 93, Issue 8, 2008, Pages 1197-1207

  Rebba, Ramesh ^a   Mahadevan, Sankaran ^b  

^a GENERAL MOTORS CORPORATION   (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Hypothesis testing; Model validation; p value; Reliability; t test

Indexed keywords

BAYESIAN NETWORKS; COMPUTATIONAL METHODS; MATHEMATICAL MODELS; STATISTICAL METHODS; UNCERTAINTY ANALYSIS;

COMPUTATIONAL MODELS; HYPOTHESIS TESTING; MODEL VALIDATION; RELIABILITY ESTIMATION;

RELIABILITY ANALYSIS;

EID: 40949090092     PISSN: 09518320     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ress.2007.08.001     Document Type: Article

References (32)

1. Oberkampf W.L., and Trucano T.G. Verification and validation in computational fluid dynamics. ProgressAerospace Sci 38 3 (2002) 209-272
2. Oberkampf W.L., and Barone M.F. Measures of agreement between computation and experiment: validation metrics. J Comput Phys 217 (2006) 5-36
3. Sargent RG. Verification and validation of simulation models. In: Proceedings of 37th conference on winter simulation, Orlando, Florida, 2004.
4. Balci O. Verification, validation and accreditation of simulation models. In: Proceedings of 29th conference on winter simulation, Atlanta, Georgia, 1997.
5. Coleman H.W., and Stern F. Uncertainties in CFD code validation. ASME J Fluids Eng 119 (1997) 795-803
6. Hills RG, Leslie I. Statistical validation of engineering and scientific models: validation experiments to applications. Sandia technical report no. SAND2003-0706. Albuquerque, NM, USA: Sandia National Laboratories; 2003.
7. Chen W., Baghdasaryan L., Buranathiti T., and Cao J. Model validation via uncertainty propagation. AIAA J 42 (2004) 1406-1415
8. Dowding K, Hills RG, Leslie I, Pilch M, Rutherford BM, Hobbs ML. Case study for model validation: assessing a model for thermal decomposition of polyurethane foam. Sandia technical report no. SAND2004-3632. Albuquerque, NM, USA: Sandia National Laboratories, 2004.
9. Zhang R., and Mahadevan S. Bayesian methodology for reliability model acceptance. J Reliab Eng Syst Saf 80 1 (2003) 95-103
10. Rebba R, Mahadevan S, Huang S. Validation and error estimation of computational models. In: Proceedings of SAMO 2004, Santa Fe, NM, 2004.
11. Hasselman TK, Wathugala WG. A hierarchical approach for model validation and uncertainty quantification. In: Proceedings of fifth world congress on computational mechanics (WCCM V), Vienna, Austria, 2002.
12. Higdon D., Kennedy M.C., Cavendish J., Cafeo J., and Ryne R.D. Combining field data and computer simulations for calibration and prediction. SIAM J Sci Comput 26 (2004) 448-466
13. Ferrandiz J.R. Bayesian inference on Mahalanobis distance: an alternative approach to Bayesian Model testing. In: Bernardo J.M., DeGroot M.H., Lindley D.V., and Smith A.F.M. (Eds). Bayesian statistics vol. 2 (1985), North-Holland, Amsterdam 645-654
14. Schervish M.J. Theory of statistics (1995), Springer, New York
15. Jiang X., and Mahadevan S. Bayesian risk-based decision method for model validation under uncertainty. J Reliab Eng Syst Saf 92 6 (2006) 707-718
16. Cohen J. The Earth is round (p<.05). Am Psychol 49 (1994) 997-1003
17. Kirk R. Practical significance: a concept whose time has come. Educat Psychol Meas 56 5 (1996) 746-759
18. Spearman C. The proof and measurement of association between two things. Am J Psychol 15 1 (1904) 72-101
19. Fisher R.A. Statistical methods for research workers (1925), Oliver and Boyd, Edinburgh
20. Neyman J., and Pearson E.S. Interpretation of significance levels and effect sizes by psychological researchers. Biometrika 20A 1 (1928) 175-240
21. Stuart A, Ord JK.Kendall's advanced theory of statistics. Vol. 1, distribution theory, 6th ed. Hodder Arnold, 1994.
22. Giles D.E.A. A saddlepoint approximation to the distribution function of the Anderson-Darling test statistic. Commun Stat Simul Comput 30 4 (2001) 899-905
23. Berger J.O., and Delampady M. Testing precise hypothesis. Stat Sci 2 3 (1987) 317-352
24. Berger J.O., and Sellke T. Testing a point null hypothesis: the irreconcilability of p-values and evidence. J Am Stat Assoc 82 397 (1987) 112-139
25. Jeffreys H.J. Theory of probability. 3rd ed (1961), Clarendon Press, Oxford
26. Logan R.W., and Nitta C.K. Comparing 10 methods for solution verification and linking to model validation. AIAA J Aerospace Comput Inform Commun 3 (2006) 354-373
27. Urbina A, Paez TL, Hinnerichs T, O'Gorman C, Hunter P, Rutherford B.On the validation of a mathematical model of a foam encapsulated system. In: Reliability and robust design in automotive engineering, SAE-2006-01-0457, SP-2032. Warrendale, PA: SAE; 2006. p. 153-60.
28. Efron B., and Tibshirani R. An introduction to bootstrap, no. 57 in monographs on statistics and applied probability (1993), Chapman & Hall, New York
29. Young G.A., and Daniels H.E. Bootstrap bias. Biometrika 77 1 (1990) 179-185
30. Rebba R, Mahadevan S. Model predictive capability assessment under uncertainty. In: Proceedings of 47th AIAA structures, structural dynamics, materials conference, Austin, TX, 18-21 April 2005.
31. Cruse T.A. Reliability-based mechanical design (1997), Marcel Dekker Inc, New York
32. Urbina A, Paez TL, Hasselman TK, Wathugala GW, Yap K. Assessment of model accuracy relative to stochastic system behavior. In: Proceedings of 44th AIAA structures, structural dynamics, materials conference, Norfolk, VA, 7-10 April 2003.