Multivariate significance testing and model calibration under uncertainty

Computer Methods in Applied Mechanics and Engineering

Volumn 197, Issue 29-32, 2008, Pages 2467-2479

  McFarland, John ^a   Mahadevan, Sankaran ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

Calibration; Hypothesis testing; Model validation; Multivariate statistics; Significance testing; Uncertainty

Indexed keywords

CALIBRATION; COMPUTER SIMULATION; HEAT PROBLEMS; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS;

HYPOTHESIS TESTING; MODEL VALIDATION; MULTIVARIATE STATISTICS; SIGNIFICANCE TESTING;

UNCERTAINTY ANALYSIS;

CALIBRATION; COMPUTER SIMULATION; HEAT PROBLEMS; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; UNCERTAINTY ANALYSIS;

EID: 43049127727     PISSN: 00457825     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cma.2007.05.030     Document Type: Article

References (40)

1. Dowding K.J., Pilch M., and Hills R.G. Formulation of the thermal problem. Comput. Methods Appl. Mech. Engrg. (2007)
2. Oberkampf W., and Barone M. Measures of agreement between computation and experiment: validation metrics. J. Comput. Phys. 217 (2006) 5-36
3. W. Oberkampf, T. Trucano, Verification and validation in computational fluid dynamics, Sandia National Laboratories, SAND2002-0529, 2002.
4. R. Sargent, Validation and verification of simulation models, in: Proceedings of the 2004 Winter Simulation Conference, Washington, DC, 2004.
5. O. Balci, Verification, validation, and accreditation of simulation models, in: Proceedings of the 29th Conference on Winter Simulation, Atlanta, GA, 1997.
6. R.G. Hills, T.G. Trucano, Statistical validation of engineering and scientific models: a maximum likelihood based metric, Sandia National Laboratories, SAND2001-1783, 2002.
7. T. Paez, A. Urbina, Validation of mathematical models of complex structural dynamic systems, in: Proceedings of the Ninth International Congress on Sound and Vibration, Orlando, FL, 2002.
8. R.G. Hills, I. Leslie, Statistical validation of engineering and scientific models: validation experiments to application, Sandia National Laboratories, SAND2003-0706, 2003.
9. K. Dowding, R.G. Hills, I. Leslie, M. Pilch, B.M. Rutherford, M.L. Hobbs, Case study for model validation: assessing a model for thermal decomposition of polyurethane foam, Sandia National Laboratories, SAND2004-3632, 2004.
10. B.M. Rutherford, K. Dowding, An approach to model validation and model-based prediction - polyurethane foam case study, Sandia National Laboratories, SAND2003-2336, 2003.
11. Chen W., Baghdasaryan L., Buranathiti T., and Cao J. Model validation via uncertainty propagation. AIAA J. 42 (2004) 1406-1415
12. Mahadevan S., and Rebba R. Validation of reliability computational models using Bayes networks. Reliab. Engrg. Syst. Safety 87 (2005) 223-232
13. Rebba R., Mahadevan S., and Huang S. Validation and error estimation of computational models. Reliab. Engrg. Syst. Safety 91 (2006) 1390-1397
14. Jiang X., and Mahadevan S. Bayesian risk-based decision method for model validation under uncertainty. Reliab. Engrg. Syst. Safety 92 (2007) 707-718
15. K. Campbell, A brief survey of statistical model calibration ideas, in: International Conference on Sensitivity Analysis of Model Output, Santa Fe, NM, 2004.
16. Trucano T., Swiler L., Igusa T., Oberkampf W., and Pilch M. Calibration, validation, and sensitivity analysis: what's what. Reliab. Engrg. Syst. Safety 91 (2006) 1331-1357
17. Vecchia A., and Cooley R. Simultaneous confidence and prediction intervals for nonlinear regression models, with application to a groundwater flow model. Water Resources Res. 23 (1987) 1237-1250
18. Beven K., and Binley A. The future of distributed models: model calibration and uncertainty prediction. Hydrol. Process. 6 (1992) 279-298
19. Stigter J., and Beck M. A new approach to the identification of model structure. Environmetrics 5 (1994) 315-333
20. Banks H. Remarks on uncertainty assessment and management in modeling and computation. Math. Comput. Modell. 33 (2001) 39-47
21. Kennedy M.C., and O'Hagan A. Bayesian calibration of computer models. J. Roy. Stat. Soc. Ser. B 63 (2001) 425-464
22. Lilliefors H. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J. Am. Stat. Assoc. 62 (1967) 399-402
23. Shapiro S., and Wilk M. An analysis of variance test for normality (complete samples). Biometrika 52 (1965) 591-611
24. Isukapalli S.S., Roy A., and Georgopoulos P.G. Stochastic Response Surface Methods (SRSMs) for uncertainty propagation: application to environmental and biological systems. Risk Anal. 18 (1998) 351-363
25. Balci O., and Sargent R. A methodology for cost-risk analysis in the statistical validation of simulation models. Commun. ACM 24 4 (1981) 190-197
26. Balci O., and Sargent R. Validation of simulation models via simultaneous confidence intervals. Am. J. Math. Manage. Sci. 4 3/4 (1984) 375-406
27. 2 test. Simulation 39 (1982) 185-192
28. Srivastava M. Methods of Multivariate Statistics (2002), John Wiley and Sons, Inc., New York
29. Rebba R., and Mahadevan S. Validation of models with multivariate output. Reliab. Engrg. Syst. Safety 91 (2006) 861-871
30. Efron B., and Tibshirani R. An Introduction to the Bootstrap (1993), Chapman and Hall, New York
31. Lee P. Bayesian Statistics, an Introduction (2004), Oxford University Press, Inc., New York
32. C. Rasmussen, Evaluation of Gaussian processes and other methods for non-linear regression, Doctoral Thesis, University of Toronto, 1996.
33. Ripley B. Spatial Statistics (1981), John Wiley, New York
34. Santner T.J., Williams B., and Notz W. The Design and Analysis of Computer Experiments (2003), Springer-Verlag, New York
35. Mardia K., and Marshall R. Maximum likelihood estimation of models for residual covariance in spatial regression. Biometrika 71 (1984) 135-146
36. Martin J., and Simpson T. Use of Kriging models to approximate deterministic computer models. AIAA J. 43 (2005) 853-863
37. Metropolis N., Rosenbluth A., Rosenbluth M., Teller A., and Teller E. Equations of state calculations by fast computing machines. J. Chem. Phys. 21 (1953) 1087-1092
38. Chib S., and Greenberg E. Understanding the Metropolis-Hastings algorithm. Am. Stat. 49 (1995) 327-335
39. Hastings W.K. Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57 (1970) 97-109
40. Haldar A., and Mahadevan S. Probability, Reliability, and Statistical Methods in Engineering Design (2000), John Wiley and Sons, Inc., New York