Validated model? Not so fast. the need for model "conditioning" as an essential addendum to model validation

Collection of Technical Papers - AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference

Volumn 3, Issue , 2007, Pages 3120-3137

  Romero, Vicente J ^a  

^a SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEST-ESTIMATE PLUS UNCERTAINTY (BEPU); PARADIGM SHIFT; VALIDATED MODEL;

OPTIMIZATION; PARAMETER ESTIMATION; UNCERTAIN SYSTEMS;

MATHEMATICAL MODELS;

EID: 34547549832     PISSN: 02734508     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. AIAA, 1998, Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, AIAA G-077-1998, American Institute of Aeronautics and Astronautics, Reston, Virginia.
2. ASME, V&V 10 - 2006 Guide for Verification and Validation in Computational Solid Mechanics, available at http://catalog.asme.org/Codes/ PrintBook/VV_10_2006_Guide_Verification.cfm.
3. Ben-Haim, Y., Information Gap Decision Theory- Decisions under severe uncertainty, Academic Press, London, 2001.
4. Black, A.R., Hobbs, M.L., Dowding, K.J., and Blanchat, T.K., 2007, "Uncertainty Quantification and Model Validation of Fire/Thermal Response Predictions," to be presented at the 18th AIAA Computational Fluid Dynamics Conference, 25-28 June 2007, Miami, Florida.
5. th International Conference on Sensitivity Analysis of Model Output (SAMO) Conference, Santa Fe, New Mexico, March 8-11, 2004. Paper available at http://library.lanl.gov/ccw/ samo2004/.
6. Coleman, H.W., and Steele, Jr., W.G., 1989, Experimentation and Uncertainty Analysis for Engineers, John Wiley & Sons, New York, New York.
7. Coleman, H.W., and Stern, F., 1997, "Uncertainties in CFD Code Validation," Journal of Fluids Engineering. December 1997, Vol. 119, pp. 795-803.
8. Department of Defense, 2006, "Key Concepts of Verification, Verification, & Accreditation," VV&A RPG document dated September 15, 2006.
9. Department of Energy - Defense Programs, 2000, "Accelerated Strategic Computing Initiative (ASCI) Program Plan," DOE/DP-99-000010592.
10. Dowding, K.J., Hills, R.G., Leslie, I.H., Pilch, M., Rutherford, B.M., and Hobbs, M.L., 2004, "Case Study for Model Validation: Assessing a Model for Thermal Decomposition of Polyurethane Foam," Sandia National Laboratories report SAND2004-3632, printed September 2004.
11. Easterling, R.G., 2001, "Measuring the Predictive Capability of Computational Models: Principles and Methods, Issues and Illustrations," Sandia National Laboratories report, SAND2001-0243, Unlimited Release, February 2001.
12. st Century Workshop, October 22-23, 2002.
13. st Century Workshop, October 22-23, 2002.
14. Hanson, K.M., and Hemez, F.M., 2001, "A Framework for Assessing Confidence in Computational Predictions," Experimental Techniques, Vol. 25.
15. th Structures, Structural Dynamics, and Materials Conference, Austin, Texas, April 18-21, 2005.
16. Hazelrigg, G.A., 2003, "Thoughts on Model Validation for Engineering Design," Proceedings of DETC'03, ASME 2003 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Chicago, Illinois, September 2-6, 2003.
17. Hills, R.G. and Trucano, T.G., 1999, "Statistical Validation of Engineering and Scientific Models: Background," Sandia National Laboratories report SAND99-1256, printed May 1999.
18. Hills, R.G., and Dowding, K., 2005, "Statistical Validation of Engineering and Scientific Models: Bounds, Calibration, and Extrapolation," Sandia National Laboratories report SAND2005-1826, printed April 2005.
19. Hodges, J. S., 1991, "Six (or so) Things You Can Do with a Bad Model," Operations Research, Vol. 39, No. 3, May - June, 1991.
20. Kennedy, M.C., and O'Hagan, A., 2001, "Bayesian Calibration of Computer Models," Journal of the Royal Statistical Society Series B - Statistical Methodology, Vol. 63, No. 3, pp.425-464.
21. Logan, R.W., and Nitta, C.K., 2006, "Comparing 10 Methods for Solution Verification, and Linking to Model Validation," Journal of Aerospace Computing, Information and Communication, Vol. 3, pp. 354-373.
22. th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, May 1-4, 2006, Newport, Rhode Island.
23. Mayes, R.L, 2006, "Validation of a Blast Pressure Loading Model for a Shell-Payload Shock Response Model," paper #251 of the 2006 International Modal Analysis Conference (IMAC XXIV), January 30 - February 2, 2006, St. Louis, Missouri.
24. Oberkampf, W.L., and Trucano, T.G., 2002, "Verification and Validation in Computational Fluid Dynamics," Progress in Aerospace Sciences, 38(3), pp. 209-272.
25. th Fluid Dynamics Conference, Portland, Oregon, June 2004.
26. Roache P.J., 1998, Verification and Validation in Computational Science and Engineering, Hermosa Publishers, Albuquerque, New Mexico.
27. nd Structures, Structural Dynamics, and Materials Conference, Seattle, Washington, April 16-19, 2001. Updated and extended version available from the author at vjromer@sandia.gov.
28. Romero, V.J., Sherman, M.P., Dempsey, J.F., Johnson, J.D., Edwards, L.R., Chen, K.C., Baron, R.V., and King, CF., 2005, "Development and Validation of a Component Failure Model," paper AIAA-2005-2141 presented at the 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, April 18-21, 2005, Austin, Texas. Refined version with corrections available from the author at vjromer@sandia.gov.
29. Romero, V.J., 2005, "On Model Validation and Extrapolation for Best-Estimate-Plus-Uncertainty Predictions," Sandia National Laboratories document SAND2005-7678C, November 2005.
30. Romero, V.J., 2006, "Some Issues in Quantification of Margins and Uncertainty (QMU) for Phenomenologically Complex Coupled Systems," paper AIAA-2006-1989 presented at the 8th AIAA Non-Deterministic Approaches Conference, May 1-4, 2006, Newport, Rhode Island.
31. Romero, V.J., "A Paradigm of Model Validation and Validated Models for Best-Estimate-Plus-Uncertainty Predictions in Systems Engineering," Paper 200-01-1746 for Soc. Automotive Engineers 2007 World Congress April 16-20, Detroit, Michigan.
32. Rutherford, B.M., and K.J. Dowding, 2003, "An Approach to Model Validation and Model-Based Prediction: Polyurethane Foam Case Study," Sandia National Laboratories report SAND2003-2336, printed July 2003.
33. Tieszen, S.R., Domino, S.P., and Black, A.R., 2005, "Validation of a Simple Turbulence Model Suitable for Closure of Temporally-Filtered Navier-Stokes Equations Using a Helium Plume," Sandia National Laboratories report SAND2005-3210, printed June 2005.
34. Trucano, T.G., Pilch, M., and Oberkampf, W.L., 2002, "General Concepts for Experimental Validation of ASCI Code Applications," Sandia National Laboratories report SAND2002-0341, printed March 2002.
35. Trucano, T.G., Swiler, L.P., Igusa, T., Oberkampf, W.L., and Pilch, M., 2006, "Calibration, validation, and sensitivity analysis: What's what," Reliability Engineering and System Safety, Vol. 91, Issue 11, pp. 1331-1357.
36. Urbina, A., Paez, T.L., and Smallwood, D.O., 2006, "A Hierarchy of Validation Measures for Structural Dynamics," paper #181 of the 2006 International Modal Analysis Conference (IMAC XXIV), January 30 - February 2, 2006, St. Louis, Missouri.