Computationally inexpensive metamodel assessment strategies

Proceedings of the ASME Design Engineering Technical Conference

Volumn 2, Issue , 2001, Pages 191-201

  Meckesheimer, Martin ^a   Barton, Russell R ^a,c   Simpson, Timothy W ^a   Booker, Andrew J ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b BOEING COMPANY   (United States)

^c 310 Leonhard Building   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER AIDED DESIGN; COMPUTER SIMULATION; INFORMATION ANALYSIS; INTERFACES (COMPUTER); MATHEMATICAL MODELS; OPTIMIZATION; PROBLEM SOLVING; ERRORS; FUNCTION EVALUATION;

METAMODEL ASSESSMENT; OPTIMIZATION CODES; APPROXIMATION ERRORS; ASSESSMENT STRATEGIES; COMPLEX PHYSICAL SYSTEMS; DESIGN OPTIMIZATION; ENGINEERING DOMAINS; INTEGRATION FRAMEWORKS; METAMODEL VALIDATION; VALIDATION APPROACH;

SYSTEMS ANALYSIS; VERIFICATION;

EID: 1542436124     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. Meckesheimer, M., Barton, R. R., Limayem, F. and Yannou, B., 2000, "Metamodeling of Combined Discrete/Continuous Responses," ASME 2000 Design Engineering Technical Conferences - Design Theory and Methodology Conference (DTM'00), Alien, J. K., ed. ASME, Baltimore, MD.
2. Simpson, T. W., Peplinski, J., Koch, P. N. and Allen, J. K., 1997, "On the Use of Statistics in Design and the Implications for Deterministic Computer Experiments," Design Theory and Methodology - DTM'97, ASME, Sacramento, CA.
3. Sobieszczanski-Sobieski, J. and Haftka, R. T., 1997, "Multidisciplinary Aerospace Design Optimization: Survey of Recent Developments," Structural Optimization, 14, pp. 1-23.
4. Barthelemy, J.-F. M. and Haftka, R. T., 1993, "Approximation Concepts for Optimum Structural Design - A Review," Structural Optimization, 5, pp. 129-144.
5. Alzubbi, A., Ndiaye, A., Mahdavi, B., Guibault, F., Ozell, B. and Trépanier, J.-Y., 2000, "On the use of Java and RMI in the development of a computer framework for MDO," Proceedings of the 8th AIAA/NASA/USAF/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Long Beach, California, USA.
6. Sobieszczanski, J., 1999, "Multidisciplinary design optimization (MDO) methods: their synergy with computer technology in the design process," Aeronautical Journal, 103, pp. 373-382.
7. Salas, A. O. and Townsend, J. C., 1998, "Framework Requirements for MDO Application Development," 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, AIAA, St. Louis, MO, 1, pp. 261-271.
8. Kleijnen, J. P. C., 1975, "A comment on Blanning's metamodel for sensitivity analysis: the regression metamodel in simulation," Interfaces, 5, pp. 21-23.
9. Barton, R. R., 1994, "Metamodeling: A State of the Art Review, " Proceedings of the 1994 Winter Simulation Conference, Tew, J. D., Manivannan, S., et al., eds., IEEE, Lake Beuna Vista, FL, pp. 237-244.
10. Koch, P. N., Simpson, T. W., Allen, J. K. and Mistree, F., 1999, "Statistical Approximations for Multidisciplinary Optimization: The Problem of Size," Special Multidisciplinary Design Optimization Issue of Journal of Aircraft, 36, pp. 275-286.
11. Booker, A. J., Dennis, J. E., Jr., Frank, P. D., Serafini, D. B., Torczon, V. and Trosset, M. W., 1999, "A Rigorous Framework for Optimization of Expensive Functions by Surrogates," Structural Optimization, 17, pp. 1-13.
12. Simpson, T. W. and Mistree, F., 1998, "Spatial Correlation Metamodels for Global Approximation in Computer-Based Engineering Design," INFORMS Seattle Fall 1998 Meeting, INFORMS, Seattle, WA.
13. Sobieski, I. P., Manning, V. M. and Kroo, I. M., 1998, "Response Surface Estimation and Refinement in Collaborative Optimization," 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, AIAA, St. Louis, MO, 1, pp. 359-370.
14. Meckesheimer, M. and Barton, R. R., 1998, "An Architecture for Metamodel-Based Design," Industrial Engineering Research Conference, Banff, Alberta.
15. Barton, R. R., 1997, "Design of Experiments for Fitting Subsystem Metamodels," Proceedings of the 1997 Winter Simulation Conference, IEEE, Atlanta, GA, pp. 303-310.
16. Wilson, B., Cappelleri, D. J., Frecker, M. I. and Simpson, T. W., 2000, "Efficient Pareto Frontier Exploration Using Surrogate Approximations," 8th AIAA/NASA/USAF/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA, Long Beach, CA.
17. Frecker, M., Simpson, T. W., Goldberg, J. H., Barton, R. R. and Belegundu, A. D., 2001, "Integrating Design Research into the Classroom: Experiments in Two Graduate Courses," 2001 Annual ASEE Conference, ASEE, Albuquerque, NM, under review.
18. Kleijnen, J. P. and Sargent, R. G., 2000, "A methodology for the fitting and validation of metamodels in simulation," European Journal of Operational Research, 120, pp. 14-29.
19. Yesilyurt, S. and Patera, A. T., 1995, "Surrogates for Numerical Simulations; Optimization of Eddy-Promoter seat Exchangers," Computer Methods in Applied Mechanics and Engineering, 121, pp. 231-257.
20. Yesilyurt, S., Paraschivoiu, M., Otto, J. and Patera, A. T., 1996, "Computer-Simulation Response Surfaces: A Bayesian-Validated Approach," 11th International Conference on Computational Methods in Water Resources (CMWR96), Aldama, A. A. et al., eds., Computational Mechanics Publishing, Cancun, Mex, 1, pp. 13-22.
21. Osio, I. G. and Amon, C. H., 1996, "An Engineering Design Methodology with Multistage Bayesian Surrogates and Optimal Sampling," Research in Engineering Design, 8, pp. 189-206.
22. Eubank, R. L., 1988, Spline smoothing and nonparametric regression, M. Dekker, New York.
23. Laslert, G. M., 1994, "Kriging and Splines: An Empirical Comparison of Their Predictive Performance in Some Applications," Journal of the American Statistical Association, 89, pp. 391-400.
24. Diaconis, P. and Efron, B., 1983, "Computer-Intensive Methods in Statistics," Scientific American, pp. 116-130.
25. Mitchell, T. J. and Morris, M. D., 1992, "Bayesian Design and Analysis of Computer Experiments: Two Examples," Statistica Sinica, 2, pp. 359-379.
26. Myers, R. H. and Montgomery, D. C., 1995, Response surface methodology: process and product optimization using designed experiments, Wiley, New York.
27. Härdle, W. and Marron, J. S., 1985, "Optimal bandwidth selection in nonparametric regression function estimation," Annals of Statistics, 13, pp. 1465-1481.
28. Shao, J., 1993, "Linear model selection by cross-validation," Journal of the American Statistical Association, 88, pp. 486-494.
29. Efron, B., 1982, The jackknife, the bootstrap, and other resampling plans, Society for Industrial and Applied Mathematics, Philadelphia, PA.
30. Efron, B. and Tibsbirani, R., 1993, An introduction to the bootstrap, Chapman & Hall, New York.
31. Hock, W. and Schittkowski, K., 1981, Test Examples for Nonlinear Programming Codes, Springer Verlag, Berlin.
32. Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P., 1989, "Design and Analysis of Computer Experiments," Statistical Science, 4, pp. 409-435.
33. Booker, A. J., 1998, "Design and Analysis of Computer Experiments," 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, AIAA, St. Louis, MO, 1, pp. 118-128.
34. de Boor, C. and Ron, A., 1990, "On multivariate polynomial interpolation," Constructive Approximation, 6, pp. 287-302.
35. Sacks, J., Schiller, S. B. and Welch, W. J., 1989, "Designs for Computer Experiments," Technometrics, 31, pp. 41-47.
36. de Boor, C. and Ron, A., 1992, "The least solution for the polynomial interpolation problem," Math. Z., 210, pp. 347-378.
37. de Boor, C. and Ron, A., 1992, "Computational aspects of polynomial interpolation in several variables," Mathematics of Computation, 58, pp. 705-727.
38. Owen, A. B., 1992, "Orthogonal Arrays for Computer Experiments, Integration and Visualization," Statistica Sinica, 2, pp. 439-452.
39. McKay, M. D., Beckman, R. J. and Conover, W. J., 1979, "A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code," Technometrics, 21, pp. 239-245.
40. Tang, B., 1993, "Orthogonal Array-Based Latin Hypercubes," Journal of the American Statistical Association, 88, pp. 1392-1397.
41. Kalagnaaam, J. R. and Diwekar, U. M., 1997, "An Efficient Sampling Technique for Off-Line Quality Control," Technometrics, 39, pp. 308-319.
42. Fang, K.-T. and Wang, Y., 1994, Number-theoretic Methods in Statistics, Chapman & Hall, New York.
43. Jin, R., Chen, W. and Simpson, T. W., 2000, "Comparative Studies of Metamodeling Techniques under Multiple Modeling Criteria," 8th AIAA/NASA/USAF/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA, Long Beach, CA.