A hybrid method for surrogate model updating in engineering design optimization

2007 Proceedings of the ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, DETC2007

Volumn 6 PART A, Issue , 2008, Pages 345-370

  Shao, Tiefu ^a   Krishnamurty, Sundar ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Design optimization; Model fidelity; Multiple global optimal points; Process reliability; Surrogate model uncertainty

Indexed keywords

COMPARISON STUDIES; DESIGN AUTOMATION CONFERENCE (DAC); DESIGN SPACES; ENGINEERING DESIGN OPTIMIZATION; EXPERIMENTAL RESULTS; GLOBAL OPTIMAL DESIGN; HIGH FIDELITY; HYBRID METHODS; INTERNATIONAL DESIGNS; LOCAL OPTIMAL; MINIMAL COSTS; MINING TECHNIQUES; MODEL-BASED DESIGNS; NOVEL METHODS; OPTIMAL REGIONS; PAPER ADDRESSES; PREDICTION VARIANCE; SALIENT FEATURES; SIMULATION-BASED DESIGN (SBD); SURROGATE MODELING; TECHNICAL CONFERENCES; TEST FUNCTIONS;

AEROSPACE APPLICATIONS; ALGORITHMS; ARCHITECTURAL DESIGN; AUTOMATION; COMPUTER AIDED DESIGN; COMPUTER NETWORKS; COMPUTER PROGRAMMING LANGUAGES; COMPUTERS; DIESEL ENGINES; ENGINEERING; FORECASTING; FUEL ADDITIVES; FUNCTION EVALUATION; GENETIC ALGORITHMS; GLOBAL OPTIMIZATION; INDUSTRIAL ENGINEERING; INTEGER PROGRAMMING; ITERATIVE METHODS; MATHEMATICAL MODELS; MECHANIZATION; OPTIMIZATION; QUALITY ASSURANCE; RELIABILITY; ROBOTICS; SYSTEMS ENGINEERING; TECHNOLOGY; UNCERTAINTY ANALYSIS;

COMPUTER SIMULATION;

EID: 44849095495     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1115/DETC2007-35482     Document Type: Conference Paper

References (82)

1. Booker, A. J., Dennis, J. E., Frank, P. D., Serafini, D. B., Torczon, V., and Trosset, M. W., 1999, "A Rigorous Framework for Optimization of Expensive Functions by Surrogates," Structural Optimization, 17(1), 1-13.
2. Gu, L., 2001, "A Comparison of Polynomial Based Regression Models in Vehicle Safety Analysis," ASME 2001 Design Engineering Technical Conferences - Design Automation Conference, DETC2001/DAC-21063, Pittsburgh, PA.
3. Simpson, T. W., Booker, A. J., Ghosh, D., Giunta, A. A., Koch, P. N., and Yang, R. J., 2004, "Approximation Methods In Multidisciplinary Analysis And Optimization: A Panel Discussion," Structural and Multidisciplinary Optimization, 27(5), 302-313.
4. Shao, T., and Krishnamurty, S., 2006, "Modeling Implications in Simulation-Based Design of Stents," ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, DETC2006-99493, Philadelphia, PA.
5. Hazelrigg, G. A., 2003, "Thoughts on Model Validation for Engineering Design," ASME 2003 Design Engineering Technical Conferences, DETC2003/DTM-48632, Chicago, Il.
6. Krishnamurty, S., and Wilmes, G., 2004, "Preference-Based Updating of Kriging Surrogate Models," 10th AIAA/ISSMO Multidisciplinary Analysis, Albany, NY, AIAA-2004-4484.
7. Simpson, T. W., Peplinski, J. D. Koch, P. N., and Allen, J. K., 2001, "Metamodels for Computer-Based Engineering Design: Survey and Recommendations," Engineering with Computers, 17(2), 129-150.
8. Barthelemy, J. F. M., and Haftka, R. T., 1993, "Approximation Concepts for Optimum Structural Design - A Review," Structural Optimization, 5(3), 129-144.
9. Barton, R. R., 1994, "Metamodeling: A State of the Art Review," the IEEE 1994 Winter Simulation Conference, Lake Beuna Vista, FL, 237-244.
10. Sobieszczanski-Sobieski, J., and Haftka, R. T., 1997, "Multidisciplinary Aerospace Design Optimization: Survey of Recent Developments," Structural Optimization, 14(1), 1-23.
11. Barton, R. R., 1998, "Simulation Metamodels," Proceedings of the 1998 Winter Simulation Conference, D. J. Medeiros, E. F. Watson, J. S. Carson, and M. S. Manivannan, eds, IEEE Computer Society Press, 167-176.
12. Simpson, T. W., Mauery, T. M., Korte, J. J., and Mistree, F., (2001), "Kriging Metamodels for Global Approximation in Simulation-Based Multidisciplinary Design Optimization," AIAA Journal, 39(12), 2233-2241.
13. Beers, W. C. M. v., and Kleijnen, J. P. C., (2004), "Kriging Interpolation in Simulation: A Survey," Proceedings of the 2004 Winter Simulation Conference, Institute of Electrical and Electronics Engineers, Piscataway, NJ, 113-121.
14. Martin, J. D., and Simpson, T. W., "On the Use of Kriging Models to Approximate Deterministic Computer Models," AIAA Journal, Vol. 43, No. 4, 2005, pp. 853-863.
15. Myers, R. H., and Montgomery, D. C., 2002, Response Surface Methodology, Process and Product Optimization Using Designed Experiments, John Wiley and Sons, New York, NY.
16. NIST/SEMATECH, e-Handbook of Statistical Methods, http://www.itl.nist. gov/div898/handbook/, Access Date: 4/16/2006.
17. Craven, P., and Wahba, G., 1978, "Smoothing Noisy Data with Spline Functions: Estimating the Correct Degree of Smoothing by The Method of Generalized Crossvalidation," Numerical Mathematics, 31, 377-403.
18. Friedman, J. H., 1991, "Multivariate Adaptive Regressive Splines," The Annals of Statistics, 19(1), 1-67.
19. Dyn, N., Levin, D., and Rippa, S., 1986, "Numerical Procedures for Surface Fitting of Scattered Data by Radial Basis Functions," SIAM Journal of Scientific and Statistical Computing, 7(2), 639-659.
20. Powell, M. J. D., 1987, "Radial Basis Functions for Multivariable Interpolation: A Review," in Mason, J.C. and Cox, M.G. eds, Algorithms for Approximation, Oxford University Press, London.
21. Rumelhart, D. E., Widrow, B., and Lehr, M. A., 1994, "The Basic Ideas in Neural Networks," Communications of the ACM, 37(3), 87-92.
22. Cheng, B., and Titterington, D. M., 1994, "Neural Networks: A Review from A Statistical Perspective," Statistical Science, 9(1), 2-54.
23. G. Strang, 1989, "Wavelets and Dilation Equations: A Brief Introduction," SIAM Review, 31, 614-627.
24. Mallat, S., 1999, A Wavelet Tour of Signal Processing, 2nd ed, Academic Press, Boston, MA.
25. Cox, E., 1994, The Fuzzy Systems Handbook: A Practitioner's Guide to Building, Using, and Maintaining Fuzzy Systems, ISBN: 0121942708, Ap Professional Press, Boston, MA.
26. Ross, T. J., 2004, Fuzzy Logic with Engineering Applications, 2nd ed, John Wiley & Sons. New York, NY.
27. Shao, T., and Krishnamurty, S., (2006), "A Clustering-Based Surrogate Model Updating Approach to Simulation-Based Engineering Design," ASME Journal of Mechanical Design, in review.
28. Hazelrigg, G. A., 1999, "On the Role and Use of Mathematical Models in Engineering Design," ASME Journal of Mechanical Design, 121, 336-341.
29. Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P., 1989, "Design and Analysis of Computer Experiments," Statistical Science, 4(4), 409-435.
30. Booker, A. J., 1998, "Design and Analysis of Computer Experiments," The 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, AIAA, St. Louis, MO, 1, (118-128).
31. Santner, T. J., Williams, B. J., and Notz, W. I., 2003, The Design and Analysis of Computer Experiments, Springer-Verlag, New York, NY.
32. Simpson, T. W., Dennis, L., and Chen, W., 2002, "Sampling Strategies for Computer Experiments: Design and Analysis," Journal of International Journal of Reliability and Application, 2(3), 209-240.
33. Morris, M. D., and Mitchell, T. J., 1995, "Exploratory designs for computer experiments," Journal of Statistical Planning and Inference, 43, 381-402.
34. Koehler, J. R., and Owen, A. B., 1996, "Computer Experiments," Handbook of Statistics, S. Ghosh and C. R. Rao, eds, Elsevier Science, New York, 13, 261-308.
35. Giunta, A. A., Wojtkiewicz, S. F., and Eldred, M. S., 2003, "Overview of Modern Design of Experiments Methods for Computational Simulations," AIAA 2003-0649, 1-17.
36. Bursztyn, D., and Steinberg, D. M., 2006, "Comparison of Designs for Computer Experiments," Journal of Statistical Planning and Inference, 136(3), 1103-1119.
37. Jin, R., Chen, W., and Sudjianto, A., 2002, "On Sequential Sampling for Global Metamodeling in Engineering Design," ASME 2002 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Montreal, Canada, DETC2002/DAC-34092.
38. Crary, S. B., 2002, "Design of Computer Experiments for Metamodel Generation,"Analog Integrated Circuits and Signal Processing, 32(1), 7-16.
39. Husslage, B., Rennen, G., Dam, R. v., and Hertog, D. d., 2006, Space-Filling Latin Hypercube Designs for Computer Experiments, ISSN: 0924-7815, Department of Econometrics and Operations Research, Tilburg University, The Netherlands.
40. McKey, M. D., Beckman, R. J., and Conover, W. J., 1979, "A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from A Computer Code," Technometrics, 21(2). 239-245.
41. Dam, E. v., Husslage, B., Hertog, D. d., and Melissen, H., 2005, Maximin Latin Hypercube Designs in Two Dimensions, ISBN: 0924-7815, Department of Econometrics and Operations Research, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands.
42. Ye, K. Q., Li, W., and Sudjianto, A., 2000, "Algorithmic Construction of Optimal Symmetric Latin Hypercube Designs," Journal of Statistical Planning and Inferences, 90, 145-159.
43. Tang, B., 1993, "Orthogonal Array-Based Latin Hypercubes," Journal of the American Statistical Association, 88(424), 1392-1397.
44. Crary, S. B., Cousseau, P., Armstrong, D., Woodcock, D. M., Mok, E. H., Dubochet, O., Lerch, P., and Renaud, P., 2000, "Optimal Design of Computer Experiments for Metamodel Generation Using I-OPTTM," Computer Modeling in Engineering & Sciences, 1(1), 127-139.
45. Bates, S. J., Sienz, J., and Langley, D. S., 2003, "Formulation of the Audze-Eglais Uniform Latin Hypercube design of experiments," Journal of Advances in Engineering Software, 34(8), 493-506.
46. Bates, S. J., Sienz, J., and Toropov, V. V., 2004, "Formulation of the Optimal Latin Hypercube Design of Experiments Using a Permutation Genetic Algorithm," 45th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Palm Springs, California, AIAA-2004-2011.
47. Yfantis, E. A., Flatman, G. T., and Behar, J. V., 1987, "Efficiency of Kriging Estimation for Square, Triangular and Hexagonal Grids," Journal of Mathematical Geology, 19, 183-205.
48. LaValle, S. R., Branicky, M. S., and Lindernann, S. R., 2004, "On the Relationship between Classical Grid Search and Probabilistic Roadmaps," International Journal of Robotics Research, 23(7-8), 673-692.
49. Cole, R. G., Healy, T. R., Wood, M. L., and Foster, D. M., 2001, "Statistical Analysis of Spatial Pattern: A Comparison of Grid and Hierarchical Sampling Approaches," Environmental Monitoring and Assessment, 69(1), 85-99.
50. Fang, K. T., Lin, D. K. J., Winker, P., and Zhang, Y., 2000, "Uniform Design: Theory and Application," Technometrics, 42(3), 237-248.
51. Statnikov, R. B., and Matusov, J. B., 2002, Multicriteria Analysis in Engineering: Using the PSI Method with MOVI 1.0, ISBN: 1402007086, Kluwer Academic Publishers, Dordrecht, The Netherlands.
52. Meckesheimer, M., Booker, A. J., Barton, R. R., and Simpson, T. W., 2002, "Computationally Inexpensive Metamodel Assessment Strategies," AIAA Journal, 40(10), 2053-2060.
53. Audze, P., and Eglais, V., 1977, "New Approach for Planning Out of Experiments," Problems of Dynamics and Strengths, 35, 104-107.
54. Owen, A. B., 1992, "Orthogonal Arrays for Computer Experiments, Integration and Visualization," Statistica Sinica, 2, 439-452.
55. Hedayat, A. S., Sloane, N. J. A., and Stufken, J., 1999, Orthogonal Arrays: Theory and Applications, Springer-Verlag, New York, NY.
56. Roy, R. K., 2001, Design of Experiments Using the Taguchi Approach: 16 Steps to Product and Process Improvement, ISBN: 0471361011, John Wiley & Sons, Inc., New York, NY.
57. Shewry, M. C., and Wynn, H. P., 1987, "Maximum Entropy Sampling," Journal of Applied Statistics, 14(2), 165-170.
58. Johnson, M. E., Moore, L. M., and Ylvisaker, D., 1990, "Minimax and Maximin Distance Designs," Journal of Statistical Planning and Inference, 26(2), 131-148.
59. Simpson, T. W., Allen, J.K, Mistree, F., 1998, "Spatial Correlation Metamodels for Global Approximation in Structural Design Optimization," ASME 1998 Design Engineering Technical Conference, Atlanta, GA, DETC98/DAC-5613.
60. Palmer, K. D., 1998, Data Collection Plans and Meta Models for Chemical Process Flowsheet Simulators, PhD Dissertation, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA.
61. Farhang-Mehr, A., and Azarm, S., 2002, "A Sequential Information-Theoretic Approach to Design of Computer Experiments," Proceedings of 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, Georgia, AIAA-2002-5571.
62. Osio, I. G., and Amon, C. H., (1996), "An Engineering Design Methodology with Multistage Bayesian Surrogates and Optimal Sampling," Research in Engineering Design, 8, 189-206.
63. Watson, A. G., and Barnes, R. J., 1995, "Infill Sampling Criteria to Locate Extremes," Mathematical Geology, 27(5), 589-608.
64. Sasena, M. J., Papalambros, P., and Goovaerts, P., 2002, "Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization," Engineering Optimization, 34(3), 263-278.
65. Kleijnen, J. P. C., and Beers, W. C. M. v., 2004, "Application- Driven Sequential Designs for Simulation Experiments: Kriging Metamodelling," The Journal of the Operational Research Society, 55(9), 876-883.
66. Wang, G. G., Dong, Z., and Aitchison, P., 2001, "Adaptive Response Surface Method - A Global Optimization Scheme for Computation-intensive Design Problems," Journal of Engineering Optimization, 33(6), 707-734.
67. Wang, G. G., 2003, "Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points," Transactions of the ASME, Journal of Mechanical Design, 125, 210-220.
68. Booker, A. J., J.E. Dennis, J., Frank, P. D., Serafini, D. B., Torczon, V., and Trosset, M. W., (1999), "A Rigorous Framework for Optimization of Expensive Functions by Surrogates," Structural Optimization, 17(1), 1-13.
69. Otto, J. C., Landman, D., and Patera, A. T., 1996, "A Surrogate Approach to the Experimental Optimization of Multielement Airfoils," Proceedings of the 6th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Bellevue, WA, 2, 1323-1333.
70. Schonlau, M., 1997, "Computer Experiments and Global Optimization," PhD thesis, University of Waterloo, Waterloo, Canada.
71. Sóbester, A., Leary, S. J., and Keane, A. J., 2005, "On the Design of Optimization Strategies Based on Global Response Surface Approximation Models," Journal of Global Optimization, 33(1), 31-59.
72. Song, W., and Keane, A. J., 2005, "A new hybrid updating scheme for an evolutionary search strategy using genetic algorithms and Kriging," 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Austin, Texas, AIAA-2005-1901.
73. Shao, T., and Krishnamurty, S., 2006, "Surrogate Model Updating Using Clustering in A Genetic Algorithm Setup," ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, Philadelphia, Pennsylvania, DETC2006-99491.
74. Reeves, C. R., and Rowe, J.E., 2003, "Genetic Algorithms - Principles and Perspectives: A Guide to GA Theory," ISBN: 1402072406, Kluwer Academic Publishers, Norwell, MA.
75. Han, J., and Kamber, M., 2006, Data Mining: Concepts and Techniques, 2nd Ed, ISBN: 1558609016, Morgan Kaufmann Publishers, San Francisco, CA.
76. Martin, J. D., and Simpson, T. W., (2003), "A Study on the Use of Kriging Models to Approximate Deterministic Computer Models," ASME 2003 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Chicago, Illinois, 567-576, DETC2003/DAC-48762.
77. Sasena, M. J., (2002), "Flexibility and Efficiency Enhancements for constrained Global Design Optimization with Kriging Approximations," Ph.D. Dissertation, University of Michigan, Ann Arbor, Michigan.
78. Wang, L., Shan, S., and Wang, G. G., (2004), "Mode-Pursuing Sampling Method for Global Optimization on Expensive Blackbox Functions," Journal of Engineering Optimization, 36(4), 419-438.
79. Yao, X., and Liu, Y., (1997), "Fast evolution strategies," Control and Cybernetics, 26(3), 467-496.
80. Dixon, L. C. W., and Szego, G. P., (1978), "The Global Optimization Problem: An Introduction," Towards Global Optimization 2, L. C. W Dixon and G. P. Szego, eds, NorthHolland, Amsterdam, The Netherlands, 1-15.
81. Osio, I. G., and Amon, C. H., (1996), "An Engineering Design Methodology with Multistage Bayesian Surrogates and Optimal Sampling," Research in Engineering Design, 8, 189-206.
82. Gold, S., and Krishnamurty, S., (1995), "Comparison of Global Optimization Methods," Final Project Report in Course ME761, Advanced Mechanical Design Laboratory, UMass-Amherst, MA.http://www.ees.urnass. edu/mie/labs/mda/mechanism/mechanism.html, access date: 11/19/06.