A preference-performance hybrid method for surrogate model updating in engineering design optimisation

International Journal of Product Development

Volumn 9, Issue 1-3, 2009, Pages 218-264

  Shao, Tiefu ^a   Krishnamurty, Sundar ^b  

^a Crouse Hinds Cooper Industries   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Design optimisation; Global optimisation; Metamodelling; Model fidelity; Multiple global optimal points; Simulation based design; Surrogate model

Indexed keywords

EID: 66949157993     PISSN: 14779056     EISSN: 17418178     Source Type: Journal    
DOI: 10.1504/IJPD.2009.026180     Document Type: Article

References (81)

1. Audze, P. and Eglais, V. (1977) 'New approach for planning out of experiments', Problems of Dynamics and Strengths, Vol. 35, pp.104-107.
2. Barthelemy, J.F.M. and Haftka, R.T. (1993) 'Approximation concepts for optimum structural design - a review', Structural Optimization, Vol. 5, No. 3, pp.129-144.
3. Barton, R.R. (1994) 'Metamodeling: A state of the art review', Proceedings of the IEEE 1994 Winter Simulation Conference, Lake Beuna Vista, Florida, 11-14 December, pp.237-244.
4. Barton, R.R. (1998) 'Simulation metamodels', in D.J. Medeiros, E.F. Watson, J.S. Carson and M.S. Manivannan (Eds.) Proceedings of the 1998 Winter Simulation Conference, IEEE Computer Society Press, pp.167-176.
5. Bates, S.J., Sienz, J. and Toropov, V.V. (2004) 'Formulation of the optimal latin hypercube design of experiments using a permutation genetic algorithm', Proceedings of the 45th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Palm Springs, California, 19-22 April, AIAA-2004-2011.
6. Beers, W.C.M.V. and Kleijnen, J.P.C. (2004) 'Kriging interpolation in simulation: A survey', Proceedings of the 2004 Winter Simulation Conference, Institute of Electrical and Electronics Engineers, Piscataway, New Jersey, pp.113-121.
7. Booker, A.J. (1998) 'Design and analysis of computer experiments', Proceedings of the 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis & Optimization, St. Louis, Missouri, 2-4 September, Vol. 1, pp.118-128.
8. Booker, A.J., Dennis, J.E., Frank, P.D., Serafini, D.B., Torczon, V. and Trosset, M.W. (1999) 'A rigorous framework for optimization of expensive functions by surrogates', Structural Optimization, Vol. 17, No. 1, pp.1-13.
9. Bursztyn, D. and Steinberg, D.M. (2006) 'Comparison of designs for computer experiments', Journal of Statistical Planning and Inference Vol. 136, No. 3, pp.1103-1119.
10. Cheng, B. and Titterington, D.M. (1994) 'Neural networks: A review from a statistical perspective', Statistical Science, Vol. 9, No. 1, pp.2-54.
11. Cole, R.G., Healy, T.R., Wood, M.L. and Foster, D.M. (2001) 'Statistical analysis of spatial pattern: A comparison of grid and hierarchical sampling approaches', Environmental Monitoring and Assessment, Vol. 69, No. 1, pp.85-99.
12. Cox, E. (1994) The Fuzzy Systems Handbook: A Practitioner's Guide to Building, Using, and Maintaining Fuzzy Systems, Boston, MA: Ap Professional Press.
13. Crary, S.B. (2002) 'Design of computer experiments for metamodel generation', Analog Integrated Circuits and Signal Processing, Vol. 32, No. 1, pp.7-16.
14. Crary, S.B., Cousseau, P., Armstrong, D., Woodcock, D.M., Mok, E.H., Dubochet, O., Lerch, P. and Renaud, P. (2000) 'Optimal design of computer experiments for metamodel generation using I-OPTTM', Computer Modeling in Engineering & Sciences, Vol. 1, No. 1, pp.127-139.
15. Craven, P. and Wahba, G. (1978) 'Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized crossvalidation', Numerical Mathematics, Vol. 31, pp.377-403.
16. Dam, E.V., Husslage, B., Hertog, D.D. and Melissen, H. (2005) Maximin Latin Hypercube Designs in Two Dimensions, Department of Econometrics and Operations Research, Tilburg University, The Netherlands.
17. Dixon, L.C.W. and Szego, G.P. (1978) 'The global optimization problem: an introduction', in L.C.W. Dixon and G.P. Szego (Eds.) Towards Global Optimization 2, North Holland, Amsterdam, The Netherlands, pp.1-15.
18. Dyn, N., Levin, D. and Rippa, S. (1986) 'Numerical procedures for surface fitting of scattered data by radial basis functions', SIAM Journal of Scientific and Statistical Computing, Vol. 7, No. 2, pp.639-659.
19. Fang, K.T., Lin, D.K.J., Winker, P. and Zhang, Y. (2000) 'Uniform design: Theory and application', Technometrics, Vol. 42, No. 3, pp.237-248.
20. Farhang-Mehr, A. and Azarm, S. (2002) 'A sequential information-theoretic approach to design of computer experiments', Proceedings of the 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Atlanta, Georgia, 4-6 September, AIAA-2002-5571.
21. Friedman, J.H. (1991) 'Multivariate adaptive regressive splines', The Annals of Statistics, Vol. 19, No. 1, pp.1-67.
22. Giunta, A.A., Wojtkiewicz, S.F. and Eldred, M.S. (2003) 'Overview of modern design of experiments methods for computational simulations', Proceedings of the 41st AIAA Aerospace Sciences Meeting and Exhibit, Reno, Nevada, 6-9 January, AIAA 2003-0649.
23. Gold, S. and Krishnamurty, S. (1995) 'Comparison of global optimization methods', Final Project Report in Course ME761, Advanced Mechanical Design Laboratory, UMass-Amherst, Massachusetts, http://www.ecs.umass.edu/mie/labs/mda/mechanism/mechanism.html (accessed 19 November 2006).
24. Gu, L. (2001) 'A comparison of polynomial based regression models in vehicle safety analysis', Proceedings of ASME 2001 Design Engineering Technical Conferences, Pittsburgh, Pennsylvania, 9-12 September, DETC2001/DAC-21063.
25. Han, J. and Kamber, M. (2006) Data Mining: Concepts and Techniques 2nd ed., San Francisco, CA: Morgan Kaufmann Publishers.
26. Hazelrigg, G.A. (1999) 'On the role and use of mathematical models in engineering design', Transactions of the ASME, ASME Journal of Mechanical Design, Vol. 121, pp.336-341.
27. Hazelrigg, G.A. (2003) 'Thoughts on model validation for engineering design', Proceedings of ASME 2003 Design Engineering Technical Conferences, Chicago, Illinois, 2-6 September, DETC2003/DTM-48632.
28. Hedayat, A.S., Sloane, N.J.A. and Stufken, J. (1999) Orthogonal Arrays: Theory and Applications, New York, NY: Springer-Verlag.
29. Husslage, B., Rennen, G., Dam, R.V. and Hertog, D.D. (2006) Space-Filling Latin Hypercube Designs for Computer Experiments, Department of Econometrics and Operations Research, Tilburg University, The Netherlands.
30. Jin, R., Chen, W. and Sudjianto, A. (2002) 'On sequential sampling for global metamodeling in engineering design', Proceedings of ASME 2002 Design Engineering Technical Conference, Montreal, Canada, 29 September-2 October, DETC2002/DAC-34092.
31. Jin, R., Chen, W. and Sudjianto, A. (2005) 'An efficient algorithm for constructing optimal design of computer experiments', Journal of Statistical Planning and Inference, Vol. 134, No. 1, pp.268-287.
32. Johnson, M.E., Moore, L.M. and Ylvisaker, D. (1990) 'Minimax and maximin distance designs', Journal of Statistical Planning and Inference, Vol. 26, No. 2, pp.131-148.
33. Jones, D.R., Schonlau, M. and Welch, W.J. (1998) 'Efficient global optimization of expensive black-box functions', Journal of Global Optimization, Vol. 13, No. 4, pp.455-492.
34. Kleijnen, J.P.C. and Beers, W.C.M.V. (2004) 'Application-driven sequential designs for simulation experiments: Kriging metamodelling', The Journal of the Operational Research Society, Vol. 55, No. 9, pp.876-883.
35. Koehler, J.R. and Owen, A.B. (1996) 'Computer experiments', in S. Ghosh and C.R. Rao (Eds.) Handbook of Statistics, New York: Elsevier Science, Vol. 13, pp.261-308.
36. LaValle, S.R., Branicky, M.S. and Lindernann, S.R. (2004) 'On the relationship between classical grid search and probabilistic roadmaps', International Journal of Robotics Research, Vol. 23, Nos. 7-8, pp.673-692.
37. Mallat, S. (1999) 'A wavelet tour of signal processing', 2nd ed., Boston, MA: Academic Press.
38. Martin, J.D. and Simpson, T.W. (2003) 'A study on the use of kriging models to approximate deterministic computer models', Proceedings of ASME 2003 Design Engineering Technical Conferences, Chicago, Illinois, 2-6 September, DETC2003/DAC-48762.
39. Martin, J.D. and Simpson, T.W. (2005) 'Use of kriging models to approximate deterministic computer models', AIAA Journal, Vol. 43, No. 4, pp.853-863.
40. McKey, M.D., Beckman, R.J. and Conover, W.J. (1979) 'A comparison of three methods for selecting values of input variables in the analysis of output from a computer code', Technometrics, Vol. 21, No. 2, pp.239-245.
41. Meckesheimer, M., Booker, A.J., Barton, R.R. and Simpson, T.W. (2002) 'Computationally inexpensive metamodel assessment strategies', AIAA Journal, Vol. 40, No. 10, pp.2053-2060.
42. Morris, M.D. and Mitchell, T.J. (1995) 'Exploratory designs for computer experiments', Journal of Statistical Planning and Inference, Vol. 43, pp.381-402.
43. Myers, R.H. and Montgomery, D.C. (2002) Response Surface Methodology, Process and Product Optimization Using Designed Experiments, New York, NY: John Wiley and Sons.
44. NIST/SEMATECH (2006) e-Handbook of Statistical Methods, http://www.itl.nist.gov/div898/handbook/ (accessed 16 April 2006).
45. Osio, I.G. and Amon, C.H. (1996) 'An engineering design methodology with multistage bayesian surrogates and optimal sampling', Research in Engineering Design, Vol. 8, pp.189-206.
46. Otto, J.C., Landman, D. and Patera, A.T. (1996) 'A surrogate approach to the experimental optimization of multielement airfoils', Proceedings of the 6th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA-96-4138, Bellevue, Washington, 4-6 September, Vol. 2, pp.1323-1333.
47. Owen, A.B. (1992) 'Orthogonal arrays for computer experiments, integration and visualization', Statistica Sinica, Vol. 2, pp.439-452.
48. Palmer, K.D. (1998) Data Collection Plans and Meta Models for Chemical Process Flowsheet Simulators, PhD dissertation, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia.
49. Powell, M.J.D. (1987) 'Radial basis functions for multivariable interpolation: A review', in J.C. Mason and M.G. Cox (Eds.) Algorithms for Approximation, London: Oxford University Press.
50. Reeves, C.R. and Rowe, J.E. (2003) 'Genetic algorithms - principles and perspectives: A guide to GA theory', Norwell, MA: Kluwer Academic Publishers.
51. Ross, T.J. (2004) Fuzzy Logic with Engineering Applications, 2nd ed., New York, NY: John Wiley & Sons.
52. Roy, R.K. (2001) 'Design of experiments using the Taguchi approach: 16 steps to product and process improvement', New York, NY: John Wiley & Sons.
53. Rumelhart, D.E., Widrow, B. and Lehr, M.A. (1994) 'The basic ideas in neural networks', Communications of the ACM, Vol. 37, No. 3, pp.87-92.
54. Sacks, J., Welch, W.J., Mitchell, T.J. and Wynn, H.P. (1989) 'Design and analysis of computer experiments', Statistical Science, Vol. 4, No. 4, pp.409-435.
55. Santner, T.J., Williams, B.J. and Notz, W.I. (2003) The Design and Analysis of Computer Experiments, New York, NY: Springer-Verlag.
56. Sasena, M.J. (2002) 'Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations', PhD dissertation, University of Michigan, Ann Arbor, Michigan.
57. Sasena, M.J., Papalambros, P. and Goovaerts, P. (2002) 'Exploration of metamodeling sampling criteria for constrained global optimization', Engineering Optimization, Vol. 34, No. 3, pp.263-278.
58. Schonlau, M. (1997) 'Computer experiments and global optimization', PhD thesis, University of Waterloo, Waterloo, Canada.
59. Shao, T. and Krishnamurty, S. (2006a) 'Modeling implications in simulation-based design of stents', Proceedings of ASME 2006 International Design Engineering Technical Conferences, DETC2006-99493, Philadelphia, Pennsylvania, 2-6 September.
60. Shao, T. and Krishnamurty, S. (2006b) 'Surrogate model updating using clustering in a genetic algorithm setup', Proceedings of ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, DETC2006-99491, Philadelphia, Pennsylvania, 2-6 September.
61. Shao, T. and Krishnamurty, S. (2008) 'A clustering-based surrogate model updating approach to simulation-based engineering design', Transactions of the ASME, ASME Journal of Mechanical Design, April, Vol. 130, No. 4, pp.041101-1-041101-13.
62. Shao, T., Wilmes, G. and Krishnamurty, S. (2007) 'Predictive modeling in engineering design', American Institute of Aeronautics and Astronautics (AIAA) Journal, November, Vol. 45, No. 11, pp.2688-2798.
63. Shewry, M.C. and Wynn, H.P. (1987) 'Maximum entropy sampling', Journal of Applied Statistics, Vol. 14, No. 2, pp.165-170.
64. Simpson, T.W., Allen, J.K. and Mistree, F. (1998) 'Spatial correlation metamodels for global approximation in structural design optimization', Proceedings of ASME 1998 Design Engineering Technical Conferences, DETC98/DAC-5613, Atlanta, Georgia, 13-16 September.
65. Simpson, T.W., Booker, A.J., Ghosh, D., Giunta, A.A., Koch, P.N. and Yang, R.J. (2004) 'Approximation methods in multidisciplinary analysis and optimization: A panel discussion', Structural and Multidisciplinary Optimization, Vol. 27, No. 5, pp.302-313.
66. Simpson, T.W., Dennis, L. and Chen, W. (2002) 'Sampling strategies for computer experiments: Design and analysis', Journal of International Journal of Reliability and Application, Vol. 2. No. 3, pp.209-240.
67. Simpson, T.W., Mauery, T.M., Korte, J.J. and Mistree, F. (2001a) 'Kriging metamodels for global approximation in simulation-based multidisciplinary design optimization', AIAA Journal, Vol. 39, No. 12, pp.2233-2241.
68. Simpson, T.W., Peplinski, J.D., Koch, P.N. and Allen, J.K. (2001b) 'Metamodels for computer-based engineering design: Survey and recommendations', Engineering with Computers, Vol. 17, No. 2, pp.129-150.
69. Sóbester, A., Leary, S.J. and Keane, A.J. (2005) 'On the design of optimization strategies based on global response surface approximation models', Journal of Global Optimization, Vol. 33, No. 1, pp.31-59.
70. Sobieszczanski-Sobieski, J. and Haftka, R.T. (1997) 'Multidisciplinary aerospace design optimization: Survey of recent developments', Structural Optimization, Vol. 14, No. 1, pp.1-23.
71. Song, W. and Keane, A.J. (2005) 'A new hybrid updating scheme for an evolutionary search strategy using genetic algorithms and kriging', Proceedings of the 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, AIAA-2005-1901, Austin, Texas, 18-21 April.
72. Statnikov, R.B. and Matusov, J.B. (2002) 'Multicriteria analysis in engineering: Using the PSI method with MOVI 1.0', Dordrecht, The Netherlands: Kluwer Academic Publishers.
73. Strang, G. (1989) 'Wavelets and dilation equations: A brief introduction', SIAM Review, Vol. 31, pp.614-627.
74. Tang, B. (1993) 'Orthogonal array-based latin hypercubes', Journal of the American Statistical Association, Vol. 88, No. 424, pp.1392-1397.
75. Wang, G.G. (2003) 'Adaptive response surface method using inherited latin hypercube design points', Transactions of the ASME, Journal of Mechanical Design, Vol. 125, pp.210-220.
76. Wang, G.G., Dong, Z. and Aitchison, P. (2001) 'Adaptive response surface method - a global optimization scheme for computation-intensive design problems', Journal of Engineering Optimization, Vol. 33, No. 6, pp.707-734.
77. Wang, L., Shan, S. and Wang, G.G. (2004) 'Mode-pursuing sampling method for global optimization on expensive black-box functions', Journal of Engineering Optimization, Vol. 36, No. 4, pp.419-438.
78. Watson, A.G. and Barnes, R.J. (1995) 'Infill sampling criteria to locate extremes', Mathematical Geology, Vol. 27, No. 5, pp.589-608.
79. Yao, X. and Liu, Y. (1997) 'Fast evolution strategies', Control and Cybernetics, Vol. 26, No. 3, pp.467-496.
80. Ye, K.Q., Li, W. and Sudjianto, A. (2000) 'Algorithmic construction of optimal symmetric latin hypercube designs', Journal of Statistical Planning and Inferences, Vol. 90, pp.145-159.
81. Yfantis, E.A., Flatman, G.T. and Behar, J.V. (1987) 'Efficiency of kriging estimation for square, triangular and hexagonal grids', Journal of Mathematical Geology, Vol. 19, pp.183-205.