Why not run the efficient global optimization algorithm with multiple surrogates?

Collection of Technical Papers - AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference

Volumn , Issue , 2010, Pages

  Viana, Felipe A C ^a   Haftka, Raphael T ^a   Watson, Layne T ^b  

^a UNIVERSITY OF FLORIDA   (United States)

^b VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SAMPLING ALGORITHMS; COMPLEX ENGINEERING SYSTEM; EFFICIENT GLOBAL OPTIMIZATION; KRIGING; RADIAL BASIS NEURAL NETWORKS; RESPONSE SURFACE; SAMPLING POINTS; SEQUENTIAL OPTIMIZATION; SIMULTANEOUS USE; SUPPORT VECTOR REGRESSION MODELS; SUPPORT VECTOR REGRESSIONS; SURROGATE-BASED OPTIMIZATION; UNCERTAINTY ESTIMATES; UNCERTAINTY ESTIMATORS;

ADAPTIVE ALGORITHMS; DESIGN; ESTIMATION; EVOLUTIONARY ALGORITHMS; GLOBAL OPTIMIZATION; INTERPOLATION; LEARNING ALGORITHMS; NEURAL NETWORKS; REACTOR CORES; REGRESSION ANALYSIS; SAMPLING; STRUCTURAL DYNAMICS; UNCERTAINTY ANALYSIS;

SHAPE OPTIMIZATION;

EID: 84855617917     PISSN: 02734508     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Sacks J, Welch WJ, Mitchell TJ, and Wynn HP, "Design and Analysis of Computer Experiments," Statistical Science, Vol. 4 (4), pp. 409-435, 1989.
2. Simpson TW, Peplinski JD, Koch PN, and Allen JK, "Meta-models for computer based engineering design: Survey and recommendations," Engineering with Computers, Vol. 17, No. 2, pp. 129-150, 2001.
3. Santner TJ, Williams BJ, and Notz W, The Design and Analysis of Computer Experiments, Springer, 2003.
4. Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, and Tucker, PK, "Surrogate-based analysis and optimization," Progress in Aerospace Sciences, Vol. 41, pp. 1-28, 2005.
5. Kleijnen JPC, Design and Analysis of Simulation Experiments, Springer Verlag, 2007.
6. Simpson TW, Toropov V, Balabanov V, and Viana FAC, "Design and Analysis of Computer Experiments in Multidisciplinary Design Optimization: a Review of How Far We Have Come - or Not," in: 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Victoria, Canada, September 10-12, 2008. AIAA 2008-5802.
7. Forrester AIJ and Keane AJ, "Recent advances in surrogate-based optimization," Progress in Aerospace Sciences, Vol. 45, No. 1-3, pp. 50-79, 2009.
8. Box GEP, Hunter JS and Hunter WG, Statistics for experimenters: an introduction to design, data analysis, and model building, John Wiley & Sons, Inc, New York, USA, 1978.
9. Myers RH, Classical and Modern Regression with Applications, 2nd edition, Duxbury Press, 2000.
10. Stein ML, Interpolation of Spatial Data: Some Theory for Kriging, Springer, 1999.
11. Martin JD and Simpson TW, "Use of Kriging models to approximate deterministic computer models," AIAA Journal, Vol. 43, No. 4, pp.853-863, 2005.
12. Kleijnen JPC, "Kriging metamodeling in simulation: a review," European Journal of Operational Research, Vol. 192, No. 3, pp. 707-716, 2009.
13. Park J and Sandberg IW, "Universal Approximation Using Radial-Basis-Function Networks," Neural Computation, Vol. 3, No. 2, pp. 246-257, 1991.
14. Cheng B and Titterington DM, "Neural networks: a review from a statistical perspective," Statistical Science, Vol. 9, No. 1, pp. 2-54, 1994.
15. Orr MJL, Introduction to Radial Basis Function Networks, Center for Cognitive Science, University of Edinburgh, 1996.
16. Berry MW and Minser KS, Algorithm 798: high-dimensional interpolation using the modified Shepard method, ACM Transactions on Mathematical Software, Vol. 25, No. 3, pp. 353-366, 1999.
17. Gantovnik V, Gürdal Z, and Watson LT, "Linear Shepard interpolation for high dimensional piecewise smooth functions," 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Albany, New York, AIAA-2004-4486, 2004.
18. Thacker WI, Zhang J, Watson LT, Birch JB, Iyer MA, and Berry MW, "Algorithm XXX: SHEPPACK: Modified Shepard Algorithm for Interpolation of Scattered Multivariate Data," 2009.
19. Smola AJ and Scholkopf B, "A tutorial on support vector regression," Statistics and Computing, Vol. 14, No. 3, pp. 199-222, 2004.
20. Cristianini N and Shawe-Taylor J, An Introduction to Support Vector Machines, Cambridge University Press, 2000.
21. Scholkopf B and Smola AJ, Learning with Kernels, The MIT Press, Cambridge, USA, 2002.
22. Jones D, Schonlau M, and Welch W, "Efficient global optimization of expensive black-box functions," Journal of Global Optimization, Vol. 13, No. 4, pp. 455-492, 1998.
23. Huang D, Allen TT, Notz WI, and Zeng N, "Global optimization of stochastic black-box systems via sequential kriging meta-models," Journal of Global Optimization, Vol. 34, No. 3, pp. 441-466, 2006.
24. Samad A, Kim K, Goel T, Haftka RT, and Shyy W, "Multiple Surrogate Modeling for Axial Compressor Blade Shape Optimization," Journal of Propulsion and Power, Vol. 24, No. 2, 2008, pp. 302-310.
25. Viana FAC and Haftka RT, "Using Multiple Surrogates for Metamodeling," in: 7th ASMO-UK/ISSMO International Conference on Engineering Design Optimization, Bath, UK, 7 - 8 July, 2008.
26. Kohavi, R., "A study of cross-validation and bootstrap for accuracy estimation and model selection," in: Fourteenth International Joint Conference on Artificial Intelligence, Vol. 2, N. 12, pp. 1137-1143, 1995.
27. Viana FAC, Haftka RT, and Steffen V, "Multiple surrogates: how cross-validation errors can help us to obtain the best predictor," Structural and Multidisciplinary Optimization, Vol. 39, No. 4, pp. 439-457, 2009.
28. Viana, FAC and Haftka RT, "Importing Uncertainty Estimates from One Surrogate to Another," in: 50th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, Palm Springs, USA, May 4 - 7, 2009. AIAA-2009-2237.
29. Mckay MD, Beckman RJ, and Conover WJ, "A Comparison of Three Methods for Selecting Values of Input Variables from a Computer Code," Technometrics, Vol. 21, pp. 239-245, 1979.
30. Mathworks contributors, MATLAB® The language of technical computing, Version 7.0 Release 14, The MathWorks Inc, 2004.
31. Meckesheimer M, Booker AJ, Barton RR, and Simpson TW, "Computationally inexpensive metamodel assessment strategies," AIAA Journal, Vol. 40, No. 10, pp. 2053-2060, 2002.
32. Varma S and Simon R, "Bias in error estimation when using cross-validation for model selection," BMC Bioinformatics, Vol. 7, No. 1, 2006.
33. Lophaven SN, Nielsen HB, and Søndergaard J, DACE - A MATLAB Kriging Toolbox, Technical Report IMM-TR-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark, 2002.
34. Gunn SR, Support Vector Machines for Classification and Regression, Technical Report, Image Speech and Intelligent Systems Research Group, University of Southampton, UK, 1997.
35. Viana FAC, SURROGATES ToolBox User's Guide, http://fchegury.googlepages. com, 2009.
36. Cherkassky V and Ma Y, "Practical Selection of SVM Parameters and Noise Estimation for SVM Regression," Neural Networks, Vol. 17, No. 1, pp. 113-126, 2004.
37. Sasena MJ, Optimization of Computer Simulations via Smoothing Splines and Kriging Metamodels, Master Thesis, University of Michigan, 1998.
38. Dixon LCW, and Szegö GP, Towards Global Optimization 2, North Holland, Amsterdam, The Netherlands, 1978.