Automatic surrogate model type selection during the optimization of expensive black-box problems

Proceedings - Winter Simulation Conference

Volumn , Issue , 2011, Pages 4269-4279

  Couckuyt, Ivo ^a   De Turck, Filip ^a   Dhaene, Tom ^a   Gorissen, Dirk ^b  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BEST APPROXIMATIONS; BEST MODEL; BLACK BOXES; BLACK-BOX SIMULATION; EFFICIENT GLOBAL OPTIMIZATION; EXPECTED IMPROVEMENTS; KRIGING; OPTIMIZATION PROCESS; STRUCTURAL OPTIMIZATION PROBLEMS; SURROGATE MODEL; SURROGATE-BASED OPTIMIZATION; TYPE SELECTION;

ALGORITHMS; STRUCTURAL OPTIMIZATION;

INTERPOLATION;

EID: 84858049758     PISSN: 08917736     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WSC.2011.6148114     Document Type: Conference Paper

References (33)

1. Bonnans, J., J. Gilbert, C. Lemarechal, and C. Sagastizabal. 2006. Numerical Optimization: Theoretical and Practical Aspects. Springer.
2. Busby, D., C. L. Farmer, and A. Iske. 2007. "Hierarchical Nonlinear Approximation for Experimental Design and Statistical Data Fitting". SIAM Journal on Scientific Computing 29 (1): 49-69. (Pubitemid 351271268)
3. Chen, P.-W., J.-Y. Wang, and H.-M. Lee. 2004, 25-29 July. "Model selection of SV Ms using GA approach". In Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on, Volume 3, 2035-2040.
4. Eldred, M. S., and D. M. Dunlavy. 2006. "Formulations for Surrogate-Based Optimization wiht Data Fit, Multifidelity, and Reduced-Order Models". In IIth AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, Portsmouth, Virginia, AIAA-2006-7117.
5. Friedrichs, F., and C. Igel. 2005. "Evolutionary tuning of multiple SV M parameters.". Neurocomputing 64: 107-117.
6. Goel, T., R. Haftka, W. Shyy, and N. Queipo. 2007. "Ensemble of surrogates". Structural and Multidisciplinary Optimization 33: 199-216. (Pubitemid 46198778)
7. Gorissen, D., K. Crombecq, I. Couckuyt, P. Demeester, and T. Dhaene. 2010. "A Surrogate Modeling and Adaptive Sampling Toolbox for Computer Based Design". Journal of Machine Learning Research 11: 2051-2055.
8. Gorissen, D., T. Dhaene, and F. DeTurck. 2009. "Evolutionary Model Type Selection for Global Surrogate Modeling". Journal of Machine Learning Research 10: 2039-2078.
9. Grosso, A., A. Jamali, and M. Locatelli. 2009. "Finding maximin latin hypercube designs by Iterated Local Search heuristics". European Journal of Operational Research 197 (2): 541-547.
10. Jones, D., C. Perttunen, and B. Stuckman. 1993. "Lipschitzian optimization without the Lipschitz constant". Optimization Theory and Applications 79 (1): 157-181.
11. Jones, D. R. 2001. "A Taxonomy of Global Optimization Methods Based on Response Surfaces". Global Optimization 21:345-383. (Pubitemid 33672374)
12. Jones, D. R, M. Schonlau, and W. J. Welch. 1998. "Efficient Global Optimization of Expensive Black-Box Functions". J. of Global Optimization 13 (4): 455-492. (Pubitemid 128507405)
13. Keane, A. J., and A. P. Bright. 1996. "Passive vibration control via unusual geometries: experiments on model aerospace structures". Journal of Sound and Vibration 190 (4): 713-719. (Pubitemid 126392721)
14. Keys, A. C., L. P. Rees, and A. G. Greenwood. 2007. "Performance Measures for Selection of Metamodels to be Used in Simulation Optimization". Decision Sciences 33:31-58.
15. Knowles, J., and H. Nakayama. 2008. "Meta-Modeling in Multiobjective Optimization". In Multiobjective Optimization: Interactive and Evolutionary Approaches, 245-284. Berlin, Heidelberg: Springer-Verlag.
16. Lessmann, S., R. Stahlbock, and S. Crone. 2006, 16-21 July. "Genetic Algorithms for Support Vector Machine Model Selection". In Proceedings of the International Joint Conference on Neural Networks, 006. IJCNN '06., 3063-3069.
17. Lim, D., Y. Jin, Y. S. Ong, and B. Sendhoff. 2008. "Generalizing Surrogate-assisted Evolutionary Computation". IEEE Transactions on Evolutionary Computation 14:329-355.
18. Lim, D., Y.-S. Ong, Y. Jin, and B. Sendhoff. 2007. "A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation". In Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation (GECCO 07), 1288-1295. New York, NY, USA: ACM.
19. Mockus, J., V. Tiesis, and A Zilinskas. 1978. "The application of Bayesian methods for seeking the extremum". Towards Global Optimization 2:117-129.
20. Ong, Y.-S., P. B. Nair, and A. J. Keane. 2003. "Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling". American Institute of Aeronautics and Astronautics Journal 41 (4): 687-696.
21. Peter, J., M. Marcelet, S. Burguburu, and V. Pediroda. 2007. "Comparison of surrogate models for the actual global optimization of a 2D turbomachinery flow". In Proceedings of the 7th WSEAS International Conference on Simulation, Modelling and Optimization, 46-51.
22. Sanchez, E., S. Pintos, and N. Queipo. 2008. "Toward an optimal ensemble of kernel-based approximations with engineering applications". Volume 36, 247-261.
23. Sóbester, A., S. J. Leary, and A. J. Keane. 2004. "A parallel updating scheme for approximating and optimizing high fidelity computer simulations". Structural and Multidisciplinary Optimization 27:371-383(13).
24. Sóbester, A., S. J. Leary, and A. J. Keane. 2005. "On the Design of Optimization Strategies Based on Global Response Surface Approximation Models". Global Optimization 33 (1): 31-59. (Pubitemid 41618780)
25. Solomatine, D. P., and A. Ostfeld. 2008. "Data-driven modelling : some past experiences and new approaches". Journal of hydroinformatics 10 (1): 3-22.
26. Suykens, J., T. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle. 2002. Least Squares Support Vector Machines. Singapore: World Scientific Publishing Co., Pte, Ltd.
27. Tomioka, S., S. Nisiyama, and T. Enoto. 2007, February. "Nonlinear Least Square Regression by Adaptive Domain Method With Multiple Genetic Algorithms". IEEE Transactions on Evolutionary Computation 11 (1): 1-16. (Pubitemid 46421665)
28. Viana, F., and R. Haftka. 2010. "Why Not Run the Efficient Global Optimization Algorithm with Multiple Surrogates?". In 51st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, AIAA 2010-3090.
29. Voutchkov, I., and A. Keane. 2006, April. "Multiobjective Optimization using Surrogates". In Adaptive Computing in Design and Manufacture 2006. Proceedings of the Seventh International Conference, edited by I. Parmee, 167-175. Bristol, UK.
30. Yao, X., and Y. Xu. 2006. "Recent Advances in Evolutionary Computation.". Journal of Computer Science and Technology 21 (1): 1-18. (Pubitemid 43207895)
31. Zhang, C., H. Shao, and Y. Li. 2000, 8-11 Oct. "Particle swarm optimisation for evolving artificial neural network". In Systems, Man, and Cybernetics, 2000 IEEE International Conference on, Volume 4, 2487-2490.
32. Zhou, Z. Z., Y. S. Ong, M. H. Lim, and B. S. Lee. 2007. "Memetic Algorithm using Multi-Surrogates for Computationally Expensive Optimization Problems". Soft Computing 11 (4): 957-971.
33. Zhou, Z. Z., Y. S. Ong, P. B. Nair, A. J. Keane, and K. Y. Lum. 2007. "Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization". IEEE Transactions On Systems, Man and Cybernetics - Part C 37 (1): 66-76.