Evolution by adapting surrogates

Evolutionary Computation

Volumn 21, Issue 2, 2013, Pages 313-340

  Le, Minh Nghia ^a   Ong, Yew Soon ^a   Menzel, Stefan ^b   Jin, Yaochu ^c   Sendhoff, Bernhard ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

^c UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Adaptation; Computationally expensive problems; Evolutionary algorithms; Evolvability; Memetic computing; Metamodelling; Surrogates

Indexed keywords

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; EVOLUTIONARY ALGORITHMS; OPTIMIZATION;

ADAPTATION; COMPUTATIONALLY EXPENSIVE PROBLEMS; EVOLVABILITY; MEMETIC COMPUTING; META-MODELLING; SURROGATES;

PROBLEM SOLVING;

ALGORITHM; ARTICLE; COMPUTER PROGRAM; COMPUTER SIMULATION; ENGINEERING; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; ENGINEERING; MODELS, STATISTICAL; SOFTWARE;

EID: 84887802849     PISSN: 10636560     EISSN: 15309304     Source Type: Journal    
DOI: 10.1162/EVCO_a_00079     Document Type: Article

References (69)

1. Acar, E., and Rais-Rohani, M. (2009). Ensemble of metamodels with optimized weight factors. Structural and Multidisciplinary Optimization, 37(3):279-294.
2. Alexandrov, N. M., Dennis, J. E., Lewis, R. M., and Torczon, V. (1998). A trust-region framework for managing the use of approximation models in optimization. Structural and Multidisciplinary Optimization, 15(1):16-23.
3. Auger, A., and Hansen, N. (2005). A restart CMA evolution strategy with increasing population size. In Proceedings of the 2005 IEEE Congress on Evolutionary Computation, CEC'05, Vol. 2, pp. 1769-1776.
4. Bishop, C. M. (1996). Neural networks for pattern recognition. Oxford, UK: Oxford University Press.
5. Booker, A. J., Dennis, J. E., Frank, P. D., Serafini, D. B., Torczon, V., and Trosset, M. W. (1999). A rigorous framework for optimization of expensive functions by surrogates. Structural and Multidisciplinary Optimization, 17(1):1-13.
6. Branke, J., and Schmidt, C. (2005). Faster convergence by means of fitness estimation. Soft Computing-A Fusion of Foundations, Methodologies and Applications, 9(1):13-20.
7. Buche, D., Schraudolph, N. N., and Koumoutsakos, P. (2005). Accelerating evolutionary algorithms with Gaussian process fitness function models. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 35(2):183-194.
8. Coquillart, S. (1990). Extended free-form deformation: A sculpturing tool for 3D geometric modeling. Computer Graphics, 24(4):187-196.
9. Cortes, C., and Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3):273-297.
10. DaCosta, L., Fialho, A., Schoenauer, M., and Sebag, M. (2008). Adaptive operator selection with dynamic multi-armed bandits. In Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation, pp. 913-920.
11. Donoho, D. L. (2000). High-dimensional data analysis: The curses and blessings of dimensionality. In Proceedings of the American Mathematical Society Conference on Math Challenges of the 21st Century.
12. Emmerich, M., Giotis, A., Özdemir, M., Bäck, T., and Giannakoglou, K. (2002). Metamodel-assisted evolution strategies. Parallel Problem Solving from Nature, PPSN VII, Vol. 2439, pp. 361-370.
13. Fielding, A. H., and Bell, J. F. (1997). A review of methods for the assessment of prediction errors in conservation presence/absence models. Environmental Conservation, 24(1):38-49.
14. Giannakoglou, K. C. (2002). Design of optimal aerodynamic shapes using stochastic optimization methods and computational intelligence. Progress in Aerospace Sciences, 38(1):43-76.
15. Goel, T., Haftka, R. T., Shyy, W., and Queipo, N. V. (2007). Ensemble of surrogates. Structural and Multidisciplinary Optimization, 33(3):199-216.
16. Goldberg, D. E. (1990). Probability matching, the magnitude of reinforcement, and classifier system bidding. Machine Learning, 5(4):407-425.
17. Hansen, N., and Kern, S. (2004). Evaluating the CMA evolution strategy on multimodal test functions. In Parallel Problem Solving from Nature, PPSN VIII, pp. 282-291.
18. Hart, W. E., Krasnogor, N., and Smith, J. E. (2004). Editorial introduction; Special issue on memetic algorithms. Evolutionary Computation, 12(3):5-6.
19. Herrera, F., Lozano, M., and Verdegay, J. L. (1998). Tackling real-coded genetic algorithms: Operators and tools for behavioural analysis. Artificial Intelligence Review, 12(4):265-319.
20. Hirsch, C. (2007). Numerical computation of internal and external flows: Fundamentals of computational fluid dynamics, 2nd ed. Woburn, MA: Butterworth-Heinemann.
21. Jasak, H., Jemcov, A., and Tukovic, Z. (2007). OpenFOAM: A C++ library for complex physics simulations. International Workshop on Coupled Methods in Numerical Dynamics.
22. Jasak, H., and Rusche, H. (2009). Dynamic mesh handling in OpenFOAM. In Proceedings of the American Institute of Aeronautics and Astronautics.
23. Jin, J. (2002). The finite element method in electromagnetics, 2nd ed. New York: Wiley.
24. Jin, R., Chen, W., and Simpson, T. W. (2001). Comparative studies of metamodelling techniques under multiple modelling criteria. Structural and Multidisciplinary Optimization, 23(1):1-13.
25. Jin, Y. (2005). A comprehensive survey of fitness approximation in evolutionary computation. Soft Computing-A Fusion of Foundations, Methodologies and Applications, 9(1):3-12.
26. Jin, Y., Olhofer, M., and Sendhoff, B. (2000). On evolutionary optimization with approximate fitness functions. In Proceedings of the Genetic and Evolutionary Computation Conference, pp. 786-793.
27. Jin, Y., Olhofer, M., and Sendhoff, B. (2002). A framework for evolutionary optimization with approximate fitness functions. IEEE Transactions on Evolutionary Computation, 6(5):481-494.
28. Jin, Y., and Sendhoff, B. (2004). Reducing fitness evaluations using clustering techniques and neural networks ensembles. In Proceedings of the Genetic and Evolutionary Computation Conference. Lecture notes in computer science, Vol. 3102 (pp. 688-699). Berlin: Springer-Verlag.
29. Keane, A. J., and Petruzzelli, N. (2000). Aircraft wing design using GA-based multi-level strategies. In Proceedings of the AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization.
30. Kim, H.-S., and Cho, S.-B. (2002). An efficient genetic algorithm with less fitness evaluation by clustering. In Proceedings of the IEEE Congress on Evolutionary Computation, pp. 887-894.
31. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (IJCAI), pp. 1137-1145.
32. Krasnogor, N., and Smith, J. (2005). A tutorial for competent memetic algorithms: Model, taxonomy, and design issues. IEEE Transactions on Evolutionary Computation, 9(5):474-488.
33. Le, M. N., Ong, Y. S., Jin, Y., and Sendhoff, B. (2009). Lamarckian memetic algorithms: Local optimum and connectivity structure analysis. Memetic Computing, 1(3):175-190.
34. Lesh, F. H. (1959). Multi-dimensional least-squares polynomial curve fitting. Communications of the ACM, 2(9):29-30.
35. Liang, K.-H., Yao, X., and Newton, C. (1999). Combining landscape approximation and local search in global optimization. In Proceedings of the 1999 Congress on Evolutionary Computation, pp. 1514-1520.
36. Lim, D., Jin, Y., Ong, Y. S., and Sendhoff, B. (2010). Generalizing surrogate-assisted evolutionary computation. IEEE Transactions on Evolutionary Computation, 14(3):329-355.
37. Lim, D., Ong, Y. S., Jin, Y., and Sendhoff, B. (2007). A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation. In Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 1288-1295.
38. Lim, D., Ong, Y. S., Jin, Y., and Sendhoff, B. (2008). Evolutionary optimization with dynamic fidelity computational models. In Proceedings of the International Conference on Advanced Intelligent Computing Theories and Applications with Aspects of Artificial Intelligence. Lecture notes in artificial intelligence, Vol. 5227 (pp. 235-242). Berlin: Springer-Verlag.
39. Mackay, D. J. (1998). Introduction to Gaussian processes. Neural Networks and Machine Learning, 168:133-165.
40. Menzel, S., and Sendhoff, B. (2008). Representing the change-Free form deformation for evolutionary design optimisation. In Evolutionary computation in practice (pp. 63-86). Berlin: Springer-Verlag.
41. Ong, Y. S., Lim, M. H., and Chen, X. S. (2010). Memetic computation-Past, present & future. IEEE Computational Intelligence Magazine, 5(2):24-31.
42. Ong, Y. S., Lim, M. H., Zhu, N., and Wong, K. W. (2006). Classification of adaptive memetic algorithms: A comparative study. IEEE Transactions on Systems, Man and Cybernetics, Part B, 36(1):141-152.
43. Ong, Y. S., Nair, P. B., and Keane, A. J. (2003). Evolutionary optimization of computationally expensive problems via surrogate modelling. American Institute of Aeronautics and Astronautics Journal, 41(4):687-696.
44. Ong, Y. S., Nair, P. B., Keane, A. J., and Wong, K. W. (2004). Surrogate-assisted evolutionary optimization frameworks for high-fidelity engineering design problems. Knowledge Incorporation in Evolutionary Computation (pp. 307-332). Berlin: Springer-Verlag.
45. Ong, Y. S., Zhou, Z., and Lim, D. (2006). Curse and blessing of uncertainty in evolutionary algorithm using approximation. In Proceedings of the IEEE Congress on Evolutionary Computation, pp. 2928-2935.
46. Powell, M. J. D. (1987). Radial basis functions for multivariable interpolation: A review. In Algorithms for approximation (pp. 143-167). New York: Clarendon Press.
47. Queipo, N. V., Haftka, R. T., Shyy, W., Goel, T., Vaidyanathan, R., and Tucker, P. K. (2005). Surrogate-based analysis and optimization. Progress in Aerospace Sciences, 41(1):1-28.
48. Regis, R. G., and Shoemaker, C. A. (2004). Local function approximation in evolutionary algorithms for the optimization of costly functions. IEEE Transactions on Evolutionary Computation, 8(5):490-505.
49. Sanchez, E., Pintos, S., and Queipo, N. V. (2008). Toward an optimal ensemble of kernel-based approximations with engineering applications. Structural and Multidisciplinary Optimization, 36(3):247-261.
50. Santana-Quintero, L. V., Montaño, A. A., and Coello Coello, C. A. (2010). A review of techniques for handling expensive functions in evolutionary multi-objective optimization. In Y. Tenne and C.-K. Goh (Eds.), Computational Intelligence in Expensive Optimization Problems (pp. 29-59). Berlin: Springer-Verlag.
51. Sederberg, T. W., and Parry, S. R. (1986). Free-form deformation of solid geometric models. Computer Graphics, 20(4):151-160.
52. Serafini, D. B. (1998). A framework for managing models in nonlinear optimization of computationally expensive functions. PhD thesis, Rice University, Houston, Texas.
53. Shang, Y.-W., and Qiu, Y.-H. (2006). A note on the extended Rosenbrock function. Evolutionary Computation, 14(1):119-126.
54. Shi, L., and Rasheed, K. (2010). A survey of fitness approximation methods applied in evolutionary algorithms. In Y. Tenne and C.-K. Goh (Eds.), Computational Intelligence in Expensive Optimization Problems (pp. 3-28). Berlin: Springer-Verlag.
55. Song, W. (2002). Shape optimisation of turbine blade firtrees. PhD thesis, School of Engineering Sciences, University of Southampton, Southampton, UK.
56. Tenne, Y. (2009). A model-assisted memetic algorithm for expensive optimization problems. In R. Chiong (Ed.), Nature-inspired algorithms for optimisation (pp. 133-169). Berlin: Springer-Verlag.
57. Tenne, Y., and Armfield, S. W. (2008a). A versatile surrogate-assisted memetic algorithm for optimization of computationally expensive functions and its engineering applications. In A. Yang, Y. Shan, and L. T. Bui, Success in evolutionary computation (pp. 43-72). Berlin: Springer-Verlag.
58. Tenne, Y., and Armfield, S. W. (2008b). Metamodel accuracy assessment in evolutionary optimization. In Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1505-1512.
59. Thierens, D. (2005). An adaptive pursuit strategy for allocating operator probabilities. In Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 1539-1546.
60. Ulmer, H., Streichert, F., and Zell, A. (2004). Evolution strategies assisted by Gaussian processes with improved preselection criterion. In Proceedings of the 2003 Congress on Evolutionary Computation, CEC'03, pp. 692-699.
61. Valiant, L. G. (2009). Evolvability. Journal of the Association for Computing Machinery, 56(1):1-21.
62. Vapnik, V. N. (1998). Statistical learning theory. New York: Wiley.
63. Voutchkov, I., and Keane, A. (2010). Multi-objective optimization using surrogates. In Y. Tenne and C.-K. Goh (Eds.), Computational Intelligence in Optimization (pp. 155-175). Berlin: Springer-Verlag.
64. Wagner, G. P., and Altenberg, L. (1996). Perspective: Complex adaptations and the evolution of evolvability. Evolution, 50(3):967-976.
65. Zerpa, L. E., Queipo, N. V., Pintos, S., and Salager, J.-L. (2005). An optimization methodology of alkaline-surfactant-polymer flooding processes using field scale numerical simulation and multiple surrogates. Journal of Petroleum Science and Engineering, 47(3-4):197-208.
66. Zhou, Z., Ong, Y. S., Nair, P. B., Keane, A. J., and Lum, K. Y. (2006). Combining global and local surrogate models to accelerate evolutionary optimization. IEEE Transactions on Systems, Man and Cybernetics, Part C, 36(6):814-823.
67. Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. (1997). Algorithm 778: L-BFGS-B: FORTRAN sub-routines for large-scale bound-constrained optimization. ACM Transactions on Mathematical Software, 23(4):550-560.
68. Zienkiewicz, O. C., and Taylor, R. L. (2006). The finite element method for solid and structural mechanics. 6th ed. Woburn, MA: Butterworth-Heinemann.
69. Zurada, J. (1992). Introduction to artificial neural systems. St. Paul, MN: West Publishing.