Surrogate-assisted evolutionary computation: Recent advances and future challenges

Swarm and Evolutionary Computation

Volumn 1, Issue 2, 2011, Pages 61-70

  Jin, Yaochu ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Evolutionary computation; Expensive optimization problems; Machine learning; Meta models; Model management; Surrogates

Indexed keywords

CALCULATIONS; CONSTRAINED OPTIMIZATION; EVOLUTIONARY ALGORITHMS; LEARNING SYSTEMS; MULTIOBJECTIVE OPTIMIZATION; OPTIMIZATION;

CONSTRAINED OPTIMI-ZATION PROBLEMS; DYNAMIC OPTIMIZATION PROBLEM (DOP); EXPENSIVE OPTIMIZATION PROBLEMS; META MODEL; MODEL MANAGEMENT; MULTI-MODAL OPTIMIZATION; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; SURROGATES;

COMPUTATIONAL EFFICIENCY;

EID: 84863906586     PISSN: 22106502     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.swevo.2011.05.001     Document Type: Article

References (101)

1. Y. Jin, B. Sendhoff, A systems approach to evolutionary multi-objective structural optimization and beyond, IEEE Computational Intelligence Magazine 4 (3) (2009) 62-76.
2. D. Douguet, e-LEA3D: A computational-aided drug design web server, Nucleic Acids Research 38 (2010) w615-w621.
3. Y. Jin, M. Olhofer, B. Sendhoff, On evolutionary optimization with approximate fitness functions, in: Genetic and Evolutionary Computation Congress, 2000, pp. 786-793.
4. J.J. Grefenstette, J.M. Fitzpatrick, Genetic search with approximate fitness evaluations, in: Proceedings of the International Conference on Genetic Algorithms and Their Applications, 1985, pp. 112-120.
5. G. Schneider, J. Schuchhardt, P. Wrede, Artificial neural networks and simulated molecular evolution are potential tools for sequence-oriented protein design, CABIOS 10 (6) (1994) 635-645.
6. D. Yang, S.J. Flockton, Evolutionary algorithms with a coarse-to-fine function smoothing, in: IEEE International Conference on Evolutionary Computation, 1995, pp. 657-662.
7. A. Ratle, Accelerating the convergence of evolutionary algorithms by fitness landscape approximation, in: Parallel Problem Solving from Nature, 1998, pp. 87-96. (Pubitemid 128145940)
8. L. Bull, On model-based evolutionary computation, Soft Computing 3 (1999) 76-82.
9. S. Pierret, Turbomachinery blade design using a Navier-Stokes solver and artificial neural network, ASME Journal of Turbomachinery 121 (3) (1999) 326-332. (Pubitemid 29384698)
10. Y. Jin, S.J. Louis, K.M. Rasheed, Approximation and learning in evolutionary computation. GECCO Workshop, July 2002.
11. Y. Jin, B. Sendhoff, Fitness approximation in evolutionary computation - a survey, in: Genetic and Evolutionary Computation Conference, 2002, pp. 1105-1112.
12. Y. Jin, A comprehensive survey of fitness approximation in evolutionary computation, Soft Computing 9 (1) (2005) 3-12. (Pubitemid 40097880)
13. Y. Tenne, C.-K. Goh (Eds.), Computational Intelligence in Expensive Optimization Problems, Springer, 2009.
14. M.M. Davarynejad, C.W. Ahn, J. Vranckena, J. van den Berga, C.A. Coello Coello, Evolutionary hidden information detection by granulation-based fitness approximation, Applied Soft Computing 10 (3) (2010) 719-729.
15. H.S. Kim, S.B. Cho, An efficient genetic algorithms with less fitness evaluation by clustering, in: Congress on Evolutionary Computation, 2001, pp. 887-894.
16. M. Salami, T. Hendtlass, The fast evaluation strategy for evolvable hardware, Genetic Programming and Evolvable Machines 6 (2) (2005) 139-162. (Pubitemid 40536279)
17. A. Forrester, A. Sobester, A. Keane, Engineering Design via Surrogate Modelling: A Practical Guide, John Wiley & Sons, 2008.
18. J.P.C. Kleijnen, Design and analysis of simulation experiments, in: International Series in Operations Research & Management Science, Springer, 2009.
19. K. Anderson, Y. Hsu, Genetic crossover strategy using an approximation concept, in: IEEE Congress on Evolutionary Computation, 1999, pp. 527-533.
20. K. Abboud, M. Schoenauer, Surrogate deterministic mutation: Preliminary results, in: Artificial Evolution, in: LNCS, 2002, pp. 919-954.
21. K. Rasheed, H. Hirsh, Informed operators: Speeding up genetic-algorithmbased design optimization using reduced models, in: Genetic and Evolutionary Computation Conference, Morgan Kaufmann, 2000, pp. 628-635.
22. I. Loshchilov, M. Schoenauer, S. Sebag, A mono surrogate for multiobjective optimization, in: Genetic and Evolutionary Computation Conference, 2010, pp. 471-478.
23. Y. Jin, M. Olhofer, B. Sendhoff, A framework for evolutionary optimization with approximate fitness functions, IEEE Transactions on Evolutionary Computation 6 (5) (2002) 481-494. (Pubitemid 35327564)
24. D. Lim, Y.-S. Ong, Y. Jin, B. Sendhoff, Trusted evolutionary algorithms, in: IEEE Congress on Evolutionary Computation, 2006, pp. 456-463.
25. J. Branke, C. Schmidt, Fast convergence by means of fitness estimation, Soft Computing 9 (1) (2005) 13-20. (Pubitemid 40097881)
26. M. Emmerich, A. Giotis, M. Uezdenir, T. Baeck, K. Giannakoglou, Metamodelassisted evolution strategies, in: Parallel Problem Solving from Nature, in: LNCS, Springer, 2002, pp. 371-380.
27. Y.S. Ong, P.B. Nair, A.J. Keane, Evolutionary optimization of computationally expensive problems via surrogate modeling, AIAA Journal 41 (4) (2003) 687-696.
28. Z. Zhou, Y.-S. Ong, M.-H. Lim, B.-S. Lee, Memetic algorithm using multisurrogates for computationally expensive optimization problems, Soft Computing 11 (10) (2007) 957-971. (Pubitemid 46767701)
29. S.Z. Martinez, C.A. Coello Coello, A memetic algorithm with non gradientbased local search assisted by a meta-model, in: Parallel Problem Solving from Nature, in: LNCS, Springer, 2010, pp. 576-585.
30. J.-F.M. Barthelemy, Approximation concepts for optimum structural design - A review, Structural Optimization 5 (1993) 129-144.
31. M. Celis, J.E. Dennis, R.A. Tapia, A trust region strategy for nonlinear equality constrained optimization, in: P. Boggs, R. Byrd, R. Schnabel (Eds.), Numerical Optimization 1984, SIAM, Philadelphia, 1985, pp. 71-82.
32. H.K. Singh, T. Ray, W. Smith, Surrogate assisted simulated annealing (SASA) for constrained multi-objective optimization, in: IEEE Congress on Evolutionary Computation, 2010, pp. 1-8.
33. H.S. Bernardino, H.J.C. Barbosa, L.G. Fonseca, A faster clonal selection algorithm for expensive optimization problems, in: Artificial Immune Systems, Springer, 2010, pp. 130-143.
34. Y. Jin, B. Sendhoff, Reducing fitness evaluations using clustering techniques and neural network ensembles, in: Genetic and Evolutionary Computation Conference, 2004, pp. 688-699. (Pubitemid 39747263)
35. F. Mota, F. Gomide, Fuzzy clustering in fitness estimation models for genetic algorithms and applications, in: IEEE International Conference on Fuzzy Systems, 2006, pp. 1388-1395. (Pubitemid 46948934)
36. L. Graening, Y. Jin, B. Sendhoff, Efficient evolutionary optimization using individual-based evolution control and neural networks: A comparative study, in: European Symposium on Artificial Neural Networks, 2005, pp. 273-278.
37. L. Graening, Y. Jin, B. Sendhoff, Individual-based Management of Meta-models for Evolutionary Optimization with Applications to Three-dimensional Blade Optimization, Springer, 2007, pp. 225-250 (chapter 6).
38. S. Tong, Active learning: Theory and applications. Ph.D. Thesis, Department of Computer Science, Stanford University, 2001.
39. D.J.C. MacKay, Introduction to gaussian processes, in: C.M. Bishop (Ed.), Neural Networks and Machine Learning, Springer, 1998, pp. 133-165.
40. J. Sacks, W.J. Welch, T.J. Mitchell, H.P. Wynn, Design and analysis of computer experiments, Statistical Science 4 (1989) 409-435.
41. D. Buche, N.N. Schraudolph, P. Koumoutsakos, Accelerating evolutionary algorithms with gaussian process fitness function models, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 35 (2) (2005) 183-194. (Pubitemid 40654431)
42. M. Emmerich, K.C. Giannakoglou, B. Naujoks, Single- and multiobjective evolutionary optimization assisted by gaussian random field metamodels, IEEE Transactions on Evolutionary Computation 10 (4) (2006) 421-439. (Pubitemid 44251376)
43. J. Knowles, Parego: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems, IEEE Transactions on Evolutionary Optimization 10 (1) (2006) 50-66. (Pubitemid 43174985)
44. Q. Zhang, W. Liu, E. Tsang, B. Virginas, Expensive multiobjective optimization by MOEA/D with gaussian process model, IEEE Transactions on Evolutionary Computation 14 (3) (2010) 456-474.
45. Y. Jin, M. Huesken, B. Sendhoff, Quality measures for approximate models in evolutionary computation, in: Proceedings of GECCO Workshops: Workshop on Adaptation, Learning and Approximation in Evolutionary Computation, 2003, pp. 170-174.
46. M. Huesken, Y. Jin, B. Sendhoff, Structure optimization of neural networks for aerodynamic optimization, Soft Computing 9 (1) (2005) 21-28. (Pubitemid 40097882)
47. H. Ulmer, F. Streichert, A. Zell, Evolution strategies with controlled model assistance, in: Congress on Evolutionary Computation, 2004, pp. 1569-1576.
48. M. Schmidt, H. Lipson, Coevolution of fitness predictors, IEEE Transactions on Evolutionary Computation 12 (6) (2008) 736-749.
49. Y. Tenne, K. Izui, S. Nishiwaki, Dimensionality-reduction frameworks for computationally expensive problems, IEEE Congress on Evolutionary Computation, 2010, pp. 1-8.
50. Z. Zhou, Y.S. Ong, P.B. Nair, A.J. Keane, K.Y. Lum, Combining global and local surrogate models to accelerate evolutionary optimization, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 37 (1) (2007) 66-76. (Pubitemid 46002490)
51. Y. Cao, Y. Jin, M. Kowalczykiewicz, B. Sendhoff, Prediction of convergence dynamics of design performance using differential recurrent neural networks, in: International Joint Conference on Neural Networks, 2008, pp. 529-534.
52. Y. Tenne, S.W. Armfield, A framework for memetic optimization using variable global and local surrogate models, Soft Computing 13 (2009) 81-793.
53. Y. Jin, B. Sendhoff, Pareto-based multi-objective machine learning: An overview and case studies, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38 (3) (2008) 397-415. (Pubitemid 351663123)
54. T. Goel, R.T. Haftka, W. Shyy, N.V. Queipo, Ensemble of surrogates, Structural and Multidisciplinary Optimization 33 (3) (2007) 199-216. (Pubitemid 46198778)
55. E. Sanchez, S. Pintos, N.V. Queipo, Toward an optimal ensemble of kernel-based approximations with engineering applications, Structural and Multidisciplinary Optimization 36 (3) (2008) 247-261.
56. D. Lim, Y.S. Ong, Y. Jin, B. Sendhoff, A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation, in: Genetic and Evolutionary Computation Conference, 2007, pp. 1288-1295. (Pubitemid 47291694)
57. A. Samad, K.-Y. Kim, Multiple surrogate modeling for axial compressor blade shape optimization, Journal of Propulsion Power 24 (2) (2008) 302-310. (Pubitemid 351683640)
58. D. Chafekar, L. Shi, K. Rasheed, J. Xuan, Constrained multi-objective ga optimization using reduced models, IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews 35 (2) (2005) 261-265. (Pubitemid 40654439)
59. A. Isaacs, T. Ray, W. Smith, An evolutionary algorithm with spatially distributed surrogates for multiobjective optimization, in: The 3rd Australian Conference on Progress in Artificial Life, 2007, pp. 257-268.
60. D. Eby, R. Averill, W. Punch, E. Goodman, Evaluation of injection island model ga performance on flywheel design optimization, in: Third Conference on Adaptive Computing in Design and Manufacturing, 1998, pp. 121-136.
61. M. Sefrioui, J. Periaux, A hierarchical genetic algorithm using multiple models for optimization, in: Parallel Problem Solving from Nature, 2000, pp. 879-888.
62. P.K.S. Nain, K. Deb, Computationally effective search and optimization procedure using coarse to fine approximation, in: IEEE Congress on Evolutionary Computation, 2003, pp. 2081-2088.
63. D. Lim, Y.S. Ong, Y. Jin, B. Sendhoff, Evolutionary optimization with dynamic fidelity computational models, in: International Conference on Intelligent Computing, in: LNCS, Springer, 2008, pp. 235-242.
64. D. Lim, Y. Jin, Y.S. Ong, B. Sendhoff, Generalizing surrogate-assisted evolutionary computation, IEEE Transactions on Evolutionary Computation 14 (3) (2010) 329-355.
65. J. Branke, Creating robust solutions by means of evolutionary algorithms, in: Parallel Problem Solving from Nature, in: LNCS, Springer, 1998, pp. 119-128. (Pubitemid 128145943)
66. M. Bhattacharya, Reduced computation for evolutionary optimization in noisy environment, in: Genetic and Evolutionary Computation Conference, 2008, pp. 2117-2122.
67. K.-H. Liang, X. Yao, C. Newton, Evolutionary search of approximated ndimensional landscapes, International Journal of Knowledge-Based Intelligent Engineering Systems 4 (3) (2000) 172-183.
68. H. Takagi, Interactive evolutionary computation: Fusion of the capabilities of ec optimization and human evaluation, Proceedings of IEEE 89 (2002) 1275-1296. (Pubitemid 33766623)
69. J.A. Biles, P.G. Anderson, L.W. Loggi, Neural network fitness functions for a musical IGA, in: The International ICSC Symposium on Intelligent Industrial Automation and Soft Computing, 1996.
70. R.R Kamalian, A.M. Agogino, H. Takagi, Use of interactive evolutionary computation with simplified modeling for computationally expensive layout design optimization, in: IEEE Congress on Evolutionary Computation, 2007, pp. 4124-4129. (Pubitemid 351371935)
71. X. Sun, D. Gong, S. Li, Classification and regression-based surrogate model - Assisted interactive genetic algorithm with individual fuzzy fitness, in: Genetic and Evolutionary Computation Conference, 2009, pp. 907-914.
72. A. Zhou, Y. Jin, Q. Zhang, B. Sendhoff, E. Tsang, Prediction-based population re-initialization for evolutionary dynamic multi-objective optimization, in: The Fourth International Conference on Evolutionary Multi-Criterion Optimization, in: LNCS, Springer, 2007, pp. 832-846. (Pubitemid 350270929)
73. I. Hatzakis, D. Wallace, Dynamic multi-objective optimization with evolutionary algorithms: A forward-looking approach, in: Genetic and Evolutionary Computation Conference, 2006, pp. 1201-1208. (Pubitemid 44611453)
74. X. Yu, Y. Jin, K. Tang, X. Yao, Robust optimization over time - a new perspective on dynamic optimization problems, in: Congress on Evolutionary Computation, 2010, pp. 3998-4003.
75. D. Lim, Y.-S. Ong, Y. Jin, B. Sendhoff, B.S. Lee, Inverse multi-objective robust evolutionary optimization, Genetic Programming and Evolvable Machines 7 (4) (2006) 383-404. (Pubitemid 46190778)
76. D. Lim, Y.-S. Ong, M.-H. Lim, Y. Jin, Single/multi-objective inverse robust evolutionary design methodology in the presence of uncertainty, in: S. Yang, Y.S. Ong, Y. Jin (Eds.), Evolutionary Computation in Dynamic and Uncertain Environments, Springer, 2007, pp. 437-456.
77. Y.-S. Ong, P.B. Nair, K.Y. Lum, Max-min surrogate-assisted evolutionary algorithm for robust design, IEEE Transactions on Evolutionary Computation 10 (4) (2006) 392-404. (Pubitemid 44251374)
78. I. Paenke, J. Banke, Y. Jin, Efficient search for robust solutions by means of evolutionary algorithms and fitness approximation, IEEE Transactions on Evolutionary Computation 10 (4) (2006) 405-420. (Pubitemid 44251375)
79. T.P. Runarsson, Constrained evolutionary optimization by approximate ranking and surrogate models, in: Parallel Problem Solving from Nature, in: LNCS, Springer, 2004, pp. 401-410. (Pubitemid 39750241)
80. S.D. Handoko, C.K. Kwoh, Y.S. Ong, Feasibility structure modeling: An effective chaperon for constrained memetic algorithms, IEEE Transactions on Evolutionary Computation 14 (5) (2010) 740-758.
81. Y. Tenne, K. Izui, S. Nishiwaki, Handling undefined vectors in expensive optimization problems, in: Applications of Evolutionary Computation, in: LNCS, Springer, 2010, pp. 582-591.
82. Y. Jin, S. Oh, M. Jeon, Incremental approximation of nonlinear constraint functions for evolutionary constrained optimization, in: IEEE Congress on Evolutionary Computation, 2010, pp. 2966-2973.
83. S. Oh, Y. Jin, M. Jeon, Approximate models for constraint functions in evolutionary constrained optimization, International Journal of Innovative Computing, Information and Control 7 (10) (2011).
84. M.K. Karakasis, K.C. Giannakoglou, Metamodel-assisted multi-objective evolutionary optimization, in: Evolutionary and Deterministic Methods for Design, Optimization and Control with Applications to Industrial and Societal Problems, EUROGEN, 2005.
85. A. Shahrokhi, A. Jahangirian, A surrogate assisted evolutionary optimization method with application to the transonic airfoil design, Engineering Optimization 42 (6) (2010) 497-515.
86. V.G. Asouti, I.C. Kampolis, K.C. Giannakoglou, A grid-enabled asynchronous metamodel-assisted evolutionary algorithm for aerodynamic optimization, Genetic Programming and Evolvable Machines 10 (4) (2009) 373-389.
87. M.H.A. Bonte, L. Fourment, T.-T. Do, A.H. van den Boogaard, J. Huetink, Optimization of forging processes using finite element simulations, Structural Multidisciplinary Optimization 42 (2010) 797-810.
88. K. Hamza, K. Saitou, Crashworthiness design using meta-models for aprroximating the response of structural members, in: Cairo University Conference on Mechanical Design and Production, 2004.
89. G. Mariani, G. Palermo, C. Silvano, V. Zaccaria, Meta-model assisted optimization for design space exploration of multi-processor systems-onchip, in: 12th Euromicro Conference on Digital System Design, Architectures, Methods and Tools, 2009, pp. 383-389.
90. G. Dellino, P. Lino, C. Meloni, A. Rizzo, Kriging metamodel management in the design optimization of a cng injection system, Mathematics and Computers in Simulation 79 (8) (2009) 2345-2360.
91. S.-T. Khu, D. Savic, Z. Kapelan, Evolutionary-based meta-modelling v the relevance of using approximate models in hydroinformatics, in: Hydroinformatics in Practice: Computational Intelligence and Technological Developments in Water Applications, Springer, 2008.
92. I. Dahm, J. Ziegler, Using artificial neural networks to construct a meta-model for the evolution of gait patterns, in: Proceedings of the 5th International Conference on Climbing and Walking Robots, 2002.
93. M.J. Powell, On the convergence of a wide range of trust region methods for unconstrained optimization, IMA Journal of Numerical Analysis 30 (1) (2010) 289-301.
94. V.J. Hodge, K.J. Lees, J.L. Austin, A high performance k-nn approach using binary neural networks, Neural Networks 17 (3) (2004) 441-458. (Pubitemid 38376010)
95. R. Li, M.T.M. Emmerich, J. Eggermont, E.G.P. Bovenkamp, T. Bäck, J. Dijkstra, J.H.C. Reiber, Metamodel-assisted mixed integer evolution strategies and their application to intravascular ultrasound image analysis, in: IEEE Congress on Evolutionary Computation, 2008, pp. 2764-2771.
96. C. Ling, J.-H. Liang, B. Wu, Z.-W. Hu, A metamodel-based optimization method for mobile ad hoc networks, in: 2010 International Conference on Computer Application and System Modeling, ICCASM, 2010, pp. 412-416.
97. Y. Jin, J. Branke, Evolutionary optimization in uncertain environmentsa survey, IEEE Transactions on Evolutionary Computation 9 (3) (2005) 303-317. (Pubitemid 40871134)
98. R. Polikar, L. Upda, S.S. Upda, V. Honavar, Learn++: An incremental learning algorithm for supervised neural networks, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 31 (4) (2001) 479-508.
99. D.H. Ackley, A Connectionist Machine for Genetic Hillclimbing, Kluwer Academic Publishers, Norwell, MA, 1987.
100. W. Hendrickx, D. Gorisson, T. Dhaene, Grid enabled sequential design and adaptive metamodeling, in: Proceedings of the 2006 Winter Simulation Conference, 2006.
101. M. Miller, Cloud Computing: Web-Based Applications That Change the Way You Work and Collaborate Online, Que Publishing, 2008.