Generalizing surrogate-assisted evolutionary computation

IEEE Transactions on Evolutionary Computation

Volumn 14, Issue 3, 2010, Pages 329-355

  Lim, Dudy ^a   Jin, Yaochu ^b   Ong, Yew Soon ^a,c   Sendhoff, Bernhard ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Approximation models; Computationally expensive problems; Memetic algorithms; Metamodels; Surrogate models; Surrogate assisted evolutionary algorithms

Indexed keywords

APPROXIMATION MODEL; MEMETIC ALGORITHMS; META MODEL; METAMODELS; SURROGATE MODEL;

APPROXIMATION ALGORITHMS; BENCHMARKING; OPTIMIZATION;

EVOLUTIONARY ALGORITHMS;

EID: 77953081384     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2009.2027359     Document Type: Article

References (74)

1. C. G. Johnson and J. J. R. Caldalda, " Introduction: Genetic algorithms in visual art and music, " Leonardo, vol. 35, no. 2, pp. 175-184, Apr. 2002.
2. C. Aranha and H. Iba, " The memetic tree-based genetic algorithm and its application to portfolio, " Memetic Comput., vol. 1, no. 2, pp. 139-151, Jun. 2009.
3. D. Simon, " Biogeography-based optimization, " IEEE Trans. Evol. Com-put., vol. 12, no. 6, pp. 702-713, Dec. 2008.
4. S. M. K. Hasan, R. Sarker, D. Essam, and D. Cornforth, " Memetic algorithms for solving job-shop scheduling problems, " Memetic Comput., vol. 1, no. 1, pp. 69-83, Mar. 2009.
5. E. W. Lameijer, T. Baeck, J. N. Kok, and A. P. Ijzerman, " Evolutionary algorithms in drug design, " Nat. Comput., vol. 4, no. 3, pp. 177-243, Sep. 2005.
6. M. Olhofer, T. Arima, T. Sonoda, and B. Sendhoff, " Optimization of a stator blade used in a transonic compressor cascade with evolution strategies, " Adaptive Computing in Design and Manufacture (ACDM). Berlin, Germany: Springer-Verlag, 2000, pp. 45-54.
7. Y. Jin, M. Olhofer, and B. Sendhoff, " A framework for evolutionary optimization with approximate fitness function, " IEEE Trans. Evol. Comput., vol. 6, no. 5, pp. 481-494, Oct. 2002.
8. Y. S. Ong, P. B. Nair, and A. J. Keane, " Evolutionary optimization of computationally expensive problems via surrogate modeling, " Am. Inst. Aeronaut. Astronaut. J., vol. 41, no. 4, pp. 687-696, 2003.
9. Y. Jin, " A comprehensive survey of fitness approximation in evolutionary computation, " Soft Comput., vol. 9, no. 1, pp. 3-12, Jan. 2005.
10. A. Ratle, " Kriging as a surrogate fitness landscape in evolutionary optimization, " Artif. Intell. Eng. Design Manufact., vol. 15, no. 1, pp. 37-49, May 2001.
11. Z. Zhou, Y. S. Ong, P. B. Nair, A. J. Keane, and K. Y. Lum, " Combining global and local surrogate models to accelerate evolutionary optimization, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 37, no. 1, pp. 66-76, Jan. 2007.
12. R. Smith, B. Dike, and S. Stegmann, " Fitness inheritance in genetic algorithms, " in Proc. ACM Symp. Appl. Comput., 1995, pp. 345-350.
13. J. H. Chen, D. E. Goldberg, S. Y. Ho, and K. Sastry, " Fitness inheritance in multiobjective optimization, " in Proc. Genet. Evol. Comput. Conf., 2002, pp. 319-326.
14. Y. Jin, M. Olhofer, and B. Sendhoff, " On evolutionary optimization with approximate fitness functions, " in Proc. Genet. Evol. Comput. Conf., 2000, pp. 786-792.
15. M. Emmerich, A. Giotis, M. Oezdenir, T. Baeck, and K. Giannakoglou, " Metamodel-assisted evolution strategies, " in Proc. Parallel Problem Solving from Nature, vol. 2439. 2002, pp. 371-380.
16. H. Ulmer, F. Streichert, and A. Zell, " Evolution strategies assisted by Gaussian processes with improved preselection criterion, " in Proc. IEEE Congr. Evol. Comput., 2003, pp. 692-699.
17. H. S. Kim and S. B. Cho, " An efficient genetic algorithms with less fitness evaluation by clustering, " in Proc. Congr. Evol. Comput., 2001, pp. 887-894.
18. Y. Jin and B. Sendhoff, " Reducing fitness evaluations using clustering techniques and neural networks ensembles, " in Proc. Genet. Evol. Com-put. Conf., vol. 3102. 2004, pp. 688-699.
19. J. Branke and C. Schmidt, " Faster convergence by means of fitness estimation, " Soft Comput., vol. 9, no. 1, pp. 13-20, Jan. 2005.
20. L. Gräning, Y. Jin, and B. Sendhoff. " Individual-based management of meta-models for evolutionary optimization with applications to 3-D blade optimization, " Evolutionary Computation in Dynamic and Uncertain Environments, S. Yang, Y.-S. Ong, and Y. Jin, Eds. Berlin, Germany: Springer-Verlag, 2007, pp. 225-250.
21. P. K. S. Nain and K. Deb, " Computationally effective search and optimization procedure using coarse-to-fine approximation, " in Proc. Congr. Evol. Comput., 2003, pp. 2081-2088.
22. Y. S. Ong, P. B. Nair, and K. Y. Lum, " Max-min surrogate-assisted evolutionary algorithm for robust aerodynamic design, " IEEE Trans. Evol. Comput., vol. 10, no. 4, pp. 392-404, Aug. 2006.
23. Y. S. Ong, P. B. Nair, and K. Y. Lum, " Evolutionary algorithm with hermite radial basis function interpolations for computationally expensive adjoint solvers, " Comput. Optim. Applicat., vol. 39, no. 1, pp. 91-119, Jan. 2008.
24. K. C. Giannakoglou, D. I. Papadimitriou, and I. C. Kampolis, " Aerodynamic shape design using evolutionary algorithms and new gradient-assisted metamodels, " Comput. Methods Appl. Mech. Eng., vol. 195, pp. 6312-6329, Sep. 2006.
25. M. D. Schmidt and H. Lipson, " Coevolution of fitness predictors, " IEEE Trans. Evol. Comput., vol. 12, no. 6, pp. 736-749, Dec. 2008.
26. J. Knowles, " ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems, " IEEE Trans. Evol. Comput., vol. 10, no. 1, pp. 50-66, Feb. 2006.
27. D. Jones, M. Schonlau, and W. Welch, " Efficient global optimization of expensive black-box functions, " J. Global Optim., vol. 13, no. 4, pp. 455-492, Dec. 1998.
28. K. Deb and P. K. S. Nain, " An evolutionary multiobjective meta-modeling procedure using artificial neural networks, " Evolutionary Computation in Dynamic and Uncertain Environments, S. Yang, Y. S. Ong, and Y. Jin, Eds. Berlin, Germany: Springer-Verlag, 2007, pp. 297-322.
29. M. Emmerich, K. Giannakoglou, and B. Naujoks, " Single and multi-objective evolutionary optimization assisted by Gaussian random field metamodels, " IEEE Trans. Evol. Comput., vol. 10, no. 4, pp. 421-439, Aug. 2006.
30. D. Chafekar, L. Shi, K. Rasheed, and J. Xuan, " Multiobjective GA optimization using reduced models, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 2, pp. 261-265, May 2005.
31. I. Voutchkov and A. J. Keane. " Multiobjective optimization using surrogates, " in Proc. 7th Int. Conf. Adaptive Comput. Design Manufact., Baarn, The Netherlands: M. C. Escher Company, 2006, pp. 167-175.
32. Y. S. Ong, P. B. Nair, A. J. Keane, and K. W. Wong, " Surrogate-assisted evolutionary optimization frameworks for high-fidelity engineering design problems, " Knowledge Incorporation in Evolutionary Computation, Y. Jin, Ed. Berlin, Germany: Springer-Verlag, 2004, pp. 307-331.
33. D. Lim, Y. S. Ong, Y. Jin, and B. Sendhoff, " A study on metamodeling techniques, ensembles, and multisurrogates in evolutionary computation, " in Proc. Genet. Evol. Comput. Conf., London, U. K.: ACM, 2007, pp. 1288-1295.
34. A. Samad and K.-Y. Kim, " Multiple surrogate modeling for axial compressor blade shape optimization, " J. Propulsion Power, vol. 24, no. 2, pp. 302-310, Mar. 2008. (Pubitemid 351683640)
35. L. E. Zerpa, N. V. Queipo, S. Pintos, and J.-L. Salager, " An optimization methodology of alkaline-surfactant-polymer flooding processes using field scale numerical simulation and multiple surrogates, " J. Petroleum Sci. Eng., vol. 47, no. 3-4, pp. 197-208, Jun. 2005.
36. D. Marjavaara, S. Lundström, and W. Shyy, " Hydraulic turbine diffuser shape optimization by multiple surrogate model approximations of pareto fronts, " ASME J. Fluids Eng., vol. 129, no. 9, pp. 1228-1240, 2007.
37. N. V. Queipo, R. T. Haftka, W. Shyy, T. Goel, R. Vaidyanathan, and P. K. Tucker, " Surrogate-based analysis and optimization, " Progr. Aerospace Sci., vol. 37, pp. 59-118, 2001.
38. E. Sanchez, S. Pintos, and N. V. Queipo, " Toward an optimal ensemble of kernel-based approximations with engineering applications, " in Proc. Int. Joint Conf. Neural Netw. (IJCNN), Jul. 2006, pp. 2152-2158.
39. A. Samad, K.-D. Lee, K.-Y. Kim, and R. T. Haftka, " Application of multiple-surrogate model to optimization of a dimpled channel, " in Proc. 7th World Congr. Struct. Multidisc. Optim., 2007, pp. 2276-2282.
40. T. Goel, R. T. Haftka, W. Shyy, and N. V. Queipo, " Ensemble of surrogates, " Struct. Multidisc. Optim., vol. 33, no. 3, pp. 199-216, Mar. 2007.
41. E. Acar and M. Rais-Rohani, " Ensemble of metamodels with optimized weight factors, " Struct. Multidisc. Optim., vol. 37, no. 3, pp. 279-294, 2009.
42. K.-H. Liang, X. Yao, and C. Newton, " Combining landscape approximation and local search in global optimization, " in Proc. 1999 Congr. Evol. Comput., Piscataway, NJ, vol. 2. 1999, pp. 1514-1520.
43. K.-H. Liang, X. Yao, and C. Newton, " Evolutionary search of approximated n-dimensional landscape, " Int. J. Knowl.-Based Intell. Eng. Syst., vol. 4, no. 3, pp. 172-183, 2000.
44. Y. S. Ong, Z. Zhou, and D. Lim, " Curse and blessing of uncertainty in evolutionary algorithm using approximation, " in Proc. Congr. Evol. Comput., Vancouver, BC, 2006, pp. 2928-2935.
45. Y. Jin and J. Branke, " Evolutionary optimization in uncertain environments: A survey, " IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 303-317, Jun. 2005.
46. R. Meuth, M. H. Lim, Y. S. Ong, and D. C. Wunsch, II, " A proposition on memes and meta-memes in computing for higher-order learning, " Memetic Comput., vol. 1, no. 2, pp. 85-100, Jun. 2009.
47. C. K. Goh, E. J. Teoh, and K. C. Tan, " Hybrid multiobjective evolutionary design for artificial neural networks, " IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1531-1548, Sep. 2008.
48. N. Noman and H. Iba, " Accelerating differential evolution using an adaptive local search, " IEEE Trans. Evol. Comput., vol. 12, no. 1, pp. 107-125, Feb. 2008.
49. D. S. Liu, K. C. Tan, C. K. Goh, and W. K. Ho, " A multiobjec-tive memetic algorithm based on particle swarm optimization, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 42-50, Feb. 2007.
50. Y. S. Ong, M. H. Lim, N. Zhu, and K. W. Wong, " Classification of adaptive memetic algorithms: A comparative study, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 1, pp. 141-152, Feb. 2006.
51. Y. Liu, X. Yao, and T. Higuchi, " Evolutionary ensembles with negative correlation learning, " IEEE Trans. Evol. Comput., vol. 4, no. 4, pp. 380-387, Nov. 2000.
52. L. S. Kwan, " Diffusion equation and global optimization, " PhD dissertation, Dept. Automat. Comput.-Aided Eng., Chin. Univ. Hong Kong, China, 2004.
53. J. F. Rodriguez, J. E. Renaud, and L. T. Watson, " Convergence of Trust-region augmented lagrangian methods using variable fidelity approximation data, " Virginia Polytech. Inst. State Univ. Blacksburg, Tech. Rep. TR-97-14, 1997.
54. C. T. Lawrence and A. L. Tits, " A computationally efficient feasible sequential quadratic programming algorithm, " Soc. Ind. Appl. Math., vol. 11, no. 4, pp. 1092-1118, 2001.
55. D. J. C. Mackay, " Introduction to Gaussian processes, " Neural Netw. Mach. Learn., vol. 168, pp. 133-165, 1998.
56. F. H. Lesh, " Multidimensional least-square polynomial curve fitting, " Commun. ACM, vol. 2, no. 9, pp. 29-30, 1959.
57. C. Bishop, Neural Networks for Pattern Recognition. London, U. K.: Oxford Univ. Press, 1995.
58. H. Ishibuchi and T. Murata, " Multiobjective genetic local search algorithm, " in Proc. IEEE Int. Conf. Evol. Comput., 1996, pp. 119-124.
59. A. Jaszkiewicz, " Genetic local search for multiple objective combinatorial optimization, " Inst. Comput. Sci., Poznan Univ. of Tech., Tech. Rep. RA-014/98, 1998.
60. J. Knowles and D. Corne, " Memetic algorithms for multiobjective optimization: Issues, methods and prospects, " Recent Advances in Memetic Algorithms, W. E. Hart, N. Krasnogor, and J. E. Smith, Ed. Berlin, Germany: Springer-Verlag, 2005, pp. 313-352.
61. N. Alexandrov, J. E. Dennis, R. M. Lewis, and V. Torczon, " A trust-region framework for managing the use of approximation models in optimization, " J. Struct. Optim., vol. 15, no. 1, pp. 16-23, 1998.
62. J. G. Digalakis and K. G. Margaritis, " On benchmarking functions for genetic algorithms, " Int. J. Comput. Math., vol. 77, no. 4, pp. 481-506, 2001.
63. P. N. Suganthan, N. Hansen, J. J. Liang, K. Deb, Y. P. Chen, A. Auger, and S. Tiwari, " Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization, " Nanyang Tech. Univ., Singapore, Tech. Rep. and IIT Kanpur, India, KanGAL Rep. 2005005, May 2005.
64. E. Zitzler, K. Deb, and L. Thiele, " Comparison of multiobjective evolutionary algorithms: Empirical results, " Evol. Comput., vol. 8, no. 2, pp. 173-195, 2000.
65. K. Deb, S. Agrawal, A. Pratab, and T. Meyarivan, " A fast elitist nondominated sorting genetic algorithm for multiobjective optimization: NSGA-II, " in Proc. Parallel Problem Solving from Nature VI Conf., vol. 1917. 2000, pp. 849-858.
66. E. Zitzler, L. Thiele, M. Laumanns, C. M. Foneseca, and V. Grunert da Fonseca, " Performance assessment of multiobjective optimizers: An analysis and review, " IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 117-132, Apr. 2003.
67. C. A. Coello Coello, D. A. Van Veldhuizen, and G. B. Lamont, Evolutionary Algorithms for Solving Multiobjective Problems. New York: Kluwer Academic, 2002, pp. 243-272.
68. D. A. Van Veldhuizen and G. B. Lamont, " Evolutionary computation and convergence to a Pareto front, " Late Breaking Papers at the Genetic Programming, 1998, pp. 221-228.
69. D. A. Van Veldhuizen, " Multiobjective evolutionary algorithms: Classifications, analysis, and new innovations, " Ph. D. dissertation, Graduate School Eng., Air Force Inst. Technol., Dayton, OH, 1999.
70. E. Zitzler, " Evolutionary algorithms for multiobjective optimization: Methods and applications, " Ph. D. dissertation, Swiss Federal Inst. Tech-nol. (ETH), Zurich, Switzerland, TIK-Schriftenreihe Nr. 30, dissertation ETH No. 13398. Aachen, Germany: Shaker Verlag, 1999.
71. E. Zitzler and L. Thiele, " Multiobjective optimization using evolutionary algorithms: A comparative case study, " in Proc. Fifth Int. Conf. Parallel Problem Solving from Nature (PPSN-V). Berlin, Germany: Springer-Verlag, 1998, pp. 292-301.
72. K. Deb, " Salient issues of multi-objective evolutionary algorithms, " in Multiobjective Optimization Using Evolutionary Algorithms, 1st ed. Chichester, U. K.: Wiley, 2001, pp. 315-446.
73. R. G. Regis and C. A. Shoemaker, " Local function approximation in evolutionary algorithms for the optimization of costly functions, " IEEE Trans. Evol. Comput., vol. 8, no. 5, pp. 490-505, Oct. 2004.
74. H.-M. Gutmann, " On the semi-norm of radial basis function inter-polants, " Dept. Applied Math. Theor. Phy., Univ. Cambridge, U. K., Tech. Rep. DAMTP 2000/NA04, 2000.