Combining global and local surrogate models to accelerate evolutionary optimization

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 1, 2007, Pages 66-76

  Zhou, Zongzhao ^a   Ong, Yew Soon ^a   Nair, Prasanth B ^b   Keane, Andy J ^b   Lum, Kai Yew ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Aerodynamic shape design; Evolutionary optimization; Gaussian process; Genetic algorithm; Global and local surrogate model; Radial basis function

Indexed keywords

GENETIC ALGORITHMS; MATHEMATICAL MODELS; OPTIMIZATION; RADIAL BASIS FUNCTION NETWORKS;

AERODYNAMIC SHAPE DESIGN; EVOLUTIONARY OPTIMIZATION; GAUSSIAN PROCESS; LAMARCKIAN EVOLUTION;

EVOLUTIONARY ALGORITHMS;

EID: 33845749639     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2005.855506     Document Type: Article

References (30)

1. Y. S. Ong, P. B. Nair, and A. J. Keane, "Evolutionary optimization of computationally expensive problems via surrogate modeling," Amer. Inst. Aero, Astron. J., vol. 41, no. 4, pp. 687-696, 2003.
2. A. Ratle, "Accelerating evolutionary algorithms using fitness function models," Parallel Problem Solving from Nature, vol. 5, pp. 87-96, 1998.
3. K. C. Giannakoglou, "Design of optimal aerodynamic shapes using stochastic optimizationmethods and computational intelligence," Int. Rev. J. Progress Aerosp. Sci., vol. 38, no. 5, pp. 43-76, 2002.
4. M. K. Karakasis, A. P. Giotis, and K. C. Giannakoglou, "Inexact information aided, low-cost, distributed genetic algorithms for aerodynamic shape optimization," Int. J. Numer. Meth. Fluids, vol. 43, pp. 1149-1166, 2003.
5. W. B. Song, "Shape optimisation of turbine blade firtrees," Ph.D. dissertation, School Eng. Sci., Univ. Southampton, Southampton, U.K., 2002.
6. A. Choudhury, P. B. Nair, and A. J. Keane, "A data-parallel approach for large-scale Gaussian process modeling," in Proc. 2nd SIAM Int. Conf. Data Mining, Arlington, VA, Apr. 2002.
7. A. A. Guinta and L. Watson, "A comparison of approximation modelling techniques: Polynomial versus interpolating models," in Proc. 7th AIAA/USAF/NASA/ISSMO Symp. Multidisciplinary Analysis and Optimization, Amer. Inst. Aero Astron. 98-4758, St. Louis, MO, Sep. 1998.
8. D. D. Daberkow and D. N. Mavris, "New approaches to conceptual and preliminary aircraft design. A comparative assessment of a neural network formulation and a response surface methodology," in Proc. AIAA, World Aviation Conf., Anaheim, CA, Sep. 1998.
9. R. Jin, W. Chen, and T. W. Simpson, "Comparative studies of metamodeling techniques under multiple modeling criteria," Struct. Multidiscipl. Optim., vol. 23, no. 1, pp. 1-13, 2001.
10. Y. Jin, "A comprehensive survey of fitness approximation in evolutionary computation," Soft Comput., vol. 9, no. 1, pp. 3-12, 2005.
11. A. J. Keane and N. Petruzzelli, "Aircraft wing design using GA-based multi-level strategies," in Proc. 8th AIAA/USAF/NASA/ISSMO Symp. Multidisciplinary Analysis Optimization, Aner. Inst. Aero. Astror.-2000-4937, Long Beach, CA, Sep. 2000, pp. A00-40 171.
12. Y. S. Ong et al., "Global convergence unconstrained and bound constrained surrogate-assisted evolutionary search in aerodynamic shape design," in Proc. IEE Congr. Evolutionary Computation CEC'03, Special Session on Design Optimisation with Evoul. Comput., vol. 3, Canberra, Australia, Dec. 2003, pp. 1856-1863.
13. M. A. El-Beltagy, P. B. Nair, and A. J. Keane, "Metamodelling techniques for evolutionary optimization of computationally expensive problems: Promise and limitations," in Proc. IEEE Genetic and Evol. Comput. Conf. (GECCO'99), Orlando, FL, Jul. 1999, pp. 196-203.
14. Y. Jin, M. Olhofer, and B. Sendho, "A framework for evolutionary optimization with approximate fitness functions," IEEE Trans. Evol. Comput., vol. 6, no. 5, pp. 481-494, Oct. 2002.
15. K. H. Liang, X. Yao, and C. Newton, "Evolutionary search of approximated n-dimensional landscapes," Int. J. Knowl.-Based Intell. Eng. Syst., vol. 4, no. 3, pp. 172-183, 2000.
16. O. Chapelle, V. Vapnik, and J. Weston, "Transductive inference for estimating values of functions," Adv. Neural Inf. Process. Syst., vol. 12, 1999.
17. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
18. D. Büche, N. N. Schraudolph, and P. Koumoutsakos, "Accelerating evolutionary algorithms with Gaussian proofs fitness function models," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 2, pp. 183-194, May 2005.
19. H. Ulmer, F. Streichert, and A. Zell, "Evolution strategies assisted by Guassian processes with improved pre-selection criterion," in Proc. IEEE Congr. Evol. Comput. CEC'03, Canberra, Australia, Dec. 2003, pp. 692-699.
20. M. Emmerich, A. Giotis, M. Oezdemir, K. Giannakoglou, and T. Baeck, "Metamodel-assisted evolution strategies," in Proc. PPSN VII, Lecture Notes in Computer Science, vol. 2439, 2002, pp. 361-370.
21. D. R. Jones, M. Schonlau, and W. J. Welch, "Efficient global optimization of expensive black-box functions," J. Global Optim., vol. 13, pp. 455-492, 1998.
22. D. Mackay, "Bayesian interpolation," Neural Computation, vol. 4, no. 3, pp. 415-447, 1992. [Online]. Available: Citeseer.ist.psu.edu/article/mackay91bayesiari.html
23. V. Torczon and M. W. Trosset, "Using approximations to accelerate engineering design optimization," in Proc. 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Amer. Inst. Aero. Astron. Paper 98-4800, no. TR-93-33, St. Louis, MO, Sep. 1998. [Online]. Available: Citeseer.ist.psu.edu/torczon98using.html
24. C. Bishop, Neural Networks for Pattern Recognition. London, U.K.: Oxford Univ. Press, 1995.
25. J. F. Rodriguez, J. E. Renaud, and L. T. Watson, "Convergence of trust region augmented lagrangian methods using variable fidelity approximation data," Struct. Optim., vol. 15, no. 34, pp. 141-156, 1998.
26. N. Alexandrov, J. E. Dennis, R. M. Lewis, and V. Torczon, "A trust region framework for managing the use of approximation models in optimization," Struct. Optim., vol. 15, no. 1, pp. 16-23, 1998.
27. Z. Zhou, Y. S. Ong, and P. B. Nair, "Hierarchical surrogate-assisted evolutionary optimization framework," in Proc. IEEE Congr. Evolutionary Computation CEC'04, Special Session on Learning and Approximation in Design Optimization, Portland, OR, Jun. 2004, pp. 1586-1593.
28. A. D. J. Anderson, Introduction to Flight, 4th ed., New York: McGraw-Hill, 2000.
29. H. K. Versteeg and W. Malalasekera, An Introduction to Computational Fluid Dynamics - The Finite Volume Methods. White Plains, NY: Longman, 1995.
30. R. M. Hicks and P. A. Henne, "Wing design by numerical optimization," J. Aircraft, vol. 15, no. 7, pp. 407-412, 1978.