Accelerating evolutionary algorithms with Gaussian process fitness function models

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 35, Issue 2, 2005, Pages 183-194

  Büche, Dirk ^a   Schraudolph, Nicol N ^a   Koumoutsakos, Petros ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Evolution control; Evolutionary algorithms (EAs); Fitness function modeling; Gas turbine compressor design; Gaussian process; Surrogate approach

Indexed keywords

COMPRESSORS; COMPUTATION THEORY; CONTROL SYSTEM SYNTHESIS; CONVERGENCE OF NUMERICAL METHODS; FUNCTIONS; GAS TURBINES; MATHEMATICAL MODELS; OPTIMIZATION;

EVOLUTION CONTROL; FITNESS FUNCTION MODELING; GAS TURBINE COMPRESSOR DESIGN; GAUSSIAN PROCESS; SURROGATE APPROACH;

EVOLUTIONARY ALGORITHMS;

EID: 18544390529     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2004.841917     Document Type: Article

References (36)

1. N. Hansen and A. Ostermeier, "Completely derandomized self-adaptation in evolution strategies," Evol. Comput., vol. 9, no. 2, pp. 159-195, 2001.
2. N. Hansen, S. D. Müller, and P. Koumoutsakos, "Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES)," Evol. Comput., vol. 11, no. 1, pp. 1-18, 2003.
3. V. Torczon and M. W. Trosset, "Using approximations to accelerate engineering design optimization, ," NASA Langley Research Center, Hampton, VA, ICASE Rep. 98-33, 1998.
4. A.J. Booker, J. E. Dennis Jr., P. D. Frank, D. B. Serafini, V. Torczon, and M. W. Trosset, "A rigorous framework for optimization of expensive functions by surrogates," Struct. Optimization, vol. 17, no. 1, pp. 1-13, 1999.
5. M. Emmerich, A. Giotis, M. Özdemir, T. Bäck, and K. Giannakoglou, "Metamodel-assisted evolution strategies," in Parallel Problem Solving From Nature - PPSN VII. New York: Springer-Verlag, 2002, pp. 361-370.
6. J.D. Martin and T. W. Simpson, "Use of adaptive metamodeling for design optimization," in Proc. AIAA/ISSMO Symp. Multidisciplinary Analysis and Optimization, 2002, Paper no. AIAA-2002-5631.
7. Y. Jin, M. Olhofer, and B. Sendhoff, "Managing approximate models in evolutionary aerodynamic design optimization," in Proc. IEEE Congr. Evolutionary Computation, vol. 1, Seoul, Korea, 2001, pp. 592-599.
8. Y. Jin, M. Olhofer, and B. Sendhoff, "On evolutionary optimization with approximate fitness functions," in Proc. Genetic and Evolutionary Computation Conf., ch. NV, Las Vegas, 2000, pp. 786-793.
9. A.P. Giotis and K. C. Giannakoglou, "Single - and multiobjective airfoil design using genetic algorithms and artificial intelligence," presented at the EUROGEN, Jyvdskyld, Finland, 1999.
10. H. Nakayama, M. Arakawa, and R. Sasaki, "A computational intelligence approach to optimization with unknown objective functions," in Artif. Neural Netw., 2001, pp. 73-80.
11. M.A. El-Beltagy and A. J. Keane, "Evolutionary optimization for computationally expensive problems using gaussian processes," in Proc. Int. Conf. Artificial Intelligence, H. Arabnia, Ed., 2001, pp. 708-714.
12. D. J. C. MacKay, "Gaussian processes - a replacement for supervised neural networks?," Lecture notes for a tutorial in advances in nueral information processing systems, 1997.
13. A. Ratle, "Accelerating the convergence of evolutionary algorithms by fitness landscape approximation," in Parallel Problem Solving From Nature - PPSN V. New York: Springer-Verlag, 1998, pp. 87-96.
14. Y. Jin, T. Okabe, and B. Sendhoff, "Adapting weighted aggregation for multiobjective evolution strategies," in 1st Int. Conf. Evolutionary MultiCriterion Optimization, E. Zitzler, K. Deb, L. Thiele, C. A. Coello Coello, and D. Corne, Eds., 2001, pp. 96-110.
15. M.N. Gibbs and D. J. C. MacKay, "Manual for tpros, v2.0,", 1997.
16. K.C. Giannakoglou, "Acceleration of genetic algorithms using artificial neural networks - theoretical background," presented at the von Karman Institute Lectures Series on Genetic Algorithms for Optimization in Aeronautics and Turbomachinery, May 2000.
17. T.W. Simpson, T. M. Mauery, J. J. Korte, and F. Mistree, "Comparison of response surface and kriging models for multidisciplinary design optimization," in Proc. 7th AIAA/USAF /NASA/ISSMO Symp. Multidisciplinary Analysis and Optimization, St. Louis, MO, 1998, AIAA paper 98-4758.
18. K. C. Giannakoglou, "Optimization and inverse design in aeronautics: how to couple genetic algorithms with radial basis function networks," in Innovative Tools for Scientific Computation in Aeronautical Engineering, J. Periaux, P. Joly, O. Pironneau, anal E. Onate, Eds. Barcelona, Spain: CIMNE, 2001.
19. S. Haykin, Neural Networks-A Comprehensive Foundation. Engelwood Cliffs, NJ: Prentice-Hall, 1994.
20. D. E. Rumelhart, G. E. Hinton, and R. I. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Explorations in the Microstructures of Cognition. Cambridge, MA: Bradford/MIT Press, 1986, vol. 1, pp. 318-362.
21. C. A. L. Bailer-Jones, H. K. D. H. Bhadeshia, and D. J. C. MacKay, "Gaussian process modeling of austenite formation in steel," Mater. Sci. Technol., vol. 15, no. 3, pp. 287-294, 1999.
22. S. Barnett, Matrix Methods for Engineers and Scientists. New York: McGraw-Hill, 1979.
23. J. Dennis and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Series in Computational Mathematics. Englewood Cliffs, NJ: Prentice-Hall, 1993.
24. H.-P. Schwefel, Numerical Optimization of Computer Models. New York: Wiley, 1981.
25. C. K. I. Williams, "Prediction with gaussian processes: from linear regression to linear prediction and beyond," in Learning and Inference in Graphical Models, M. I. Jordan, Ed. Norwell, MA: Kluwer, 1998.
26. M. Seeger, C. Williams, and N. Lawrence, "Fast forward selection to speed up sparse gaussian process regression," presented at the 9th Int. Workshop on Artificial Intelligence and Statistics, Key West, FL, 2003.
27. M.N. Gibbs, "Bayesian Gaussian processes for regression and classification," Ph.D. thesis, Univ. Cambridge, Cambridge, U.K., 1997.
28. M.E. Johnson, L. M. Moore, and D. Ylvisaker, "Minimax and maximin distance designs," J. Statist. Inference Plan., vol. 26, pp. 131-148, 1990.
29. S. Kern, S. Müller, D. Büche, N. Hansen, and P. Koumoutsakos, "Learning probability distributions in continuous evolutionary algorithms," in Workshop Fundamentals in Evolutionary Algorithms, Thirteenth International Colloquium on Automata, Languages and Programming, Eindhoven, The Netherlands, 2003.
30. M. Drela and H. Youngren, "A User's Guide to MISES 2.1," Massachusetts Inst. Technology, Cambridge, 1995.
31. L. Huyse and R. M. Lewis, "Aerodynamic shape optimization of two-dimensional airfoils under uncertain operating conditions," NASA Langley Research Center, Hampton, VA, ICASE no. 2001-1, 2001.
32. D. Büche, G. Guidati, and P. Stoll, "Automated design optimization of compressor blades for stationary, large-scale turbomachinery," in Proc. ASME/IGTI Turbo Expo3, 2003, Paper no. GT2003-38421.
33. I. Rechenberg, Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Stuttgart, Germany: Fromman-Holzboog, 1973.
34. H.-P. Schwefel, Evolution and Optimum Seeking. New York: Wiley, 1995.
35. H.-P. Schwefel and G. Rudolph, "Contemporary evolution strategies," in Proc. 3rd Eur. Conf. Artificial Life, Granada, Spain, 1995, pp. 893-907.
36. D. Büche, "Multi-objective evolutionary optimization of gas turbine components," Ph.D. dissertation , ETH, Zürich, Switzerland, 2004.