Local function approximation in evolutionary algorithms for the optimization of costly functions

IEEE Transactions on Evolutionary Computation

Volumn 8, Issue 5, 2004, Pages 490-505

  Regis, Rommel G ^a   Shoemaker, Christine A ^a  

^a School of Civil and Environmental Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; ESTIMATION; FINITE ELEMENT METHOD; FUNCTIONS; GLOBAL OPTIMIZATION; INTERPOLATION; NONLINEAR SYSTEMS; QUADRATIC PROGRAMMING; RADIAL BASIS FUNCTION NETWORKS; REGRESSION ANALYSIS; STATISTICAL TESTS;

COMPLEX NONLINEAR FINITE ELEMENT SIMULATION MODEL; COSTLY FUNCTIONS; EVOLUTION STRATEGY; LATIN HYBERCUBE DESIGN; LOCAL FUNCTION APPROXIMATION; QUADRATIC REGRESSION;

EVOLUTIONARY ALGORITHMS;

EID: 7744229939     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2004.835247     Document Type: Article

References (61)

1. G. E. P. Box and N. R. Draper, [i Empirical Model-Building and Response Surfaces i]. New York: Wiley, 1987.
2. A. I. Khuri and J. A. Cornell, [i Response Surfaces i]. New York: Marcel Dekker, 1987.
3. R. H. Myers and D. C. Montgomery, [i Response Surface Methodology: Process and Product Optimization Using Designed Experiments i]. New York: Wiley, 1995.
4. D. Jones, "A taxonomy of global optimization methods based on response surfaces," [i J. Global Opt. i], vol. 21, no. 4, pp. 345-383, 2001.
5. D. R. Jones, M. Schonlau, and W. J. Welch, "Efficient global optimization of expensive black-box functions," [i J. Global Opt. i], vol. 13, no. 4, pp. 455-492, 1998.
6. J. Sacks, W. J. Welch, T. J. Mitchell, and H. P. Wynn, "Design and analysis of computer experiments," [i Statist. Sci. i], vol. 4, no. 4, pp. 409-435, 1989.
7. T. W. Simpson, T. M. Mauery, J. J. Korte, and F. Mistree, "Comparison of response surface and kriging models for multidisciplinary design optimization," in [i Proc. 7th AIAA/USAF/NASA/ISSMO Symp. Multidisciplinary Analysis Optimization i], vol. 1, St. Louis, MO, 1998, pp. 381-391
8. M. Björkman and K. Holmström, "Global optimization of costly nonconvex functions using radial basis functions," [i Opt. Eng. i], vol. 1, no. 4, pp. 373-397, 2000.
9. H.-M. Gutmann, "Radial basis function methods for global optimization," Ph.D. dissertation, Dept. Applied Math. Theor. Phy., Univ. Cambridge, Cambridge, U.K., Sept. 2001.
10. H.-M. Gutmann, "A radial basis function method for global optimization," [i J. Global Opt. i], vol. 19, no. 3, pp. 201-227, 2001.
11. T. Ishikawa and M. Matsunami, "An optimization method based on radial basis functions," [i IEEE Trans. Mag. i], vol. 33, pp. 1868-1871, Mar. 1997.
12. T. Ishikawa, Y. Tsukui, and M. Matsunami, "A combined method for the global optimization using radial basis function and deterministic approach," [i IEEE Trans. Mag. i], vol. 35, pp. 1730-1733, May 1999.
13. M. J. D. Powell, "The theory of radial basis function approximation in 1990," in [i Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions i], W. Light, Ed. London, U.K.: Oxford Univ. Press, 1992, pp. 105-210.
14. M. J. D. Powell, "Recent research at cambridge on radial basis functions," in [i New Developments in Approximation Theory, International Series of Numerical Mathematics, Volume 132 i], M. Muller, M. Buhmann, D. Mache, and M. Felten, Eds, Basel: Birkhauser Verlag, 1999, pp. 215-232.
15. W. Chen and S. Varadarajan, "Integration of design of experiments and artificial neural networks for achieving affordable concurrent design," presented at the 38th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, Materials Conf. AIAA/ASME/AHS Adaptive Structures Forum, Kissimmee, FL, 1997. AIAA-97-1230.
16. W. Liu and S. M. Batill, "Gradient-enhanced neural network response surface approximations," presented at the AIAA Multidisciplinary Analysis and Optimization Conf. Exhibit, Long Beach, CA, 2000. AIAA Paper 2000-4923.
17. D. Padmanabhan and S. M. Batill, "An iterative concurrent subspace robust design framework," presented at the AIAA Multidisciplinary Analysis and Optimization Conf. Exhibit, Long Beach, CA, 2000. AIAA Paper 2000-4841.
18. R. S. Sellar and S. M. Batill, "Concurrent subspace optimization using gradient-enhanced neural network approximations," presented at the 6th Annu. AIAA/NASA/ISSMO Symp. Multidisciplinary Analysis Optimization, Bellevue, WA, 1996. AIAA Paper 96-4019.
19. R. S. Sellar, S. M. Batill, and J. E. Renaud, "Response surface based, concurrent subspace optimization for multidisciplinary system design," presented at the AIAA Aerospace Sciences Meeting and Exhibit, Reno, NV, 1996. AIAA Paper 96-0714.
20. A. Ratle, "Accelerating the convergence of evolutionary algorithms by fitness landscape approximation," in [i Parallel Problem Solving from Nature - PPSN V, Springer Verlag, Lecture Notes in Computer Science i], T. Bäck, A. E. Eiben, M. Schoenauer, and H.-P. Schwefel, Eds. Berlin, Germany: Springer-Verlag, 1998, pp. 87-96.
21. A. Ratle, "Optimal sampling strategies for learning a fitness model," in [i Proc. 1999 Congr. Evolutionary Computation i], vol. 3, Washington, DC, 1999, pp. 2078-2085.
22. M. El-Beltagy, P. Nair, and A. Keane, "Metamodeling techniques for evolutionary optimization of computationally expensive problems: Promises and limitations," in [i Proc. Genetic Evolutionary Computation Conf., Vol. 1 i], W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith, Eds. San Francisco, CA, 1999, pp. 196-203.
23. M. A. El-Beltagy and A. J. Keane, "Evolutionary optimization for computationally expensive problems using Gaussian processes," in [i Proc. Int. Conf. Artificial Intelligence IC-AI'2001, Vol. II i], H. Arabnia, Ed.. Las Vegas, NV, 2001, pp. 708-714.
24. Y. Jin, M. Olhofer, and B. Sendhoff, "On evolutionary optimization with approximate fitness functions," in [i Proc. Genetic Evolutionary Computation Conf. i], Las Vegas, NV, 2000, pp. 786-792.
25. Y. Jin, "Managing approximate models in evolutionary aerodynamic design optimization," in [i Proc. IEEE Congr. Evolutionary Computation i], vol. 1, Seoul, Korea, May 2001, pp. 592-599.
26. Y. Jin, "A framework for evolutionary optimization with approximate fitness functions," [i IEEE Trans. Evol. Comput. i], vol. 6, pp. 481-494, Oct. 2002.
27. K. Rasheed, "An incremental-approximate-clustering approach for developing dynamic reduced models for design optimization," in [i Proc. Congr. Evolutionary Computation (CEC) i], 2000, pp. 986-993.
28. K. Rasheed, X. Ni, and S. Vattam, "Comparison of methods for developing dynamic reduced models for design optimization," in [i Proc. Congr. Evolutionary Computation ( CEC) i], 2002, pp. 390-395.
29. Y. Jin, "Fitness approximation in evolutionary computation - A survey," in [i Proc. Genetic Evolutionary Computation Conf. ( GECCO i], New York, July 2002, pp. 1105-1112.
30. K. Rasheed, S. Vattam, and X. Ni, "Comparison of methods for using reduced models to speed up design optimization," in [i Proc. Genetic Evolutionary Computation Conf. (GECCO) i], 2002, pp. 1180-1187.
31. H.-M. Gutmann, "On the semi-norm of radial basis function interpolants," Dept. Applied Math. Theor. Phy., Univ. Cambridge, Cambridge, U.K., Tech. Rep. DAMTP 2000/NA04, 2000.
32. [i Handbook of Statistics, 13: Design and Analysis of Computer Experiments i], S. Ghosh and C. R. Rao, Eds., North-Holland, Amsterdam, The Netherlands, 1996, pp. 261-308. J. R. Koehler, A. B. Owen, "Computer experiments".
33. M. D. Morris and T. J. Mitchell, "Exploratory designs for computational experiments," [i J. Statis. Planning Inference i], vol. 43, pp. 381-402, 1995.
34. K. Q. Ye, W. Li, and A. Sudjianto, "Algorithmic construction of orthogonal symmetric latin hypercube designs," [i J. Statis. Planning Inference i], vol. 90, pp. 145-159, 2000.
35. H.-P. Schwefel, [i Numerische Optimierung von Computer-Modellen mittels der Evolutionsstrategie, Vol. 26 of Interdisciplinary Systems Research i], Basel: Birkhäuser, 1977.
36. J.-H. Yoon and C. A. Shoemaker, "Comparison of optimization methods for ground-water bioremediation," [i J. Water Resources Planning Manage. i], vol. 125, pp. 54-63, 1999.
37. L. C. W. Dixon and G. Szegö, "The global optimization problem: An introduction," in [i Toward Global Optimization 2 i], L. C. W. Dixon and G. Szegö, Eds. Amsterdam, The Netherlands: North-Holland, 1978, pp. 1-15.
38. L. A. Rastrigin, [i Systems of Extremal Control i] Nauka, Moscow, 1974. in Russian.
39. D. H. Ackley, [i A Connectionist Machine for Genetic Hillclimbing i]. Norwell, MA: Kluwer, 1987.
40. T. Bäck and H.-P. Schwefel, "Evolutionary computation: An overview," in [i Proc. 1996 IEEE Int. Conf. Evolutionary Computation i], 1996, pp. 20-29.
41. T. Bäck, [i Evolutionary Algorithms in Theory and Practice i]. New York: Oxford Univ. Press, 1996.
42. D. B. Fogel, [i Evolutionary Computation: Toward a New Philosophy of Machine Intelligence i]. Piscataway, New Jersey: IEEE Press, 1995.
43. J. H. Holland, "Outline for a logical theory of adaptive systems," [i J. Assoc. Comput. Mach. i], vol. 3, pp. 297-314, 1962.
44. J. H. Holland, [i Adaptation in Natural and Artificial Systems i]. Ann Arbor, MI: Univ. Michigan Press, 1975.
45. I. Rechenberg, [i Cybernetic Solution Path of an Experimental Problem i]. Farnborough, Hants., UK: Royal Aircraft Establishment, Aug. 1965, Library translation no. 1122.
46. I. Rechenberg, [i Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution i]. Stuttgart, Germany: Frommann-Holzboog, 1973.
47. I. Rechenberg, [i Evolutionsstragie '94 Volume 1 of Werkstatt Bionik und Evolutionstechnik i]. Stuttgart, Germany: Frommann-Holzboog, 1994.
48. H.-P. Schwefel, [i Kybernetische Evolution als Strategie der experimentellen Forschung in der Strömungstechnik i], Berlin: Diplomarbeit, Technische Universität, 1965.
49. H.-P. Schwefel, [i Numerical Optimization of Computer Experiments i]. Chichester, U.K.: Wiley, 1981.
50. H.-P. Schwefel, [i Evolution and Optimum Seeking i], ser. Sixth-Generation Computer Technology Series. New York: Wiley, 1995.
51. L. J. Fogel, "Toward inductive inference automata," in [i Proc. Int. Federation Information Processing Congr. i], Munich, Germany, 1962, pp. 395-399.
52. L. J. Fogel, A. J. Owens, and M. J. Walsh, [i Artificial Intelligence through Simulated Evolution i]. New York: Wiley, 1966.
53. M. McKay, R. Beckman, and W. Conover, "A comparison of three methods for selecting values of input variables in the analysis of output from a computer code," [i Technometrics i], vol. 21, pp. 239-246, 1979.
54. S. Taylor, "Modeling enhanced in-situ biodegradation in groundwater: Model response to biological parameter uncertainty," in [i Proc. 1993 Groundwater Modeling Conf. i]. Golden, CO, pp. 4-51-4-60.
55. T. B. Culver and C. A. Shoemaker, "Dynamic optimal control for groundwater remediation with flexible management periods," [i Water Resources Res. i], vol. 28, no. 3, pp. 629-641, 1992.
56. C. A. Shoemaker, P. Mugunthan, and R. G. Regis, "Function approximation optimization for costly nonlinear models with environmental examples," presented at the 2003 INFORMS Annu. Meeting, Atlanta, GA.
57. C. A. Shoemaker, M. Willis, W. Zhang, and J. Gossett, "Model analysis of reductive dechlorination with data from cape canaveral field site," in [i Innovative Methods in Support of Bioremediation i], V. Magar, T. Vogel, C. Aelion, and A. Leeson, Eds. Columbus, OH: Battelle, 2001, pp. 125-131.
58. H.-P. Schwefel, "Collective phenomena in evolutionary systems," in [i Preprints of the 31st Annu. Meeting Int. Soc. for General System Research i], vol. 2, Budapest, June 1987, pp. 1025-1033.
59. J. Neter, W. Wasserman, and M. H. Kutner, [i Applied Linear Statistical Models i]. Burr Ridge, IL: Richard D. Irwin, Inc., 985.
60. R. G. Miller Jr., [i Simultaneous Statistical Inference i]. New York: Springer-Verlag, 1981.
61. P. J. Bickel and K. A. Doksum, [i Mathematical Statistics i]. Englewood Cliffs, NJ: Prentice-Hall, 1977.