A general noise model and its effects on evolution strategy performance

IEEE Transactions on Evolutionary Computation

Volumn 10, Issue 4, 2006, Pages 380-391

  Arnold, Dirk V ^a   Beyer, Hans Georg ^b  

^a DALHOUSIE UNIVERSITY   (Canada)

^b VORARLBERG UNIVERSITY OF APPLIED SCIENCES   (Austria)

Author keywords

Biased or skew noise; Evolution strategies; Evolutionary optimization; Generalized noise; Outliers; Progress rate analysis

Indexed keywords

EVOLUTIONARY ALGORITHMS; MATHEMATICAL MODELS; OPTIMIZATION; SPURIOUS SIGNAL NOISE;

BIASED NOISE; EVOLUTION STRATEGIES; EVOLUTIONARY OPTIMIZATION; GENERALIZED NOISE; OUTLIERS; PROGRESS RATE ANALYSIS; SKEW NOISE;

GAUSSIAN NOISE (ELECTRONIC);

EID: 33747400562     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2005.859467     Document Type: Article

References (31)

1. J. M. Fitzpatrick and J. J. Grefenstette, "Genetic algorithms in noisy environments," Mach. Learn., vol. 3, pp. 101-120, 1988.
2. M. Rattray and J. Shapiro, "Noisy fitness evaluation in genetic algorithms and the dynamics of learning," in Foundations of Genetic Algorithms 4, R. K. Belew and M. D. Vose, Eds. San Francisco, CA: Morgan Kaufmann, 1997, pp. 117-139.
3. B. L. Miller and D. E. Goldberg, "Genetic algorithms, selection schemes, and the varying effects of noise," Evol. Comput., vol. 4, no. 2, pp. 113-131, 1997.
4. H.-G. Beyer, "Evolutionary algorithms in noisy environments: Theoretical issues and guidelines for practice," Comput. Methods in Mech. Appl. Eng., vol. 186, pp. 239-267, 2000.
5. Y. Jin and J. Branke, "Evolutionary optimization in uncertain environments - A survey," IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 303-317, 2005.
6. D. V. Arnold, Noisy Optimization with Evolution Strategies, ser. Genetic Algorithms and Evolutionary Computation. Norwell, MA: Kluwer, 2002.
7. D. V. Arnold and H.-G. Beyer, "Local performance of the (1 + 1)-ES in a noisy environment," IEEE Trans. Evol. Comput., vol. 6, no. 1, pp. 30-41, 2002.
8. I.λ)-ES in a noisy environment," in Foundations of Genetic Algorithms 6, W. N. Martin and W. M. Spears, Eds. San Francisco, CA: Morgan Kaufmann, 2001, pp. 127-141.
9. I.λ)-ES in a noisy environment," in Parallel Problem Solving from Nature - PPSN VI, M. Schoenauer, K. Deb, G. Rudolph, X. Yao, E. Lutton, J. J. M. Guervós, and H.-P. Schwefel, Eds. Heidelberg, Germany: Springer-Verlag, 2000, pp. 39-48.
10. N-search spaces disturbed by noise," Theoretical Comput. Sci., vol. 289, no. 1, pp. 629-647, 2002.
11. D. V. Arnold and H.-G. Beyer, "A comparison of evolution strategies with other direct search methods in the presence of noise," Comput. Optim. Appl., vol. 24, no. 1, pp. 135-159, 2003.
12. D. V. Arnold and H.-G. Beyer, "Performance analysis of evolutionary optimization with cumulative step length adaptation," IEEE Trans. Autom. Control, vol. 49, no. 4, pp. 617-622, 2004.
13. Y. Jin and B. Sendhoff, "Fitness approximation in evolutionary computation: A survey," in Proc. Genetic and Evol. Comput. Conf., W. B. Langdon, E. Cantú-Paz, K. E. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. E. Miller, E. Burke, and N. Jonoska, Eds., 2002, pp. 1105-1112.
14. D. Büche, P. Stoll, R. Dornberger, and P. Koumoutsakos, "Multiobjective evolutionary algorithm for the optimization of noisy combustion processes," IEEE Trans. Syst., Man, Cybern. - Part C: Appl. Rev., vol. 32, no. 4, pp. 460-473, 2002.
15. J. Branke, "Efficient evolutionary algorithms for searching robust solutions," in Adaptive Computing in Design and Manufacture, I. C. Parmee, Ed. Heidelberg, Germany: Springer-Verlag, 2000, pp. 275-285.
16. J. Branke, Evolutionary Optimization in Dynamic Environments, ser. Genetic Algorithms and Evolutionary Computation. Norwell, MA: Kluwer, 2001.
17. I,λ)-ES optimizing functions disturbed by generalized noise," in Foundations of Genetic Algorithms 7, K. A. De Jong, R. Poli, and J. Rowe, Eds. San Mateo, CA: Morgan Kaufmann, 2003, pp. 307-328.
18. B. Sendhoff, H.-G. Beyer, and M. Olhofer, "The influence of stochastic quality functions on evolutionary search," in Recent Advances in Simulated Evolution and Learning, K. C. Tan, M. H. Lim, X. Yao, and L. Wang, Eds. New York: World Scientific, 2003, pp. 152-172.
19. K. Sastry and D. Goldberg, "Genetic algorithms, efficiency enhancement, and deciding well with differing fitness bias values," in Proc. Genetic and Evol. Comput. Conference, W. B. Langdon, E. Cantú-Paz, K. E. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke, and N. Jonoska, Eds., 2002, pp. 536-543.
20. D. V. Arnold and H.-G. Beyer, "On the effects of outliers on evolutionary optimization," in Intelligent Data Engineering and Automated Learning, J. Liu, Y. Cheung, and H. Yin, Eds. Heidelberg, Germany: Springer-Verlag, 2003, pp. 151-160.
21. H.-G. Beyer, The Theory of Evolution Strategies, ser. Natural Computing. Heidelberg, Germany: Springer-Verlag, 2001.
22. I. Rechenberg, Evolutionsstrategie: Optimierung technischer Systeme nach den Prinzipien der biologischen Evolution. Stuttgart: Frommann-Holzboog, 1973.
23. N. Hansen and A. Ostermeier, "Completely derandomized self-adaptation in evolution strategies," Evol. Comput., vol. 9, no. 2, pp. 159-195, 2001.
24. I,λ)-ES on ellipsoidal fitness models disturbed by noise," in Proc. Genetic Evol. Comput., E. Cantú-Paz, J. A. Foster, K. Deb, L. D. Davis, R. Roy, U.-M. O'Reilly, H.-G. Beyer, R. Standish, G. Kendall, S. Wilson, M. Harman, J. Wegener, D. Dasgupta, M. A. Potter, A. C. Schultz, N. Jonoska, K. A. Dowsland, and J. F. Miller, Eds., 2003, pp. 525-536.
25. H. A. David and H. N. Nagaraja, "Concomitants of order statistics," in Handbook of Statistics, N. Balakrishnan and C. R. Rao, Eds. Amsterdam, The Netherlands: Elsevier, 1998, vol. 16, pp. 487-513.
26. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions. New York: Dover, 1965.
27. I. Rechenberg, Evolutionsstrategie '94. Stuttgart: Frommann-Holzboog, 1994.
28. U. Hammel and T. Bäck, "Evolution strategies on noisy functions: How to improve convergence properties," in Parallel Problem Solving from Nature - PPSN III, Y. Davidor, R. Manner, and H.-P. Schwefel, Eds. Heidelberg, Germany: Springer-Verlag, 1994, pp. 159-168.
29. H. Szu and R. Hartley, "Fast simulated annealing," Physics Letters A, vol. 122, pp. 157-162, 1987.
30. G. Rudolph, "Local convergence rates of simple evolutionary algorithms with Cauchy mutations," IEEE Trans. Evol. Comput., vol. 1, no. 4, pp. 249-258, 1997.
31. A. Stuart and J. K. Ord, Kendall's Advanced Theory of Statistics. Volume 1: Distribution Theory, 6th ed. London, U.K.: Edward Arnold, 1994.