A game-theoretic and dynamical-systems analysis of selection methods in coevolution

IEEE Transactions on Evolutionary Computation

Volumn 9, Issue 6, 2005, Pages 580-602

  Ficici, Sevan G ^a   Melnik, Ofer ^b   Pollack, Jordan B ^c  

^a HARVARD UNIVERSITY   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c BRANDEIS UNIVERSITY   (United States)

Author keywords

Coevolutionary algorithms; Dynamical systems; Game theory; Selection methods; Solution concepts

Indexed keywords

CHAOS THEORY; CONVERGENCE OF NUMERICAL METHODS; GAME THEORY; MATHEMATICAL MODELS; SYSTEMS ANALYSIS;

COEVOLUTIONARY ALGORITHMS; SELECTION METHODS; SOLUTION CONCEPTS;

EVOLUTIONARY ALGORITHMS;

EID: 29244465537     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2005.856203     Document Type: Article

References (59)

1. C. D. Rosin and R. Belew, "New methods for competitive coevolution," Evol. Comput., vol. 5, no. 1, pp. 1-29, 1997.
2. J. Cartlidge and S. Bullock, "Learning lessons from the common cold: How reducing parasite virulence improves coevolutionary optimization," in Proc. Congr. Evol. Comput., D. B. Fogel, M. A. El-Sharkawi, and X. Yao, Eds, 2002, pp. 1420-1425.
3. J. M. Smith, Evolution and the Theory of Games. Cambridge, U.K.: Cambridge Univ. Press, 1982.
4. J. Hofbauer and K. Sigmund, Evolutionary Games and Population Dynamics. Cambridge, U.K.: Cambridge Univ. Press, 1998.
5. J. Weibull, Evolutionary Game Theory. Cambridge, MA: MIT Press, 1995.
6. L. Samuelson, Evolutionary Games and Equilibrium Selection. Cambridge, MA: MIT Press, 1997.
7. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA: MIT Press, 1998.
8. D. E. Goldberg and K. Deb, "A comparative analysis of selection schemes used in genetic algorithms," in Foundations of Genetic Algorithms (FOGA 1), G. J. Rawlins, Ed., 1991, pp. 69-93.
9. P. J. Hancock, "An empirical comparison of selection methods in evolutionary algorithms," in Lecture Notes in Computer Science, T. C. Fogarty, Ed. New York: Springer-Verlag, 1994, vol. 865, Proc. Evol. Comput. (AISB Workshop), pp. 80-94.
10. T. Blickle and L. Thiele, "A comparison of selection schemes used in evolutionary algorithms," Evol. Comput., vol. 4, no. 4, pp. 361-394, 1996.
11. M. Mitchell, An Introduction to Genetic Algorithms. Cambridge,MA: MIT Press, 1996.
12. E. Cantú-Paz, "Order statistics and selection methods of evolutionary algorithms," Inf. Process. Lett., vol. 82, no. 1, pp. 15-22, 2002.
13. S. G. Ficici, O. Melnik, and J. B. Pollack, "A game-theoretic investigation of selection methods used in evolutionary algorithms," in Proc. 2000 Congr. Evol. Comput., A. Zalzala et al., Eds., 2000, pp. 880-887.
14. J. M. Smith and G. R. Price, "The logic of animal conflict," Nature, vol. 246, pp. 15-18, 1973.
15. M. A. Nowak, A. Sasaki, C. Taylor, and D. Fudenberg, "Emergence of cooperation and evolutionary stability in finite populations," Nature, vol. 428, pp. 646-650, Apr. 2004.
16. G. B. Fogel, P. C. Andrews, and D. B. Fogel, "On the instability of evolutionary stable strategies in small populations," Ecological Modeling, vol. 109, pp. 283-294, 1998.
17. J. Nash, "Noncooperative games," Ann. Math., ser. 2nd, vol. 54, no. 2, pp. 286-295, 1951.
18. D. Fudenberg and J. Tirole, Game Theory. Cambridge, MA: MIT Press, 1998.
19. D. Bishop and C. Cannings, "A generalized war of attrition," J. Theor. Biol., vol. 70, pp. 85-124, 1978.
20. R. Dawkins, The Selfish Gene. London, U.K.: Oxford Univ. Press, 1989.
21. S. H. Strogatz, Nonlinear Dynamics and Chaos. Reading, MA: Addison-Wesley, 1994.
22. B. Skyrms, "Chaos and the explanatory significance of equilibrium: Strange attractors in evolutionary game dynamics," in Proc. Biennial Meeting Philos. Sci. Assoc., vol. 2, 1992, pp. 374-394.
23. D. B. Fogel, "An overview of evolutionary programming," in Evolutionary Algorithms. ser. IMA Volumes in Mathematics and its Applications, L. D. Davis, K. De Jong, M. D. Vase, and L. D. Whitley, Eds. Berlin, Germany: Springer-Verlag, 1997, pp. 89-109.
24. D. B. Fogel, G. B. Fogel, and P. C. Andrews, "On the instability of evolutionary stable states," BioSystems, vol. 44, pp. 135-152, 1997.
25. H.-O. Peitgen, H. Jürgens, and D. Saupe, Chaos and Fractals: New Frontiers of Science. New York: Springer-Verlag, 1992.
26. T. Bäck, "Evolution strategies: An alternative evolutionary algorithm," in Lecture Notes in Computer Science, J.-M. Alliot, E. Lutton, E. Ronald, M. Schoenauer, and D. Snyers, Eds., 1996, vol. 1063, Proc. Eur. Conf. Artif. Evol., pp. 3-20.
27. H.-P. Schwefel, Evolution and Optimum Seeking. New York: Wiley, 1995.
28. J. Grefenstette, "Rank-based selection," in Handbook of Evolutionary Computation, T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds. Bristol, U.K.: Inst. Physics, 1997, ch. C2.4.
29. J. E. Baker, "Adaptive selection methods for genetic algorithms," in Proc. 1st Int. Conf. Genetic Algorithms, J. J. Grefenstette, Ed., 1988, pp. 101-111.
30. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
31. T. Blickle, "Tournament selection," in Handbook of Evolutionary Computation, T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds. Bristol, U.K.: Inst. Physics, 1997, ch. C2.3.
32. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing. New York: Wiley, 1989.
33. M. de la Maza and B. Tidor, "An analysis of selection procedures with particular attention paid to proportional and Boltzmann selection," in Proc. 5th Int. Conf. Genetic Algorithms, S. Forrest, Ed., 1993, pp. 124-131.
34. S. W. Mahfoud, "Boltzmann selection," in Handbook of Evolutionary Computation, T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds. Bristol, U.K.: Inst. Physics, 1997, ch. C2.5.
35. N. Metropolis, M. Stein, and P. Stein, "On finite limit sets for transformations on the unit interval," J. Combinatorial Theory (A), vol. 15, pp. 25-44, 1973.
36. D. B. Fogel, "Other selection methods," in Handbook of Evolutionary Computation, T. Bäck, D. B. Fogel, and Z. Michalewicz, Eds. Bristol, U.K.: Inst. Physics, 1997, ch. C2.6.
37. P. J. Angeline and J. B. Pollack, "Competitive environments evolve better solutions for complex tasks:' in Proc. 5th Int. Conf. Genetic Algorithms, S. Forrest, Ed., 1993, pp. 264-270.
38. C. W. Reynolds, "Competition, coevolution and the game of tag," in Artificial Life IV, R. A. Brooks and P. Maes, Eds. Cambridge, MA: MIT Press, 1994, pp. 59-69.
39. S. Nolfi and D. Floreano, "Co-evolving predator and prey robots: Do 'arm races' arise in artificial evolution?," Artificial Life, vol. 4, no. 4, pp. 311-335, 1998.
40. J. B. Pollack and A. D. Blair, "Co-evolution in the successful learning of backgammon strategy," Machine Learning, vol. 32, no. 3, pp. 225-240, 1998.
41. K. Chellapilla and D. B. Fogel, "Evolving neural networks to play checkers without expert knowledge," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1382-1391, 1999.
42. D. B. Fogel, T. Hays, S. Hahn, and J. Quon, "A self-learning evolutionary chess program," Proc. IEEE, vol. 92, no. 12, pp. 1947-1954, 2004.
43. D. Hillis, "Co-evolving parasites improves simulated evolution as an optimization procedure," Physica D, vol. 42, pp. 228-234, 1990.
44. L. Pagie and P. Hogeweg, "Evolutionary consequences of coevolving targets," Evol. Comput., vol. 5, no. 4, pp. 401-418, 1997.
45. H. Juillé and J. B. Pollack et al., "Coevolving the 'ideal' trainer: Application to the discovery of cellular automata rules" in Proc. 3rd Annu. Genetic Program. Conf., J. R. Koza et al., Eds., 1998, pp. 519-527.
46. S. G. Ficici and J. B. Pollack, "Game theory and the simple coevolutionary algorithm: Some results on fitness sharing," in Proc. Genetic Evol. Comput. Conf. Workshop Program, R. Heckendorn, Ed., 2001, pp. 2-7.
47. S. G. Ficici, "Solution Concepts in Coevolutionary Algorithms" Ph.D. dissertation, Brandeis Univ., Waltham, MA, May 2004.
48. D. B. Fogel and H.-G. Beyer, "Do evolutionary processes minimize expected losses?" J. Theor Biol., vol. 207, pp. 117-123, 2000.
49. D. B. Fogel and G. B. Fogel, "Evolutionary stable strategies are not always stable under evolutionary dynamics" in Evolutionary Programming IV, J. McDonnell, R. Reynolds, and D. B. Fogel, Eds. Cambridge, MA: MIT Press, 1995, pp. 565-577.
50. S. G. Ficici and J. B. Pollack et al., "Effects of finite populations on evolutionary stable strategies," in Proc. 2000 Genetic Evol. Comput, Conf., L. D. Whitley et al., Eds., 2000, pp. 927-934.
51. S. G. Ficici and J. B. Pollack et al., "Finite-population dynamics in games with polymorphic attractors" Comput. Sci. Dept., Brandeis Univ., Waltham, MA, Tech. Rep. CS-05-257, 2005.
52. R. Axelrod, The Evolution of Cooperation. New York: Basic Books, 1984.
53. M. A. Nowak and K. Sigmund, "Game-dynamical aspects of the prisoner's dilemma," Appl. Math. Comput., vol. 30, pp. 191-213, 1989.
54. R. Axelrod, "The evolution of strategies in the iterated prisoner's dilemma," in Genetic Algorithms and Simulated Annealing, L. Davis, Ed. San Mateo, CA: Morgan Kaufmann, 1987, pp. 32-41.
55. R. L. Riolo, M. D. Cohen, and R. Axelrod, "Evolution of cooperation without reciprocity," Nature, vol. 414, pp. 441-443, 2001.
56. N. Meuleau and C. Lattaud, "The artificial evolution of cooperation," in Lecture Notes in Computer Science, J.-M. Alliot, E. Lutton, E. Ronald, M. Schoenauer, and D. Snyers, Eds. New York: Springer-Verlag, 1996, vol. 1063, Proc. Eur. Conf. Artif. Evol., pp. 159-180.
57. A. Katok and B. Hasselblatt, Introduction to the Modern Theory of Dynamical Systems. Cambridge, U.K.: Cambridge Univ. Press, 1995.
58. R. W. Easton, Geometric Methods for Discrete Dynamical Systems. London, U.K.: Oxford Univ. Press, 1998.
59. T. Yi, Y. Qi-Sen, J. Zhi-Gang, and W. Zu-Wang, "Evolutionarily stable strategy, stable state, periodic cycle and chaos in a simple discrete time two-phenotype model," J. Theor. Biol., vol. 188, pp. 21-27, 1997.