Evolving team compositions by agent swapping

IEEE Transactions on Evolutionary Computation

Volumn 17, Issue 2, 2013, Pages 282-298

  Lichocki, Pawel ^a   Wischmann, Steffen ^a,b   Keller, Laurent ^b   Floreano, Dario ^a  

^a EPFL   (Switzerland)

^b UNIVERSITY OF LAUSANNE   (Switzerland)

Author keywords

Cooperation; crossover; evolutionary computation; multiagent systems; team composition; team optimization

Indexed keywords

COOPERATION; CROSSOVER; EVOLUTIONARY METHOD; EXPLORATION AND EXPLOITATION; INDIVIDUAL BEHAVIOR; PRE-MATURE CONVERGENCES; TEAM COMPOSITION; TEAM OPTIMIZATION;

ELECTRIC SHIP EQUIPMENT; EVOLUTIONARY ALGORITHMS; MULTI AGENT SYSTEMS;

OPTIMIZATION;

EID: 84875737730     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2012.2191292     Document Type: Article

References (90)

1. E. Bonabeau, M. Dorigo, and G. Theraulaz, Swarm Intelligence: From Natural to Artificial Systems. New York: Oxford Univ. Press, 1999.
2. E. Bonabeau, M. Dorigo, and G. Theraulaz, "Inspiration for optimization from social insect behaviour," Nature, vol. 406, no. 6791, pp. 39-42, 2000.
3. C. Reynolds, "An evolved, vision-based behavioral model of coordinated group motion," in Proc. 2nd Int. Conf. Simulat. Adap. Behavior, 1993, pp. 384-392.
4. W. Xiang and H. Lee, "Ant colony intelligence in multi-agent dynamic manufacturing scheduling," Eng. Applicat. Artif. Intell., vol. 21, no. 1, pp. 73-85, 2008.
5. G. Mathews, H. Durrant-Whyte, and M. Prokopenko, "Decentralised decision making in heterogeneous teams using anonymous optimisation," Robot. Autonomous Syst., vol. 57, no. 3, pp. 310-320, 2009.
6. M. Quinn, L. Smith, G. Mayley, and P. Husbands, "Evolving controllers for a homogeneous system of physical robots: Structured cooperation with minimal sensors," Philosophic. Trans. Royal Soc. London. Series A: Math., Phys. Eng. Sci., vol. 361, no. 1811, pp. 2321-2343, 2003.
7. M. Dorigo, V. Trianni, E. Şahin, R. Grob, T. Labella, G. Baldassarre, S. Nolfi, J. Deneubourg, F. Mondada, D. Floreano, L. M. Gambardella, "Evolving self-organizing behaviors for a swarm-bot," Autonomous Robots, vol. 17, no. 2, pp. 223-245, 2004.
8. C. Parker and H. Zhang, "Cooperative decision-making in decentralized multiple-robot systems: The best-of-n problem," IEEE/ASME Trans. Mech., vol. 14, no. 2, pp. 240-251, Apr. 2009.
9. G. Baldassarre, S. Nolfi, and D. Parisi, "Evolving mobile robots able to display collective behaviors," Artif. Life, vol. 9, no. 3, pp. 255-267, 2003.
10. S. Nolfi and D. Floreano, Evolutionary Robotics: The Biology, Intelligence, and Technology. Cambridge, MA: MIT Press, 2000.
11. H. Iba, "Emergent cooperation for multiple agents using genetic programming," in Proc. 4th Int. Conf. Parallel Problem Solv. Nat., 1996, pp. 32-41.
12. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents Multi-Agent Syst., vol. 11, no. 3, pp. 387-434, 2005.
13. M. Waibel, L. Keller, and D. Floreano, "Genetic team composition and level of selection in the evolution of cooperation," IEEE Trans. Evol. Computat., vol. 13, no. 3, pp. 648-660, Jun. 2009.
14. T. Miconi, "When evolving populations is better than coevolving individuals: The blind mice problem," in Proc. 18th Int. Joint Conf. Artif. Intell., 2003, pp. 647-652.
15. J. Bongard, "The legion system: A novel approach to evolving heterogeneity for collective problem solving," in Proc. EuroGP, 2000, pp. 16-28.
16. S. Luke and L. Spector, "Evolving teamwork and coordination with genetic programming," in Proc. 1st Annu. Conf. Genet. Program., 1996, pp. 150-156.
17. T. Haynes and S. Sen, "Crossover operators for evolving a team," in Proc. 2nd Annu. Conf. Genet. Program., 1997, pp. 162-167.
18. Y. Suzuki and T. Arita, "A comprehensive evaluation of the methods for evolving a cooperative team," Artif. Life Robot., vol. 10, no. 2, pp. 157-161, 2006.
19. K. De Jong, "Learning with genetic algorithms: An overview," Mach. Learn., vol. 3, nos. 2-3, pp. 121-138, 1988.
20. M. Brameier and W. Banzhaf, "Evolving teams of predictors with linear genetic programming," Genet. Program. Evol. Mach., vol. 2, no. 4, pp. 381-407, 2001.
21. T. Haynes and S. Sen, "Co-adaptation in a team," Int. J. Computat. Intell. Organiz., vol. 1, no. 4, pp. 1-20, 1996.
22. D. Andre and A. Teller, "Evolving team Darwin united," in Proc. RoboCup-98: Robot Soccer World Cup II, 1999, pp. 346-351.
23. S. Luke, C. Hohn, J. Farris, G. Jackson, and J. Hendler, "Co-evolving soccer softbot team coordination with genetic programming," in Proc. RoboCup-97: Robot Soccer World Cup I, 1998, pp. 398-411.
24. L. Bull, "Evolutionary computing in multi-agent environments: Operators," in Proc. 7th Int. Conf. EP, 1998, pp. 370-377.
25. A. Eiben, G. Nitschke, and M. Schut, "Collective specialization for evolutionary design of a multi-robot system," in Proc. Swarm Robot., 2007, pp. 189-205.
26. D. Floreano, S. Mitri, S. Magnenat, and L. Keller, "Evolutionary conditions for the emergence of communication in robots," Curr. Biol., vol. 17, no. 6, pp. 514-519, 2007.
27. T. Soule and R. Heckendorn, "Improving performance and cooperation in multi-agent systems," in Proc. Genet. Program. Theory Practice V, 2008, pp. 221-237.
28. G. Syswerda, "Uniform crossover in genetic algorithms," in Proc. 3rd ICGA, 1989, pp. 2-9.
29. L. Eshelman, R. Caruana, and J. Schaffer, "Biases in the crossover landscape," in Proc. 3rd ICGA, 1989, pp. 10-19.
30. K. De Jong and W. Spears, "A formal analysis of the role of multi-point crossover in genetic algorithms," Ann. Math. Artif. Intell., vol. 5, no. 1, pp. 1-26, 1992.
31. T. Nakashima, M. Takatani, M. Udo, H. Ishibuchi, and M. Nii, "Performance evaluation of an evolutionary method for robocup soccer strategies," in Proc. RoboCup 2005: Robot Soccer World Cup IX, 2006, pp. 616-623.
32. A. Hara and T. Nagao, "Emergence of cooperative behavior using ADG: Automatically Defined Groups," in Proc. GECCO, 1999, pp. 1038-1046.
33. J. Koza, "Evolving the architecture of a multi-part program in genetic programming using architecture-altering operations," in Proc. 4th Annu. Conf. Evol. Program., 1995, pp. 695-718.
34. C. Ferreira, "Gene expression programming: A new adaptive algorithm for solving problems," Complex Syst., vol. 13, no. 2, pp. 87-129, 2001.
35. M. Sebag and M. Schoenauer, "Mutation by imitation in boolean evolution strategies," in Proc. 4th Conf. PPSN, 1996, pp. 356-365.
36. S. Berman, A. Halasz, M. Hsieh, and V. Kumar, "Optimized stochastic policies for task allocation in swarms of robots," IEEE Trans. Robot., vol. 25, no. 4, pp. 927-937, Aug. 2009.
37. T. Dahl, M. Matarić, and G. Sukhatme, "Multi-robot task allocation through vacancy chain scheduling," Robot. Autonomous Syst., vol. 57, nos. 6-7, pp. 674-687, 2009.
38. S. Beshers and J. Fewell, "Models of division of labor in social insects," Annu. Rev. Entomol., vol. 46, no. 1, pp. 413-440, 2001.
39. C. Smith, A. Toth, A. Suarez, and G. Robinson, "Genetic and genomic analyses of the division of labour in insect societies," Nat. Rev. Genet., vol. 9, no. 10, pp. 735-748, 2008.
40. A. Duarte, F. Weissing, I. Pen, and L. Keller, "An evolutionary perspective on self-organized division of labor in social insects," Annu. Rev. Ecol., Evol. System., vol. 42, pp. 91-110, Dec. 2011.
41. G. Robinson, "Regulation of division of labor in insect societies," Annu. Rev. Entomol., vol. 37, no. 1, pp. 637-665, 1992.
42. D. Gordon, "The organization of work in social insect colonies," Nature, vol. 380, no. 6570, pp. 121-124, 1996.
43. J. Fewell, "Social insect networks," Science, vol. 301, no. 5641, p. 1867, 2003.
44. E. Robinson, O. Feinerman, and N. Franks, "Flexible task allocation and the organization of work in ants," Proc. Royal Soc. B: Biol. Sci., vol. 276, no. 1677, p. 4373, 2009.
45. S. Luke. (2010). A User Manual for the ECJ Evolutionary Computation Library [Online]. Available: http://www.cs.gmu.edu/∼eclab/projects/ecj/docs/ manual/manual.pdf
46. R. Brooks, "New approaches to robotics," Science, vol. 253, no. 5025, p. 1227, 1991.
47. R. Brooks, "Intelligence without representation," Artif. Intell., vol. 47, nos. 1-3, pp. 139-159, 1991.
48. T. Balch and R. Arkin, "Behavior-based formation control for multirobot teams," IEEE Trans. Robot. Automat., vol. 14, no. 6, pp. 926-939, Dec. 1998.
49. M. Campos, E. Bonabeau, G. Theraulaz, and J. Deneubourg, "Dynamic scheduling and division of labor in social insects," Adap. Behavior, vol. 8, no. 2, pp. 83-95, 2000.
50. C. Jones and M. Mataric, "Adaptive division of labor in large-scale minimalist multi-robot systems," in Proc. IEEE/RSJ Int. Conf. IROS, Oct. 2003, vol. 2, pp. 1969-1974.
51. M. Matarić, G. Sukhatme, and E. Østergaard, "Multi-robot task allocation in uncertain environments," Autonomous Robots, vol. 14, no. 2, pp. 255-263, 2003.
52. W. Agassounon and A. Martinoli, "Efficiency and robustness of threshold-based distributed allocation algorithms in multi-agent systems," in Proc. 1st Int. Joint Conf. Autonomous Agents Multiagent Syst.: Part 3, 2002, pp. 1090-1097.
53. P. Lichocki, K. Krawiec, and W. Jaśkowski, "Evolving teams of cooperating agents for real-time strategy game," in Proc. EvoWorkshops Applicat. Evol. Comput., 2009, pp. 333-342.
54. M. Preuss, N. Beume, H. Danielsiek, T. Hein, B. Naujoks, N. Piatkowski, R. Ster, A. Thom, and S. Wessing, "Towards intelligent team composition and maneuvering in real-time strategy games," IEEE Trans. Computat. Intell. AI Games, vol. 2, no. 2, pp. 82-98, Jun. 2010.
55. M. Dorigo, M. Birattari, and T. Stutzle, "Ant colony optimization," IEEE Computat. Intell. Mag., vol. 1, no. 4, pp. 28-39, Nov. 2006.
56. T. White, B. Pagurek, and F. Oppacher, "ASGA: Improving the ant system by integration with genetic algorithms," in Proc. 3rd Annu. Conf. Genet. Program., 1998, pp. 610-617.
57. P. Lichocki, D. Tarapore, L. Keller, and D. Floreano, "Neural networks as mechanisms to regulate division of labor," Am. Naturalist, vol. 179, no. 3, pp. 391-400, 2012.
58. S. Goings, J. Clune, C. Ofria, and R. Pennock, "Kin selection: The rise and fall of kin-cheaters," in Proc. 9th Int. Conf. Simul. Syn. Living Syst. Artif. Life, 2004, pp. 303-308.
59. S. Mitri, D. Floreano, and L. Keller, "The evolution of information suppression in communicating robots with conflicting interests," Proc. Nat. Acad. Sci., vol. 106, no. 37, pp. 15786-15790, 2009.
60. M. Waibel, D. Floreano, and L. Keller, "A quantitative test of Hamilton's rule for the evolution of altruism," PLoS Biol., vol. 9, no. 5, p. e1000615, 2011.
61. Y. Shoham and K. Leyton-Brown, Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge, MA: Cambridge Univ. Press, 2009.
62. M. Waibel, D. Floreano, S. Magnenat, and L. Keller, "Division of labour and colony efficiency in social insects: Effects of interactions between genetic architecture, colony kin structure and rate of perturbations," Proc. Royal Soc. B: Biol. Sci., vol. 273, no. 1595, pp. 1815-1823, 2006.
63. D. Goldberg, K. Deb, and J. Clark, "Genetic algorithms, noise, and the sizing of populations," Complex Syst., vol. 6, no. 4, pp. 333-362, 1991.
64. K. De Jong, "Genetic algorithms are not function optimizers," in Proc. 2nd Workshop Found. Genet. Algorithms, 1993, pp. 5-17.
65. L. Whitley, "Fundamental principles of deception in genetic search," in Proc. 1st Workshop Found. Genet. Algorithms, 1991, pp. 221-241.
66. J. Horn and D. Goldberg, "Genetic algorithm difficulty and the modality of fitness landscapes," in Proc. 3rd Workshop Found. Genet. Algorithms, 1994, pp. 243-269.
67. R. Page, Jr., and S. Mitchell, "Self-organization and the evolution of division of labor," Apidologie, vol. 29, nos. 1-2, pp. 171-190, 1998.
68. E. Bonabeau, G. Theraulaz, and J. Deneubourg, "Quantitative study of the fixed threshold model for the regulation of division of labour in insect societies," Proc. Biol. Sci., vol. 263, no. 1376, pp. 1565-1569, 1996.
69. D. Tarapore, D. Floreano, and L. Keller, "Task-dependent influence of genetic architecture and mating frequency on division of labour in social insect societies," Behavioral Ecol. Sociobiol., vol. 64, no. 4, pp. 675-684, 2010.
70. T. Miconi, "A collective genetic algorithm," in Proc. GECCO, 2001, pp. 876-883.
71. G. Werner and M. Dyer, "Evolution of communication in artificial organisms," in Proc. 2nd Int. Conf. Artif. Life, 1991, pp. 659-687.
72. S. Ficici, R. Watson, and J. Pollack, "Embodied evolution: A response to challenges in evolutionary robotics," in Proc. 8th Eur. Workshop Learn. Robots, 1999, pp. 14-22.
73. K. Stanley, B. Bryant, and R. Miikkulainen, "Real-time neuroevolution in the nero video game," IEEE Trans. Evol. Computat., vol. 9, no. 6, pp. 653-668, Dec. 2005.
74. R. Watson, S. Ficici, and J. Pollack, "Embodied evolution: Distributing an evolutionary algorithm in a population of robots," Robot. Autonomous Syst., vol. 39, no. 1, pp. 1-18, 2002.
75. L. Spector, J. Klein, C. Perry, and M. Feinstein, "Emergence of collective behavior in evolving populations of flying agents," Genet. Program. Evol. Mach., vol. 6, no. 1, pp. 111-125, 2005.
76. C. Ward, F. Gobet, and G. Kendall, "Evolving collective behavior in an artificial ecology," Artif. Life, vol. 7, no. 2, pp. 191-209, 2001.
77. E. Simoes and D. Barone, "Predation: An approach to improving the evolution of real robots with a distributed evolutionary controller," in Proc. IEEE ICRA, Aug. 2002, vol. 1, pp. 664-669.
78. R. Bianco and S. Nolfi, "Toward open-ended evolutionary robotics: Evolving elementary robotic units able to self-assemble and self-reproduce, " Connect. Sci., vol. 16, no. 4, pp. 227-248, 2004.
79. A. Agah and G. Bekey, "Phylogenetic and ontogenetic learning in a colony of interacting robots," Autonomous Robots, vol. 4, no. 1, pp. 85-100, 1997.
80. A. Cangelosi and D. Parisi, "The emergence of a 'language' in an evolving population of neural networks," Connect. Sci., vol. 10, no. 2, pp. 83-97, 1998.
81. M. Quinn, "A comparison of approaches to the evolution of homogeneous multi-robot teams," in Proc. CEC, 2001, vol. 1, pp. 128-135.
82. A. Agah and K. Tanie, "Robots playing to win: Evolutionary soccer strategies," in Proc. IEEE ICRA, Apr. 1997, vol. 1, pp. 632-637.
83. M. Potter and K. De Jong, "A cooperative coevolutionary approach to function optimization," in Proc. 3rd Int. Conf. PPSN, 1994, pp. 249-257.
84. M. A. Potter and D. V. De Jong, "Cooperative coevolution: An architecture for evolving coadapted subcomponents," Evol. Computat., vol. 8, no. 1, pp. 1-29, 2000.
85. R. Wiegand, W. Liles, and K. De Jong, "An empirical analysis of collaboration methods in cooperative coevolutionary algorithms," in Proc. GECCO, 2001, pp. 1235-1242.
86. M. Mirolli and D. Parisi, "How can we explain the emergence of a language that benefits the hearer but not the speaker?" Connect. Sci., vol. 17, no. 3, pp. 307-324, 2005.
87. L. Panait, S. Luke, and R. Wiegand, "Biasing coevolutionary search for optimal multiagent behaviors," IEEE Trans. Evol. Computat., vol. 10, no. 6, pp. 629-645, Dec. 2006.
88. H. Botee and E. Bonabeau, "Evolving ant colony optimization," Complex Syst., vol. 1, no. 2, pp. 149-159, 1998.
89. A. Agogino, K. Stanley, and R. Miikkulainen, "Online interactive neuro-evolution," Neural Process. Lett., vol. 11, no. 1, pp. 29-38, 2000.
90. J. Grefenstette, "Credit assignment in rule discovery systems based on genetic algorithms," Mach. Learn., vol. 3, no. 2, pp. 225-245, 1988.