Task switching in multirobot learning through indirect encoding

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2011, Pages 2802-2809

  D'Ambrosio, David B ^a   Lehman, Joel ^a   Risi, Sebastian ^a   Stanley, Kenneth O ^a  

^a University of Central Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HYPERNEAT; KHEPERA; MULTI-ROBOT DOMAINS; MULTI-ROBOT LEARNING; ROBOT TEAMS; TASK SWITCHING; TEAM MEMBERS;

ENCODING (SYMBOLS); GEOMETRY; INDUSTRIAL ROBOTS; LEARNING ALGORITHMS; MULTI AGENT SYSTEMS; NEURAL NETWORKS; ROBOTICS;

INTELLIGENT ROBOTS;

EID: 84455207473     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2011.6048150     Document Type: Conference Paper

References (30)

1. D. B. D'Ambrosio, J. Lehman, S. Risi, and K. O. Stanley, "Evolving policy geometry for scalable multiagent learning," in Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1. International Foundation for Autonomous Agents and Multiagent Systems, 2010, pp. 731-738.
2. D. B. D'Ambrosio and K. O. Stanley, "Generative encoding for multiagent learning," in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2008). New York, NY: ACM Press, 2008.
3. R. Makar, S. Mahadevan, and M. Ghavamzadeh, "Hierarchical multiagent reinforcement learning," in Proceedings of the fifth international conference on Autonomous agents, ser. AGENTS '01. New York, NY, USA: ACM, 2001, pp. 246-253.
4. S. Nolfi, "Using emergent modularity to develop control systems for mobile robotics," Adaptive Behavior, vol. 3-4, pp. 343-364, 1997. (Pubitemid 127094768)
5. D. Floreano and J. Urzelai, "Evolutionary robots with on-line self-organization and behavioral fitness," Neural Networks, vol. 13, pp. 431-4434, 2000.
6. J. Hu and M. P. Wellman, "Multiagent reinforcement learning: theoretical framework and an algorithm," in Proc. 15th International Conf. on Machine Learning. Morgan Kaufmann, San Francisco, CA, 1998, pp. 242-250.
7. M. Bowling and M. Veloso, "Multiagent learning using a variable learning rate," Artificial Intelligence, vol. 136, no. 2, pp. 215-250, 2002. (Pubitemid 34232184)
8. H. Santana, G. Ramalho, V. Corruble, and B. Ratitch, "Multi-agent patrolling with reinforcement learning," Autonomous Agents and Multiagent Systems, International Joint Conference on, vol. 3, pp. 1122-1129, 2004.
9. L. Busoniu, B. D. Schutter, and R. Babuska, "Learning and coordination in dynamic multiagent systems," Delft University of Technology, Tech. Rep. 05-019, 2005.
10. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents and Multi-Agent Systems, vol. 3, no. 11, pp. 383-434, November 2005.
11. L. Panait, R. Wiegand, and S. Luke, "Improving coevolutionary search for optimal multiagent behaviors," Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI), pp. 653-658, 2003.
12. S. Ficici and J. Pollack, "A game-theoretic approach to the simple coevolutionary algorithm," Lecture notes in computer science, pp. 467-476, 2000.
13. L. Panait, K. Tuyls, and S. Luke, "Theoretical Advantages of Lenient Learners: An Evolutionary Game Theoretic Perspective," The Journal of Machine Learning Research, vol. 9, pp. 423-457, 2008. (Pubitemid 351469016)
14. N. Correll and A. Martinoli, "Collective inspection of regular structures using a swarm of miniature robots," in Experimental Robotics IX, ser. Springer Tracts in Advanced Robotics, M. Ang and O. Khatib, Eds. Springer Berlin / Heidelberg, 2006, vol. 21, pp. 375-386.
15. M. Quinn, L. Smith, G. Mayley, and P. Husbands, "Evolving controllers for a homogeneous system of physical robots: Structured cooperation with minimal sensors," Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, vol. 361, no. 1811, p. 2321, 2003.
16. K. O. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evolutionary Computation, vol. 10, pp. 99-127, 2002.
17. -, "Competitive coevolution through evolutionary complexification,"Journal of Artificial Intelligence Research, vol. 21, pp. 63-100, 2004.
18. J. C. Bongard, "Evolving modular genetic regulatory networks," in Proceedings of the 2002 Congress on Evolutionary Computation, 2002.
19. K. O. Stanley, "Compositional pattern producing networks: A novel abstraction of development," Genetic Programming and Evolvable Machines Special Issue on Developmental Systems, vol. 8, no. 2, pp. 131-162, 2007.
20. K. O. Stanley and R. Miikkulainen, "A taxonomy for artificial embryogeny," Artificial Life, vol. 9, no. 2, pp. 93-130, 2003.
21. P. Verbancsics and K. O. Stanley, "Evolving static representations for task transfer," Journal of Machine Learning Research, pp. 1737-1763, 2010.
22. K. O. Stanley, D. B. D'Ambrosio, and J. Gauci, "A hypercube-based indirect encoding for evolving large-scale neural networks," Artificial Life, vol. 15, no. 2, pp. 185-212, 2009.
23. J. Gauci and K. O. Stanley, "Autonomous Evolution of Topographic Regularities in Artificial Neural Networks," Neural Computation Journal, 2010, to appear.
24. J. Clune, B. E. Beckmann, C. Ofria, and R. T. Pennock, "Evolving coordinated quadruped gaits with the hyperneat generative encoding,"in Proceedings of the IEEE Congress on Evolutionary Computation (CEC-2009) Special Section on Evolutionary Robotics. Piscataway, NJ, USA: IEEE Press, 2009.
25. E. Haasdijk, A. Rusu, and A. Eiben, "HyperNEAT for Locomotion Control in Modular Robots," Evolvable Systems: From Biology to Hardware, pp. 169-180, 2010.
26. J. Secretan, N. Beato, D. B. D'Ambrosio, A. Rodriguez, A. Campbell, and K. O. Stanley, "Picbreeder: Evolving pictures collaboratively online," in CHI '08: Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems. New York, NY, USA: ACM, 2008, pp. 1759-1768.
27. A. Almeida, G. Ramalho, H. Santana, P. Tedesco, T. Menezes, V. Corruble, and Y. Chevaleyre, "Recent advances on multi-agent patrolling,"in Advances in Artificial Intelligence SBIA 2004, ser. Lecture Notes in Computer Science, A. L. C. Bazzan and S. Labidi, Eds. Springer Berlin / Heidelberg, 2004, vol. 3171, pp. 126-138.
28. J.-S. Marier, C. Besse, and B. Chaib-draa, "Solving the continuous time multiagent patrol problem," in Robotics and Automation (ICRA), 2010 IEEE International Conference on, May 2010, pp. 941-946.
29. Webots, "http://www.cyberbotics.com," commercial Mobile Robot Simulation Software. [Online]. Available: http://www.cyberbotics.com
30. C. Green, "SharpNEAT homepage," http://sharpneat.sourceforge. net/, 2003-2006.