Evolving policy geometry for scalable multiagent learning

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 2, Issue , 2010, Pages 731-738

  D'Ambrosio, David B ^a   Lehman, Joel ^a   Risi, Sebastian ^a   Stanley, Kenneth O ^a  

^a University of Central Florida   (United States)

Author keywords

CPPNs; Evolutionary Computation; HyperNEAT; Multiagent learning; NEAT; Neural Networks

Indexed keywords

AUTONOMOUS AGENTS; ENCODING (SYMBOLS); EVOLUTIONARY ALGORITHMS; GEOMETRY; NEURAL NETWORKS; PERSONNEL TRAINING;

CPPNS; EVOLUTIONARY APPROACH; FURTHER TRAININGS; GEOMETRIC POSITION; HYPERNEAT; MULTI-AGENT LEARNING; NEAT; TRADITIONAL APPROACHES;

MULTI AGENT SYSTEMS;

EID: 84883071493     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. T. Aaltonen. et al. Measurement of the top quark mass with dilepton events selected using neuroevolution at CDF. Physical Review Letters, 2009.
2. P-J. Bentley and S. Kumar. The ways to grow designs: A comparison of embryogenies for an evolutionary design problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-1999), pages 35-43, San Francisco, 1999. Kaufmann.
3. J. C. Bongard. Evolving modular genetic regulatory networks. In Proceedings of the 2002 Congress on Evolutionary Computation, 2002.
4. M. Bowling and M. Veloso. Multiagent learning using a variable learning rate. Artificial Intelligence, 136(2):215-250, 2002.
5. B. D. Bryant and R. Miikkulainen. Neuroevolution for adaptive teams. In Proceedings of the 2003 Congress on Evolutionary Computation (CEC 2003), Volume 3, pages 2194-2201, Piscataway, NJ, 2003. IEEE.
6. L. Busoniu, R. Babuska, and B. De Schutter. A comprehensive survey of multi-agent reinforcement learning. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 38(2):156-172, Mar. 2008.
7. L. Busoniu, B. D. Schutter, and R. Babuska. Learning and coordination in dynamic multiagent systems. Technical Report 05-019, Delft University of Technology, 2005.
8. C. Claus and C. Boutilier. The dynamics of reinforcement learning in cooperative multiagent systems. In Proceedings of the National Conference on Artificial Intelligence, pages 746-752. John Wiley & Sons LTD, 1998.
9. J. Clune, B. E. Beckmann, C. Ofria, and R. T. Pennock. Evolving coordinated quadruped gaits with the hyperneat generative encoding. In Proc. of the Congress on Evolutionary Computation (CEC-2009) Spec. Sect, on Evolutionary Robotics, Piscataway, NJ, USA, 2009. IEEE Press.
10. J. Clune, R. T. Pennock, and C. Ofria. The sensitivity of hyperneat to different geometric representations of a problem. In Proc. of the Genetic and Evolutionary Computation Conf. (GECCO-2009), New York, NY, USA, 2009. ACM Press.
11. D. B. D'Ambrosio and K. O. Stanley. Generative encoding for multiagent learning. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2008), New York, NY, 2008. ACM Press.
12. T. N. Dupuy. The Evolution of Weapons and Warfare. Da Capo, New York, NY, USA, 1990.
13. S. Ficici and J. Pollack. A game-theoretic approach to the simple revolutionary algorithm. Lecture notes in computer science, pages 467-476, 2000.
14. J. Gauci and K. O. Stanley. A case study on the critical role of geometric regularity in machine learning. In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (AAAI-2008), Menlo Park, CA, 2008. AAAI Press.
15. J. Gauci and K. O. Stanley. Autonomous Evolution of Topographic Regularities in Artificial Neural Networks. Neural Computation Journal, 2010. To appear.
16. C. Green. SharpNEAT homepage. http://sharpneat.sourceforge.net/, 2003-2006.
17. F. Gruau, D. Whitley, and L. Pyeatt. A comparison between cellular encoding and direct encoding for genetic neural networks. In J. R. Koza, D. E. Goldberg, D. B. Fogel, and R. L. Riolo, editors, Genetic Programming 1996, pages 81-89, Cambridge, MA, 1996. MIT Press.
18. T. Haynes and S. Sen. Co-adaptation in a team. International Journal of Computational Intelligence and Organizations, 1(4):1-20, 1996.
19. G. S. Hornby and J. B. Pollack. Creating high-level components with a generative representation for body-brain evolution. Artificial Life, 8(3), 2002.
20. J. Hu and M. P. Wellman. Multiagent reinforcement learning: theoretical framework and an algorithm. In Proc. 15th International Conf. on Machine Learning, pages 242-250. Morgan Kaufmann, San Francisco, CA, 1998.
21. L. Panait and S. Luke. Cooperative multi-agent learning: The state of the art. Autonomous Agents and Multi-Agent Systems, 3(11):383-434, November 2005.
22. L. Panait, K. Tuyls, and S. Luke. Theoretical Advantages of Lenient Learners: An Evolutionary Game Theoretic Perspective. The Journal of Machine Learning Research, 9:423-457, 2008.
23. L. Panait, R. Wiegand, and S. Luke. Improving coevolutionary search for optimal multiagent behaviors. Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI), pages 653-658, 2003.
24. M. A. Potter, K. A. De Jong, and J. J. Grefenstette. A coevolutionary approach to learning sequential decision rules. In L. J. Eshelman, editor, Proc. of the Sixth Intl. Conference on Genetic Algs. San Francisco: Kaufmann, 1995.
25. B. Price and C. Boutilier. Implicit imitation in multiagent reinforcement learning. In Machine Learning, pages 325-334. Morgan Kaufmann Publishers, INC., 1999.
26. J. Secretan, N. Beato, D. B. D'Ambrosio, A. Rodriguez, A. Campbell, and K. O. Stanley. Picbreeder: Evolving pictures collaboratively online. In CHI '08: Proc. of the twenty-sixth annual SIGCHI conf. on Human factors in computing systems, pages 1759-1768, New York, NY, USA, 2008. ACM.
27. K. O. Stanley. Compositional pattern producing networks: A novel abstraction of development. Genetic Programming and Evolvable Machines Special Issue on Developmental Systems, 8(2):131-162, 2007.
28. K. O. Stanley. D. B. D'Ambrosio, and J. Gauci. A hypercube-based indirect encoding for evolving large-scale neural networks. Artificial Life, 15(2):185-212, 2009.
29. K. O. Stanley and R. Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10:99-127. 2002.
30. K. O. Stanley and R. Miikkulainen. A taxonomy for artificial embryogeny. Artificial Life, 9(2):93-130, 2003.
31. K. O. Stanley and R. Miikkulainen. Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research, 21:63-100, 2004.
32. M. Tan. Multi-agent reinforcement learning: Independent vs. cooperative agents. Readings in agents, pages 487-494, 1997.