Predicting and preventing coordination problems in cooperative Q-learning systems

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2007, Pages 780-785

  Fulda, Nancy ^a   Ventura, Dan ^a  

^a 3361 TMCB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONCEPTUAL FRAMEWORKS; COORDINATION PROBLEMS; DESIGN TOOL; MULTI-AGENT LEARNING; MULTI-AGENT SETTING; OPTIMAL SYSTEM PERFORMANCE; Q-LEARNING;

MULTI AGENT SYSTEMS;

LEARNING ALGORITHMS;

EID: 84880861539     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Michael Bowling. Convergence and noregret in multiagent learning. In Neural Information Processing Systems, pages 209-216, 2004.
2. Y. Cao, A. Fukunaga, A. Kahng, and F. Meng. Cooperative mobile robots: Antecedents and directions. Autonomous Robots, 4:1-23, 1997.
3. Caroline Claus and Craig Boutilier. The dynamics of reinforcement learning in cooperative multiagent systems. In Proceedings of the National Conference on Artificial Intelligence, pages 746-752, 1998.
4. Nancy Fulda and Dan Ventura. Dynamic joint action perception for q-learning agents. In Proceedings of the International Conference on Machine Learning and Applications, pages 73-78, 2003.
5. Nancy Fulda and Dan Ventura. Incremental policy learning: An equilibrium selection algorithm for reinforcement learning agents with common interests. In Proceedings of the International Joint Conference on Neural Networks, pages 1121-1126, 2004.
6. J. Hu and M. Wellman. Multiagent reinforcement learning: theoretical framework and an algorithm. In Proceedings of the International Conference on Machine Learning, pages 242-250, 1998.
7. J. Hu and M. Wellman. Nash q-learning for general-sum stochastic games. Journal of Machine Learning Research, 4:1039-1069, 2003.
8. S. Kapetanakis and D. Kudenko. Improving on the reinforcement learning of coordination in cooperative multi-agent systems. In Second AISB Symposium on Adaptive Agents and Multi-Agent Systems, 2002.
9. Martin Lauer and Martin Riedmiller. An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In Proceedings of the International Conference on Machine Learning, pages 535-542, 2000.
10. Michael Littman. Friend or foe q-learning in general-sum markov games. In Proceedings of the International Conference on Machine Learning, pages 322-328, 2001.
11. Pattie Maes and Rodney A. Brooks. Learning to coordinate behaviors. In Proceedings of the National Conference on Artificial Intelligence, pages 796-802, 1990.
12. M. J. Mataric. Learning social behavior. Robotics and Autonomous Systems, 20:191-204, 1997.
13. M. Mundhe and S. Sen. Evaluating concurrent reinforcement learners. In Proceedings of the International Conference on Multiagent Systems, pages 421-422, 2000.
14. Ann Nowe, Katja Verbeeck, and Tom Lenaerts. Learning agents in a homo egualis society. In Proceedings of Learning Agents Workshop, Agents 2001 Conference, 2001.
15. Andrea Schaerf, Yoav Shoham, and Moshe Tennenholtz. Adaptive load balancing: A study in multi-agent learning. Journal of Artificial Intelligence Research, 2:475-500, 1995.
16. Sandip Sen and Mahendra Sekaran. Individual learning of coordination knowledge. JETAI, 10(3):333-356, 1998.
17. Sandip Sen, Mahendra Sekaran, and John Hale. Learning to coordinate without sharing information. In Proceedings of the National Conference on Artificial Intelligence, pages 426-431, 1994.
18. Peter Stone and Manuela Veloso. Multiagent systems: A survey from a machine learning perspective. Autonomous Robots, 8(3):345-383, 2000.
19. Ming Tan. Multi-agent reinforcement learning: Independent vs. cooperative learning. In Readings in Agents, pages 487-494, 1997.
20. John N. Tsitsiklis. Asynchronous stochastic approximation and q-learning. Machine Learning, 16:185-202, 1994.
21. X. Wang and T. Sandholm. Reinforcement learning to play an optimal nash equilibrium in team markov games. In Neural Information Processing Systems, pages 1571-1578, 2002.
22. C. J. C. H.Watkins. Learning from Delayed Rewards. PhD thesis, University of Cambridge, 1989.
23. H. Peyton Young. The evolution of conventions. Econometrica, 61:57-84, 1993.