A reinforcement learning scheme for a partially-observable multi-agent game

Machine Learning

Volumn 59, Issue 1-2, 2005, Pages 31-54

  Ishii, Shin ^a   Fujita, Hajime ^b   Mitsutake, Masaoki ^b   Yamazaki, Tatsuya ^c   Matsuda, Jun ^d   Matsuno, Yoichiro ^e  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^c NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^d OSAKA GAKUIN UNIVERSITY   (Japan)

^e RICOH COMPANY LTD   (Japan)

Author keywords

Card game; Model based; Multi agent system; POMDP; Reinforcement learning

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; INFORMATION RETRIEVAL; LEARNING SYSTEMS; MARKOV PROCESSES;

CARD GAME; MODEL-BASED; MULTI-AGENT SYSTEM; POMDP; REINFORCEMENT LEARNING;

GAME THEORY;

EID: 21244489639     PISSN: 08856125     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10994-005-0461-8     Document Type: Article

References (23)

1. Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983). Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans. Syst., Man. & Cybern., 13, 834-846.
2. Blair, J. R. S., Mutchler, D., & Lent, M. (1995). Perfect recall and pruning in games with imperfect information. Computational Intelligence, 12, 131-154.
3. Crites, R. H. (1996). Large-scale dynamic optimization using teams of reinforcement learning agents. Ph.D. thesis, University of Massachusetts, Amherst.
4. Crites, R. H., & Barto, A. G. (1996). Elevator group control using multiple reinforcement learning agents. Machine Learning, 33, 235-262.
5. Ginsberg, M. (2001). Gib: Imperfect information in a computationally challenging fame. Journal of Artificial Intelligence Research, 14, 303-358.
6. Hu, J., & Wellman, M. P. (1998). Multiagent reinforcement learning: Theoretical framework and an algorithm. In Proceedings of the Fifteenth International Conference on Machine learning (pp. 242-250).
7. Ishii, S., Yoshida, W., & Yoshimoto, J. (2002). Control of exploitation-exploration meta-parameter in reinforcement learning. Neural Networks, 15, 665-687.
8. Kaelbling, L. P., Littman, M. L., & Cassandra, A. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99-134.
9. Lin, L.-J., & Mitchell, T. (1992). Memory approaches to reinforcement learning in non-markovian domains. Tech. rep., CMU-CS-92-138.
10. Littman, M. L. (1994). Markov games as a framework for multi-agent reinforcement learning. In Proceedings of the 11th International Conference on Machine Learning (pp. 157-163).
11. Matsuno, Y., Yamazaki, T., Matsuda, J., & Ishii, S. (2001). A multi-agent reinforcement learning method for a partially-observable competitive game. In Proceedings of the Fifth International Conference on Autonomous Agents (pp. 39-40).
12. McCallum, A. (1995). Reinforcement learning with selective perception and hidden state. Ph. D. thesis, Univercity of Rochester.
13. Moody, J., & Darken, C. J. (1989). Fast learning in networks of locally-tuned processing units. Neural Computation, 1, 281-294.
14. Moore, A., & Atkeson, C. (1993). Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13, 103-130.
15. Nagayuki, Y., Ishii, S., & Doya, K. (2000). Multi-agent reinforcement learning: An approach based on the other agent's internal model. In Proceedings of the Fourth International Conference on MultiAgent Systems (pp. 215-221).
16. Salustowicz, K. P., Wiering, M. A., & Schmidhuber, J. (1998). Learning team strategies: Soccer case studies. Machine Learning, 33, 263-282.
17. Sandholm, T. W., & Crites, R. H. (1995). Multiagent reinforcement learning in the iterated prisoner's dilemma, Biosystems, 37, 147-166.
18. Sato, M., & Ishii, S. (2000). On-line em algorithm for the normalized gaussian network. Neural Computation, 12, 407-432.
19. Sen, S., Sekaran, M., & Hale, J. (1994). learning to coordinate without sharing information. In Proceedings of the Twelfth National Conference on Artificial Intelligence (pp. 426-431).
20. Sutton, R., & Barto, A. (Eds.). (1998). Reinforcement learning: An introduction. MIT Press.
21. Tan, M. (1993). Multi-agent reinforcement learning: Independent vs. cooperative agents. In Proceedings of the Tenth International Conference on Machine Learning (pp. 330-337).
22. Tesauro, G. J. (1994). Td-gammon, a self-teaching backgammon program, achieves masterlevel play. Neural Computation, 6, 215-219.
23. Whitehead, S., & Lin, L.-J. (1995). Reinforcement learning of non-markov decision processes. Artificial Intelligence, 73, 271-306.