Learning automata based multi-agent system algorithms for finding optimal policies in Markov games

Asian Journal of Control

Volumn 14, Issue 1, 2012, Pages 137-152

  Masoumi, Behrooz ^a   Meybodi, Mohammad Reza ^b  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

^b AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

learning automata; Markov games; multi agent systems; optimal policy

Indexed keywords

AUTOMATA THEORY; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES; ROBOTS; SOFTWARE AGENTS;

AVERAGE REWARD; COMPUTER EXPERIMENT; DYNAMIC THRESHOLD; LEARNING AUTOMATA; MARKOV DECISION PROCESSES; MARKOV GAMES; MODEL MULTI-AGENT SYSTEMS; OPTIMAL POLICIES;

MULTI AGENT SYSTEMS;

EID: 84856285917     PISSN: 15618625     EISSN: 19346093     Source Type: Journal    
DOI: 10.1002/asjc.315     Document Type: Article

References (29)

1. Vlassis, N., A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence, Morgan and Claypool Publishers, Amesterdam, The Netherlands (2007).
2. Goel A. K., V. Kumar, and, S. Srinivasan, " Application of multi-agent system & agent coordination," 2nd Natl. Conf. Math. Tech.-Emerg. Paradigms Electron. IT Ind., New Delhi, India, pp. 328-337 (2008).
3. Boccadoro, M., F. Martinelli, and, P. Valigi, " A multi-agent control scheme for a supply chain model," Asian J. Control, Vol. 10, No. 2, pp. 260-266 (2008).
4. Piovesan, J. L., C. T. Abdallah, and, H. G. Tanner, " A hybrid framework for resource allocation among multiple agents moving on discrete environments," Asian J. Control, Vol. 10, No. 2, pp. 171-186 (2008).
5. González, E. J., A. Hamilton, L. Moreno, R. L. Marichal, G. N. Marichal, and, J. Toledo, " A MAS implimentation for system identification and process control," Asian J. Control, Vol. 8, No. 4, pp. 417-423 (2006). (Pubitemid 46342883)
6. Shoham, Y., Multiagent Systems: Algorithmic Game Theoretic and Logical Foundations, Cambridge University Press, Cambridge, UK (2009).
7. Nowe, A., and, K. Verbeeck, " Colonies of learning automata," IEEE Trans. Syst., Man Cybern., Vol. 32, pp. 772-780 (2002). (Pubitemid 35428564)
8. Hu, J., and, M. P. Wellman, " Nash Q-learning for general-sum stochastic games," J. Mach. Learn. Res., Vol. 4, pp. 1039-1069 (2003).
9. Claus, C., and, C. Boutilier, " The dynamics of reinforcement learning in cooperative multiagent systems," 15th Natl. Conf. Artif. Intell., Madison, WI, pp. 746-752 (1998).
10. Thathachar, M. A. L., and, P. S. Sastry, Networks of Learning Automata: Techniques for Online Stochastic Optimization, Kluwer Academic Publishers, Dordrecht, The Netherlands (2004).
11. Khojasteh, M. R., and, M. R. Meybodi, " Evaluating learning automata as a model for cooperation in complex multi-agent domains," RoboCup 2006: Robot Soccer World Cup, Bremen, Germany, Vol. 4434, pp. 410-417, (2007).
12. Nowé, A., K. Verbeeck, and, M. Peeters, " Learning automata as a basis for multi-agent reinforcement learning," Learn. Adapt. Multi-Agent Syst., Vol. 3898, pp. 71-85 (2006). (Pubitemid 43986769)
13. Verbeeck, K., A. Nowe, P. Vrancx, and, M. Peeters, " Multi-automata learning," In Reinforcement Learning, Weber, C., M. Elshaw, N. M. Mayer, (eds). I-Tech Education and Publishing, Vienna, pp. 167-185 (2008).
14. Verbeeck, K., A. Nowé, M. Peeters, and, K. Tuyls, " Multi-agent reinforcement learning in stochastic single and multi-stage games," Adapt. Agents Multi-Agent Syst. Part III., Vol. 3394, pp. 275-294 (2005).
15. Sastry, P., V. Phansalkar, and, M. A. L. Thathachar, " Decentralized learning of nash equilibria in multi-person stochastic games with incomplete information," IEEE Trans. Syst. Man Cybern., Vol. 24, pp. 769-777 (1994).
16. Billard, E. A., and, S. Lakshmivarahan, " Learning in multilevel games with incomplete information-part I," IEEE Trans. Syst. Man Cybern. Part B, Vol. 29, pp. 329-339 (1999).
17. Vrancx, P., K. Verbeeck, and, A. Nowé, " Decentralized learning in Markov games," IEEE Trans. Syst. Man Cybern., Part B, Vol. 38, pp. 976-981 (2008).
18. Abtahi, F., and, M. R. Meybodi, " Solving multi-agent Markov decision processes using learning automata," 6th Int. Symp. Intell. Syst., Subotica, Serbia, pp. 1-6 (2008).
19. Masoumi, B., M. R. Meybodi, and, B. Jafarpour, " Solving general sum stochastic games using learning automata," 2nd Joint Cong. Fuzzy Intell. Syst., Tehran, Iran (2008).
20. Masoumi, B and, M. R. Meybodi, " Utilization of networks of learning automata for solving decision problems in decentralized multiagent systems," 17th Iranian Conf. Electr. Eng., Tehran, Iran (2009).
21. Zhuang, X and, Z. Chen, " Strategy entropy as a measure of strategy convergence in reinforcement learning," 1st Int. Conf. Intell. Netw. Intell. Syst., Wuhan, China, pp. 81-84 (2008).
22. Narendra, K. S., and, M. A. L. Thathachar, Learning Automata: an Introduction, Prentice-Hall, Upper Saddle River, NJ (1989).
23. Lakshmivarahan, S., and, K. Narendra, " Learning algorithms for two-person zero-sum stochastic games with incomplete information," Math. Oper. Res., Vol. 6, pp. 379-386 (1981).
24. Wheeler, R. M., and, K. S. Narendra, " Decentralized learning in finite Markov chains," IEEE Trans. Autom. Control, Vol. 31, pp. 519-526 (1986).
25. Fink, A. M., " Equilibrium in a stochastic N-person game," J. Sci. Hiroshima Univ. Ser. A-I, Vol. 28, pp. 89-93 (1964).
26. Greenwald, A., and, K. Hall, " Correlated Q-learning," 20th Int. Conf. Mach. Learn., Washington, DC, pp. 242-249 (2003).
27. Golan, A., " Information and entropy econometrics-volume overview and synthesis," J. Econom., Vol. 138, pp. 379-387 (2007). (Pubitemid 46646965)
28. Xie, L., " Topological entropy and data rate for practical stability: a scalar case," Asian J. Control, Vol. 11, No. 4, pp. 376-385 (2009).
29. Costa, M., A. Goldberger, and, C. Peng, " Multi-scale entropy analysis of complex physiologic time series," Phys. Rev. Lett., Vol. 89, pp. 1-4 (2002).