Dynamics of Boltzmann Q learning in two-player two-action games

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 85, Issue 4, 2012, Pages

  Kianercy, Ardeshir ^a   Galstyan, Aram ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC BEHAVIORS; BOLTZMANN; NASH EQULIBRIA; POINT STRUCTURE; Q-LEARNING;

ASYMPTOTIC ANALYSIS;

DYNAMICS;

EID: 84860692863     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.85.041145     Document Type: Article

References (28)

1. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction (The MIT press, Cambridge, MA, 2000).
2. C. Claus and C. Boutilier, Proceedings of the National Conference on Artificial Intelligence (American Association for Artificial Intelligence, Menlo Park, CA, USA, 1998), pp. 746-752.
3. S. P. Singh, M. J. Kearns, and Y. Mansour, Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2000), pp. 541-548.
4. M. Bowling and M. Veloso, Proceedings of the 17th International Joint Conference on Artificial Intelligence (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2001), Vol. 2, pp. 1021-1026.
5. J. Hofbauer and K. Sigmund, Evolutionary Games and Population Dynamics (Cambridge University Press, Cambridge, UK, 1998).
6. Y. Sato and J. P. Crutchfield, Phys. Rev. E PLEEE8 1539-3755 10.1103/PhysRevE.67.015206 67, 015206 (R) (2003).
7. Y. Sato, E. Akiyama, and J. P. Crutchfield, Physica D: Nonlinear Phenomena PDNPDT 0167-2789 10.1016/j.physd.2005.06.031 210, 21 (2005). (Pubitemid 41277023)
8. K. Tuyls, K. Verbeeck, and T. Lenaerts, Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems (ACM, New York, NY, USA, 2003), pp. 693-700.
9. E. R. Gomes and R. Kowalczyk, Proceedings of the 26th Annual International Conference on Machine Learning (ICML) (ACM, New York, NY, USA, 2009).
10. M. Wunder, M. Littman, and M. Babes, Proceedings of the 27th International Conference on Machine Learning (ICML) (Omnipress, Haifa, Israel, 2010), pp. 1167-1174.
11. D. Lee, M. L. Conroy, B. P. McGreevy, and D. J. Barraclough, Cognit. Brain Res. CBRREZ 0926-6410 10.1016/j.cogbrainres.2004.07.007 22, 45 (2004). (Pubitemid 39550751)
12. S. Kim, J. Hwang, H. Seo, and D. Lee, Neural Networks NNETEB 0893-6080 10.1016/j.neunet.2009.03.010 22, 294 (2009).
13. C. J. Burke, P. N. Tobler, M. Baddeley, and W. Schultz, Proc. Natl. Acad. Sci. PNASA6 0027-8424 10.1073/pnas.1003111107 107, 14431 (2010).
14. K. Tuyls, P. J. Hoen, and B. Vanschoenwinkel, J. Autonomous Agents of Multi-Agent Systems 1387-2532 10.1007/s10458-005-3783-9 12, 115 (2006). (Pubitemid 43146342)
15. E. Hopkins, Econometrica 0012-9682 10.1111/1468-0262.00372 70, 2141 (2002).
16. J. Hofbauer and E. Hopkins, Games and Economic Behavior GEBEEF 0899-8256 10.1016/j.geb.2004.06.006 52, 133 (2005). (Pubitemid 40792429)
17. C. J. C. H. Watkins and P. Dayan, Mach. Learn. 0885-6125 10.1023/A:1022676722315 8, 279 (1992).
18. D. S. Leslie and E. J. Collins, SIAM J. Control Optim. SJCODC 0363-0129 10.1137/S0363012903437976 44, 495 (2006).
19. K. Friston, Nature Reviews Neuroscience 1471-0048 10.1038/nrn2787 11, 127 (2010).
20. J. Hofbauer and K. Sigmund, Bulletin of the American Mathematical Society 0273-0979 10.1090/S0273-0979-03-00988-1 40, 479 (2003). (Pubitemid 37180461)
21. J. Hofbauer, J. Math. Biol. JMBLAJ 0303-6812 10.1007/BF02409754 34, 675 (1996).
22. T. Borgers and R. Sarin, Journal of Economic Theory JECTAQ 0022-0531 10.1006/jeth.1997.2319 77, 1 (1997). (Pubitemid 127172745)
23. Y. Sato, E. Akiyama, and J. D. Farmer, Proc. Natl. Acad. Sci. PNASA6 0027-8424 10.1073/pnas.032086299 99, 4748 (2002). (Pubitemid 34286056)
24. Tobias Galla, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.103. 198702 103, 198702 (2009).
25. S. H. Strogatz, Nonlinear Dynamics And Chaos (Westview Press, Cambridge, 2001).
26. D. H. Wolpert, M. Harré, E. Olbrich, N. Bertschinger, and J. Jost, Phys. Rev. E PLEEE8 1539-3755 10.1103/PhysRevE.85.036102 85, 036102 (2012).
27. A. Galstyan, J. Autonomous Agents of Multi-Agent Systems 1387-2532 10.1007/s10458-011-9181-6 (2011).
28. M. Kaisers and K. Tuyls, AAAI Workshop on Interactive Decision Theory and Game Theory (AAAI, Menlo Park, CA, USA, 2011).