Exponential moving average Q-learning algorithm

IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL

Volumn , Issue , 2013, Pages 31-38

  Awheda, Mostafa D ^a   Schwartz, Howard M ^a  

^a CARLETON UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EXPONENTIAL MOVING AVERAGES; MULTI-AGENT REINFORCEMENT LEARNING; OPTIMAL POLICIES; POLICY ITERATION; Q-LEARNING AGENTS; Q-LEARNING ALGORITHMS; STOCHASTIC GAME;

ARTIFICIAL INTELLIGENCE; DYNAMIC PROGRAMMING; FERTILIZERS; ITERATIVE METHODS; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

EID: 84891544020     PISSN: 23251824     EISSN: 23251867     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2013.6614986     Document Type: Conference Paper

References (17)

1. R. Bellman, Dynamic Programming, Princeton University Press, 1957.
2. M. Bowling, Convergence and no-regret in multiagent learning, In Advances in Neural Information Processing Systems 17. MIT Press, 2005.
3. M. Bowling and M. Veloso, Multiagent learning using a variable learning rate, Artificial Intelligence, 136 (2):215-250, 2002.
4. L. Buşoniu and R. Babu?ska and B. D. Schutter, Multiagent reinforcement learning: A survey, 9th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1-6, 2006.
5. L. Buşoniu and R. Babu?ska and B. D. Schutter, A comprehensive survey of multiagent reinforcement learning, IEEE Trans Syst Man Cybern C, 38(2):156-172, 2008.
6. S. Abdallah and V. Lesser, A multiagent reinforcement learning algorithm with non-linear dynamics, Journal of Artificial Intelligence Research 33, pp. 521-549, 2008.
7. A. Burkov and B. Chaib-draa, Effective learning in the presence of adaptive counterparts, Journal of Algorithms, 64(4):127-138, 2009.
8. V. Conitzer and T. Sandholm, Awesome: A general multiagent learning algorithm that converges in self-play and learns a best response against stationary opponents, Machine Learning, 67(1-2), pp. 23-43, 2007.
9. R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, 1960.
10. J. Hu and M. P. Wellman, Multiagent reinforcement learning: Theoretical framework and an algorithm, In proceedings fifteenth international conference on machine learning, pp. 242-250, 1998.
11. J. Hu and M. P. Wellman, Nash q-learning for general-sum stochastic games, Journal of Machine Learning Research, 4:1039-1069, 2003.
12. L. P. Kaelbling and M. L. Littman and A. W. Moore, Reinforcement learning: A survey, Journal of Artificial Intelligence Research, 4:237-285, 1996.
13. S. Sen and G. Weiss, Learning in multiagent systems, In: Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. The MIT Press, Cambridge, 1999.
14. S. Singh and M. Kearns and Y. Mansour, Nash convergence of gradient dynamics in general-sum games, In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pp. 541-548, 2000.
15. R. S. Sutton and A. G. Barto, Reinforcement learning: an introduction, The MIT Press, Cambridge, Massachusetts, 1998.
16. G. Tesauro, Extending q-learning to general adaptive multi-agent systems, In Advances in Neural Information Processing Systems 16, pp. 215-250, 2004.
17. C. Zhang and V. Lesser, Multi-agent learning with policy prediction, In Proceedings of the 24th National Conference on Artificial Intelligence (AAAI10), Atlanta, GA, USA, pp. 746-752, 2010.