Deep recurrent q-learning for partially observable MDPs

AAAI Fall Symposium - Technical Report

Volumn FS-15-06, Issue , 2015, Pages 29-37

  Hausknecht, Matthew ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; DECISION MAKING; INTELLIGENT AGENTS; REINFORCEMENT LEARNING;

COMPLEX TASK; DECISION POINTS; INPUT LAYERS; LEARNING TO PLAY; LIMITED MEMORY; PARTIAL OBSERVATION; Q-LEARNING; SINGLE FRAMES;

QUALITY CONTROL;

EID: 84964687570     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Bakker, B. 2001. Reinforcement learning with long short- Term memory. In NIPS, 1475-1482. MIT Press.
2. Bellemare, M. G.; Naddaf, Y.; Veness, J. and Bowling, M. 2013. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research 47:253-279.
3. Guo, X.; Singh, S.; Lee, H.; Lewis, R. L.; and Wang, X. 2014. Deep learning for real-time atari game play using offline monte-carlo tree search planning. In Ghahramani, Z.; Welling, M.; Cortes, C.; Lawrence, N.; and Weinberger, K., eds., Advances in Neural Information Processing Systems 27. Curran Associates, Inc. 3338-3346.
4. Hochreiter, S., and Schmidhuber, J. 1997. Long short-term memory. Neural Comput. 9(8): 1735-1780.
5. Jia, Y.; Shelhamer, E.; Donahue, J.; Karayev, S.; Long, J.; Girshick, R.; Guadarrama, S.; and Darrell, T. 2014. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093.
6. Karpathy, A.; Johnson, J.; and Li, F.-F. 2015. Visualizing and understanding recurrent networks. arXiv preprint.
7. Mnih, V.; Kavukcuoglu, K.; Silver, D.; Rusu, A. A.; Veness, J.; Bellemare, M. G.; Graves, A.; Riedmiller, M.; Fidjeland, A. K.; Ostrovski, G.; Petersen, S.; Beattie, C.; Sadik, A.; Antonoglou, I.; King, H.; Kumaran, D.; Wierstra, D.; Legg, S.; and Hassabis, D. 2015. Human-level control through deep reinforcement learning. Nature 518(7540):529-533.
8. Narasimhan, K.; Kulkarni, T.; and Barzilay, R. 2015. Language understanding for text-based games using deep reinforcement learning. CoRR abs/1506.08941.
9. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. MIT Press.
10. Tieleman, T., and Hinton, G. 2012. Lecture 6.5-RmsProp: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning.
11. Tsitsiklis, J. N. and Roy, B. V. 1997. An analysis of temporal-difference learning with function approximation. IEEE Transactions on Automatic Control 42(5):674-690.
12. Watkins, C. J. C. H. and Dayan, P. 1992. Q-learning. Machine Learning 8(3-4):279-292.
13. Wierstra, D.; Foerster, A.; Peters, J.; and Schmidthuber, J. 2007. Solving deep memory POMDPs with recurrent policy gradients.
14. Zeiler, M. D. 2012. ADADELTA: An adaptive learning rate method. CoRR abs/1212.5701.