Control of memory, active perception, and action in minecraft

33rd International Conference on Machine Learning, ICML 2016

Volumn 6, Issue , 2016, Pages 4067-4089

  Oh, Junhyuk ^a   Chockalingam, Valliappa ^a   Singh, Satinder ^a   Lee, Honglak ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; REINFORCEMENT LEARNING;

ACTIVE PERCEPTIONS; DELAYED REWARDS; FIRST PERSON; GENERALIZATION PERFORMANCE; HIGH-DIMENSIONAL; PARTIAL OBSERVABILITY; VISUAL OBSERVATIONS;

MEMORY ARCHITECTURE;

EID: 84999048282     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Bahdanau, Dzmitry, Cho, Kyunghyun, and Bengio, Yoshua. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations, 2015.
2. Bakker, Bram, Zhumatiy, Viktor, Gruener, Gabriel, and Schmidhuber, Jiirgen. A robot that reinforcement-learns to identify and memorize important previous observations. In Intelligent Robots and Systems, 2003.
3. Bellemare, M. G., Naddaf, Y., Veness, J., and Bowling, M. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research, 47:253-279, 06 2013.
4. Collobert, Ronan, Kavukcuoglu, Koray, and Farabet, Clement. Torch7: A matlab-like environment for machine learning. In BigLearn, Advances in the Neural Information Processing System Workshop, 2011.
5. Girshick, Ross, Donahue, Jeff, Darrell, Trevor, and Malik, Jitendra. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014.
6. Graves, Alex. Generating sequences with recurrent neural networks. arXivpreprint arXiv:1308.0850, 2013.
7. Graves, Alex, Wayne, Greg, and Danihelka, Ivo. Neural turing machines. arXiv preprint arXiv: 1410.5401, 2014.
8. Guo, Xiaoxiao, Singh, Satinder, Lee, Honglak, Lewis, Richard L, and Wang, Xiaoshi. Deep learning for real-time atari game play using offline monte-carlo tree search planning. In Advances in the Neural Information Processing System, 2014.
9. Hausknecht, Matthew and Stone, Peter. Deep recurrent q-learning for partially observable mdps. In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents, 2015.
10. Hochreiter, Sepp and Schmidhuber, Jiirgen. Long short- term memory. Neural Computation, 9(8): 1735-1780, 1997.
11. Joulin, Armand and Mikolov, Tomas. Inferring algorithmic patterns with stack-augmented recurrent nets. In Advances in the Neural Information Processing System, 2015.
12. Kocsis, Levente and Szepesvari, Csaba. Bandit based monte-carlo planning. In European Conference on Machine Learning, 2006.
13. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Advances in the Neural Information Processing System, 2012.
14. Lange, Sascha and Riedmiller, Martin. Deep auto-encoder neural networks in reinforcement learning. In International Joint Conference on Neural Networks, 2010.
15. LeCun, Yann, Bengio, Yoshua, and Hinton, Geoffrey. Deep learning. Nature, 521(7553):436-444, 2015.
16. Levine, Sergey and Koltun, Vladlen. Guided policy search. In Proceedings of the International Conference on Machine Learning, 2013.
17. Levine, Sergey, Finn, Chelsea, Darrell, Trevor, and Abbeel, Pieter. End-to-end training of deep visuomotor policies. Journal of Machine Learning Research, 2016.
18. Lillicrap, Timothy P, Hunt, Jonathan J, Pritzel, Alexander, Heess, Nicolas, Erez, Tom, Tassa, Yuval, Silver, David, and Wierstra, Daan. Continuous control with deep reinforcement learning. In International Conference on Learning Representations, 2016.
19. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A, Veness, Joel, Bellemare, Marc G, Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K, Ostrovski, Georg, Petersen, Stig, Beattie, Charles, Sadik, Amir, Antonoglou, Ioannis, King, Helen, Kumaran, Dharshan, Wierstra, Daan, Legg, Shane, and Hassabis, Demis. Human-level control through deep reinforcement learning. Nature, 518(7540):529-533, 2015.
20. Mnih, Volodymyr, Badia, Adria Puigdomenech, Mirza, Mehdi, Graves, Alex, Lillicrap, Timothy P, Harley, Tim, Silver, David, and Kavukcuoglu, Koray. Asynchronous methods for deep reinforcement learning. In Proceedings of the International Conference on Machine Learning, 2016.
21. Nair, Vinod and Hinton, Geoffrey E. Rectified linear units improve restricted boltzmann machines. In Proceedings of the International Conference on Machine Learning, 2010.
22. Narasimhan, Karthik, Kulkarni, Tejas, and Barzilay, Regina. Language understanding for text-based games using deep reinforcement learning. In Conference on Empirical Methods on Natural Language Processing, 2015.
23. Oh, Junhyuk, Guo, Xiaoxiao, Lee, Honglak, Lewis, Richard L, and Singh, Satinder. Action-conditional video prediction using deep networks in atari games. In Advances in the Neural Information Processing System, 2015.
24. Olton, David S. Mazes, maps, and memory. American Psychologist, 34(7):583, 1979.
25. Schaul, Tom, Horgan, Daniel, Gregor, Karol, and Silver, David. Universal value function approximators. In Proceedings of the International Conference on Machine Learning, 2015.
26. Schmidhuber, Jiirgen. Deep learning in neural networks: An overview. Neural Networks, 61:85-117, 2015.
27. Schulman, John, Levine, Sergey, Moritz, Philipp, Jordan, Michael I, and Abbeel, Pieter. Trust region policy optimization. In Proceedings of the International Conference on Machine Learning, 2015.
28. Simonyan, Karen and Zisserman, Andrew. Very deep con- volutional networks for large-scale image recognition. In International Conference on Learning Representations, 2015.
29. Stadie, Bradly C, Levine, Sergey, and Abbeel, Pieter. Incentivizing exploration in reinforcement learning with deep predictive models. arXiv preprint arXiv: 1507.00814, 2015.
30. Sukhbaatar, Sainbayar, Szlam, Arthur, Synnaeve, Gabriel, Chintala, Soumith, and Fergus, Rob. Mazebase: A sandbox for learning from games. arXiv preprint arXiv:1511.07401, 2015a.
31. Sukhbaatar, Sainbayar, Weston, Jason, and Fergus, Rob. End-to-end memory networks. In Advances in the Neural Information Processing System, 2015b.
32. Tesauro, Gerald. Temporal difference learning and td- gammon. Communications of the ACM, 38(3):58-68, 1995.
33. Watkins, Christopher JCH and Dayan, Peter. Q-learning. Machine Learning, 8(3-4):279-292, 1992.
34. Weston, Jason, Chopra, Sumit, and Bordes, Antoine. Memory networks. In International Conference on Learning Representations, 2015.
35. Wierstra, Daan, Forster, Alexander, Peters, Jan, and Schmidhuber, Jiirgen. Recurrent policy gradients. Logic Journal of lGPL, 18(5):620-634, 2010.
36. Zaremba, Wojciech and Sutskever, Ilya. Reinforcement learning neural turing machines. arXiv preprint arXiv:1505.00521, 2015.
37. Zaremba, Wojciech, Mikolov, Tomas, Joulin, Armand, and Fergus, Rob. Learning simple algorithms from examples. In Proceedings of the International Conference on Machine Learning, 2016.
38. Zhang, Marvin, Levine, Sergey, McCarthy, Zoe, Finn, Chelsea, and Abbeel, Pieter. Policy learning with continuous memory states for partially observed robotic control. In International Conference on Robotics and Automation, 2016.