Universal value function approximators

32nd International Conference on Machine Learning, ICML 2015

Volumn 2, Issue , 2015, Pages 1312-1320

  Schaul, Tom ^a   Horgan, Dan ^a   Gregor, Karol ^a   Silver, David ^a  

^a DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING ALGORITHMS; LEARNING SYSTEMS;

CORE COMPONENTS; FUNCTION APPROXIMATORS; OBSERVED VALUES; VALUE FUNCTIONS;

REINFORCEMENT LEARNING;

EID: 84969760283     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Bellemare, Marc G, Naddaf, Yavar, Veness, Joel, and Bowling, Michael. The arcade learning environment: An evaluation platform for general agents. arXiv preprint arXiv:1207.4708, 2012.
2. Caruana, Rich. Multitask learning. Machine learning, 28 (1):41-75, 1997.
3. Collobert, Ronan, Kavukcuoglu, Koray, and Farabet, Clément. Torch7: A matlab-like environment for machine learning. In Big Learn, NIPS Workshop, 2011a.
4. Collobert, Ronan, Weston, Jason, Bottou, Léon, Karlen, Michael, Kavukcuoglu, Koray, and Kuksa, Pavel. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493-2537, 2011b.
5. Da Silva, Bruno, Konidaris, George, and Barto, Andrew. Learning parameterized skills. arXiv preprint arXiv: 1206.6398, 2012.
6. Deisenroth, Marc Peter, Englert, Peter, Peters, Jan, and Fox, Dieter. Multi-task policy search for robotics. In Robotics and Automation (ICRA), 2014 IEEE International Conference on, pp. 3876-3881. IEEE, 2014.
7. Foster, David and Dayan, Peter. Structure in the space of value functions. Machine Learning, 49(2-3):325-346, 2002.
8. Kaelbling, Leslie Pack. Hierarchical learning in stochastic domains: Preliminary results. In Proceedings of the tenth international conference on machine learning, volume 951, pp. 167-173, 1993.
9. Keshavan, Raghunandan H., Oh, Sewoong, and Montanari, Andrea. Matrix completion from a few entries. CoRR, abs/0901.3150, 2009.
10. Kingma, Diederik P. and Ba, Jimmy. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.
11. Kober, Jens, Wilhelm, Andreas, Oztop, Erhan, and Peters, Jan. Reinforcement learning to adjust parametrized motor primitives to new situations. Autonomous Robots, 33 (4):361-379, 2012.
12. Konidaris, George, Scheidwasser, Ilya, and Barto, Andrew G. Transfer in reinforcement learning via shared features. The Journal of Machine Learning Research, 13 (1): 1333-1371, 2012.
13. Mikolov, Tomas, Sutskever, Ilya, Chen, Kai, Corrado, Greg S, and Dean, Jeff. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pp. 3111-3119, 2013.
14. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Graves, Alex, Antonoglou, Ioannis, Wierstra, Daan, and Riedmiller, Martin. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013.
15. Modayil, Joseph, White, Adam, and Sutton, Richard S. Multi-timescale nexting in a reinforcement learning robot. Adaptive Behavior, 22(2): 146-160, 2014.
16. Precup, Doina, Sutton, Richard S, and Dasgupta, Sanjoy. Off-policy temporal-difference learning with function approximation. In ICML, pp. 417-424. Citeseer, 2001.
17. Ring, Mark Bishop. Continual Learning in Reinforcement Environments. PhD thesis, University of Texas at Austin, 1994.
18. Schaul, Tom and Ring, Mark. Better generalization with forecasts. In Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pp. 1656-1662. AAAI Press, 2013.
19. Singh, Satinder, Littman, Michael L, Jong, Nicholas K, Pardoe, David, and Stone, Peter. Learning predictive state representations. In ICML, pp. 712-719, 2003.
20. Sutton, Richard S and Barto, Andrew G. Introduction to reinforcement learning. MIT Press, 1998.
21. Sutton, Richard S and Tanner, Brian. Temporal-difference networks. In Saul, L.K., Weiss, Y., and Bottou, L. (eds.), Advances in Neural Information Processing Systems 17, pp. 1377-1384. MIT Press, 2005.
22. Sutton, Richard S, Precup, Doina, and Singh, Satinder. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial intelligence, 112(1): 181-211, 1999.
23. Sutton, Richard S, Modayil, Joseph, Delp, Michael, De-gris, Thomas, Pilarski, Patrick M, White, Adam, and Precup, Doina. Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. In The 10th International Conference on Autonomous Agents and Multiagent Systems-Volume 2, pp. 761-768, 2011.
24. Van der Maaten, Laurens and Hinton, Geoffrey. Visualizing data using t-sne. Journal of Machine Learning Research, 9(2579-2605):85, 2008.
25. van Otterlo, Martijn. The logic of adaptive behavior: knowledge representation and algorithms for adaptive sequential decision making under uncertainty in first-order and relational domains, volume 192. Ios Press, 2009.
26. Yao, Hengshuai, Szepesvári, Csaba, Sutton, Richard S, Modayil, Joseph, and Bhatnagar, Shalabh. Universal option models. In Advances in Neural Information Processing Systems, pp. 990-998, 2014.