Policy distillation

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Rusu, Andrei A ^a   Colmenarejo, Sergio Gómez ^a   Gülçehre, Çaglar ^a,b   Desjardins, Guillaume ^a   Kirkpatrick, James ^a   Pascanu, Razvan ^a   Mnih, Volodymyr ^a   Kavukcuoglu, Koray ^a   Hadsell, Raia ^a  

^a DEEPMIND   (United Kingdom)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; DISTILLATION; MACHINE LEARNING; VISION;

MULTIPLE TASKS; REINFORCEMENT LEARNING AGENT; VISUAL TASKS;

REINFORCEMENT LEARNING;

EID: 85083952240     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Jimmy Ba and Rich Caruana. Do deep nets really need to be deep? In Advances in Neural Information Processing Systems (NIPS), pages 2654–2662. Curran Associates, Inc., 2014.
2. A. G. Barto and T. G. Dietterich. Handbook of learning and approximate dynamic programming. Wiley-IEEE Press, 2004.
3. Cristian Bucila, Rich Caruana, and Alexandru Niculescu-Mizil. Model compression. In KDD, pages 535–541. ACM, 2006.
4. Rich Caruana. Multitask learning. Mach. Learn., 28(1):41–75, July 1997.
5. William Chan, Nan Rosemary Ke, and Ian Lane. Transferring knowledge from a rnn to a dnn. arXiv preprint arXiv:1504.01483, 2015.
6. Amir-massoud Farahmand, Doina Precup, and Mohammad Ghavamzadeh. Generalized classification-based approximate policy iteration. In Tenth European Workshop on Reinforcement Learning (EWRL), volume 2, 2012.
7. Philip J. Fleming and John J. Wallace. How not to lie with statistics: The correct way to summarize benchmark results. Commun. ACM, 29(3):218–221, March 1986.
8. Evan Greensmith, Peter L. Bartlett, and Jonathan Baxter. Variance reduction techniques for gradient estimates in reinforcement learning. Journal of Machine Learning Research (JMLR), pages 1471–1530, 2004.
9. Xiaoxiao Guo, Satinder P. Singh, Honglak Lee, Richard L. Lewis, and Xiaoshi Wang. Deep learning for real-time atari game play using offline monte-carlo tree search planning. In Advances in Neural Information Processing Systems (NIPS), pages 3338–3346, 2014.
10. G. Hinton, O. Vinyals, and J. Dean. Distilling the Knowledge in a Neural Network. Deep Learning and Representation Learning Workshop, NIPS, 2014.
11. Levente Kocsis and Csaba Szepesvári. Bandit based monte-carlo planning. In Machine Learning: ECML 2006, pages 282–293. Springer, 2006.
12. Alessandro Lazaric, Mohammad Ghavamzadeh, and Rémi Munos. Analysis of a classification-based policy iteration algorithm. In ICML-27th International Conference on Machine Learning, pages 607–614. Omni-press, 2010.
13. Jinyu Li, Rui Zhao, Jui-Ting Huang, and Yifan Gong. Learning small-size dnn with output-distribution-based criteria. In Proc. Interspeech, 2014.
14. Percy Liang, Hal Daum III, and Dan Klein. Structure compilation: trading structure for features. In Proceedings of International Conference on Machine Learning (ICML), 2008.
15. Joshua Menke and Tony Martinez. Improving supervised learning by adapting the problem to the learner. International Journal of Neural Systems, 19(01):1–9, 2009.
16. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin A. Riedmiller. Playing atari with deep reinforcement learning. Deep Learning Workshop, NIPS, 2013.
17. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hass-abis. Human-level control through deep reinforcement learning. Nature, 518(7540):529–533, 02 2015.
18. Arun Nair, Praveen Srinivasan, Sam Blackwell, Cagdas Alcicek, Rory Fearon, Alessandro De Maria, Vedavyas Panneershelvam, Mustafa Suleyman, Charles Beattie, Stig Petersen, Shane Legg, Volodymyr Mnih, Koray Kavukcuoglu, and David Silver. Massively parallel methods for deep reinforcement learning. CoRR, abs/1507.04296, 2015.
19. Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550, 2014.
20. Stéphane Ross, Geoffrey J Gordon, and J Andrew Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. arXiv preprint arXiv:1011.0686, 2010.
21. S. Shalev-Shwartz. SelfieBoost: A Boosting Algorithm for Deep Learning. ArXiv e-prints, November 2014.
22. Richard S. Sutton and Andrew G. Barto. Introduction to Reinforcement Learning. MIT Press, Cambridge, MA, USA, 1st edition, 1998.
23. Zhiyuan Tang, Dong Wang, Yiqiao Pan, and Zhiyong Zhang. Knowledge transfer pre-training. arXiv preprint arXiv:1506.02256, 2015.
24. T. Tieleman and G. Hinton. Lecture 6.5—RmsProp: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning, 2012.
25. L.J.P. van der Maaten and G.E. Hinton. Visualizing high-dimensional data using t-sne. Journal of Machine Learning Research (JMLR), 2008.
26. Hado van Hasselt, Arthur Guez, and David Silver. Deep reinforcement learning with double q-learning. In Proceedings of the AAAI Conference on Artificial Intelligence.
27. Dong Wang, Chao Liu, Zhiyuan Tang, Zhiyong Zhang, and Mengyuan Zhao. Recurrent neural network training with dark knowledge transfer. arXiv preprint arXiv:1505.04630, 2015.