Improved deep reinforcement learning for robotics through distribution-based experience retention

IEEE International Conference on Intelligent Robots and Systems

Volumn 2016-November, Issue , 2016, Pages 3947-3952

  De Bruin, Tim ^a   Kober, Jens ^a   Tuyls, Karl ^a,b   Babuška, Robert ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

INTELLIGENT ROBOTS; MAGNETIC LEVITATION VEHICLES; ROBOTS;

DEEP NEURAL NETWORKS; FUNCTION APPROXIMATORS; GENERALIZATION PERFORMANCE; LIFE LONG LEARNING; MAGNETIC MANIPULATION; SAMPLE DISTRIBUTIONS; TEMPORAL DIFFERENCE ERRORS; UNIFORM DISTRIBUTION;

REINFORCEMENT LEARNING;

EID: 85006341752     PISSN: 21530858     EISSN: 21530866     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2016.7759581     Document Type: Conference Paper

References (14)

1. J. Kober, J. A. Bagnell, and J. Peters, "Reinforcement learning in robotics: A survey", International Journal of Robotics Research, vol. 32, no. 11, pp. 1238-1274, 2013.
2. S. Levine, C. Finn, T. Darrell, and P. Abbeel, "End-to-end training of deep visuomotor policies", 2015, arXiv:1504.00702 [cs. LG].
3. V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. P. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu, "Asynchronous methods for deep reinforcement learning", 2016, arXiv:1602.01783 [cs. LG].
4. D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. V. D. Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis, "Mastering the game of go with deep neural networks and tree search", Nature, vol. 529, no. 7585, pp. 484-489, 2016.
5. L.-J. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching", Machine Learning, vol. 8, no. 3-4, pp. 293-321, 1992.
6. T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, "Continuous control with deep reinforcement learning", in International Conference on Learning Representations (ICLR), 2016.
7. V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, S. Petersen, C. Beattie, A. Sadik, I. Antonoglou, H. King, D. Kumaran, D. Wierstra, S. Legg, and D. Hassabis, "Human-level control through deep reinforcement learning", Nature, vol. 518, no. 7540, pp. 529-533, 2015.
8. T. de Bruin, J. Kober, K. Tuyls, and R. Babuška, "The importance of experience replay database composition in deep reinforcement learning", 2015, deep Reinforcement Learning Workshop, Advances in Neural Information Processing Systems (NIPS).
9. T. Schaul, J. Quan, I. Antonoglou, and D. Silver, "Prioritized experience replay", 2015, arXiv:1511.05952 [cs. LG].
10. G. Montavon, G. B. Orr, and K.-R. Müller, Eds., Neural Networks: Tricks of the Trade, 2nd ed., ser. Lecture Notes in Computer Science (LNCS). Springer, 2012, vol. 7700.
11. D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, "Deterministic policy gradient algorithms", in International Conference on Machine Learning (ICML), 2014, pp. 387-395.
12. I. Goodfellow, M. Mirza, X. Da, A. Courville, and Y. Bengio, "An empirical investigation of catastrophic forgeting in gradient-based neural networks", 2013, arXiv:1312.6211 [stat. ML].
13. E. Parzen, "On estimation of a probability density function and mode", The Annals of Mathematical Statistics, vol. 33, no. 3, pp. 1065-1076, 1962.
14. G. Ciuti, P. Valdastri, A. Menciassi, and P. Dario, "Robotic magnetic steering and locomotion of capsule endoscope for diagnostic and surgical endoluminal procedures", Robotica, vol. 28, no. 02, pp. 199-207, 2010.