Comparing human-centric and robot-centric sampling for robot deep learning from demonstrations

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2017, Pages 358-365

  Laskey, Michael ^a   Chuck, Caleb ^a   Lee, Jonathan ^a   Mahler, Jeffrey ^a   Krishnan, Sanjay ^a   Jamieson, Kevin ^a   Dragan, Anca ^a   Goldberg, Ken ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Department of Industrial Engineering and Operations Research ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY IMAGES; DECISION TREES; DEEP LEARNING; HUMAN FORM MODELS; PERSONNEL TRAINING; ROBOTICS; ROBOTS; SUPERVISORY PERSONNEL; SUPPORT VECTOR MACHINES; TREES (MATHEMATICS);

CORRECTIVE CONTROL; HUMAN SUPERVISORS; LEARNING FROM DEMONSTRATION; LEARNING MODELS; OPTIMAL POLICIES; PHYSICAL ROBOTS; POLICY PERFORMANCE; TRAINING ERRORS;

LEARNING ALGORITHMS;

EID: 85027999290     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2017.7989046     Document Type: Conference Paper

References (23)

1. "Tensor flow", https://www.tensorflow.org/.
2. B. Akgun, M. Cakmak, K. Jiang, and A. L. Thomaz, "Keyframe-based learning from demonstration", International Journal of Social Robotics, vol. 4, no. 4, pp. 343-355, 2012.
3. B. Akgun, K. Subramanian, and A. L. Thomaz, "Novel interaction strategies for learning from teleoperation. "
4. B. D. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration", Robotics and autonomous systems, vol. 57, no. 5, pp. 469-483, 2009.
5. P. L. Bartlett and S. Mendelson, "Rademacher and gaussian complexities: Risk bounds and structural results", Journal of Machine Learning Research, vol. 3, no. Nov, pp. 463-482, 2002.
6. S. Bengio, O. Vinyals, N. Jaitly, and N. Shazeer, "Scheduled sampling for sequence prediction with recurrent neural networks", in Advances in Neural Information Processing Systems, 2015, pp. 1171-1179.
7. R. Dillmann, M. Kaiser, and A. Ude, "Acquisition of elementary robot skills from human demonstration", in International symposium on intelligent robotics systems. Citeseer, 1995, pp. 185-192.
8. F. Duvallet, T. Kollar, and A. Stentz, "Imitation learning for natural language direction following through unknown environments", in ICRA. IEEE, 2013, pp. 1047-1053.
9. A. Graves, G. Wayne, M. Reynolds, T. Harley, I. Danihelka, A. Grabska-Barwińska, S. G. Colmenarejo, E. Grefenstette, T. Ramalho, J. Agapiou et al., "Hybrid computing using a neural network with dynamic external memory", Nature, vol. 538, no. 7626, pp. 471-476, 2016.
10. H. He, J. Eisner, and H. Daume, "Imitation learning by coaching", in Advances in Neural Information Processing Systems, 2012, pp. 3149-3157.
11. B. Kim and J. Pineau, "Maximum mean discrepancy imitation learning." in Robotics Science and Systems, 2013.
12. M. Laskey, J. Lee, C. Chuck, D. Gealy, W. Hsieh, F. T. Pokorny, A. D. Dragan, and K. Goldberg, "Robot grasping in clutter: Using a hierarchy of supervisors for learning from demonstrations", Automation Science and Engineering (CASE), 2016 IEEE, pp. 827-834, 2016.
13. M. Laskey, S. Staszak, W. Y.-S. Hsieh, J. Mahler, F. T. Pokorny, A. D. Dragan, and K. Goldberg, "Shiv: Reducing supervisor burden in dagger using support vectors for efficient learning from demonstrations in high dimensional state spaces", in Robotics and Automation (ICRA), 2016 IEEE International Conference on. IEEE, 2016, pp. 462-469.
14. S. Levine, C. Finn, T. Darrell, and P. Abbeel, "End-to-end training of deep visuomotor policies", arXiv preprint arXiv:1504.00702, 2015.
15. S. Levine and V. Koltun, "Variational policy search via trajectory optimization", in Advances in Neural Information Processing Systems, 2013, pp. 207-215.
16. D. A. Pomerleau, "Alvinn: An autonomous land vehicle in a neural network", Carnegie-Mellon University, Tech. Rep., 1989.
17. S. Ross and D. Bagnell, "Efficient reductions for imitation learning", in International Conference on Artificial Intelligence and Statistics, 2010, pp. 661-668.
18. S. Ross and J. A. Bagnell, "Reinforcement and imitation learning via interactive no-regret learning", arXiv preprint arXiv:1406.5979, 2014.
19. S. Ross, G. J. Gordon, and J. A. Bagnell, "A reduction of imitation learning and structured prediction to no-regret online learning", AISTATS. Vol. 1. No. 2, 2011.
20. S. Ross, N. Melik-Barkhudarov, K. S. Shankar, A. Wendel, D. Dey, J. A. Bagnell, and M. Hebert, "Learning monocular reactive uav control in cluttered natural environments", in ICRA, 2013 IEEE. IEEE.
21. S. Shalev-Shwartz et al, "Online learning and online convex optimization", Foundations and Trends® in Machine Learning, vol. 4, no. 2, pp. 107-194, 2012.
22. E. V. Slud, "Distribution inequalities for the binomial law", Ann. Probab., vol. 5, no. 3, pp. 404-412, 06 1977. [Online]. Available: http://dx.doi.org/10.1214/aop/1176995801
23. V. Vapnik, "Principles of risk minimization for learning theory", in Advances in Neural Information Processing Systems, 1992, pp. 831-838.