SHIV: Reducing supervisor burden in DAgger using support vectors for efficient learning from demonstrations in high dimensional state spaces

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 462-469

  Laskey, Michael ^a   Staszak, Sam ^a   Hsieh, Wesley Yu Shu ^a   Mahler, Jeffrey ^a   Pokorny, Florian T ^a   Dragan, Anca D ^a   Goldberg, Ken ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DEPARTMENT OF INDUSTRIAL ENGINEERING AND OPERATIONS RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COST FUNCTIONS; RISK ASSESSMENT; ROBOTICS; SUPERVISORY PERSONNEL; SUPPORT VECTOR MACHINES;

CLUTTER SIMULATION; DRIVING SIMULATOR; EFFICIENT LEARNING; HUMAN INTERVENTION; NEEDLE INSERTION; ONE-CLASS SUPPORT VECTOR MACHINE; OUTLIER REJECTION; STATE DISTRIBUTIONS;

VECTOR SPACES;

EID: 84977591120     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487167     Document Type: Conference Paper

References (34)

1. P. Abbeel, A. Coates, M. Quigley, and A. Y. Ng, "An application of reinforcement learning to aerobatic helicopter flight, " NIPS, vol. 19, p. 1, 2007.
2. P. Abbeel, D. Dolgov, A. Y. Ng, and S. Thrun, "Apprenticeship learning for motion planning with application to parking lot navigation, " in IROS 2008. IEEE/RS. IEEE.
3. P. Abbeel and A. Y. Ng, "Apprenticeship learning via reinforcement learning, " in Proceedings of the twenty-first international conference on Machine learning, 2004, p. 1.
4. B. D. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration, " Robotics and autonomous systems, vol. 57, no. 5, pp. 469-483, 2009.
5. L. E. Atlas, D. A. Cohn, and R. E. Ladner, "Training connectionist networks with queries and selective sampling, " in NIPS, 1990, pp. 566-573.
6. L. Breiman, "Bagging predictors, " Machine learning, vol. 24, no. 2, pp. 123-140, 1996.
7. R. Burbidge, J. J. Rowland, and R. D. King, "Active learning for regression based on query by committee, " in Intelligent Data Engineering and Automated Learning-IDEAL 2007. Springer, 2007, pp. 209-218.
8. S. Chernova and M. Veloso, "Interactive policy learning through confidence-based autonomy, " Journal of Artificial Intelligence Research, vol. 34, no. 1, p. 1, 2009.
9. D. Cohn, L. Atlas, and R. Ladner, "Improving generalization with active learning, " Machine learning, vol. 15, no. 2, pp. 201-221, 1994.
10. F. Duvallet, T. Kollar, and A. Stentz, "Imitation learning for natural language direction following through unknown environments, " in ICRA. IEEE, 2013, pp. 1047-1053.
11. D. H. Grollman and O. C. Jenkins, "Dogged learning for robots, " in ICRA, 2007 IEEE.
12. X. Guo, S. Singh, H. Lee, R. L. Lewis, and X. Wang, "Deep learning for real-time atari game play using offline monte-carlo tree search planning, " in NIPS, 2014, pp. 3338-3346.
13. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies, " Artificial Intelligence Review, vol. 22, no. 2, pp. 85-126, 2004.
14. Intuitive Surgical, "Annual report, " 2014.
15. K. Judah, A. Fern, and T. Dietterich, "Active imitation learning via state queries, " in Proceedings of the ICML Workshop on Combining Learning Strategies to Reduce Label Cost, 2011.
16. K. Judah, A. Fern, and T. G. ietterich, "Active imitation learning via reduction to iid active learning, " arXiv preprint arXiv:1210. 4876, 2012.
17. B. Kim and J. Pineau, "Maximum mean discrepancy imitation learning. " in Robotics Science and Systems, 2013.
18. J. E. King, J. A. Haustein, S. S. Srinivasa, and T. Asfour, "Nonprehensile whole arm rearrangement planning on physics manifolds, " ICRA 2015 IEEE.
19. E. M. Knox and R. T. Ng, "Algorithms for mining distancebased outliers in large datasets, " in Proceedings of the International Conference on Very Large Data Bases, 1998.
20. S. Levine, C. Finn, T. Darrell, and P. Abbeel, "End-to-end training of deep visuomotor policies, " arXiv preprint arXiv:1504. 00702, 2015.
21. H. Liu, J. D. Lafferty, and L. A. Wasserman, "Sparse nonparametric density estimation in high dimensions using the rodeo, " in International Conference on Artificial Intelligence and Statistics, 2007, pp. 283-290.
22. T. Liu and M. C. Cavusoglu, "Optimal needle grasp selection for automatic execution of suturing tasks in robotic minimally invasive surgery, " in ICRA, 2015. IEEE.
23. W. Liu, G. Hua, and J. R. Smith, "Unsupervised one-class learning for automatic outlier removal, " in CVPR, 2014 IEEE, 2014, pp. 3826-3833.
24. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, "Scikit-learn: Machine learning in Python, " Journal of Machine Learning Research, vol. 12, pp. 2825-2830, 2011.
25. D. A. Pomerleau, "Alvinn: An autonomous land vehicle in a neural network, " Carnegie-Mellon University, Tech. Rep., 1989.
26. S. Ross and D. Bagnell, "Efficient reductions for imitation learning, " in International Conference on Artificial Intelligence and Statistics, 2010, pp. 661-668.
27. S. Ross, G. J. Gordon, and J. A. Bagnell, "A reduction of imitation learning and structured prediction to no-regret online learning, " arXiv preprint arXiv:1011. 0686, 2010.
28. S. Ross, N. Melik-Barkhudarov, K. S. Shankar, A. Wendel, D. Dey, J. A. Bagnell, and M. Hebert, "Learning monocular reactive uav control in cluttered natural environments, " in ICRA, 2013 IEEE. IEEE.
29. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution, " Neural computation, vol. 13, no. 7, pp. 1443-1471, 2001.
30. B. Schölkopf and A. J. Smola, Learning with kernels: Support vector machines, regularization, optimization, and beyond. MIT press, 2002.
31. S. T. Tokdar and R. E. Kass, "Importance sampling: A review, " Wiley Interdisciplinary Reviews: Computational Statistics, vol. 2, no. 1, pp. 54-60, 2010.
32. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification, " The Journal of Machine Learning Research, vol. 2, pp. 45-66, 2002.
33. J. Van Den Berg, S. Miller, D. Duckworth, H. Hu, A. Wan, X.-Y. Fu, K. Goldberg, and P. Abbeel, "Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations, " in ICRA, 2010 IEEE. IEEE, 2010, pp. 2074-2081.
34. R. Vert and J.-P. Vert, "Consistency and convergence rates of oneclass svms and related algorithms, " The Journal of Machine Learning Research, vol. 7, pp. 817-854, 2006.