Direct loss minimization inverse optimal control

Robotics: Science and Systems

Volumn 11, Issue , 2015, Pages

  Doerr, Andreas ^a   Ratliff, Nathan ^a,b   Bohg, Jeannette ^b   Toussaint, Marc ^a   Schaal, Stefan ^b,c  

^a UNIVERSITY OF STUTTGART   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85006176757     PISSN: None     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: 10.15607/RSS.2015.XI.013     Document Type: Conference Paper

References (35)

1. Brenna D Argall, Sonia Chernova, Manuela Veloso, and Brett Browning. A survey of robot learning from demonstration. Robotics and autonomous systems, 57(5):469-483, 2009.
2. A. Auger and N. Hansen. A restart CMA evolution strategy with increasing population size. In B. McKay et al., editors, The 2005 IEEE International Congress on Evolutionary Computation (CEC'05), volume 2, pages 1769-1776, 2005.
3. A. Boularias, J. Kober, and J. Peters. Relative entropy inverse reinforcement learning. In Proceedings of Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2011), 2011. URL http://jmlr.csail.mit.edu/proceedings/papers/v15/boularias11a/boularias11a.pdf.
4. Jia Pan Chonhyon Park and Dinesh Manocha. ITOMP: Incremental trajectory optimization for real-time replanning in dynamic environments. In International Conference on Automated Planning and Scheduling (ICAPS), 2012.
5. Michael Collins. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing - Volume 10. Association for Computational Linguistics, 2002.
6. Mike Depinet, Patrick MacAlpine, and Peter Stone. Keyframe sampling, optimization, and behavior integration: Towards long-distance kicking in the robocup 3d simulation league. In H. Levent Akin, Reinaldo A. C. Bianchi, Subramanian Ramamoorthy, and Komei Sugiura, editors, RoboCup-2014: Robot Soccer World Cup XVIII, Lecture Notes in Artificial Intelligence. Springer Verlag, Berlin, 2015.
7. Anca Dragan, Nathan Ratliff, and Siddhartha Srinivasa. Manipulation planning with goal sets using constrained trajectory optimization. In 2011 IEEE International Conference on Robotics and Automation, May 2011.
8. Nikolaus Hansen. The cma evolution strategy: A tutorial. Vu le, 29, 2005.
9. A. Herzog, P. Pastor, M. Kalakrishnan, L. Righetti, T. Asfour, and S. Schaal. Template-based learning of grasp selection. In Robotics and Automation (ICRA), 2012 IEEE International Conference on, pages 2379-2384, 2012. URL http://www-clmc.usc.edu/publications/H/herzog-ICRA2012.pdf.
10. M. Kalakrishnan, S. Chitta, E. Theodorou, P. Pastor, and S. Schaal. STOMP: Stochastic trajectory optimization for motion planning. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, 2011. URL http://www-clmc.usc.edu/publications/K/kalakrishnan-ICRA2011.pdf.
11. M. Kalakrishnan, P. Pastor, L. Righetti, and S. Schaal. Learning objective functions for manipulation. In IEEE International Conference on Robotics and Automation, 2013. URL /publications/K/kalakrishnan-ICRA2013.pdf.
12. J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning, pages 282-289, 2001.
13. Sergey Levine and Vladlen Koltun. Continuous inverse optimal control with locally optimal examples. In ICML 2012, 2012.
14. C. Karen Liu, Aaron Hertzmann, and Zoran Popovic. Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. Graph, 24:1071-1081, 2005.
15. D. McAllester, T. Hazan, and J. Keshet. Direct loss minimization for structured prediction. In Neural Information and Processing Systems (NIPS), 2010.
16. Andrew Miller and Peter K. Allen. Graspit!: A Versatile Simulator for Robotic Grasping. IEEE Robotics and Automation Magazine, 11(4):110-122, 2004.
17. Daniel Munoz, J. Andrew Bagnell, Nicolas Vandapel, and Martial Hebert. Contextual classification with functional max-margin markov networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
18. Nathan Ratliff, J. Andrew (Drew) Bagnell, and Martin Zinkevich. Maximum margin planning. In International Conference on Machine Learning, July 2006.
19. Nathan Ratliff, J. Andrew (Drew) Bagnell, and Siddhartha Srinivasa. Imitation learning for locomotion and manipulation. In IEEE-RAS International Conference on Humanoid Robots, November 2007.
20. Nathan Ratliff, J. Andrew (Drew) Bagnell, and Martin Zinkevich. (online) subgradient methods for structured prediction. In Eleventh International Conference on Artificial Intelligence and Statistics (AIStats), March 2007.
21. Nathan Ratliff, Matthew Zucker, J. Andrew (Drew) Bagnell, and Siddhartha Srinivasa. CHOMP: Gradient optimization techniques for efficient motion planning. In IEEE International Conference on Robotics and Automation (ICRA), May 2009.
22. Nathan Ratliff, Marc Toussaint, and Stefan Schaal. Riemannian motion optimization. Technical report, Max Planck Institute for Intelligent Systems, 2015.
23. A. Saxena, J. Driemeyer, J. Kearns, and A.Y. Ng. Robotic grasping of novel objects. In Neural Information Processing Systems, 2006.
24. John D. Schulman, Jonathan Ho, Alex Lee, Ibrahim Awwal, Henry Bradlow, and Pieter Abbeel. Finding locally optimal, collision-free trajectories with sequential convex optimization. In In the proceedings of Robotics: Science and Systems (RSS), 2013.
25. David Silver, J. Andrew (Drew) Bagnell, and Anthony (Tony) Stentz. Learning from demonstration for autonomous navigation in complex unstructured terrain. International Journal of Robotics Research, 29(12):1565-1592, October 2010.
26. Freek Stulp and Olivier Sigaud. Path integral policy improvement with covariance matrix adaptation. In Proceedings of the 29th International Conference on Machine Learning (ICML), 2012.
27. Freek Stulp and Olivier Sigaud. Path integral policy improvement with covariance matrix adaptation. arXiv preprint arXiv:1206.4621, 2012.
28. B. Taskar, V. Chatalbashev, D. Koller, and C. Guestrin. Learning structured prediction models: A large margin approach. In Twenty Second International Conference on Machine Learning (ICML05), Bonn, Germany, August 2005.
29. Evangelos A. Theodorou, Jonas Buchli, and Daniel Lee. A generalized path integral control approach to reinforcement learning. The Journal of Machine Learning Research, pages 3137-3181, 2010.
30. Marc Toussaint. Newton methods for k-order Markov constrained motion problems. CoRR, abs/1407.0414, 2014. URL http://arxiv.org/abs/1407.0414.
31. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In International Conference on Machine Learning (ICML), pages 104-112, 2004.
32. Paul Vernaza and Daniel D Lee. Scalable real-time object recognition and segmentation via cascaded, discriminative markov random fields. In Robotics and Automation (ICRA), 2010 IEEE International Conference on, pages 3102-3107. IEEE, 2010.
33. Shao Zhifei and Er Meng Joo. A survey of inverse reinforcement learning techniques. International Journal of Intelligent Computing and Cybernetics, 5(3):293-311, 2012.
34. Brian D. Ziebart, Andrew Maas, J. Andrew (Drew) Bagnell, and Anind Dey. Maximum entropy inverse reinforcement learning. In Proceeding of AAAI 2008, July 2008.
35. Matthew Zucker, James Kuffner, and J. Andrew (Drew) Bagnell. Adaptive workspace biasing for sampling based planners. In Proc. IEEE Int'l Conf. on Robotics and Automation, May 2008.