Sample-based informationl-theoretic stochastic optimal control

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2014, Pages 3896-3902

  Lioutikov, Rudolf ^a   Paraschos, Alexandros ^a   Peters, Jan ^a,b   Neumann, Gerhard ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY; REINFORCEMENT LEARNING; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS; SYSTEM THEORY;

INFORMATION THEORETIC BOUNDS; MODEL-BASED REINFORCEMENT LEARNING; SIMULATED ROBOT; STATE-OF-THE-ART APPROACH; STOCHASTIC OPTIMAL CONTROL; SYSTEM DYNAMICS MODEL; UNDERLYING SYSTEMS; VALUE FUNCTIONS;

STOCHASTIC MODELS;

EID: 84908057666     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2014.6907424     Document Type: Conference Paper

References (20)

1. R. Stengel, Stochastic Optimal Control: Theory and Application. John Wiley & Sons, Inc., 1986.
2. H. Kappen, "An Introduction to Stochastic Control Theory, Path Integrals and Reinforcement Learning, " in Cooperative Behavior in Neural Systems, vol. 887, 2007.
3. M. Toussaint, "Robot Trajectory Optimization using Approximate Inference, " in 26th International Conference on Machine Learning, ser. (ICML), 2009.
4. K. Rawlik, M. Toussaint, and S. Vijayakumar, "On Stochastic Optimal Control and Reinforcement Learning by Approximate Inference, " in Proceedings of Robotics: Science and Systems, 2012.
5. C. Daniel, G. Neumann, and J. Peters, "Learning Sequential Motor Tasks, " in IEEE International Conference on Robotics and Automation (ICRA), 2013, submitted.
6. J. Peters, K. Mülling, and Y. Altun, "Relative Entropy Policy Search, " in Proceedings of the 24th National Conference on Artificial Intelligence (AAAI), 2010.
7. J. G. Schneider, "Exploiting Model Uncertainty Estimates for Safe Dynamic Control Learning, " in NIPS, 1997, pp. 1047-1053.
8. M. Deisenroth and C. Rasmussen, "PILCO: A Model-Based and Data-Efficient Approach to Policy Search, " in 28th International Conference on Machine Learning (ICML), 2011.
9. J. Morimoto and C.Atkeson, "Minimax differential dynamic programming: An application to robust bipedwalking, " Neural Information Processing Systems 2002, 2002.
10. E. Todorov and W. L., "A Generalized Iterative LQG Method for Locally-Optimal Feedback Control of Constrained Nonlinear Stochastic Systems, " in 24th American Control Conference (ACC), 2005.
11. G. J. Gordon, "Stable Function Approximation in Dynamic Programming, " in 12th International Conference on Machine Learning (ICML), 1995.
12. M. Azar, V. Gómez, and H. J. Kappen, "Dynamic Policy Programming, " Journal of Machine Learning Research, vol. 13, no. Nov, pp. 3207-3245, 2012.
13. M. G. Lagoudakis and R. Parr, "Least-Squares Policy Iteration, " Journal of Machine Learning Research, vol. 4, pp. 1107-1149, December 2003. [Online]. Available: http://dl.acm.org/citation.cfm?id=945365.964290
14. G. Neumann and J. Peters, "Fitted Q-Iteration by Advantage Weighted Regression, " in Neural Information Processing Systems (NIPS), 2009.
15. E. Theodorou, J. Buchli, and S. Schaal, "Reinforcement Learning of Motor Skills in High Dimensions: A Path Integral Approach, " in 2010 IEEE International Conference on Robotics and Automation (ICRA), 2010.
16. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. The MIT Press, 2006.
17. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004.
18. T. Mathworks. Matlab Optimization Toolbox User's Guide.
19. F. Sisser, "Elimination of bounds in Optimization Problems by Transforming Variables, " Mathematical Programming, vol. 20, no. 1, pp. 110-121, 1981.
20. T. Lens, "Physical human-robot interaction with a lightweight, elastic tendon driven robotic arm: Modeling, control, and safety analysis, " Ph.D. dissertation, TU Darmstadt, Department of Computer Science, July 4 2012.