Inverse optimal control with linearly-solvable MDPs

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 335-342

  Dvijotham, Krishnamurthy ^a   Todorov, Emanuel ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS STATE SPACE; CONTROL ENGINEERING; CONTROL POLICY; DENSITY ESTIMATION; FORWARD PROBLEM; INVERSE ALGORITHM; INVERSE REINFORCEMENT LEARNING; INVERSE-OPTIMAL CONTROL; LOG LIKELIHOOD; MAXIMUM ENTROPY; NONLINEAR PROBLEMS; ORDERS OF MAGNITUDE; SPECIAL PROPERTIES; UNCONSTRAINED OPTIMIZATION; VALUE FUNCTIONS;

CONTROL; LEARNING ALGORITHMS; LEARNING SYSTEMS; LINEARIZATION; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION;

DATA REDUCTION;

EID: 77956518472     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Abbeel, P. and Ng, A.Y. Apprenticeship learning via inverse reinforcement learning. In Proceedings of the twenty-first international conference on Machine learning, pp. 1. ACM, 2004.
2. Abbeel, Pieter, Coates, Adam, Quigley, Morgan and Ng, Andrew Y. An application of reinforcement learning to aerobatic helicopter flight. In In Advances in Neural Information Processing Systems 19. MIT Press, 2007.
3. Baker, CL., Tenenbaum, J.B., and Saxe, R.R. Goal inference as inverse planning. In Proceedings of the 29th annual meeting of the cognitive science society, 2007.
4. Collins, S., Ruina, A., Tedrake, R. and Wisse, M. Efficient bipedal robots based on passive-dynamic walkers. Science, 307(5712):1082, 2005.
5. Deng, H. and Krstic, M. Stochastic nonlinear stabilization-I: A backstepping design. Systems and Control Letters, 32(3):143-150, 1997.
6. Kaiman, R. When is a linear control system optimal? Trans AMSE J Basic Eng, Ser D, pp. 51-60, 1964.
7. Kappen, H.J. Linear theory for control of nonlinear stochastic systems. Physical Review Letters, 95(20): 200-201, 2005.
8. Körding, K.P. and Wolpert, D.M. The loss function of sensorimotor learning. Proceedings of the National Academy of Sciences of the United States of America, 101(26):9839, 2004.
9. Ng, A.Y. and Russell, S. Algorithms for inverse reinforcement learning. In Proceedings of the Seventeenth International Conference on Machine Learning, pp. 663-670. Morgan Kaufmann Publishers Inc., 2000.
10. Schmidt, M. minfunc, 2005. http://www.cs.ubc.ca/~schmidtm/Software/ minFunc.html.
11. Srinivasan, M. and Ruina, A. Computer optimization of a minimal biped model discovers walking and running. Nature, 439(7072):72-75, 2005.
12. Syed, U., Bowling, M. and Schapire, R.E. Apprenticeship learning using linear programming. In Proceedings of the 25th international conference on Machine learning, pp. 1032-1039. ACM, 2008.
13. Todorov, E. Optimality principles in sensorimotor control. Nature Neuroscience, 7(9):907-915, 2004.
14. Todorov, E. Linearly-solvable Markov decision problems. Advances in neural information processing systems, 19:1369, 2007.
15. Todorov, E. Eigenfunction approximation methods for linearly-solvable optimal control problems. In IEEE International Symposium on Adaptive Dynamic Programming and Reinforcemenet Learning, 2009a.
16. Todorov, E. Efficient computation of optimal actions. Proceedings of the National Academy of Sciences, 106(28):11478, 2009b.
17. Treuille, A., Lee, Y. and Popovic, Z. Near-optimal character animation with continuous control. In ACM SIGGRAPH 2007 papers, pp. 7. ACM, 2007.
18. Yin, Wotao. Gurobi mex: A matlab interface for gurobi, 2009-2010. http://www.caam.rice.edu/~wyl/gurobimmex.
19. Ziebart, B.D., Maas, A., Bagnell, J.A. and Dey, A.K. Maximum entropy inverse reinforcement learning. In Proc. AAAI, pp. 1433-1438, 2008.