Infinite-horizon model predictive control for periodic tasks with contacts

Robotics: Science and Systems

Volumn 7, Issue , 2012, Pages 73-80

  Erez, Tom ^a   Tassa, Yuval ^b   Todorov, Emanuel ^c  

^a WASHINGTON UNIVERSITY   (United States)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84938253074     PISSN: None     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: 10.15607/rss.2011.vii.010     Document Type: Conference Paper

References (29)

1. F. A. Almeida. Waypoint navigation using constrained infinite horizon model predictive control. 2008.
2. J. Baxter and P. L. Bartlett. Infinite-horizon policygradient estimation. Journal of Artificial Intelligence Research, 15 (4): 319-350, 2001.
3. D. P. Bertsekas. Dynamic programming and suboptimal control: A survey from ADP to MPC. European Journal of Control, 11 (4-5): 310-334, 2005. ISSN 0947-3580.
4. H. G. Bock and K. J. Plitt. A multiple shooting algorithm for direct solution of optimal control problems. Proceedings of the 9th IFAC world congress, 1984.
5. A. E. Bryson and Y. C. Ho. Applied optimal control. Wiley New York, 1975. ISBN 0470114819.
6. Ahmed Chemori and Mazen Alamir. Multi-step limit cycle generation for rabbit's walking based on a nonlinear low dimensional predictive control scheme. Mechatronics, 16 (5): 259-277, June 2006. ISSN 0957-4158. doi: 16/j.mechatronics.2005.12. 001. URL http://www.sciencedirect.com/science/article/ pii/S095741580600002X.
7. H. Chen and F. Allgwer. A Quasi-Infinite horizon nonlinear model predictive control scheme with guaranteed stability. Automatica, 34 (10): 1205-1217, 1998. doi: 10.1016/S0005-1098 (98)00073-9. URL http://www. sciencedirect.com/science/article/B6V21-3VCT7RM-5/ 2/e304a7046ed4bc72e4b4ff0f03ceabde.
8. M. Diehl, H. Ferreau, and N. Haverbeke. Efficient numerical methods for nonlinear MPC and moving horizon estimation. Nonlinear Model Predictive Control, pages 391-417, 2009.
9. Dimitar Dimitrov, Pierre-Brice Wieber, Olivier Stasse, Hans Joachim Ferreau, and Holger Diedam. An optimized linear model predictive control solver for online walking motion generation. Proceedings of the 2009 IEEE international conference on Robotics and Automation, page 1266-1271, 2009. URL http://portal.acm.org/ citation.cfm?id=1703435.1703640. ACM ID: 1703640.
10. J. C. Dunn and D. P. Bertsekas. Efficient dynamic programming implementations of Newton's method for unconstrained optimal control problems. Journal of Optimization Theory and Applications, 63 (1): 23-38, 1989. ISSN 0022-3239.
11. A. Gosavi. A reinforcement learning algorithm based on policy iteration for average reward: Empirical results with yield management and convergence analysis. Machine Learning, 55 (1): 5-29, 2004. ISSN 0885-6125.
12. Bei Hu and A. Linnemann. Toward infinite-horizon optimality in nonlinear model predictive control. IEEE Transactions on Automatic Control, 47 (4): 679-682, 2002. doi: 10.1109/9.995049. URL http://ieeexplore.ieee. org/lpdocs/epic03/wrapper.htm?arnumber=995049.
13. David Harris Jacobson and D. Q. Mayne. Differential Dynamic Programming. Elsevier, 1970.
14. Sridhar Mahadevan. Average reward reinforcement learning: Foundations, algorithms, and empirical results. Machine Learning, 22: 159-196, 1996.
15. Ian R Manchester, Uwe Mettin, Fumiya Iida, and Russ Tedrake. Stable dynamic walking over uneven terrain. International Journal of Robotics Research, 30: 265-279, March 2011. ISSN 0278-3649. doi: http://dx.doi.org/ 10.1177/0278364910395339. URL http://dx.doi.org/10. 1177/0278364910395339. ACM ID: 1945949.
16. D. Q. Mayne, J. B. Rawlings, C. V. Rao, and P. O. Scokaert. Constrained model predictive control: Stability and optimality. Automatica, 36: 789-814, 2000. ISSN 0005-1098.
17. K. Mombaur. Using optimization to create self-stable human-like running. Robotica, 27 (03): 321-330, 2009. ISSN 0263-5747.
18. M. Morari and J. H. Lee. Model predictive control: past, present and future. Computers & Chemical Engineering, 23 (4-5): 667-682, 1999. ISSN 0098-1354.
19. G. Pannocchia, S. J. Wright, and J. B. Rawlings. Existence and computation of infinite horizon model predictive control with active steady-state input constraints. IEEE Transactions on Automatic Control, 48 (6): 1002-1006, 2003. doi: 10.1109/TAC.2003. 812783. URL http://ieeexplore.ieee.org/lpdocs/epic03/ wrapper.htm?arnumber=1205193.
20. L. S. Pontryagin, V. G. Boltyanskii, and R. V. Gamkrelidze. The Theory of Optimal Processes. 110 (7), 1956.
21. A. Schwartz. A reinforcement learning method for maximizing undiscounted rewards. In Proceedings of the Tenth International Conference on Machine Learning, volume 298, page 305, 1993.
22. S. P. Singh. Reinforcement learning algorithms for average-payoff Markovian decision processes. In Proceedings of the twelfth national conference on Artificial intelligence, pages 700-705, 1994. ISBN 0262611023.
23. Y. Tassa and E. Todorov. Stochastic complementarity for local control of discontinuous dynamics. In Proceedings of Robotics: Science and Systems (RSS), 2010.
24. Yuval Tassa, Tom Erez, and Emo Todorov. Optimal limitcycle control recast as bayesian inference. Proceedings of the 18th IFAC world congress, 1984.
25. Yuval Tassa, Tom Erez, and William Smart. Receding horizon differential dynamic programming. In J.C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, page 1465. MIT Press, Cambridge, MA, 2008.
26. R. Tedrake, T. W. Zhang, and H. S. Seung. Stochastic policy gradient reinforcement learning on a simple 3D biped. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), volume 3, pages 2849-2854, 2004. ISBN 0780384636.
27. K. Wampler and Z. Popović. Optimal gait and form for animal locomotion. ACM Transactions on Graphics (TOG), 28 (3): 1-8, 2009. ISSN 0730-0301. doi: 10.1145/1531326.1531366. URL http://portal.acm.org/ citation.cfm?doid=1531326.1531366.
28. Andrew Witkin and Michael Kass. Spacetime constraints. In Proceedings of the 15th annual conference on Computer graphics and interactive techniques-SIGGRAPH '88, pages 159-168, 1988. doi: 10.1145/54852. 378507. URL http://portal.acm.org/citation.cfm?doid= 54852.378507.
29. Jia-chi Wu and Zoran Popović. Terrain-adaptive bipedal locomotion control. ACM Trans. Graph., 29: 72: 1-72: 10, July 2010. ISSN 0730-0301.