Robust task-based control policies for physics-based characters

ACM Transactions on Graphics

Volumn 28, Issue 5, 2009, Pages

  Coros, Stelian ^a   Beaudoin, Philippe ^a   Van De Panne, Michiel ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Animation; Simulation of skilled movement

Indexed keywords

CONSTRAINED STATE; CONTROL POLICY; DYNAMICS MODELS; FINITE VOLUME; OPTIMIZED CONTROL; PHYSICS-BASED; PRECOMPUTING; ROBUST TASK; TARGET LOCATION; TASK STATE;

ANIMATION; REINFORCEMENT;

INTERACTIVE COMPUTER GRAPHICS;

EID: 77749243022     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1661412.1618516     Document Type: Conference Paper

References (36)

1. ABE, Y., DA SILVA, M., AND POPOVÍC, J. 2007. Multiobjective control with frictional contacts. In Proc. ACM SIGGRAPH/EG Symposium on Computer Animation, 249-258.
2. ATKESON, C. G., AND MORIMOTO, J. 2003. Nonparametric representation of policies and value functions: A trajectory-based approach. In Advances in Neural Information Processing Systems 15, 1611-1618.
3. ATKESON, C. G., AND STEPHENS, B. 2007. Random sampling of states in dynamic programming. In Proc. Neural Information Processing Systems Conf.
4. BYL, K., AND TEDRAKE, R. 2008. Approximate optimal control of the compass gait on rough terrain. In Proc. IEEE Int'l Conf. on Robotics and Automation.
5. CHESTNUTT, J., LAU, M., CHEUNG, K. M., KUFFNER, J., HODGINS, J. K., AND KANADE, T. 2005. Footstep planning for the Honda ASIMO humanoid. In Proc. IEEE Int'l Conf. on Robotics and Automation.
6. CHESTNUTT, J. 2007. Navigation Planning for Legged Robots. PhD thesis, Carnegie Mellon University.
7. CHOI, M., LEE, J., AND SHIN, S. 2003. Planning biped locomotion using motion capture data and probabilistic roadmaps. ACM Transactions on Graphics 22, 2, 182-203.
8. COROS, S., BEAUDOIN, P., YIN, K., AND VAN DE PANNE, M. 2008. Synthesis of constrained walking skills. ACM Trans. on Graphics (Proc. SIGGRAPH ASIA) 27, 5, Article 113.
9. DA SILVA, M., ABE, Y., AND POPOVÍC, J. 2008. Interactive simulation of stylized human locomotion. ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3, Article 82.
10. DA SILVA, M., DURAND, F., AND POPOVIC, J. 2009. Linear Bellman combination for control of character animation. ACM Trans. on Graphics (Proc. SIGGRAPH) 28, 3, Article 82.
11. ERNST, D., GEURTS, P., AND WEHENKEL, L. 2005. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research 6, 503-556.
12. FALOUTSOS, P., VAN DE PANNE, M., AND TERZOPOULOS, D. 2001. Composable controllers for physics-based character animation. In Proc. ACM SIGGRAPH, 251-260.
13. HODGINS, J., WOOTEN, W., BROGAN, D., AND O'BRIEN, J. 1995. Animating human athletics. In Proc. ACM SIGGRAPH, 71-78.
14. IKEMOTO, L., ARIKAN, O., AND FORSYTH, D. A. 2005. Learning to move autonomously in a hostile world. Tech. Rep. UCB/CSD-05-1395, EECS Department, University of California, Berkeley, Jun.
15. KAJITA, S., KANEHIRO, F., KANEKO, K., FUJIWARA, K., HARADA, K., YOKOI, K., AND HIRUKAWA, H. 2003. Biped walking pattern generation by using preview control of zeromoment point. In Proc. IEEE Int'l Conf. on Robotics and Automation.
16. KHATIB, O., SENTIS, L., PARK, J., AND WARREN, J. 2004. Whole body dynamic behavior and control of human-like robots. International Journal of Humanoid Robotics 1, 1, 29-43.
17. LASZLO, J. F., VAN DE PANNE, M., AND FIUME, E. 1996. Limit cycle control and its application to the animation of balancing and walking. In Proc. ACM SIGGRAPH, 155-162.
18. LAU, M., AND KUFFNER, J. J. 2005. Behavior planning for character animation. In ACM SIGGRAPH/EG Symposium on Computer Animation.
19. LAU, M., AND KUFFNER, J. 2006. Precomputed search trees: Planning for interactive goal-driven animation. In ACM SIGGRAPH/ EG Symposium on Computer Animation, 299-308.
20. LEE, J., AND LEE, K. H. 2004. Precomputing avatar behavior from human motion data. ACM SIGGRAPH/EG Symposium on Computer Animation, 79-87.
21. LO, W., AND ZWICKER, M. 2008. Real-time planning for parameterized human motion. In ACM SIGGRAPH/EG Symposium on Computer Animation.
22. MCCANN, J., AND POLLARD, N. 2007. Responsive characters from motion fragments. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3, Article 6.
23. MORIMOTO, J., AND ATKESON, C. G. 2007. Learning biped locomotion: Application of poincare-map-based reinforcement leraning. IEEE Robotics & Automation Magazine 14, 2, 41-51.
24. MORIMOTO, J., ATKESON, C. G., ENDO, G., AND CHENG, G. 2007. Improving humanoid locomotive performance with learnt approximated dynamics via guassian processes for regression. In Proc. IEEE Int'l Conf. on Robotics and Automation.
25. MUICO, U., LEE, Y., POPOVIC', J., AND POPOVIC', Z. 2009. Contact-aware nonlinear control of dynamic characters. ACM Transactions on Graphics (Proc. SIGGRAPH) 28, 3, Article 81.
26. ODE. Open dynamics engine, http://www.ode.org/.
27. RAIBERT, M. H., AND HODGINS, J. K. 1991. Animation of dynamic legged locomotion. In Proc. ACM SIGGRAPH, 349-358.
28. SHARON, D., AND VAN DE PANNE, M. 2005. Synthesis of controllers for stylized planar bipedal walking. In Proc. IEEE Int'l Conf. on Robotics and Automation.
29. SOK, K. W., KIM, M., AND LEE, J. 2007. Simulating biped behaviors from human motion data. ACM Trans. on Graphics (Proc. SIGGRAPH) 26, 3, Article 107.
30. SUTTON, R., AND BARTO, A. 1998. Reinforcement Learning: An Introduction. MIT Press.
31. TEDRAKE, R., ZHANG, T., AND SEUNG, H. 2004. Stochastic policy gradient reinforcement learning on a simple 3D biped. In Proc. Int'l Conf. on Intelligent Robots and Systems, vol. 3.
32. TREUILLE, A., LEE, Y., AND POPOVÍC, Z. 2007. Near-optimal character animation with continuous control. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3, Article 7.
33. YIN, K., LOKEN, K., AND VAN DE PANNE, M. 2007. SIMBICON: Simple biped locomotion control. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3, Article 105.
34. YOSHIDA, E., BELOUSOV, I., ESTEVES, C., AND LAUMOND, J. 2005. Humanoid motion planning for dynamic tasks. In Humanoid Robots.
35. ZHAO, L., AND SAFONOVA, A. 2008. Achieving good connectivity in motion graphs. In ACM SIGGRAPH/EG Symposium on Computer Animation.
36. ZORDAN, V., MAJKOWSKA, A., CHIU, B., AND FAST, M. 2005. Dynamic response for motion capture animation. ACM Transactions on Graphics (Proc. SIGGRAPH) 24, 3, 697-701.