Linear Bellman combination for control of character animation

ACM Transactions on Graphics

Volumn 28, Issue 3, 2009, Pages

  Da Silva, Marco ^a   Durand, Frédo ^a   Popovi, Jovan ^a,b,c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ADOBE RESEARCH   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Optimal control; Physically based animation

Indexed keywords

CHARACTER ANIMATION; COMPUTER OPTIMIZATION; MANUAL TUNING; OPTIMAL CONTROL; PHYSICALLY BASED ANIMATION; STEPPING MOTION;

ANIMATION; COMPUTER CONTROL SYSTEMS; OPTIMIZATION;

CONTROLLERS;

EID: 70349666986     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1531326.1531388     Document Type: Conference Paper

References (46)

1. ABBEEL, P., AND NG, A. Y. 2004. Apprenticeship learning via inverse reinforcement learning. In International Conference on Machine learning (ICML), ACM, vol.69, 1:1-1:8.
2. ATKESON, C. G., AND MORIMOTO, J. 2002. Nonparametric representation of policies and value functions: A trajectory-based approach. In Advances in Neural Information Processing Systems (NIPS), vol.15, 1611-1618.
3. ATKESON, C. G. 1994. Using local trajectory optimizers to speed up global optimization in dynamic programming. In Advances in Neural Information Processing Systems (NIPS), vol.6, 663-670.
4. BARBIC, J., AND POPOVIC , J. 2008. Real-time control of physically based simulations using gentle forces. ACM Transactions on Graphics 27, 5, 163:1-163:10.
5. BELLMAN, R. E. 1957. Dynamic Programming. Princeton University Press, Princeton, NJ.
6. BERGOU, M., MATHUR, S., WARDETZKY, M., AND GRINSPUN, E. 2007. Tracks: toward directable thin shells. ACM Transactions on Graphics 26, 3, 50:1-50:10.
7. BERTSEKAS, D. P. 2007. Dynamic Programming and Optimal Control, 3 ed., vol.I. Athena Scientific, Nashua, NH.
8. BROTMAN, L. S., AND NETRAVALI, A. N. 1988. Motion interpolation by optimal control. In Computer Graphics (Proceedings of SIGGRAPH 88), 309-315.
9. BURRIDGE, R. R., RIZZI, A. A., AND KODITSCHEK, D. E. 1999. Sequential composition of dynamically desterous robot behaviours. International Journal of Robotics Research 18, 6, 534-555.
10. COROS, S., BEAUDOIN, P., YIN, K., AND VAN DE PANNE, M. 2008. Synthesis of constrained walking skills. ACM Transactions on Graphics 27, 5, 113:1-113:9.
11. DA SILVA, M., ABE, Y., AND POPOVIC, J. 2008. Simulation of human motion data using short-horizon model-predictive control. Computer Graphics Forum 27, 2, 371-380.
12. DA SILVA, M., ABE, Y., AND POPOVIC , J. 2008. Interactive simulation of stylized human locomotion. ACM Transactions on Graphics 27, 3, 82:1-82:10.
13. EREZ, T., AND SMART, W. 2007. Bipedal walking on rough terrain using manifold control. International Conference on Intelligent Robots and Systems (IROS), 1539-1544.
14. FALOUTSOS, P., VAN DE PANNE, M., AND TERZOPOULOS, D. 2001. Composable controllers for physics-based character animation. In Proceedings of ACM SIGGRAPH 2001, Annual Conference Series, 251-260.
15. FATTAL, R., AND LISCHINSKI, D. 2004. Target-driven smoke animation. ACM Transactions on Graphics 23, 3, 441-448.
16. FLEMING, W. H. 1978. Exit probabilities and optimal stochastic control. Applied Mathematics and Optimization 4, 329-346.
17. HODGINS, J. K., AND POLLARD, N. S. 1997. Adapting simulated behaviors for new characters. In Proceedings of SIGGRAPH 97, Annual Conference Series, 153-162.
18. HODGINS, J. K., WOOTEN, W. L., BROGAN, D. C., AND O'BRIEN, J. F. 1995. Animating human athletics. In Proceedings of ACM SIGGRAPH 95, Annual Conference Series, 71-78.
19. HOLLAND, C. 1977. A new energy characterization of the smallest eigenvalue fo the schrödinger equation. Communications on Pure and Applied Mathematics 30, 755-765.
20. JACOBSON, D., AND MAYNE, D. 1970. Differential Dynamic Programming, 1st ed. Elsevier, New York.
21. KAPPEN, H. J. 2005. Linear theory for control of nonlinear stochastic systems. Physical Review Letters 95, 20, 200-204.
22. LASZLO, J. F., VAN DE PANNE, M., AND FIUME, E. L. 1996. Limit cycle control and its application to the animation of balancing and walking. In Proceedings of SIGGRAPH 96, Annual Conference Series, 155-162.
23. LIU, C. K., HERTZMANN, A., AND POPOVIC, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Transactions on Graphics 24, 3, 1071-1081.
24. MCCANN, J., AND POLLARD, N. 2007. Responsive characters from motion fragments. ACM Transactions on Graphics 26, 3, 6:1-6:7.
25. MCNAMARA, A., TREUILLE, A., POPOVIC, Z., AND STAM, J. 2004. Fluid control using the adjoint method. ACM Transactions on Graphics 23, 3, 449-456.
26. MILAM, M. B. 2003. Real-Time Optimal Trajectory Generation for Constrained Dynamical Systems. PhD thesis, Caltech.
27. NGO, J. T., AND MARKS, J. 1993. Spacetime constraints revisited. In Proceedings of ACM SIGGRAPH 2000, Annual Conference Series, 343-350.
28. OKSENDAL, B. K. 2002. Stochastic Differential Equations: An Introduction with Applications. Springer, New York, NY.
29. POLLARD, N. S., AND BEHMARAM-MOSAVAT, F. 2000. Forcebased motion editing for locomotion tasks. In In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 663-669.
30. POPOVIC , Z., AND WITKIN, A. P. 1999. Physically based motion transformation. In Computer Graphics (Proceedings of SIGGRAPH 99), ACM SIGGRAPH, Annual Conference Series, 11-20.
31. SAFONOVA, A., HODGINS, J., AND POLLARD, N. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Transactions on Graphics 23, 3, 514-521.
32. SOK, K. W., KIM, M., AND LEE, J. 2007. Simulating biped behaviors from human motion data. ACM Transactions on Graphics 26, 3, 107:1-107:9.
33. SULEJMANPASÍC, A., AND POPOVIC , J. 2005. Adaptation of performed ballistic motion. ACM Transactions on Graphics 24, 1, 165-179.
34. SUTTON, R. S., AND BARTO, A. G. 1998. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA.
35. TASSA, Y., EREZ, T., AND SMART, W. 2008. Receding horizon differential dynamic programming. In Advances in Neural Information Processing Systems (NIPS), vol.20, 1465-1472.
36. TODOROV, E. 2006. Bayesian Brain: Probabilistic Approaches to Neural Coding. MIT Press, Cambridge, MA, ch. 12, 269-298.
37. TODOROV, E. 2006. Linearly-solvable markov decision problems. Advances in Neural Information Processing Systems (NIPS) 19, 1369-1376.
38. TODOROV, E. 2008. Efficient computation of optimal actions. http://www.cogsci.ucsd.edu/-todorov/papers/framework.pdf. Unpublished manuscript, March.
39. TODOROV, E. 2009. Compositionality of optimal control laws. http://www.cogsci.ucsd.edu/-todorov/papers/primitives.pdf. Unpublished manuscript, January 15.
40. TREUILLE, A., LEE, Y., AND POPOVIC , Z. 2007. Near-optimal character animation with continuous control. ACM Transactions on Graphics 26, 3, 7:1-7:7.
41. VAN DE PANNE, M., KIM, R., AND FIUME, E. 1994. Synthesizing parameterized motions. In Eurographics Workshop on Simulation and Animation.
42. WITKIN, A., AND KASS, M. 1988. Spacetime constraints. In Computer Graphics (Proceedings of SIGGRAPH 88), vol.22, 159-168.
43. WOOTEN, W. L., AND HODGINS, J. K. 2000. Simulating leaping, tumbling, landing and balancing humans. International Conference on Robotics and Automation (ICRA), 656-662.
44. YIN, K., LOKEN, K., AND VAN DE PANNE, M. 2007. SIMBICON: Simple biped locomotion control. ACM Transactions on Graphics 26, 3, 105:1-105:10.
45. YIN, K., COROS, S., BEAUDOIN, P., AND VAN DE PANNE, M. 2008. Continuation methods for adapting simulated skills. ACM Transactions on Graphics 27, 3, 81:1-81:7.
46. ZORDAN, V. B., AND HODGINS, J. K. 2002. Motion capturedriven simulations that hit and react. In Symposium on Computer Animation (SCA), 89-96.