Video-based 3D motion capture through biped control

ACM Transactions on Graphics

Volumn 31, Issue 4, 2012, Pages

  Vondrak, Marek ^a   Sigaly, Leonid ^b   Hodgins, Jessica ^b   Jenkinsx, Odest ^a  

^a BROWN UNIVERSITY   (United States)

^b DISNEY RESEARCH   (United States)

Author keywords

Bipedal control; Video based motion capture

Indexed keywords

3D MOTION CAPTURE; CONTROL PARAMETERS; CONTROL TASK; CONTROLLER STRUCTURES; FEEDBACK MECHANISMS; HIGH-DIMENSIONAL; HUMAN BEHAVIORS; HUMAN MOTIONS; INCREMENTAL OPTIMIZATION; MONOCULAR VIDEO; MOTION CAPTURE; OBJECTIVE FUNCTIONS; OPTIMAL CONTROLS; STATE-SPACE; VIDEO-BASED MOTION CAPTURE;

ESTIMATION; STRUCTURAL OPTIMIZATION;

CONTROLLERS;

EID: 84872238404     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2185520.2185523     Document Type: Article

References (37)

1. BARAFF, D. 1996. Linear-time dynamics using Lagrange multipliers. In ACM SIGGRAPH.
2. BHAT, K. S., SEITZ, S. M., POPOVIC, J., AND KHOSLA, P. 2002. Computing the physical parameters of rigid-body motion from video. In ECCV, 551-566.
3. BO, L., AND SMINCHISESCU, C. 2010. Twin Gaussian processes for structured prediction. IJCV 87, 1-2.
4. BRUBAKER, M. A., AND FLEET, D. J. 2008. The Kneed Walker for human pose tracking. In IEEE CVPR.
5. BRUBAKER, M. A., FLEET, D. J., AND HERTZMANN, A. 2007. Physics-based person tracking using simplified lower body dynamics. In IEEE CVPR.
6. BRUBAKER, M. A., SIGAL, L., AND FLEET, D. J. 2009. Estimating contact dynamics. In ICCV.
7. CHU, D., SHAPIRO, A., ALLEN, B., AND FALOUTSOS, P. 2007. A dynamic controller toolkit. In ACM SIGGRAPH Video Game Symposium (Sandbox), 21-26.
8. CLINE, M. 2002. Rigid Body Simulation with Contact and Constraints. Master's thesis, The University of British Columbia.
9. COROS, S., BEAUDOIN, P., AND VAN DE PANNE, M. 2009. Robust task-based control policies for physics-based characters. In ACM Transactions on Graphics, vol. 28.
10. CRISIS. 2006. http://crisis.sourceforge.net/.
11. DEMPSTER, W. T. 1955. Space requirements of the seated operator: Geometrical, kinematic, and mechanical aspects of the body with special reference to the limbs. Tech. rep., Wright-Patterson Air Force Base 55-159.
12. ELGAMMAL, A., HARWOOD, D., AND DAVIS, L. 2000. Nonparametric model for background subtraction. In ECCV.
13. GALL, J., STOLL, C., DE AGUIAR, E., THEOBALT, C., ROSENHAHN, B., AND SEIDEL, H.-P. 2009. Motion capture using joint skeleton tracking and surface estimation. In IEEE CVPR, 1746-1753.
14. HANSEN, N. 2006. The CMA evolution strategy: A comparing review. Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms., 75-102.
15. HODGINS, J. K., WOOTEN, W. L., BROGAN, D. C., AND O'BRIEN, J. F. 1995. Animating human athletics. In ACM SIGGRAPH, 71-78.
16. KWON, T., AND HODGINS, J. 2010. Control systems for human running using an inverted pendulum model and a reference motion capture sequence. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation.
17. LEE, Y., KIM, S., AND LEE, J. 2010. Data-driven biped control. ACM Transactions on Graphics 29, 4.
18. LIU, C. K., HERTZMANN, A., AND POPOVIĆ, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Transactions on Graphics 24, 3.
19. LIU, L., YIN, K., VAN DE PANNE, M., SHAO, T., AND XU, W. 2010. Sampling-based contact-rich motion control. ACM Transactions on Graphics 29, 4.
20. METAXAS, D., AND TERZOPOULOS, D. 1993. Shape and nonrigid motion estimation through physics-based synthesis. IEEE Transactions on PAMI 15, 6, 580-591.
21. MUICO, U., LEE, Y., POPOVIC, J., AND POPOVIC, Z. 2009. Contact-aware nonlinear control of dynamic characters. ACM Transactions on Graphics 28, 3.
22. NGO, T., AND MARKS, J. 1993. Spacetime constraints revisited. In ACM SIGGRAPH.
23. ODE. 2006. http://www.ode.org/.
24. PANG, J. S., AND FACCHINEI, F. 2003. Finite-dimensional variational inequalities and complementarity problems (i). Springer.
25. SCHAAL, S., AND SCHWEIGHOFER, N. 2005. Computational motor control in humans and robots. Cur. Op. in Neurobio., 6.
26. SIGAL, L., BALAN, A., AND BLACK, M. J. 2010. Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal of Computer Vision 87, 1-2, 4-27.
27. SILVA, M. D., ABE, Y., AND POPOVIC, J. 2008. Interactive simulation of stylized human locomotion. ACM Transactions on Graphics 27, 3.
28. SMINCHISESCU, C., KANAUJIA, A., AND METAXAS, D. 2007. Bm3e: Discriminative density propagation for visual tracking. IEEE Transactions on PAMI 29, 11.
29. TSAI, Y.-Y., CHENG, K. B., LIN, W.-C., LEE, J., AND LEE, T.-Y. 2010. Real-time physics-based 3d biped character animation using an inverted pendulum model. IEEE Transactions on Visualization and Computer Graphics 16, 2, 325-337.
30. URTASUN, R., J.FLEET, D., AND FUA, P. 2006. Gaussian process dynamical models for 3d people tracking. In IEEE CVPR.
31. VONDRAK, M., SIGAL, L., AND JENKINS, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE CVPR.
32. WANG, J., FLEET, D. J., AND HERTZMANN, A. 2009. Optimizing walking controllers. ACM Transactions on Graphics 28, 5.
33. WANG, J., FLEET, D. J., AND HERTZMANN, A. 2010. Optimizing walking controllers for uncertain inputs and environments. ACM Transactions on Graphics 29, 4.
34. WEI, X., AND CHAI, J. 2010. Videomocap: Modeling physically realistic human motion from monocular video sequences. ACM Transactions on Graphics 29, 4.
35. WREN, C. R., AND PENTLAND, A. 1998. Dynamic models of human motion. In Automatic Face and Gesture Recognition.
36. YIN, K., LOKEN, K., AND VAN DE PANNE, M. 2007. SIMBICON: Simple biped locomotion control. ACM Transactions on Graphics 26, 3.
37. YIN, K., COROS, S., BEAUDOIN, P., AND VAN DE PANNE, M. 2008. Continuation methods for adapting simulated skills. ACM Transactions on Graphics 27, 3.