VideoMocap: Modeling physically realistic human motion from monocular video sequences

ACM Transactions on Graphics

Volumn 29, Issue 4, 2010, Pages

  Wei, Xiaolin ^a   Chai, Jinxiang ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Data driven animation; Interactive 3D visual tracking; Performance animation; Physics based animation; Video based motion capture; Vision for graphics

Indexed keywords

DATA-DRIVEN ANIMATION; PERFORMANCE ANIMATION; PHYSICS-BASED ANIMATION; VIDEO-BASED MOTION CAPTURE; VISION FOR GRAPHICS; VISUAL TRACKING;

ANIMATION; VIDEO RECORDING;

THREE DIMENSIONAL;

EID: 77956366084     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1778765.1778779     Document Type: Article

References (34)

1. AGARWAL, A., AND TRIGGS, B. 2006. Recovering 3D human pose from monocular images. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI). 28 (1):44-58.
2. BAZARAA, M. S., SHERALI, H. D., AND SHETTY, C. M. 1993. Nonlinear Programming: Theory and Algorithms. John Wiley and Sons Ltd. 2nd Edition.
3. BREGLER, C., MALIK, J., AND PULLEN, K. 2004. Twist Based Acquisition and Tracking of Animal and Human Kinematics. International Journal of Computer Vision. 56 (3):179-194.
4. BRUBAKER, M. A., AND FLEET, D. J. 2008. The Kneed Walker for human pose tracking. In Proceedings of IEEE CVPR. 1-8.
5. CHAI, J., AND HODGINS, J. 2005. Performance Animation from Low-dimensional Control Signals. In ACM Transactions on Graphics. 24 (3):686-696.
6. CHEN, Y.-L., AND CHAI, J. 2009. Simultaneous Reconstruction of 3D Human Skeleton and Motion from Monocular Video Sequences. Proceedings of The Ninth Asian Conference on Computer Vision.
7. COHEN, M. F. 1992. Interactive Spacetime Control for Animation. In Proceedings of ACM SIGGRAPH 1992. 293-302.
8. COMANICIU, D., AND MEER, P. 2002. Mean Shift:A Robust Approach Toward Feature Space Analysis. In IEEE Trans. Pattern Analysis and Machine Intelligence. 24 (5):603-619.
9. COWLEY, A., AND TAYLOR, C. J., 2001. Videomocap: A video based motion capture system. http://www.cis.upenn.edu/cjtaylor/RESEARCH/projects/Johansson/ VideoMoCap.html.
10. DIFRANCO, D. E., CHAM, T.-J., AND REHG, J. M. 2001. Reconstruction of 3D figure motion from 2D correspondences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1:307-314.
11. ELGAMMAL, A., AND LEE, C. 2004. Inferring 3D body pose from silhouettes using activity manifold learning. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2:681-688.
12. HAMPEL, F. R., RONCHETTI, E. M., ROUSSEEUW, P. J., AND STAHEL, W. A. 1986. Robust Statistics: The Approach Based on Influence Functions. Wiley.
13. HOWE, N., LEVENTON, M., AND FREEMAN, W. 1999. Bayesian Reconstruction of 3D Human Motion from Singlecamera Video. In Advances in Neural Information Processing Systems 12. 820-826.
14. HUBER, P. J. 1981. Robust Statistics. Wiley.
15. 3E: Discriminative density propagation for visual tracking. In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI). 29 (11):2030-2044.
16. LIU, K., HERTZMANN, A., AND POPOVIĆ, Z. 2005. Learning Physics-Based Motion Style with Nonlinear Inverse Optimization. In ACM Transactions on Graphics. 23 (3):1071-1081.
17. LOURAKIS, M. I. A. 2009. levmar: Levenberg marquardt nonlinear least squares algorithms in c/c++. In http://www.ics.forth.gr/lourakis/levmar/.
18. LOY, G., ERIKSSON, M., SULLIVAN, J., AND CARLSSON, S. 2004. Monocular 3D Reconstruction of Human motion in Long Action Sequences. In European Conference on Computer Vision. 442-455.
19. MATCHMOVER, 2008. http://www.realviz.com/.
20. PAVLOVIĆ, V., REHG, J. M., AND MACCORMICK, J. 2000. Learning Switching Linear Models of Human Motion. In Advances in Neural Information Processing Systems 13, 981-987.
21. POLLARD, N., AND REITSMA, P. 2001. Animation of Humanlike Characters: Dynamic Motion Filtering with A Physically Plausible Contact Model. In In Yale Workshop on Adaptive and Learning Systems.
22. POPOVIĆ, Z., AND WITKIN, A. P. 1999. Physically Based Motion Transformation. In Proceedings of ACM SIGGRAPH 1999. 11-20.
23. ROSALES, R., AND SCLAROFF, S. 2000. Specialized Mappings and the Estimation of Human Body Pose from a Single Image. In Proceedings of the Workshop on Human Motion. 19-24.
24. SAFONOVA, A., HODGINS, J., AND POLLARD, N. 2004. Synthesizing Physically Realistic Human Motion in Low-Dimensional, Behavior-Specific Spaces. In ACM Transactions on Graphics. 23 (3):514-521.
25. SIDENBLADH, H., BLACK, M. J., AND SIGAL, L. 2002. Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In European Conference on Computer Vision. 784-800.
26. SMINCHISESCU, C., AND JEPSON, A. 2004. Generative Modeling for Continuous Non-Linearly Embedded Visual Inference. In ICML, 759-766.
27. SULEJMANPASIC, A., AND POPOVIĆ, J. 2005. Adaptation of Performed Ballistic Motion. In ACM Transactions on Graphics. 24 (1):165-179.
28. TAYLOR, C. J. 2000. Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image. In Computer Vision and Image Understanding. 80 (3):349-363.
29. URTASUN, R., FLEET, D. J., HERTZMANN, A., AND FUA, P. 2005. Priors for people tracking from small training sets. In IEEE International Conference on Computer Vision, 403-410.
30. VICON SYSTEMS, 2009. http://www.vicon.com.
31. VONDRAK, M., SIGAL, L., AND JENKINS, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
32. WEI, X., AND CHAI, J. 2008. Interactive Tracking of 2D Generic Objects with Spacetime Optimization. In Proceedings of European Conference on Computer Vision. 1:657-670.
33. WEI, X., AND CHAI, J. 2009. Modeling 3D Human Poses from Uncalibrated Monocular Images. Proceedings of IEEE Conference on Computer Vision.
34. WITKIN, A., AND KASS, M. 1988. Spacetime Constraints. In Proceedings of ACM SIGGRAPH 1998. 159-168.