Accurate realtime full-body motion capture using a single depth camera

ACM Transactions on Graphics

Volumn 31, Issue 6, 2012, Pages

  Wei, Xiaolin ^a   Zhang, Peizhao ^a   Chai, Jinxiang ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

3D pose detection; Human motion tracking; Motion capture; Performance based animation; Vision based motion modeling

Indexed keywords

3D TRACKING; ALTERNATIVE SYSTEMS; AUTOMATIC METHOD; DEPTH CAMERA; DEPTH CUE; DEPTH IMAGE; FULL BODY; FULL-BODY MOTIONS; HUMAN BODY MODELS; HUMAN MOTION TRACKING; HUMAN MOVEMENTS; HUMAN POSE; LINEAR SYSTEM SOLVER; MAP ESTIMATION; MAXIMUM A POSTERIORI; MOTION CAPTURE; MOTION MODELING; OCCLUSION REASONING; POSE DETECTION; REAL TIME; REAL-TIME REGISTRATION; REGISTRATION PROBLEMS; WHOLE PROCESS;

ANIMATION; CAMERAS; ITERATIVE METHODS; LINEAR SYSTEMS; TARGET TRACKING; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 84870234121     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2366145.2366207     Document Type: Conference Paper

References (21)

1. AMIT, Y., AND GEMAN, D. 1997. Shape quantization and recognition with randomized trees. Neural Computation. 9(7):1545-1588.
2. BAAK, A., MÜLLER, M., BHARAJ, G., SEIDEL, H.-P., AND THEOBALT, C. 2011. A data-driven approach for real-time full body pose reconstruction from a depth camera. In IEEE 13th International Conference on Computer Vision (ICCV), 1092-1099.
3. BAKER, S., AND MATTHEWS, I. 2004. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision. 56(3):221-255.
4. BREGLER, C., MALIK, J., AND PULLEN, K. 2004. Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision. 56(3):179-194.
5. CHAI, J., AND HODGINS, J. 2005. Performance animation from low-dimensional control signals. In ACM Transactions on Graphics. 24(3):686-696.
6. GANAPATHI, V., PLAGEMANN, C., KOLLER, D., AND THRUN, S. 2010. Real time motion capture using a single time-of-flight camera. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 755-762.
7. GIRSHICK, R., SHOTTON, J., KOHLI, P., CRIMINISI, A., AND FITZGIBBON, A. 2011. Efficient regression of general-activity human poses from depth images. In Proceedings of IEEE 13th International Conference on Computer Vision, 415-422.
8. GREST, D., KRUGER, V., AND KOCH, R. 2007. Single view motion tracking by depth and silhouette information. In Proceedings of the 15th Scandinavian Conference on Image Analysis (SCIA), 719-729.
9. KINECT, 2012. Microsoft Kinect for Xbox 360.
10. KNOOP, S., VACEK, S., AND DILLMANN, R. 2006. Sensor fusion for 3D human body tracking with an articulated 3D body model. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1686-1691.
11. LEPETIT, V., AND FUA, P. 2006. Keypoint recognition using randomized trees. IEEE Transactions on Pattern Analysis and Machine Intelligence. 28(9): 1465-1479.
12. LIU, H., WEI, X., CHAI, J., HA, I., AND RHEE, T. 2011. Realtime human motion control with a small number of inertial sensors. In Symposium on Interactive 3D Graphics and Games, ACM, I3D '11, 133-140.
13. MICROSFT KINECT API FOR WINDOWS, 2012. http://www.microsoft.com/en-us/ kinectforwindows/.
14. MOESLUND, T. B., HILTON, A., AND KRUGER, V. 2006. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding. 104:90-126.
15. PLAGEMANN, C., GANAPATHI, V., KOLLER, D., AND THRUN, S. 2010. Realtime identification and localization of body parts from depth images. In Proceedings of International Conferences on Robotics and Automation (ICRA 2010), 3108-3113.
16. SHOTTON, J., FITZGIBBON, A., COOK, M., SHARP, T., FINOCCHIO, M., MOORE, R., KIPMAN, A., AND BLAKE, A. 2011. Real-time human pose recognition in parts from a single depth image. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1297-1304.
17. SIDDIQUI, M., AND MEDIONI, G. 2010. Human pose estimation from a single view point, real-time range sensor. In CVCG at CVPR.
18. SLYPER, R., AND HODGINS, J. 2008. Action capture with accelerometers. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 193-199.
19. TAUTGES, J., ZINKE, A., KRÜGER, B., BAUMANN, J., WEBER, A., HELTEN, T., MÜLLER, M., SEIDEL, H.-P., AND EBERHARDT, B. 2011. Motion reconstruction using sparse accelerometer data. ACM Transactions on Graphics. 30(3): 18:1- 18:12.
20. VICON SYSTEMS, 2011. http://www.vicon.com.
21. YE, M., WANG, X., YANG, R., REN, L., AND POLLEFEYS, M. 2011. Accurate 3D pose estimation from a single depth image. In Proceedings of IEEE 13th International Conference on Computer Vision, 731-738.