Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture

ACM Transactions on Graphics

Volumn 33, Issue 6, 2014, Pages

  Zhang, Peizhao ^a   Siu, Kristin ^b   Zhang, Jianjie ^a   Liu, C Karen ^b   Chai, Jinxiang ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Full body shape modeling; Human body tracking; Motion capture; Physics based modeling

Indexed keywords

CAMERAS; IMAGE RECONSTRUCTION; INPUT OUTPUT PROGRAMS; ITERATIVE METHODS; KINEMATICS; MOTION CAPTURE; MOTION TRACKING; PRESSURE MEASUREMENT; PRESSURE SENSORS; QUADRATIC PROGRAMMING;

ALTERNATIVE SYSTEMS; FULL BODY; HUMAN BODY TRACKING; ITERATIVE LINEAR SOLVER; MOTION RECONSTRUCTION; MULTIPLE DEPTH CAMERAS; OPTIMIZATION FRAMEWORK; PHYSICS-BASED MODELING;

WEARABLE SENSORS;

EID: 84914689133     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2661229.2661286     Document Type: Conference Paper

References (35)

1. ADELSBERGER, R., AND TRÖSTER, G. 2013. Pimu: A wireless pressure-sensing imu. In ISSNIP, IEEE Proceedings of the 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing.
2. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. ACM Trans. Graph. 22, 3 (July), 587-594.
3. ASCENSION, 2014. http://www.ascension-tech.com/.
4. BAAK, A., MÜLLER, M., BHARAJ, G., SEIDEL, H.-P., AND THEOBALT, C. 2011. A data-driven approach for real-time full body pose reconstruction from a depth camera. In IEEE 13th International Conference on Computer Vision (ICCV), 1092-1099.
5. BREGLER, C., MALIK, J., AND K PULLEN. 2004. Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision. 56(3):179-194.
6. BRIDSON, R., MARINO, S., AND FEDKIW, R. 2003. Simulation of clothing with folds and wrinkles. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 28-36.
7. BRUBAKER, M. A., AND FLEET, D. J. 2008. The Kneed Walker for human pose tracking. In Proceedings of IEEE CVPR.
8. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '96, 303-312.
9. DE AGUIAR, E., STOLL, C., THEOBALT, C., AHMED, N., SEIDEL, H.-P., AND THRUN, S. 2008. Performance capture from sparse multi-view video. ACM Trans. Graph. 27, 3 (Aug.), 98:1-98:10.
10. ELGAMMAL, A., AND LEE, C. 2004. Inferring 3D body pose from silhouettes using activity manifold learning. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2: 681-688.
11. FISCHLER, M. A., AND BOLLES, R. C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. of the ACM 24, 6, 381-395.
12. FISHER, S., AND LIN, M. C. 2001. Deformed distance fields for simulation of non-penetrating flexible bodies. In Proceedings of the Eurographic Workshop on Computer Animation and Simulation, Springer-Verlag New York, Inc., New York, NY, USA, 99-111.
13. GREST, D., KRUGER, V., AND KOCH, R. 2007. Single view motion tracking by depth and silhouette information. In Proceedings of the 15th Scandinavian Conference on Image Analysis (SCIA), 719-729.
14. GUENDELMAN, E., BRIDSON, R., AND FEDKIW, R. 2003. Nonconvex rigid bodies with stacking. ACM Trans. Graph. 22, 3 (July), 871-878.
15. HA, S., BAI, Y., AND LIU, C. K. 2011. Human motion reconstruction from force sensors. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '11, 129-138.
16. HASLER, N., STOLL, C., SUNKEL, M., ROSENHAHN, B., AND SEIDEL, H.-P. 2009. A statistical model of human pose and body shape. In Computer Graphics Forum (Proc. Eurographics 2008), P. Dutr'e and M. Stamminger, Eds., vol. 2.
17. KNOOP, S., VACEK, S., AND DILLMANN, R. 2006. Sensor fusion for 3d human body tracking with an articulated 3d body model. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1686-1691.
18. KOVAR, L., SCHREINER, J., AND GLEICHER, M. 2002. Footskate cleanup for motion capture editing. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '02, 97-104.
19. MICROSOFT KINECT API FOR WINDOWS, 2014. http://www.microsoft.com/en-us/kinectforwindows/.
20. MOESLUND, T. B., HILTON, A., AND KRÜGER, V. 2006. A survey of advances in vision-based human motion capture and analysis. Journal of Computer Vision and Image Understanding. 104:90-126.
21. PAVLOVIĆ, V., REHG, J. M., AND MACCORMICK, J. 2000. Learning Switching Linear Models of Human Motion. In Advances in Neural Information Processing Systems 13, 981-987.
22. PLAGEMANN, C., GANAPATHI, V., KOLLER, D., AND THRUN, S. 2010. Realtime identification and localization of body parts from depth images. In Proceedings of International Conferences on Robotics and Automation (ICRA 2010), 3108-3113.
23. ROSALES, R., AND SCLAROFF, S. 2000. Specialized mappings and the estimation of human body pose from a single image. In Proceedings of the Workshop on Human Motion. 19-24.
24. SHOTTON, J., FITZGIBBON, A., COOK, M., SHARP, T., FINOCCHIO, M., MOORE, R., KIPMAN, A., AND BLAKE, A. 2011. Real-time human pose recognition in parts from a single depth image. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1297-1304.
25. TEKSCAN, 2014. http://www.tekscan.com/.
26. URTASUN, R., FLEET, D. J., HERTZMANN, A., AND FUA., P. 2005. Priors for people tracking from small training sets. In IEEE International Conference on Computer Vision, 403-C410.
27. VICON SYSTEMS, 2014. http://www.vicon.com.
28. VLASIC, D., BARAN, I., MATUSIK, W., AND POPOVIĆ, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Trans. Graph. 27, 3 (Aug.), 97:1-97:9.
29. VONDRAK, M., SIGAL, L., AND JENKINS, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
30. VONDRAK, M., SIGAL, L., HODGINS, J., AND JENKINS, O. 2012. Video-based 3d motion capture through biped control. ACM Trans. Graph. 31, 4 (July), 27:1-27:12.
31. WEI, X. K., AND CHAI, J. 2010. Videomocap: Modeling physically realistic human motion from monocular video sequences. ACM Transactions on Graphics. 29(4): Article No. 42.
32. WEI, X., ZHANG, P., AND CHAI, J. 2012. Accurate realtime full-body motion capture using a single depth camera. ACM Trans. Graph. 31, 6 (Nov.), 188:1-188:12.
33. XSENS, 2014. http://www.xsens.com.
34. YE, M., WANG, X., YANG, R., REN, L., AND POLLEFEYS, M. 2011. Accurate 3d pose estimation from a single depth image. In Proceedings of IEEE 13th International Conference on Computer Vision, 731-738.
35. YIN, K., AND PAI, D. K. 2003. Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 329-338.