Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs

Computer Graphics Forum

Volumn 36, Issue 2, 2017, Pages 349-360

  von Marcard, T ^a   Rosenhahn, B ^a   Black, M J ^b   Pons Moll, G ^b  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

Categories and Subject Descriptors (according to ACM CCS); I.3.3 Computer Graphics : Three Dimensional Graphics and Realism Animation

Indexed keywords

COMPUTER GRAPHICS;

3D HUMAN POSE ESTIMATION; DESCRIPTORS; HUMAN MOTION CAPTURE; INERTIAL SENSOR; JOINT OPTIMIZATION; MULTIPLE-FRAME; THREE-DIMENSIONAL GRAPHICS AND REALISM; UNDER-CONSTRAINED;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 85019702578     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.13131     Document Type: Article

References (36)

1. Akhter I., Black M.J.: Pose-conditioned joint angle limits for 3D human pose reconstruction. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (2015), pp. 1446–1455. 10
2. Andrews S., Huerta I., Komura T., Sigal L., Mitchell K.: Real-time physics-based motion capture with sparse sensors. In Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016) (2016), ACM, p. 5. 3, 10
3. Baak A., Helten T., Müller M., Pons-Moll G., Rosenhahn B., Seidel H.-P.: Analyzing and evaluating markerless motion tracking using inertial sensors. In European Conference on Computer Vision (2010), Springer, pp. 139–152. 4
4. Bogo F., Kanazawa A., Lassner C., Gehler P., Romero J., Black M.J.: Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image. In Computer Vision – ECCV 2016 (Oct. 2016), Lecture Notes in Computer Science, Springer International Publishing. 2
5. Chai J., Hodgins J.K.: Performance animation from low-dimensional control signals. In ACM Transactions on Graphics (TOG) (2005), vol. 24, ACM, pp. 686–696. 2
6. CMU motion capture database. http://mocap.cs.cmu.edu/. 1
7. Gall J., Stoll C., De Aguiar E., Theobalt C., Rosenhahn B., Seidel H.-P.: Motion capture using joint skeleton tracking and surface estimation. In Computer Vision and Pattern Recognition, 2009. CVPR 2009 (2009), pp. 1746–1753. 8
8. Hannink J., Kautz T., Pasluosta C., Gassmann K.-G., Klucken J., Eskofier B.: Sensor-based gait parameter extraction with deep convolutional neural networks. IEEE Journal of Biomedical and Health Informatics (2016). 2
9. Helten T., Muller M., Seidel H.-P., Theobalt C.: Real-time body tracking with one depth camera and inertial sensors. In Proceedings of the IEEE International Conference on Computer Vision (2013), pp. 1105–1112. 3
10. Hartley R., Trumpf J., Dai Y., Li H.: Rotation averaging. International Journal of Computer Vision 103, 3 (2013), 267–305. 5
11. Ionescu C., Papava D., Olaru V., Sminchisescu C.: Human3.6M: Large scale datasets and predictive methods for 3D human sensing in natural environments. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 7 (jul 2014), 1325–1339. 8
12. Loper M., Mahmood N., Romero J., Pons-Moll G., Black M.J.: SMPL: A skinned multi-person linear model. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 34, 6 (Oct. 2015), 248:1–248:16. 2, 3
13. Liu H., Wei X., Chai J., Ha I., Rhee T.: Realtime human motion control with a small number of inertial sensors. In Symposium on Interactive 3D Graphics and Games (2011), ACM, pp. 133–140. 2
14. Mixamo. http://www.mixamo.com/. 1
15. Murray R.M., Li Z., Sastry S.S., Sastry S.S.: A mathematical introduction to robotic manipulation. CRC press, 1994. 3
16. House of moves. http://moves.com/. 1
17. Marcard T. v., Pons-Moll G., Rosenhahn B.: Human pose estimation from video and IMUs. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 38, 8 (aug 2016), 1533–1547. 2, 3, 5, 8, 9
18. Pons-Moll G., Baak A., Gall J., Leal-Taixe L., Muller M., Seidel H., Rosenhahn B.: Outdoor human motion capture using inverse kinematics and von mises-fisher sampling. pp. 1243–1250. 3, 8
19. Pons-Moll G., Rosenhahn B.: Ball joints for marker-less human motion capture. In Applications of Computer Vision (WACV), 2009 Workshop on (2009), IEEE, pp. 1–8. 3
20. Pons-Moll G., Rosenhahn B.: Model-Based Pose Estimation. Springer, 2011, ch. 9, pp. 139–170. 3, 6
21. Pons-Moll G., Romero J., Mahmood N., Black M.J.: Dyna: A model of dynamic human shape in motion. ACM Transactions on Graphics, (Proc. SIGGRAPH) 34, 4 (2015), 120. 10
22. Roetenberg D., Luinge H., Slycke P.: Moven: Full 6dof human motion tracking using miniature inertial sensors. Xsen Technologies, December (2007). 2, 3, 8
23. Rhodin H., Richardt C., Casas D., Insafutdinov E., Shafiei M., Seidel H.-P., Schiele B., Theobalt C.: EgoCap: egocentric marker-less motion capture with two fisheye cameras. 162. 10
24. Sigal L., Balan A., Black M.: Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal on Computer Vision (IJCV) 87, 1 (2010), 4–27. 8
25. Slyper R., Hodgins J.: Action capture with accelerometers. In ACM SIGGRAPH/Eurographics, SCA (2008). 2
26. Simi Reality Motion Systems. http://www.simi.com. 1
27. Schwarz L., Mateus D., Navab N.: Discriminative human full-body pose estimation from wearable inertial sensor data. Modelling the Physiological Human (2009), 159–172. 2
28. Shiratori T., Park H.S., Sigal L., Sheikh Y., Hodgins J.K.: Motion capture from body-mounted cameras. In ACM Transactions on Graphics (TOG) (2011), vol. 30, ACM, p. 31. 10
29. Streuber S., Quiros-Ramirez M.A., Hill M.Q., Hahn C.A., Zuffi S., O'Toole A., Black M.J.: Body Talk: Crowdshaping realistic 3D avatars with words. ACM Trans. Graph. (Proc. SIGGRAPH) 35, 4 (July 2016), 54:1–54:14. 7
30. Taylor J., Bordeaux L., Cashman T., Corish B., Keskin C., Sharp T., Soto E., Sweeney D., Valentin J., Luff B., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Transactions on Graphics (TOG) 35, 4 (2016), 143. 2
31. Tagliasacchi A., Schröder M., Tkach A., Bouaziz S., Botsch M., Pauly M.: Robust articulated-ICP for real-time hand tracking. In Computer Graphics Forum (2015), vol. 34, Wiley Online Library, pp. 101–114. 2
32. Tautges J., Zinke A., Krüger B., Baumann J., Weber A., Helten T., Müller M., Seidel H.-P., Eberhardt B.: Motion reconstruction using sparse accelerometer data. ACM Transactions on Graphics (TOG) 30, 3 (2011), 18. 2
33. Vlasic D., Adelsberger R., Vannucci G., Barnwell J., Gross M., Matusik W., Popović J.: Practical motion capture in everyday surroundings. vol. 26, ACM, p. 35. 2, 3, 8
34. Vlasic D., Baran I., Matusik W., Popović J.: Articulated mesh animation from multi-view silhouettes. In ACM Transactions on Graphics (TOG) (2008), vol. 27, ACM, p. 97. 8
35. Vicon. http://www.vicon.com. 1
36. XSens. https://www.xsens.com/products/. 2, 9