SMPL: A skinned multi-person linear model

ACM Transactions on Graphics

Volumn 34, Issue 6, 2015, Pages

  Loper, Matthew ^a,b   Mahmood, Naureen ^a   Romero, Javier ^a   Pons Moll, Gerard ^a   Black, Michael J ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b Industrial Lights and Magic   (United States)

Author keywords

Blendshapes; Body shape; Skinning; Soft tissue

Indexed keywords

COMPUTER GRAPHICS;

BLENDSHAPES; BODY SHAPES; GRAPHICS PIPELINE; LINEAR FUNCTIONS; ROTATION MATRICES; SKINNING; SOFT TISSUE; SOFT TISSUE DEFORMATION;

TISSUE;

EID: 84995874936     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2816795.2818013     Document Type: Conference Paper

References (42)

1. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. ACM Trans. Graph. (Proc. SIGGRAPH) 21, 3 (July), 612-619.
2. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. ACM Trans. Graph. (Proc. SIGGRAPH) 22, 3, 587-594.
3. ALLEN, B., CURLESS, B., POPOVIĆ, Z., AND HERTZMANN, A. 2006. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Airela-Ville, Switzerland, Switzerland, SCA '06, 147-156.
4. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. SCAPE: Shape Completion and Animation of PEople. ACM Trans. Graph. (Proc. SIGGRAPH 24, 3, 408-416.
5. BARAN, I., AND POPOVIĆ, J. 2007. Automatic rigging and animation of 3D characters. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3 (July).
6. BOGO, F., ROMERO, J., LOPER, M., AND BLACK, M. J. 2014. FAUST: Dataset and evaluation for 3D mesh registration. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 3794-3801.
7. CHANG, W., AND ZWICKER, M. 2009. Range scan registration using reduced deformable models. Computer Graphics Forum 28, 2, 447-456.
8. CHEN, Y., LIU, Z., AND ZHANG, Z. 2013. Tensor-based human body modeling. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 105-112.
9. 2000. CMU graphics lab motion capture database. http://mocap.cs.cmu.edu. Accessed: 2012-12-11.
10. CORAZZA, S., AND GAMBARETTO, E., 2014. Automatic generation of 3D character animation from 3D meshes, Aug. 5. US Patent 8,797,328.
11. DE AGUIAR, E., THEOBALT, C., THRUN, S., AND SEIDEL, H.-P. 2008. Automatic conversion of mesh animations into skeleton-based animations. Computer Graphics Forum 27, 2, 389-397.
12. 2015. Dyna dataset. http://dyna.is.tue.mpg.de/. Accessed: 2015-05-15.
13. FREIFELD, O., AND BLACK, M. J. 2012. Lie bodies: A manifold representation of 3D human shape. In European Conf. on Computer Vision (ECCV), Springer-Verlag, A. Fitzgibbon et al. (Eds.), Ed., Part I, LNCS 7572, 1-14.
14. HASLER, N., STOLL, C., SUNKEL, M., ROSENHAHN, B., AND SEIDEL, H. 2009. A statistical model of human pose and body shape. Computer Graphics Forum 28, 2, 337-346.
15. HASLER, N.,THORMÄHLEN, T.,ROSENHAHN, B.,AND SEIDEL, H.-P. 2010. Learning skeletons for shape and pose. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, New York, NY, USA, I3D '10, 23-30.
16. HIRSHBERG, D., LOPER, M., RACHLIN, E., AND BLACK, M. 2012. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In European Conf. on Computer Vision (ECCV), Springer-Verlag, A. F. et al. (Eds.), Ed., LNCS 7577, Part IV, 242-255.
17. JAMES, D. L., AND TWIGG, C. D. 2005. Skinning mesh animations. ACM Trans. Graph. 24, 3 (July), 399-407.
18. KAVAN, L., AND ŽÁRA, J. 2005. Spherical blend skinning: A real-time deformation of articulated models. In Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games, ACM, New York, NY, USA, I3D '05, 9-16.
19. KAVAN, L., COLLINS, S., ŽÁRA, J., AND O'SULLIVAN, C. 2008. Geometric skinning with approximate dual quaternion blending. ACM Transactions on Graphics (TOG) 27, 4, 105:1-105:23.
20. KAVAN, L., COLLINS, S., AND O'SULLIVAN, C. 2009. Automatic linearization of nonlinear skinning. In Proceedings of the 2009 Symposium on Interactive 3D Graphics and Games, ACM, New York, NY, USA, I3D '09, 49-56.
21. KRY, P. G., JAMES, D. L., AND PAI, D. K. 2002. EigenSkin: Real time large deformation character skinning in hardware. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '02, 153-159.
22. KURIHARA, T., AND MIYATA, N. 2004. Modeling deformable human hands from medical images. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '04, 355-363.
23. LAWSON, C. L., AND HANSON, R. J. 1995. Solving least squares problems. Classics in applied mathematics. SIAM, Philadelphia, PA. SIAM : Society of industrial and applied mathematics.
24. LE, B. H., AND DENG, Z. 2012. Smooth skinning decomposition with rigid bones. ACM Trans. Graph. 31, 6 (Nov.), 199:1-199:10.
25. LE, B. H., AND DENG, Z. 2014. Robust and accurate skeletal rigging from mesh sequences. ACM Trans. Graph. 33, 4 (July), 84:1-84:10.
26. LEWIS, J. P., CORDNER, M., AND FONG, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '00, 165-172.
27. LOPER, M. M., AND BLACK, M. J. 2014. OpenDR: An approximate differentiable renderer. In Computer Vision - ECCV 2014, Springer, Heidelberg, D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, Eds., vol. 8695 of Lecture Notes in Computer Science, 154-169.
28. LOPER, M.M.,MAHMOOD, N.,AND BLACK, M. J. 2014. MoSh: Motion and shape capture from sparse markers. ACM Trans. Graph., (Proc. SIGGRAPH Asia) 33, 6 (Nov.), 220:1-220:13.
29. MERRY, B., MARAIS, P., AND GAIN, J. 2006. Animation space: A truly linear framework for character animation. ACM Trans. Graph. 25, 4 (Oct.), 1400-1423.
30. MILLER, C., ARIKAN, O., AND FUSSELL, D. 2010. Frankenrigs: Building character rigs from multiple sources. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, New York, NY, USA, I3D '10, 31-38.
31. MOHR, A., AND GLEICHER, M. 2003. Building efficient, accurate character skins from examples. ACM Trans. Graph. (Proc. SIGGRAPH), 562-568.
32. NOCEDAL, J., AND WRIGHT, S. J. 2006. Numerical Optimization, 2nd ed. Springer, New York.
33. PONS-MOLL, G., ROMERO, J., MAHMOOD, N., AND BLACK, M. J. 2015. Dyna: A model of dynamic human shape in motion. ACM Transactions on Graphics, (Proc. SIGGRAPH) 34, 4 (July), 120:1-120:14.
34. RHEE, T., LEWIS, J., AND NEUMANN, U. 2006. Real-time weighted pose-space deformation on the GPU. EUROGRAPHICS 25, 3.
35. ROBINETTE, K., BLACKWELL, S., DAANEN, H.,BOEHMER, M., FLEMING, S., BRILL, T., HOEFERLIN, D., AND BURNSIDES, D. 2002. Civilian American and European Surface Anthropometry Resource (CAESAR) final report. Tech. Rep. AFRL-HE-WP-TR-2002-0169, US Air Force Research Laboratory.
36. ROUET, C., AND LEWIS, J., 1999. Method and apparatus for creating lifelike digital representations of computer animated objects by providing corrective enveloping, Mar. 16. US Patent 5,883,638.
37. SCHAEFER, S., AND YUKSEL, C. 2007. Example-based skeleton extraction. In Proceedings of the Fifth Eurographics Symposium on Geometry Processing, Eurographics Association, Airela-Ville, Switzerland, Switzerland, SGP '07, 153-162.
38. SEO, H., CORDIER, F., AND MAGNENAT-THALMANN, N. 2003. Synthesizing animatable body models with parameterized shape modifications. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 120-125.
39. TSOLI, A., MAHMOOD, N., AND BLACK, M. J. 2014. Breathing life into shape: Capturing, modeling and animating 3D human breathing. ACM Trans. Graph., (Proc. SIGGRAPH) 33, 4 (July), 52:1-52:11.
40. WANG, X. C., AND PHILLIPS, C. 2002. Multi-weight enveloping: Least-squares approximation techniques for skin animation. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '02, 129-138.
41. WANG, R. Y., PULLI, K., AND POPOVIĆ, J. 2007. Real-time enveloping with rotational regression. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3 (July).
42. WEBER, O., SORKINE, O., LIPMAN, Y., AND GOTSMAN, C. 2007. Context-aware skeletal shape deformation. Computer Graphics Forum 26, 3 (Sept.), 265-274.