Enriching Facial Blendshape Rigs with Physical Simulation

Computer Graphics Forum

Volumn 36, Issue 2, 2017, Pages 75-84

  Kozlov, Yeara ^a,b   Bradley, Derek ^a   Bächer, Moritz ^a   Thomaszewski, Bernhard ^a   Beeler, Thabo ^a   Gross, Markus ^a,b  

^a DISNEY RESEARCH   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

Categories and Subject Descriptors (according to ACM CCS); I.3.5 Computer Graphics : Computational Geometry and Object Modeling Physically Based Modeling

Indexed keywords

COMPUTATIONAL GEOMETRY; COMPUTER GRAPHICS;

ANIMATION PIPELINE; BLENDSHAPE ANIMATION; COMPUTATIONAL GEOMETRY AND OBJECT MODELING; DESCRIPTORS; FACIAL ANIMATION; MUSCLE ACTIVATION; PHYSICAL SIMULATION; SIMULATION FRAMEWORK;

ANIMATION;

EID: 85019659774     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.13108     Document Type: Article

References (39)

1. Beeler T., Hahn F., Bradley D., Bickel B., Beardsley P., Gotsman C., Sumner R.W., Gross M.: High-quality passive facial performance capture using anchor frames. ACM Trans. Graphics (Proc. SIGGRAPH) 30 (2011), 75:1–75:10. 2
2. Bradley D., Heidrich W., Popa T., Sheffer A.: High resolution passive facial performance capture. ACM Trans. Graphics (Proc. SIGGRAPH) 29 (2010), 41:1–41:10. 2
3. Barbarino G., Jabareen M., Trzewik J., Mazza E.: Physically based finite element model of the face. In LNCS (2008), pp. 1–10. 2
4. Bergou M., Mathur S., Wardetzky M., Grinspun E.: Tracks: Toward directable thin shells. ACM Trans. Graph. 26, 3 (July 2007). 3
5. Barrielle V., Stoiber N., Cagniart C.: Blendforces: A dynamic framework for facial animation. In Eurographics (2016).
6. Cong M., Bhat K.S., Fedkiw R.P.: Art-Directed Muscle Simulation for High-End Facial Animation. In Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2016), Kavan L., Wojtan C., (Eds.), The Eurographics Association.
7. Cong M., Bao M., Jane L.E., Bhat K.S., Fedkiw R.: Fully automatic generation of anatomical face simulation models. In Proc. SCA (2015), pp. 175–183. 2
8. Coros S., Martin S., Thomaszewski B., Schumacher C., Sumner R., Gross M.: Deformable objects alive ACM Trans. Graphics (Proc. SIGGRAPH) 31, 4 (2012), 69:1–69:9. 3
9. Fyffe G., Jones A., Alexander O., Ichikari R., Debevec P.: Driving high-resolution facial scans with video performance capture. ACM Trans. Graphics 34, 1 (2014), 8:1–8:14. 2
10. Fan Y., Litven J., Pai D.K.: Active volumetric musculoskeletal systems. ACM Trans. Graph. 33, 4 (July 2014), 152:1–152:9. 4
11. Galoppo N., Otaduy M.A., Moss W., Sewall J., Curtis S., Lin M.C.: Controlling deformable material with dynamic morph targets. In Proc. of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (February 2009). 3
12. Gast T.F., Schroeder C., Stomakhin A., Jiang C., Teran J.M.: Optimization integrator for large time steps. IEEE Transactions on Visualization and Computer Graphics 21, 10 (Oct 2015), 1103–1115. 5
13. Hahn F., Martin S., Thomaszewski B., Sumner R., Coros S., Gross M.: Rig-space physics. ACM Trans. Graphics (Proc. SIGGRAPH) 31, 4 (2012), 72. 3
14. Hahn F., Thomaszewski B., Coros S., Sumner R., Gross M.: Efficient simulation of secondary motion in rig-space. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2013), SCA '13. 3
15. Ichim A.-E., Kavan L., Nimier-David M., Pauly M.: Building and animating user-specific volumetric face rigs. In SCA (2016). 3
16. Klaudiny M., Hilton A.: High-detail 3d capture and nonsequential alignment of facial performance. In 3DIMPVT (2012).
17. Kähler K., Haber J., Seidel H.-P.: Geometry-based muscle modeling for facial animation. In Graphics Interface (2001). 2
18. Kondo R., Kanai T., Anjyo K.-I.: Directable animation of elastic objects. In Proc. SCA (2005), pp. 127–134. 3
19. Lewis J.P., Anjyo K., Rhee T., Zhang M., Pighin F., Deng Z.: Practice and theory of blendshape facial models. In EG 2014 - State of the Art Reports (2014). 2
20. Lee Y., Terzopoulos D., Waters K.: Realistic modeling for facial animation. In SIGGRAPH '95 (1995). 2
21. Li Y., Xu H., Barbič J.: Enriching triangle mesh animations with physically based simulation. IEEE Transactions on Visualization and Computer Graphics PP, 99 (2016), 1–1.
22. Mithraratne K., Hung A., Sagar M., Hunter P.: An efficient heterogeneous continuum model to simulate active contraction of facial soft tissue structures. In Proc. IFMBE (2010). 2
23. Martin S., Thomaszewski B., Grinspun E., Gross M.: Example-based elastic materials. ACM Trans. Graph. 30, 4 (2011). 3, 5
24. Ma W.-C., Wang Y.-H., Fyffe G., Chen B.-Y, Debevec P.: A blendshape model that incorporates physical interaction. Computer Animation and Virtual Worlds 23, 3–4 (2012), 235–243.
25. McAdams A., Zhu Y., Selle A., Empey M., Tamstorf R., Teran J., Sifakis E.: Efficient elasticity for character skinning with contact and collisions. ACM Trans. Graph. 30, 4 (July 2011), 37:1–37:12. 3
26. Narain R., Overby M., Brown G.E.: ADMM ⊇ projective dynamics: Fast simulation of general constitutive models. In Proc. SCA (2016), pp. 21–28. 5, 7
27. Nocedal J., Wright S.J.: Numerical Optimization, 2nd ed. Springer, New York, 2006. 7
28. Picinbono G., Delingette H., Ayache N.: Non-linear anisotropic elasticity for real-time surgery simulation. Graphical Models 65, 5(2003), 305–321. 5
29. Pons-Moll G., Romero J., Mahmood N., Black M.J.: Dyna: A model of dynamic human shape in motion. ACM Transactions on Graphics, (Proc. SIGGRAPH) 34, 4 (Aug. 2015), 120:1–120:14. 3
30. Röhrle O., Pullan A.: Three-dimensional finite element modelling of muscle forces during mastication. J. Biomech. 40, 15 (2007). 2
31. Sorkine O., Cohen-Or D., Lipman Y., Alexa M., Rössl C., Seidel H.-P.: Laplacian surface editing. In Proceedings of the EUROGRAPHICS/ACM SIGGRAPH Symposium on Geometry Processing (2004), ACM Press, pp. 179–188. 7
32. Si H.: Tetgen - a quality tetrahedral mesh generator and three-dimensional delaunay triangulator. Weierstrass Institute for Applied Analysis and Stochastic, Berlin, Germany (2006). 6
33. Schuller C., Kavan L., Panozzo D., Sorkine-Hornung O.: Locally injective mappings. Computer Graphics Forum (proceedings of EUROGRAPHICS/ACM SIGGRAPH Symposium on Geometry Processing) 32, 5 (2013), 125–135. 6
34. Sifakis E., Neverov I., Fedkiw R.: Automatic determination of facial muscle activations from sparse motion capture marker data. In ACM Trans. Graphics (2005), vol. 24, pp. 417–425. 2
35. Terzopoulos D., Waters K.: Physically-based facial modeling, analysis, and animation. J. of Vis. and Comp. Anim. 1, 2 (1990), 73–80. 2
36. Warburton M., Maddock S.: Physically-based forehead animation including wrinkles. Comput. Animat. Virtual Worlds (2015). 2
37. Xu H., Barbič J.: Pose-space subspace dynamics. ACM Trans. on Graphics (SIGGRAPH 2016) 35, 4 (2016). 3
38. You L., Southern R., Zhang J.J.: Adaptive physics–inspired facial animation. In Motion in Games. 2009, pp. 207–218. 2
39. Zhou K., Huang J., Snyder J., Liu X., Bao H., Guo B., Shum H.-Y.: Large mesh deformation using the volumetric graph laplacian. In ACM SIGGRAPH 2005 Papers (New York, NY, USA, 2005), SIGGRAPH '05, ACM, pp. 496–503. 6