Facial performance synthesis using deformation-driven polynomial displacement maps

ACM Transactions on Graphics

Volumn 27, Issue 5, 2008, Pages

  Ma, Wan Chun ^a,b   Jones, Andrew ^a   Chiang, Jen Yuan ^a   Hawkins, Tim ^a   Frederiksen, Sune ^a   Peers, Pieter ^a   Vukovic, Marko ^c   Ouhyoung, Ming ^b   Debevec, Paul ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^c Sony Imageworks   (United States)

Author keywords

Facial performance synthesis; Polynomial displacement maps

Indexed keywords

3-D SCANNING; AUTOMATICALLY GENERATE; CAPTURE SYSTEMS; FACIAL ANIMATIONS; FACIAL DEFORMATIONS; FACIAL GEOMETRIES; FACIAL PERFORMANCE SYNTHESIS; HIGH FREQUENCIES; HIGH RESOLUTIONS; LOCAL DEFORMATIONS; MOTION CAPTURE DATUMS; MOTION CAPTURES; MUSCLE DEFORMATIONS; NOVEL METHODS; PARAMETERIZED; PERFORMANCE DATUMS; PHOTOMETRIC STEREOS; SKIN PORES; SPARSE SETS; STRUCTURED LIGHTS; SYNTHESIS OF; SYNTHESIS PHASE;

ANIMATION; DEFORMATION; OPTICAL PROJECTORS; POLYNOMIALS; THREE DIMENSIONAL;

POLYNOMIAL APPROXIMATION;

EID: 57749188465     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1409060.1409074     Document Type: Article

References (28)

1. BICKEL, B., BOTSCH, M., ANGST, R., MATUSIK, W., OTADUY, M., PFISTER, H., AND GROSS, M. 2007. Multi-scale capture of facial geometry and motion. ACM Transactions on Graphics 26, 3(JuIy), 33:1-33:10.
2. BICKEL, B., LANG, M., BOTSCH, M., OTADUY, M., AND GROSS, M. 2008. Pose-space animation and transfer of facial details. In 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, 57-66.
3. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proc. of the 8th European Conference on Computer Vision, Springer-Verlag, Prague, Czech Republic.
4. CERDA, E., AND MAHADEVAN, L. 2003. Geometry and physics of wrinkling. Physical Review Letters 90, 7 (February), 074302+.
5. DAVIS, J., NEHAB, D., RAMAMOORTHI, R., AND RUSINKLEWICZ, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 2, 296-302.
6. GOLOVINSKIY, A., MATUSIK, W., PFISTER, H., RUSINKIEWICZ, S., AND FUNKHOUSER, T. 2006. A statistical model for synthesis of detailed facial geometry. ACM Transactions on Graphics 25, 3 (July), 1025-1034.
7. GUENTER, B., GRIMM., C., WOOD, D., MALVAR, H., AND PIGHIN, F. 1998. Making faces. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 55-66.
8. HARO, A., GUENTER, B., AND ESSA, I. 2001. Real-time, photorealistic, physically based rendering of fine scale human skin structure. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering, 53-62.
9. HAWKINS, T., WENGER, A., TCHOU, C., GARDNER, A., GÖRANSSON, F., AND DEBEVEC, P. 2004. Animatable facial reflectance fields. In Rendering Techniques 2004: 15th Eurographics Workshop on Rendering, 309-320.
10. JONES, A., GARDNER, A., BOLAS, M., MCDOWALL, I., AND DEBEVEC, P. 2006. Performance geometry capture for spatially varying relighting. In CVMP 2006.
11. JOSHI, P., TIEN, W. C., DESBRUN, M., AND PIGHIN, F. 2003. Learning controls for blend shape based realistic facial animation. In 2003 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 187-192.
12. LEE, Y., TERZOPOULOS, D., AND WATERS, K. 1995. Realistic modeling for facial animation. Proceedings of SIGGRAPH 95, 55-62.
13. MA, W.-C., HAWKINS, T., PEERS, P., CHABERT, C.-F., WEISS, M., AND DEBEVEC, P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques, 183-194.
14. MALZBENDER, T., GELB, D., AND WOLTERS, H. 2001. Polynomial texture maps. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 519-528.
15. MALZBENDER, T., WILBURN, B., GELB, D., AND AMBRISCO, B. 2006. Surface enhancement using real-time photometric stereo and reflectance transformation. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, 245-250.
16. NEHAB, D., RUSINKIEWICZ, S., DAVIS, J., AND RAMAMOORTHI, R. 2005. Efficiently combining positions and normals for precise 3d geometry. ACM Transactions on Graphics 24, 3 (Aug.), 536-543.
17. OAT, C. 2007. Animated wrinkle maps. In SIGGRAPH 2007: ACM SIGGRAPH 2007 courses, ACM, New York, NY, USA, 33-37.
18. PARKE, F. I. 1972. Computer generated animation of faces. In ACM'72: Proceedings of the ACM annual conference, ACM, New York, NY, USA, 451-457.
19. PIGHIN, F., HECKER, J., LISCHINSKI., D., SZELISKI, R., AND SALESIN, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 75-84.
20. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3d model acquisition. ACM Transactions on Graphics 21, 3 (July), 438-446.
21. SÁNCHEZ, M. A. 2006. Techniques for performance-based, real-time facial animation. PhD thesis, University of Sheffield.
22. SIFAKIS, E., NEVEROV, I., AND FEDKTW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Transactions on Graphics 24, 3 (Aug.), 417-425.
23. TERZOPOULOS, D., AND WATERS, K. 1990. Physically-based facial modelling, analysis, and animation. Journal of Visualization and Computer Animation 1, 2, 73-80.
24. VLASIC, D., BRAND, M., PFISTER, H., AND POPOVIĆ, J. 2005. Face transfer with multilinear models. ACM Transactions on Graphics 24, 3 (Aug.), 426-433.
25. WENGER, A., GARDNER, A., TCHOU, C., UNGER, J., HAWKINS, T., AND DEBEVEC, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Transactions on Graphics 24, 3 (Aug.), 756-764.
26. WILLIAMS, L. 1990. Performance-driven facial animation. In Computer Graphics (Proceedings of SIGGRAPH 90), 235-242.
27. ZHANG, S., AND HUANG, P. 2006. High-resolution, real-time three-dimensional shape measurement. Optical Engineering 45, 12.
28. ZHANG, L., SNAVELY, N., CURLESS, B., AND SEITZ, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3 (Aug.), 548-558.