Playable universal capture: Compression and real-time sequencing of image-based facial animation

SIGGRAPH 2006 - ACM SIGGRAPH 2006 Courses

Volumn , Issue , 2006, Pages

  Borshukov, George ^a   Montgomery, Jefferson ^a   Werner, Witek ^a  

^a ELECTRONIC ARTS   (United States)

Author keywords

Data compression; Facial animation; Facial modeling; GPU rendering; Image based techniques; Performance capture; Real time implementation

Indexed keywords

ANIMATION; DATA COMPRESSION; ENCODING (SYMBOLS); INTERACTIVE COMPUTER GRAPHICS; QUALITY CONTROL; REAL TIME CONTROL; SIGNAL ENCODING;

FACIAL ANIMATION; FACIAL MODEL; GPU RENDERING; IMAGE-BASED TECHNIQUES; PERFORMANCE CAPTURE; REAL-TIME IMPLEMENTATIONS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 85027883216     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1185657.1185848     Document Type: Conference Paper

References (38)

1. ARIKAN, O., and FORSYTH, D. 2002. Interactive motion generation from examples. In Proceedings of SIGGRAPH 2002, 483-490.
2. BLANZ, V., and VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of SIGGRAPH 99, 187-194.
3. BLANZ, V, BOSSO, C, POGGIO, T., and VETTER, T. 2003. Reanimating faces in images and video. In Computer Graphics Forum, Vol. 22, No. 3 EUROGRAPHICS 2003, 641-650.
4. BORSHUKOV, G., and LEWIS, J. P. 2003. Realistic human face rendering for "The Matrix Reloaded". In Proceedings of SIGGRAPH 2003 Sketches and Applications.
5. BORSHUKOV, G., PIPONI, D., LARSEN, O., LEWIS, J. P., and TEMPELAAR-LIETZ, C. 2003. Universal Capture: Image-based facial animation for "The Matrix Reloaded". In Proceedings of SIGGRAPH2003 Sketches and Applications.
6. BORSHUKOV, G., SABOURIN, K., SUZUKI, M., LARSEN, O., MIHASHI, T., FAIMAN, K., SCHINDERMAN, S., JAMES, O., and JACK, J. 2004. Making of The Superpunch. In Proceedings of SIGGRAPH 2004 Sketches and Applications.
7. BREGLER, C, COVELL, M., and SLANEY, M. 1997. Video rewrite: Driving visual speech with audio. In Proceedings of SIGGRAPH 97, 353-360.
8. BREGLER, C, HERTZMANN, A., and BIERMANN, H. 2000. Recovering non-rigid 3d shape from image streams. In Proceedings of IEEE CVPR 2000.
9. DECARLO, D., and METAXAS, D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proceedings of CVPR, 231-238.
10. ESSA, I., and PENTLAND, A. 1997. Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7, 757-763.
11. ESSA, I., BASU, S., DARRELL, T., and PENTLAND, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proceedings of the Computer Animation, IEEE Computer Society, 68-79.
12. EZZAT, T., GEIGER, G., and POGGIO, T. 2002. Trainable video-realistic speech animation. In Proceedings of SIGGRAPH 2002, 388-398.
13. FERNANDO, R. 2004. GPU Gems. Addison-Wesley.
14. GUENTER, B., GRIMM, C, WOOD, D., MALVAR, H., and PIGHIN, F. 1998. Making faces. In Proceedings of SIGGRAPH 98, 55-66.
15. HOTELLING, H. 1933. Analysis of a complex of statistical variables with principle components. Journal of Educational Psychology 24, 498-520.
16. HYNEMAN, W., ITOKAZU, H., WILLIAMS, L., and ZHAO, X. 2005. Human face project. In Proceedings of SIGGRAPH 2005 Courses: Digital Face Cloning, 29-46.
17. JENSEN, H. W., and MARSCHNER., S. R., LEVOY, M., and HANRAHAN, P. 2001. A practical model for subsurface light transport. In Proceedings of SIGGRAPH 2001, 511-518.
18. KOVAR, L., GLEICHER, M., and PIGHIN, F. 2002. Motion graphs. In Proceedings of SIGGRAPH 2002, 473-482.
19. LEE, Y., TERZOPOULOS, D., and WATERS, K. 1993. Constructing physics-based facial models of individuals. In Proceedings of Graphics Interface 93, 1-8.
20. LEE, Y., TERZOPOULOS, D., and WATERS, K. 1995. Realistic modeling for facial animation. In Proceedings of SIGGRAPH 95, 55-62.
21. MORI, M. 1982. The Buddha in the Robot. Tuttle.
22. PARKE, F. 1972. Computer generated animation of faces. In Proceedings ACM annual conference.
23. PARKE, F. 1974. A parametric model for human faces. PhD thesis, University of Utah, Salt Lake City, Utah.
24. PHARR, M. 2005. GPU Gems 2. Addison-Wesley.
25. PIGHIN, F., HECKER, J., LISCHINSKI, D., SZELISKI, R., and SALESIN, D. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH 98, 75-84.
26. PIGHIN, F., SZELISKI, R., and SALESIN, D. 1999. Resynthesizing facial animation through 3d model-based tracking. In Internation Conference on Computer Vision (ICCV), 143-150.
27. REVERET, L., and ESSA, I. 2001. Visual coding and tracking of speech related facial motion. In Proceedings of the IEEE CVPR International Workshop on Cues in Communication.
28. SANDER, P. V, GOSSELIN, D., and MITCHELL, J. L. 2004. Real-time skin rendering on graphics hardware. In Proceedings of SIGGRAPH 2004 Sketches and Applications.
29. SCHODL, A., SZELISKI, R., SALESIN, D. H., and ESSA, I. 2000. Video textures. In Proceedings of SIGGRAPH2000, 489-498.
30. SIFAKIS, E., NEVEROV, I., and FEDKIW, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. In Proceedings of SIGGRAPH 2005, 417-425.
31. SIROVICH, L., and KIRBY, M. 1987. Low-dimensional procedure for the characterization of human faces. Journal of Optical Society of America 4, 3 (March), 519-524.
32. STRANG, G. 1980. Linear Algebra and its Applications, 2 ed. Academic Press, New York.
33. TERZOPOULOS, D., and WATERS, K. 1991. Techniques for realistic facial modeling and animation. In Computer Animation 91, Springer-Verlag, 59-74.
34. TURK, M., and PENTLAND, A. 1991. Face recognition using eigenfaces. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 586-591.
35. VLASIC, D., BRAND, M., PFISTER, H., and POPOVIC, J. 2005. Face transfer with multilinear models. In Proceedings of SIGGRAPH 2005, 426-433.
36. WATERS, K. 1987. A muscle model for animating threedimensional facial expression. In Proceedings of SIGGRAPH 87, 17-24.
37. WILLIAMS, L. 1990. Performance-driven facial animation. In Proceedings of SIGGRAPH 90, 235-242.
38. ZHANG, L., SNAVELY, N., CURLESS, B., and SEITZ, S. M. 2004. Spacetime faces: High-resolution capture for modeling and animation. In Proceedings of SIGGRAPH 2004, 548-558.