A generic framework for efficient 2-D and 3-D facial expression analogy

IEEE Transactions on Multimedia

Volumn 9, Issue 7, 2007, Pages 1384-1395

  Song, Mingli ^a   Dong, Zhao ^b   Theobalt, Christian ^b   Wang, Huiqiong ^c   Liu, Zicheng ^d   Seidel, Hans Peter ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c ZHEJIANG UNIVERSITY   (China)

^d MICROSOFT RESEARCH   (United States)

Author keywords

Expression analogy; Facial animation; Facial image synthesis

Indexed keywords

3D FACES; COMPUTATION TIME; COMPUTER ANIMATION; FACE REPRESENTATIONS; FACIAL ANIMATION; FACIAL EXPRESSIONS; FACIAL IMAGE SYNTHESIS; GENERIC FRAMEWORKS; GENERIC METHOD; MAP EXPRESSIONS; SIMPLE SYSTEM; TRIANGLE MESH;

ANIMATION; FACE RECOGNITION; IMAGE ENHANCEMENT;

THREE DIMENSIONAL;

EID: 56749093125     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.906591     Document Type: Article

References (34)

1. S. B. Göktürk, C. Tomasi, B. Girod, and J.-Y. Bouguet, "Model-based face tracking for view-independent facial expression recognition, " in Proc. 5th IEEE Int. Conf. Automatic Face and Gesture Recognition, 2002, pp. 287-293.
2. K. Waters, "A muscle model for animating three dimensional facial expression, " Comput. Graph., vol. 21, no. 4, pp. 17-24, 1987.
3. Y. Lee, D. Terzopoulos, and K. Walters, "Realistic modelling for facial animation, " in SIGGRAPH '95: Proc. 22nd Annu. Conf. Computer Graphics and Interactive Techniques, New York, 1995, pp. 55-62.
4. H. Pyun, Y. Kim, W. Chae, H. W. Kang, and S. Y. Shin, "An examplebased approach for facial expression cloning, " in SCA '03: Proc. 2003 ACM SIGGRAPH/Eurographics Symp. Computer Animation, 2003, pp. 167-176.
5. K. Kähler, J. Haber, and H. P. Seidel, "Geometry-based muscle modeling for facial animation, " in Proc. Graphics Interface, 2001, pp. 37-46.
6. Z. Liu, Y. Shan, and Z. Zhang, "Expressive expression mapping with ratio images, " in SIGGRAPH '01: Proc. 28th Annu. Conf. Computer Graphics and Interactive Techniques, New York, 2001, pp. 271-276.
7. Q. Zhang, B. G. Z. Liu, and H. Shum, "Geometry-driven photorealistic facial expression synthesis, " in Proc. Eurography/Siggraph Symp. Computer Animation, 2003, pp. 177-187.
8. E. Cosatto and H. P. Graf, "Photo-realistic talking-heads from image samples, " IEEE Trans. Multimedia, vol. 2, no. 2, pp. 152-163, 2000.
9. L. Zhang, N. Snavely, B. Curless, and S. M. Seitz, "Spacetime faces: High resolution capture for modeling and animation, " ACM Trans. Graph., vol. 23, no. 3, pp. 548-558, 2004.
10. Y. Wang, X. Huang, C.-S. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang, "High resolution acquisition, learning and transfer of dynamic 3-d facial expressions, " Comput. Graph. Forum, vol. 23, no. 3, pp. 677-686, 2004.
11. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The feret evaluation methodology for face recognition algorithms, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 1090-1104, 2000.
12. L. Williams, "Performance-driven facial animation, " in SIGGRAPH '90: Proc. 17th Annu. Conf. Computer Graphics and Interactive Techniques, New York, 1990, pp. 235-242.
13. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin, "Synthesizing realistic facial expressions from photographs, " in SIGGRAPH '98: Proc. 25th Annu. Conf. Computer Graphics and Interactive Techniques, New York, 1998, pp. 75-84.
14. J. Noh and U. Neumann, "Expression cloning, " in SIGGRAPH '01: Proc. 28th Annu. Conf. Computer Graphics and Interactive Techniques, 2001, pp. 277-288.
15. R. W. Sumner and J. Popovic, Deformation Transfer for Triangle Meshes. New York: ACM, 2004, vol. 23, pp. 399-405.
16. O. Sorkine, D. Cohen-Or, Y. Lipman, M. Alexa, C. Rössl, and H. P. Seidel, "Laplacian surface editing, " in Proc. Eurographics/ACM SIG-GRAPH Symp. Geometry Processing, 2004, pp. 179-188.
17. F. I. Parke and K. Waters, Computer Facial Animation. Wellesley, MA: A. K. Peters, 1998.
18. S. E. Brennan, Caricature Generator: MS Visual Studies. Cambridge, MA: MIT Press, 1982.
19. P. Litwinowicz and L. Williams, "Animating images with drawings, " in SIGGRAPH '94: Proc. 21st Annu. Conf. Computer Graphics and Interactive Techniques, New York, 1994, pp. 409-412.
20. P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto, CA.: Consulting Psychologists Press, 1978.
21. J. Ostermann, "Animation of synthetic faces in mpeg-4, " in Proc. Computer Animation, 1998, pp. 49-51.
22. W. Gao, Y. Chen, R. Wang, S. Shan, and D. Jiang, "Learning and synthesizing mpeg-4 compatible 3-d face animation from video sequence, " IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 1119-1128, 2003.
23. B. Park, H. Chung, T. Nishita, and S. Y. Shin, "A feature-based approach to facial expression cloning, " J. Comput. Animation Virtual Worlds, vol. 16, no. 3-4, pp. 291-303, 2005.
24. Y. Yu, K. Zhou, D. Xu, X. Shi, H. Bao, B. Guo, and H. Y. Shum, "Mesh editing with poisson-based gradient field manipulation, " ACM Trans. Graph., vol. 23, no. 3, pp. 644-651, 2004.
25. R. Zayer, C. Rössl, Z. Karni, and H.-P. Seidel, "Harmonic guidance for surface deformation, " Comput. Graph. Forum, vol. 24, no. 3, pp. 601-609, 2005.
26. M. Botsch, R. Sumner, M. Pauly, and M. Gross, "Deformation transfer for detail-preserving surface editing, " in Proc. Vision, Modeling, and Visualization (VMV), 2006, pp. 357-364.
27. V. Blanz, K. Scherbaum, T. Vetter, and H. P. Seidel, "Exchanging faces in images, " Comput. Graph. Forum, vol. 23, no. 3, pp. 669-676, 2004.
28. M. Song, H. Wang, J. Bu, C. Chen, and Z. Liu, "Subtle facial expression modeling with vector field decomposition, " in Proc. Int. Conf. Image Processing (ICIP), 2006, pp. 2101-2104.
29. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models, " IEEE Trans. Pattern Anal. Mach. Intell, vol. 23, no. 6, pp. 681-685, 2001.
30. A. Sheffer and V. Kraevoy, "Pyramid coordinates for morphing and deformation, " in Proc. Int. Symp. 3-D Data Processing, Visualization and Transmission, 2004, pp. 68-75.
31. W. Gautschi, Numerical Analysis. New York: Birkhauser, 1997.
32. J. H. Challis, "A procedure for determining rigid body transformation parameters, " J. Biomechanics, vol. 28, no. 6, pp. 733-737, 1995.
33. X. Gu, S. J. Gortler, and H. Hoppe, "Geometry images, " in SIGGRAPH '02: Proc. 29th Annu. Conf. Computer Graphics and Interactive Techniques, New York, 2002, pp. 355-361.
34. T. Beier and S. Neely, "Feature-based image metamorphosis, " in SIG-GRAPH '92: Proc. 19th Annu. Conf. Computer Graphics and Interactive Techniques, New York, 1992, pp. 35-42.