Text driven 3D photo-realistic talking head

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 3307-3308

  Wang, Lijuan ^a   Han, Wei ^a,b   Soong, Frank K ^a   Huo, Qiang ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

3D; Audio visual synthesis; Photo realistic; Talking head

Indexed keywords

2D IMAGES; 2D VIDEO; 3D; 3D GEOMETRY; 3D HEAD; AUDIO-VISUAL; DYNAMIC TEXTURES; FACIAL EXPRESSIONS; FEATURE VECTORS; GEOMETRIC TRAJECTORY; HEAD MOTION; HIGH QUALITY; MESH MODEL; PHOTO-REALISTIC; RECONSTRUCTION ALGORITHMS; TALKING HEADS; TELEPRESENCE;

ANIMATION; HIDDEN MARKOV MODELS; TEXTURES; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 84865755132     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. E. Cosatto and H. P. Graf, "Photo-Realistic Talking Heads From Image Samples," IEEE Trans. Multimedia, vol. 2, no. 3, pp. 152-163, 2000.
2. T. Ezzat, G. Geiger, and T. Poggio, "Trainable Video Realistic Speech Animation," in Proc. ACM SIGGRAPH2002, San Antonio, Texas, 2002, pp. 388-398.
3. B. J. Theobald, S. Fagel, G. Bailly, and F. Elisei, "LIPS 2008: Visual Speech Synthesis Challenge," in Proc. INTERSPEECH 2008, pp. 2310-2313.
4. K. Liu, J. Ostermann, "Realistic Facial Animation System for Interactive Services," in Proc. INTERSPEECH 2008, Brisbane, Australia, Sept. 2008, pp.2330-2333.
5. L. Wang, Y. Wu, X. Zhuang, and F. Soong, "Synthesizing Visual Speech Trajectory with Minimum Generation Error," in Proc. ICASSP 2011, Prague, Czech Republic, May 2011.
6. L. Wang, W. Han, X. Qian, and F. Soong, "Synthesizing Photo-Real Talking Head via Trajectory-Guided Sample Selection," in Proc. INTERSPEECH 2010, Chiba, Japan, Sept. 2010, pp.446-449.
7. X. Zhuang, L. Wang, F. Soong, and M. Hasegawa-Johnson, "A Minimum Converted Trajectory Error (MCTE) Approach to High Quality Speech-to-Lips Conversion," in Proc. INTERSPEECH 2010, Chiba, Japan, Sept. 2010, pp.1736-1739.
8. K. Wu, L. Wang, F. Soong, Y. Yam, "A Sparse And Low-Rank Approach To Efficient Face Alignment For Photo-Real Talking Head Synthesis," in Proc. ICASSP 2011, Prague, Czech Republic, May 2011.
9. Y. Hu, D. Jiang, S. Yan, L. Zhang, H. Zhang, "Automatic 3D Reconstruction for Face Recognition," in Proc. of the Sixth IEEE international Conference on Automatic Face and Gesture Recognition (FGR'04).
10. L. Xin, Q. Wang, J. Tao, X. Tang, T. Tan, and H. Shum, "Automatic 3D Face Modeling from Video," in Proc. ICCV 2005, Oct. 2005, pp.1193-1199.
11. Z. Liu, Z. Zhang, D. Adler, E. Hanson, M. Cohen, "A Robust and Fast Face Modeling System," in Proc. IEEE Pacific Rim Conference on Multimedia 2001, pp.269-276.