High quality lip-sync animation for 3D photo-realistic talking head

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2012, Pages 4529-4532

  Wang, Lijuan ^a   Han, Wei ^a,b   Soong, Frank K ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

3D; audio visual synthesis; lip sync; photorealistic; talking head

Indexed keywords

2D TEXTURES; 3D; 3D GEOMETRY; 3D HEAD; FACIAL EXPRESSIONS; FEATURE VECTORS; GEOMETRIC TRAJECTORY; HEAD MOTION; HIGH QUALITY; LIP-SYNC; MESH MODEL; PHOTO-REALISTIC; RECONSTRUCTION ALGORITHMS; SPEECH ANIMATION; TALKING HEADS;

ANIMATION; HIDDEN MARKOV MODELS; SIGNAL PROCESSING; TEXTURES; THREE DIMENSIONAL;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84863490267     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2012.6288925     Document Type: Conference Paper

References (10)

1. N. Ersotelos and F. Dong, "Building Highly Realistic Facial Modeling and Animation: a Survey," Visual Computer, vol. 28, pp. 13-30, 2008.
2. E. Cosatto and H. P. Graf, "Photo-Realistic Talking Heads from Image Samples," IEEE Trans. Multimedia, vol. 2, no. 3, pp. 152-163, 2000.
3. T. Ezzat, G. Geiger, and T. Poggio, "Trainable Video Realistic Speech Animation," in Proc. ACM SIGGRAPH2002, San Antonio, Texas, 2002, pp. 388-398.
4. K. Liu, J. Ostermann, "Realistic Facial Animation System for Interactive Services," in Proc. INTERSPEECH 2008, Brisbane, Australia, Sept. 2008, pp. 2330-2333.
5. L. Wang, Y. Wu, X. Zhuang, and F. Soong, "Synthesizing Visual Speech Trajectory with Minimum Generation Error," in Proc. ICASSP 2011, Prague, Czech Republic, May 2011, pp. 4580-4583.
6. L. Wang, W. Han, X. Qian, and F. Soong, "Synthesizing Photo-Real Talking Head via Trajectory-Guided Sample Selection," in Proc. INTERSPEECH 2010, Chiba, Japan, Sept. 2010, pp. 446-449.
7. K. Wu, L. Wang, F. Soong, Y. Yam, "A Sparse and Low-Rank Approach to Efficient Face Alignment for Photo-Real Talking Head Synthesis," in Proc. ICASSP 2011, Prague, Czech Republic, May 2011, pp. 1397-1400.
8. Y. Hu, D. Jiang, S. Yan, L. Zhang, H. Zhang, "Automatic 3D Reconstruction for Face Recognition," in Proc. of the Sixth IEEE international Conference on Automatic Face and Gesture Recognition (FGR'04), 2004, pp. 843-848.
9. L. Xin, Q. Wang, J. Tao, X. Tang, T. Tan, and H. Shum, "Automatic 3D Face Modeling from Video," in Proc. ICCV 2005, Oct. 2005, pp. 1193-1199.
10. Z. Liu, Z. Zhang, D. Adler, E. Hanson, M. Cohen, "A Robust and Fast Face Modeling System," in Proc. IEEE Pacific Rim Conference on Multimedia 2001, pp. 269-276.