Real-time synthesis of chinese visual speech and facial expressions using MPEG-4 FAP features in a three-dimensional avatar

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 4, Issue , 2006, Pages 1802-1805

  Wu, Zhiyong ^a   Zhang, Shen ^b   Cai, Lianhong ^b   Meng, Helen M ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

Expression; MPEG 4; Visual speech synthesis

Indexed keywords

ANIMATION; BLENDING; MOTION PICTURE EXPERTS GROUP STANDARDS; SPEECH; SPEECH SYNTHESIS;

DEFORMATION FUNCTION; EXPRESSION; FACIAL ANIMATION PARAMETERS; FACIAL CONFIGURATION; FACIAL EXPRESSIONS; MPEG-4; REAL-TIME SYNTHESIS; VISUAL SPEECH SYNTHESIS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 34547549756     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Motion Pictures Expert Group, ISO/IEC 14496-2: 1999/Amd. 1: 2000(E). International Standard, Information Technology - Coding of Audio-Visual Objects. Part 2: Visual; Amendment 1: Visual Extensions.
2. Balci, K., "Xface: MPEG-4 based Open Source Toolkit for 3D Facial Animation", Proc. Advance Visual Interfaces, 399-402, 2004.
3. Cassell, J., "Embodied Conversational Agents: Representation and Intelligence in User Interface", AI magazine, 22(3): 67-83, 2001.
4. Branstrom, B. and House, D., "Multimodality and Speech Technology: Verbal and Non-verbal Communication in Talking Agents", Proc. Eurospeech, 2901-2904, 2003.
5. Wang, J.Q., Wong, K.H., Heng, P.A., Meng, H., and Wong, T.T., "A Real-time Cantonese Text-to-Audiovisual Speech Synthesizer", Proc. ICASSP, 653-656, 2004.
6. Wang, Z.M., Cai, L.H., and Ai, H.Z., "A Dynamic Viseme Model for Personalizing a Talking Head", Proc. 6th Int. Conf. on Signal Processing, 2:1015-1018, 2002.
7. Lyons, M.J., Akamatsu, S. et al, "Automatic Classification of Single Facial Images", IEEE Trans on Pattern Analysis and Machine Intelligence, 21(12):1357-1362, 1999.
8. Cohen, M.M. and Massaro, D.W., "Modeling Co-articulation in Synthetic Visual Speech", Models and Techniques in Computer Animation, 139-156, 1993.
9. Lofqvist, A., "Speech as Audible Gestures", Speech Production and Speech Modeling, 289-322, 1990.
10. SSML: http://www.w3.org/TR/speech-synthesis/.