Automatic viseme clustering for audiovisual speech synthesis

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 2173-2176

  Mattheyses, Wesley ^a   Latacz, Lukas ^a   Verhelst, Werner ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

Audiovisual speech synthesis; Facial animation; Visemes

Indexed keywords

ATOMIC UNITS; AUDIO-VISUAL SPEECH; DATA AVAILABILITY; FACIAL ANIMATION; MANY-TO-ONE; SYNTHESIS OPTIMIZATION; SYNTHESIS TECHNIQUES; SYNTHETIC SPEECH; VISEMES; VISUAL SPEECH; VISUAL SPEECH SYNTHESIS;

ANIMATION; MOTION PICTURE EXPERTS GROUP STANDARDS; SPEECH PROCESSING;

SPEECH SYNTHESIS;

EID: 84865793091     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Chen, T., "Audiovisual speech processing", IEEE Signal Processing Magazine, 8:9-21, 2001.
2. Hilder, S., Theobald B.J., Harvey, R., "In Pursuit of Visemes", International Conference on Auditory-Visual Speech Processing (AVSP), 154-159, 2010.
3. Jackson, P.L., "The theoretical minimal unit for visual speech perception: visemes and coarticulation", Volta Review, 90(5):99-115, 1988.
4. Ezzat, T., Poggio, T., "Visual speech synthesis by morphing visemes", International Journal of Computer Vision, 38(1):45-57, 2000.
5. Mattheyses W., Latacz L., Verhelst W., "Optimized Photorealistic Audiovisual Speech Synthesis Using Active Appearance Modeling", International Conference on Auditory-visual Speech Processing '10, 2010.
6. Edwards, G.J., Taylor, C.J., Cootes, T.F., "Interpreting Face Images using Active Appearance Models", Int. Conf. on Face and Gesture Recognition, 300-305, 1998.
7. Mattheyses, W., Latacz, L. and Verhelst, W., "On the importance of audiovisual coherence for the perceived quality of synthesized visual speech", EURASIP Journal on Audio, Speech, and Music Processing, SI: Animating Virtual Speakers or Singers from Audio: Lip-Synching Facial Animation, 2009.
8. Theobald, B.-J., Fagel, S., Bailly, G., Elisei, F., "LIPS2008: Visual speech synthesis challenge", Interspeech '08, 1875-1878, 2008.
9. Pandzic, I.S., Forchheimer, R., "MPEG-4 Facial Animation: The Standard, Implementation and Applications", JohnWiley & Sons, Inc., 2003.