Optimized Photorealistic Audiovisual Speech Synthesis Using Active Appearance Modeling

Auditory-Visual Speech Processing 2010, AVSP 2010

Volumn , Issue , 2010, Pages

  Mattheyses, Wesley ^a   Latacz, Lukas ^a   Verhelst, Werner ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

AAM modeling; audiovisual speech synthesis

Indexed keywords

IMAGE RECOGNITION; SPEECH PROCESSING; SPEECH RECOGNITION; TEXTURES;

AAM MODELING; ACTIVE APPEARANCE MODELS; AUDIO-VISUAL SPEECH; AUDIOVISUAL SPEECH SYNTHESIS; IMAGE INFORMATION; PHOTO-REALISTIC; SHAPE AND TEXTURES; SHAPE PARAMETERS; TEXTURE PARAMETERS; VISUAL SPEECH;

SPEECH SYNTHESIS;

EID: 84865387939     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Mattheyses, W., Latacz, L. and Verhelst, W.,”On the importance of audiovisual coherence for the perceived quality of synthesized visual speech”, EURASIP Journal on Audio, Speech, and Music Processing, SI: Animating Virtual Speakers or Singers from Audio: Lip-Synching Facial Animation, 2009
2. Cosatto, E and Graf, H.P.,”Photo-realistic talking-heads from image samples”, IEEE Transactions on multimedia, Volume 2 152-163, 2000
3. Edwards, G.J., Taylor, C.J. and Cootes, T.F.,”Interpreting Face Images using Active Appearance Models”, Int. Conf. on Face and Gesture Recognition, 300-305, 1998
4. Theobald, B.J., Bangham, J.A., Matthews, I.A. and Cawley, G.C.,”Near-videorealistic synthetic talking faces: implementation and evaluation”, Speech Communication, Volume 44 127-140, 2004
5. Theobald, B.-J., Fagel, S., Bailly, G. and Elisei, F., “LIPS2008: Visual speech synthesis challenge”, Interspeech'08, 1875-1878, 2008
6. Mattheyses, W., Latacz, L. and Verhelst, W.,”Active Appearance Models for Photorealistic Visual Speech Synthesis”, Interspeech'10, 2010
7. Stegmann, M.B., Ersboll, B.K., Larsen, R.,”FAME - A Flexible Appearance Modelling Environment”, IEEE Transactions on Medical Imaging, Volume 22(10), 1319-1331, 2003
8. Hunt, A. and Black, A.,”Unit selection in a concatenative speech synthesis system using a large speech database”, International Conference on Acoustics, Speech and Signal Processing, 373-376, 1996
9. Mattheyses, W., Latacz, L., Kong, Y.O. and Verhelst, W.,”A Flemish Voice for the Nextens Text-To-Speech System”, Fifth Slovenian and First International Language Technologies Conference, 2006
10. Woods, J.C.,”Lip-Reading: A Guide for Beginners (2nd edn)”, Royal National Institute for Deaf people: London, 1994
11. Mattheyses, W., Latacz, L. and Verhelst, W.,”Multimodal Coherency Issues in Designing and Optimizing Audiovisual Speech Synthesis Techniques”, International Conference on Auditory-Visual Speech Processing, Norwich, UK, 2009
12. Swerts, M. and Krahmer, E.,”The importance of different facial areas for signaling visual prominence”, Interspeech'06, 2006
13. Munhall, K., Jones, J., Callan, D., Kuratate, T. and Vatikiotis-Bateson, E.,”Visual prosody and speech intelligibility”, Psychological Science, Volume 15, 133-137, 2004