Multimodal Coherency Issues in Designing and Optimizing Audiovisual Speech Synthesis Techniques

Auditory-Visual Speech Processing 2009, AVSP 2009

Volumn , Issue , 2009, Pages 47-52

  Mattheyses, Wesley ^a   Latacz, Lukas ^a   Verhelst, Werner ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

audiovisual speech synthesis; audiovisual synchrony; multimodal unit selection

Indexed keywords

AUDIO-VISUAL SPEECH; AUDIOVISUAL SPEECH SYNTHESIS; AUDIOVISUAL SYNCHRONY; DESYNCHRONIZATION; MULTI-MODAL; MULTIMODAL UNIT SELECTION; PERCEIVED QUALITY; SYNTHESIS TECHNIQUES; TEXT-TO-SPEECH SYNTHESIS SYSTEM; UNIT SELECTION;

SPEECH SYNTHESIS;

EID: 84912561967     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Pandzic, I., Ostermann J. and Millen D.,”Users Evaluation: Synthetic talking faces for interactive services”, The Visual Computer, Volume 15 2330-2340, 1999
2. Hunt, A. and Black, A.,”Unit selection in a concatenative speech synthesis system using a large speech database”, International Conference on Acoustics, Speech and Signal Processing, 373–376, 1996
3. McGurk, H. and MacDonald, J., “Hearing lips and seeing voices”, Nature, Volume 264 746–748, 1976
4. Ezzat, T., Geiger, G. and Poggio, T.,”Trainable videorealistic speech animation”, Association for Computing Machinery’s Special Interest Group on Graphics and Interactive Techniques, Volume 21 388–398, 2002
5. Cosatto, E, Potamianos, G. and Graf, H.P.,”Audio-Visual Unit Selection for the Synthesis of Photo-Realistic Talking-Heads”, International Conference on Multimedia and Expo, 619–622, 2000
6. Theobald, B.J., Bangham, J.A., Matthews, I.A. and Cawley, G.C.,”Near-videorealistic synthetic talking faces: implementation and evaluation”, Speech Communication, Volume 44 127–140, 2004
7. Fagel, S.,”Joint Audio-Visual Units Selection - The Javus Speech Synthesizer”, International Conference on Speech and Computer, 2006
8. Mattheyses, W., Latacz, L., Verhelst, W. and Sahli, H.,”Multimodal Unit Selection for 2D Audiovisual Text-to-Speech Synthesis”, Springer Lecture Notes in Computer Science, Volume 4261 125–136, 2008
9. Mattheyses, W., Latacz, L. and Verhelst, W.,”On the importance of audiovisual coherence for the perceived quality of synthesized visual speech”, EURASIP Journal on Audio, Speech, and Music Processing, SI: Animating Virtual Speakers or Singers from Audio: Lip-Synching Facial Animation, 2009
10. Theobald, B.-J., Fagel, S., Bailly, G. and Elisei, F., “LIPS2008: Visual speech synthesis challenge”, Inter-speech 2008, 1875–1878, 2008
11. Verhelst, W. and Roelands, M., “An Overlap-Add Technique based on Waveform Similarity (WSOLA) for High-Quality Time-Scale Modification of Speech” International Conference on Acoustics, Speech, and Signal Processing, 554–557, 1993
12. Kominek, J. and Black, A.W., “The CMU Arctic speech databases”, 5th ISCA Speech Synthesis Workshop, 223–224 2004
13. Mattheyses, W., Latacz, L., Kong, Y.O. and Verhelst, W.,”A Flemish Voice for the Nextens Text-To-Speech System”, Fifth Slovenian and First International Language Technologies Conference, 2006
14. Grant, K.W., Van Wassenhove, V. and Poeppel, D., “Detection of auditory (cross-spectral) and auditoryvisual (cross-modal) synchrony”, Speech Communication, Volume 44:Special Issue on Audiovisual Speech Processing 43–53, 2004