Multimodal unit selection for 2D audiovisual text-to-speech synthesis

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5237 LNCS, Issue , 2008, Pages 125-136

  Mattheyses, Wesley ^a   Latacz, Lukas ^a   Verhelst, Werner ^a   Sahli, Hichem ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIOVISUAL; INTERACTIVE COMPUTER SYSTEMS; MACHINE LEARNING; SPEECH SYNTHESIS;

AUDIO-VISUAL CORRELATIONS; AUDIO-VISUAL DATABASE; AUDIO-VISUAL SPEECH; MULTIMODAL OUTPUT; PHOTO-REALISTIC; SYNTHESIS TECHNIQUES; SYNTHETIC SPEECH; TEXT-TO-SPEECH SYSTEM;

SPEECH COMMUNICATION;

EID: 57949116211     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-85853-9_12     Document Type: Conference Paper

References (20)

1. Bailly, G., Brar, M., Elisei, F., Odisio, M.: Audiovisual speech synthesis. International Journal of Speech Technology 6, 331-346 (2003)
2. Breen. A.P., Bowers. E., Welsh, W.: An Investigation into the Generation of Mouth Shapes for a Talking Head. In: International Conference on Spoken Language Processing, vol. 4, pp. 2159-2162 (1996)
3. Bregler, C., Covell, M., Slaney, M.: Video Rewrite: Driving Visual Speech with Audio. In: Association for Computing Machinery's Special Interest Group on Graphics and Interactive Techniques, pp. 353-360 (1997)
4. Cosatto, E., Graf, H.P.: Sample-Based Synthesis of Photo-Realistic Talking Heads. Computer Animation, 103-110 (1998)
5. Cosatto, E., Graf, H.P.: Photo-realistic talking-heads from image samples. IEEE Transactions on multimedia 2, 152-163 (2000)
6. Cosatto, E., Potamianos, G., Graf, H.P.: Audio-Visual Unit Selection for the Synthesis of Photo-Realistic Talking-Heads. International Conference on Multimedia, and Expo, pp. 619-622 (2000)
7. Ezzat, T., Poggio, T.: Visual Speech Synthesis by Morphing Visemes (MikeTalk). MIT AI Lab, A.I Memo 1658 (1999)
8. Ezzat, T., Geiger, G., Poggio, T.: Trainable videorealistic speech animation. Association for Computing Machinery's Special Interest Group on Graphics and Interactive Techniques 21, 388-398 (2002)
9. Fagel, S.: Joint Audio-Visual Units Selection - The Javus Speech Synthesizer. In: International Conference on Speech and Computer (2006)
10. Goyal, U.K., Kapoor, A., Kalra, P.: Text-to-Audio Visual Speech Synthesizer. Virtual Worlds, 256-269 (2000)
11. Grant, K.W., Greenberg, S.: Speech Intelligibility Derived From Asynchrounous Processing of Auditory-Visual Information. In: Workshop on Audio-Visual Speech Processing, pp. 132-137 (2001)
12. Hunt, A., Black, A.: Unit selection in a concatenative speech synthesis system using a large speech database. In: International Conference on Acoustics, Speech and Signal Processing, pp. 373-376 (1996)
13. Kerkhoff, J., Marsi, E.: NeXTeNS: a New Open Source Text-to-speech System for Dutch. In: 13th meeting of Computational Linguistics in the Netherlands (2002)
14. Latacz, L., Kong, Y., Verhelst, W.: Unit Selection Synthesis Using Long NonUniform Units and Phoneme Identity Matching. In: 6th ISCA Workshop on Speech Synthesis, pp. 270-275 (2007)
15. Mattheyses, W., Latacz, L., Kong, Y.O., Verhelst, W.: Flemish Voice for the Nextens Text-To-Speech System. In: Fifth Slovenian and First International Language Technologies Conference (2006)
16. McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264, 746-748 (1976)
17. Moulines, E., Charpentier, F.: Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Communication 9, 453-467 (1990)
18. Pandzic, I., Ostermann, J., Milien, D.: Users Evaluation: Synthetic talking faces for interactive services. The Visual Computer 15, 2330-2340 (1999)
19. Theobald, B.J., Bangham, J.A., Matthews, I.A., Cawley, G.C.: Near-videorealistic synthetic talking faces: implementation and evaluation. Speech Communication 44, 127-140 (2004)
20. Wolberg, G.: Digital image warping. IEEE Computer Society Press, Los Alamitos (1990)