On the importance of audiovisual coherence for the perceived quality of synthesized visual speech

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2009, Issue , 2009, Pages

  Mattheyses, Wesley ^a   Latacz, Lukas ^a   Verhelst, Werner ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 70350003751     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1155/2009/169819     Document Type: Article

References (29)

1. Pandzic I. S., Ostermann J., Millen D., User evaluation: synthetic talking faces for interactive services The Visual Computer 1999 15 7-8 330 340
2. Bailly G., Brar M., Elisei F., Odisio M., Audiovisual speech synthesis International Journal of Speech Technology 2003 6 331 346
3. Elisei F., Odisio M., Bailly G., Badin P., Creating and controlling video-realistic talking heads Proceedings of the Workshop on Audio-Visual Speech Processing (AVSP 01) 2001 Aalborg, Denmark 90 97
4. Bregler C., Covell M., Slaney M., Video rewrite: driving visual speech with audio Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 97) August 1997 Los Angeles, Calif, USA 353 360
5. Ezzat T., Poggio T., Visual speech synthesis by morphing visemes (MikeTalk) 1999 A.I Memo No: 1658 MIT AI Lab
6. Goyal U. K., Kapoor A., Kalra P., Text-to-audio visual speech synthesizer Proceedings of the 2nd International Conference on Virtual Worlds July 2000 256 269
7. Hunt A., Black A., Unit selection in a concatenative speech synthesis system using a large speech database 1 Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 96) May 1996 Atlanta, Ga, USA 373 376
8. Cosatto E., Graf H. P., Photo-realistic talking-heads from image samples IEEE Transactions on Multimedia 2000 2 3 152 163
9. Weiss C., A framework for data-driven video-realistic audio-visual speech synthesis Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 04) May 2004 Lisbon, Portugal
10. Liu K., Ostermann J., Realistic facial animation system for interactive services Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech 08) September 2008 Brisbane, Australia
11. Ezzat T., Geiger G., Poggio T., Trainable videorealistic speech animation 21 Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 02) July 2002 San Antonio, Tex, USA 388 398
12. Theobald B. J., Bangham J. A., Matthews I. A., Cawley G. C., Nearvideorealistic synthetic talking faces: implementation and evaluation Speech Communication 2004 44 14 127 140
13. Cootes T., Edwards G., Taylor C., Active appearance models 2 Proceedings of the European Conference on Computer Vision 1998 484 498
14. Grant K. W., Greenberg S., Speech intelligibility derived from asynchrounous processing of auditory-visual information Proceedings of the Workshop on Audio-Visual Speech Processing 2001 132 137
15. Grant K. W., Van Wassenhove V., Poeppel D., Detection of auditory (cross-spectral) and auditoryvisual (cross-modal) synchrony Speech Communication 2004 44 14 43 53
16. McGurk H., MacDonald J., Hearing lips and seeing voices Nature 1976 264 5588 746 748
17. Fagel S., Joint audio-visual units selectionthe javus speech synthesizer Proceedings of the International Conference on Speech and Computer 2006
18. Theobald B.-J., Fagel S., Bailly G., Elisei F., LIPS2008: visual speech synthesis challenge Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech 08) September 2008 Brisbane, Australia
19. Mattheyses W., Verhelst W., Verhoeve P., Robust pitch marking for prosodic modification of speech using td-psola Proceedings of the 2nd Annual IEEE Benelux/DSP Valley Signal Processing Symposium (SPS-DARTS 06) March 2006 Antwerp, Belgium 43 46
20. Latacz L., Kong Y., Verhelst W., Unit selection synthesis using long non-uniform units and phoneme identity matching Proceedings of the 6th ISCA Workshop on Speech Synthesis August 2007 Bonn, Germany 270 275
21. Latacz L., Kong Y., Mattheyses W., Verhelst W., An overview of the VUB entry for the 2008 blizzard challenge Proceedings of the Interspeech Blizzard Challenge 2008
22. Moulines E., Charpentier F., Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones Speech Communication 1990 9 453 467
23. Mattheyses W., Latacz L., Kong Y., Verhelst W., A flemish voice for the nextens text-to-speech system Proceedings of the 5th Slovenian and 1st International Language Technologies Conference October 2006 Lublijana, Slovenia 148 153
24. Wolberg G., Digital Image Warping 1990 Los Alamitos, Calif, USA IEEE Computer Society Press
25. Krahmer E., Ruttkay S., Swerts M., Wesselink W., Pitch, eyebrows and the perception of focus Proceedings of the Speech Prosody April 2002 Aix-en-Provence, France 443 446
26. Graf H. P., Cosatto E., Strom V., Huang F. J., Visual prosody: facial movements accompanying speech Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition May 2002 Washington, DC, USA 396 401
27. Conkie A., Isard I., Optimal coupling of diphones Proceedings of the 2nd ESCA/IEEE Workshop on Speech Synthesis 1994 293 304
28. Verhelst W., Roelands M., An overlap-add technique based on waveform similarity (WSOLA) for high-quality time-scale modification of speech Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 93) April 1993 Minneapolis, Minn, USA 554 557
29. Kominek J., Black A. W., The CMU arctic speech databases Proceedings of the 5th ISCA Speech Synthesis Workshop 2004 Pittsburgh, Pa, USA 223 224