A trainable trajectory formation model TD-HMM parameterized for the LIPS 2008 challenge

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2008, Pages 2318-2321

  Bailly, Gérard ^a   Govokhina, Oxana ^a,b   Breton, Gaspard ^b   Elisei, Frédéric ^a   Savariaux, Christophe ^a  

^a CNRS   (France)

^b Orange R and D   (France)

Author keywords

Facial animation audiovisual speech synthesis; HMM

Indexed keywords

ASYNCHRONY; AUDIO-VISUAL SPEECH; CONTEXT DEPENDENT; HMM; MOTION CAPTURE DATA; PARAMETERIZED; PREDICTION ERRORS; TRAJECTORY FORMATION; TRIPHONES;

ANIMATION; SPEECH SYNTHESIS; TRAJECTORIES;

SPEECH COMMUNICATION;

EID: 84867216889     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Badin, P., et al., Three-dimensional linear articulatory modeling of tongue, lips and face based on MRI and video images. Journal of Phonetics, 2002. 30(3): p. 533-553.
2. Bailly, G., et al., Audiovisual speech synthesis. International Journal of Speech Technology, 2003. 6: p. 331-346.
3. Bailly, G., et al. Degrees of freedom of facial movements in face-to-face conversational speech. in International Workshop on Multimodal Corpora. 2006. Genoa - Italy. p. 33-36.
4. Bailly, G., G. Gibert, and M. Odisio. Evaluation of movement generation systems using the point-light technique. in IEEE Workshop on Speech Synthesis. 2002. Santa Monica, CA. p. 27-30.
5. Beskow, J. Rule-based Visual Speech Synthesis. in Eurospeech. 1995. Madrid, Spain. p. 299-302.
6. Cohen, M.M. and D.W. Massaro, Modeling coarticulation in synthetic visual speech, in Models and Techniques in Computer Animation, D. Thalmann and N. Magnenat-Thalmann, Editors. 1993, Springer-Verlag: Tokyo. p. 141-155.
7. Dixon, N.F. and L. Spitz, The detection of audiovisual desynchrony. Perception, 1980. 9: p. 719-721.
8. Donovan, R., Trainable speech synthesis, in Univ. Eng. Dept. 1996, University of Cambridge: Cambridge, UK p. 164.
9. Elisei, F., et al. Creating and controlling video-realistic talking heads. in Auditory-Visual Speech Processing Workshop. 2001. Scheelsminde, Denmark. p. 90-97.
10. Govokhina, O., G. Bailly, and G. Breton. Learning optimal audiovisual phasing for a HMM-based control model for facial animation. in ISCA Speech Synthesis Workshop. 2007. Bonn, Germany.
11. Govokhina, O., et al. TDA: A new trainable trajectory formation system for facial animation. in InterSpeech. 2006. Pittsburgh, PE. p. 2474-2477.
12. Grant, K.W., V. van Wassenhove, and D. Poeppel. Discrimination of auditory-visual synchrony. in Audio Visual Speech Processing. 2003. St Jorioz, France. p. 31-35.
13. Hazen, T.J., Visual model structures and synchrony constraints for audio-visual speech recognition. IEEE Trans. on Speech and Audio Processing, 2005.
14. Kaburagi, T. and M. Honda, A model of articulator trajectory formation based on the motor tasks of vocal-tract shapes. Journal of the Acoustical Society of America, 1996. 99(5): p. 3154-3170.
15. Kuratate, T., et al. Audio-visual synthesis of talking faces from speech production correlates. in EuroSpeech. 1999. p. 1279-1282.
16. McGurk, H. and J. MacDonald, Hearing lips and seeing voices. Nature, 1976. 264: p. 746-748.
17. Revéret, L., G. Bailly, and P. Badin. MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation. in International Conference on Speech and Language Processing. 2000. Beijing, China. p. 755-758.
18. Tamura, M., et al. Text-to-audio-visual speech synthesis based on parameter generation from HMM. in EUROSPEECH. 1999. Budapest, Hungary. p. 959-962.
19. Tamura, M., et al. Visual speech synthesis based on parameter generation from HMM: speech-driven and text-and-speech-driven approaches. in Auditory-visual Speech Processing Workshop. 1998. Terrigal, Sydney, Australia. p. 219-224.
20. Tokuda, K., et al. Speech parameter generation algorithms for HMM-based speech synthesis. in IEEE International Conference on Acoustics, Speech, and Signal Processing. 2000. Istanbul, Turkey. p. 1315-1318.
21. Weiss, C. Framework for data-driven video-realistic audio-visual speech synthesis. in Int. Conf. on Language Resources and Evaluation. 2004. Lisbon.
22. Whalen, D.H., Coarticulation is largely planned. Journal of Phonetics, 1990. 18(1): p. 3-35.
23. Zen, H., K. Tokuda, and T. Kitamura. An introduction of trajectory model into HMM-based speech synthesis. in ISCA Speech Synthesis Workshop. 2004. Pittsburgh, PE. p. 191-196.