Learning Optimal Audiovisual Phasing for an HMM-based Control Model for Facial Animation

6th ISCA Workshop on Speech Synthesis, SSW 2007

Volumn , Issue , 2007, Pages 1-4

  Govokhina, Oxana ^a,b   Bailly, Gérard ^a   Breton, Gaspard ^b  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

^b ORANGE LABS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS/SYNTHESIS; CONTROL MODEL; FACIAL ANIMATION; FORMATION SYSTEMS; HMM-BASED; ITERATIVE ANALYSIS; PREDICTION ERRORS; SYNTHESISED; TRAJECTORY FORMATION; TRIPHONES;

EID: 78649417844     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. N. F. Dixon and L. Spitz, "The detection of audiovisual desynchrony," Perception, vol. 9, pp. 719-721, 1980.
2. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature, vol. 264, pp. 746-748, 1976.
3. D. H. Whalen, "Coarticulation is largely planned," Journal of Phonetics, vol. 18, pp. 3-35, 1990.
4. K. W. Grant, V. van Wassenhove, and D. Poeppel, "Discrimination of auditory-visual synchrony," presented at Audio Visual Speech Processing, St Jorioz, France, 2003.
5. G. Bailly, M. Bérar, F. Elisei, and M. Odisio, "Audiovisual speech synthesis," International Journal of Speech Technology, vol. 6, pp. 331-346, 2003.
6. J. Beskow, "Rule-based Visual Speech Synthesis," presented at Eurospeech, Madrid, Spain, 1995.
7. M. M. Cohen and D. W. Massaro, "Modeling coarticulation in synthetic visual speech," in Models and Techniques in Computer Animation, D. Thalmann and N. Magnenat-Thalmann, Eds. Tokyo: Springer-Verlag, 1993, pp. 141-155.
8. G. Bailly, G. Gibert, and M. Odisio, "Evaluation of movement generation systems using the point-light technique," presented at IEEE Workshop on Speech Synthesis, Santa Monica, CA, 2002.
9. T. Kaburagi and M. Honda, "A model of articulator trajectory formation based on the motor tasks of vocal-tract shapes," Journal of the Acoustical Society of America, vol. 99, pp. 3154-3170, 1996.
10. C. Weiss, "Framework for data-driven video-realistic audio-visual speech synthesis," presented at Int. Conf. on Language Resources and Evaluation, Lisbon, 2004. [11] M. Tamura, T. Masuko, T. Kobayashi, and K. Tokuda, "Visual speech synthesis based on parameter generation from HMM: speech-driven and text-and-speech-driven approaches," presented at Auditory-visual Speech Processing Workshop, Terrigal, Sydney, Australia, 1998.
11. H. Zen, K. Tokuda, and T. Kitamura, "An introduction of trajectory model into HMM-based speech synthesis," presented at ISCA Speech Synthesis Workshop, Pittsburgh, PE, 2004.
12. G. Gravier, G. Potamianos, and C. Neti, "Asynchrony modeling for audio-visual speech recognition," presented at Human Language Technology Conference, San Diego, CA, 2002.
13. T. J. Hazen, "Visual model structures and synchrony constraints for audio-visual speech recognition," IEEE Trans. on Speech and Audio Processing, 2005.
14. T. Kuratate, K. G. Munhall, P. E. Rubin, E. Vatikiotis-Bateson, and H. Yehia, "Audio-visual synthesis of talking faces from speech production correlates," presented at EuroSpeech, 1999.
15. L. Revéret, G. Bailly, and P. Badin, "MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation," presented at International Conference on Speech and Language Processing, Beijing, China, 2000.
16. F. Elisei, M. Odisio, G. Bailly, and P. Badin, "Creating and controlling video-realistic talking heads," presented at Auditory-Visual Speech Processing Workshop, Scheelsminde, Denmark, 2001.
17. G. Bailly, F. Elisei, P. Badin, and C. Savariaux, "Degrees of freedom of facial movements in face-to-face conversational speech," presented at International Workshop on Multimodal Corpora, Genoa - Italy, 2006.
18. P. Badin, G. Bailly, L. Revéret, M. Baciu, C. Segebarth, and C. Savariaux, "Three-dimensional linear articulatory modeling of tongue, lips and face based on MRI and video images," Journal of Phonetics, vol. 30, pp. 533-553, 2002.
19. R. Donovan, "Trainable speech synthesis," in Univ. Eng. Dept. Cambridge, UK: University of Cambridge, 1996, pp. 164.
20. M. Tamura, S. Kondo, T. Masuko, and T. Kobayashi, "Text-to-audio-visual speech synthesis based on parameter generation from HMM," presented at EUROSPEECH, Budapest, Hungary, 1999.
21. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis," presented at IEEE International Conference on Acoustics, Speech, and Signal Processing, Istanbul, Turkey, 2000.
22. S. E. G. Öhman, "Numerical model of coarticulation," Journal of the Acoustical Society of America, vol. 41, pp. 310-320, 1967.
23. O. Govokhina, G. Bailly, G. Breton, and P. Bagshaw, "TDA: A new trainable trajectory formation system for facial animation," presented at InterSpeech, Pittsburgh, PE, 2006.