TDA: A new trainable trajectory formation system for facial animation

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 5, Issue , 2006, Pages 2474-2477

  Govokhina, Oxana ^a,b   Bailly, Gérard ^a   Breton, Gaspard ^b   Bagshaw, Paul ^b  

^a Institut de la Communication Parlee   (France)

^b ORANGE LABS   (France)

Author keywords

Facial animation; Visual speech synthesis

Indexed keywords

ANIMATION; SPEECH SYNTHESIS;

FACIAL ANIMATION; FACIAL MOVEMENTS; MOTION CAPTURE DATA; MOVEMENT PLANNING; PARAMETRIC SPACES; PLANNING STRATEGIES; TRAJECTORY FORMATION; VISUAL SPEECH SYNTHESIS;

TRAJECTORIES;

EID: 44949159884     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Bailly, G. (1998) Learning to speak. Sensori-motor control of speech movements. Speech Communication, 22(2-3): p.251-267.
2. Bailly, G., Gibert, G., and Odisio, M. (2002) Evaluation of movement generation systems using the point-light technique, in IEEE Workshop on Speech Synthesis. Santa Monica, CA. p.27-30.
3. Browman, C.P. and Goldstein, L.M. (1989) Articulatory gestures as phonological units. Phonology, 6: p.201-251.
4. Cohen, M.M. and Massaro, D.W. ( 1993) Modeling coarticulation in synthetic visual speech, in Models and Techniques in Computer Animation, D. Thalmann and N. Magnenat-Thalmann, Editors. Springer-Verlag: Tokyo, p. 141-155.
5. Dixon, N.F. and Spitz, L. (1980) The detection of audiovisual desynchrony. Perception, 9: p.719-721.
6. Donovan, R. (1996) Trainable speech synthesis. PhD thesis, in Univ. Eng. Dept. University of Cambridge: Cambridge, UK. 164 pages.
7. Ezzat, T., Geiger, G., and Poggio, T. (2002) Trainable videorealistic speech animation. ACM Transactions on Graphics, 21(3): p.388-398.
8. Govokhina, O., Bailly, G., Breton, G., and Bagshaw, P. (2006) Evaluation de systèmes de génération de mouvements faciaux, in Journées d'Etudes sur la Parole. Rennes - France
9. Govokhina, O., Bailly, G., Breton, G., and Bagshaw, P. (2006) A new trainable trajectory formation system for facial animation, in ISCA Workshop on Experimental Linguistics. Athens, Greece
10. Huang, F.J., Graf, H.P., and Cosatto, E. (2002) Triphone-based unit selection for concatenative visual speech synthesis, in International Conference on Acoustics, Speech and Signal Processing. Orlando, FL. p.1315-1318.
11. Hunt, A.J. and Black, A.W. (1996) Unit selection in a concatenative speech synthesis system using a large speech database, in International Conference on Acoustics, Speech and Signal Processing. Atlanta, GA. p.373-376.
12. McGurk, H. and MacDonald, J. (1976) Hearing lips and seeing voices. Nature, 264: p.746-748.
13. Minnis, S. and Breen, A.P. (1998) Modeling visual coarticulation in synthetic talking heads using a lip motion unit inventory with concatenative synthesis, in International Conference on Speech and Language Processing. Beijing, China, p.759-762.
14. Öhman, S.E.G. (1967) Numerical model of coarticulation. Journal of the Acoustical Society of America, 41: p.310-320.
15. Okadome, T., Kaburagi, T., and Honda, M. (1999) Articulatory movement formation by kinematic triphone model, in IEEE International Conference on Systems Man and Cybernetics,. Tokyo, Japan, p.469-474.
16. Revéret, L., Bailly, G., and Badin, P. (2000) MOTHER: a new generation of talking heads providing a flexible articulatory control for video-realistic speech animation. in International Conference on Speech and Language Processing. Beijing - China, p.755-758.
17. Saltzman, E.L. and Munhall, K.G. (1989) A dynamical approach to gestural patterning in speech production. Ecological Psychology, 1(4): p.1615-1623.
18. Sereno, J.A., Baum, A.R., Cameron Marean, G., and Lieberman, P. (1987) Acoustic analysis and perceptual data on anticipatory labial coarticulation in adults and children. Journal of Acoustical Society of America, 81: p.512-519.
19. Tamura, M., Kondo, S., Masuko, T., and Kobayashi, T. ( 1999) Text-to-audio-visual speech synthesis based on parameter generation from HMM. in EUROSPEECH. Budapest, Hungary, p.959-962.
20. Taylor, P. and Black, A.W. ( 1999) Speech synthesis by phonological structure matching, in EuroSpeech. Budapest, Hungary, p.1531-1534.
21. Toda, T., Black, A.W., and Tokuda, K. (2004) Mapping from articulatory movements to vocal tract spectrum with gaussian mixture model for articulatory speech synthesis, in International Speech Synthesis Workshop. Pittsburgh, PA. p.26-31.
22. Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., and Kitamura, T. (2000) Speech parameter generation algorithms for HMM-based speech synthesis, in IEEE International Conference on Acoustics, Speech, and Signal Processing. Istanbul, Turkey. p. 1315-1318.
23. Whalen, D.H. (1990) Coarticulation is largely planned. Journal of Phonetics, 18(1): p.3-35.
24. Yehia, H., Kuratate, T., and Vatikiotis-Bateson, E. (2000) Facial animation and head motion driven by speech acoustics. in 5th Seminar on Speech Production: Models and Data & CREST Workshop on Models of Speech Production: Motor Planning and Articulatory Modelling. Kloster Seeon, Germany, p.265-268.
25. Yoshimura, T., Tokuda, K., Masuko, T., Kobayashi, T., and Kitamura, T. (1998) Duration modeling for HMM-based speech synthesis, in International Conference on Spoken Language Processing. Sydney, p.29-32.
26. Zen, H., Tokuda, K., and Kitamura, T. (2004) An introduction of trajectory model into HMM-based speech synthesis, in ISCA Speech Synthesis Workshop. Pittsburgh, PE. p. 191-196.