Speech-driven lip motion generation with a trajectory HMM

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2008, Pages 2314-2317

  Hofer, Gregor ^a   Yamagishi, Junichi ^a   Shimodaira, Hiroshi ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Audio visual speech; Lip synchronisation; Talking head

Indexed keywords

ANIMATION PARAMETER; AUDIO-VISUAL SPEECH; DRIVE CONTROL; GENERATION ALGORITHM; LIP MOTIONS; MOTION TRAJECTORIES; NOVEL TECHNIQUES; OPTIMAL SEQUENCE; PERCEPTUAL EVALUATION; SPEECH ANIMATION; SPEECH SIGNALS; SYNCHRONISATION; TALKING HEADS;

ANIMATION; HIDDEN MARKOV MODELS; OPTIMIZATION; SPEECH ANALYSIS; TRAJECTORIES;

SPEECH COMMUNICATION;

EID: 84867226738     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. H. Graf, E. Cosatto, and V. Strom, "Visual prosody: facial movements accompanying speech," Automatic Face and Gesture Recognition, Jan 2002.
2. M. M. Cohen and D. W. Massaro, "Modeling coarticulation in synthetic visual speech," in Models and Techniques in Computer Animation. Springer-Verlag, 1993.
3. M. Tamura, S. Kondo, T. Masuko, and T. Kobayashi, "Textto-audio- visual speech synthesis based on parameter generation fromhmm," in .European Conference on Speech Communication and Technology, 1999, pp. 959-962.
4. Z. Wen, P. Hong, and T. Huang, "Real time speech driven facial animation using formant analysis," Multimedia and Expo, 2001. ICME 2001. IEEE International Conference on, pp. 817-820, 22-25 Aug. 2001.
5. C.-K. Hsieh and Y.-C. Chen, "Partial linear regression for audio-driven talking head application," Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, pp. 281-284, 6-6 July 2005.
6. M. Brand, "Voice puppetry," in Proceedings of the 26th annual conference on Computer graphics and interactive techniques (SIGGRAPH'99), 1999, pp. 21-28.
7. S. Nakamura, "Statisitical Multimodal Integration for Audio-Visual Speech Processing," IEEE Trans. Neural Networks, vol. 13, no. 4, pp. 854-866, 2002.
8. H. Zen, K. Tokuda, and T. Kitamura, "Reformulating the HMM as a trajectory model by imposing explicit relationships between static and dynamic feature vector sequences," Computer Speech and Language, vol. 21, no. 1, 2007.
9. G. Hofer and H. Shimodaira, "Automatic head motion prediction from speech data," in Proc. Interspeech 2007, Antwerp, Belgium, Aug. 2007.
10. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorigthms for HMM-based speech synthesis," in Proc. ICASSP 2000, Jun. 2000, pp. 1315-1318.
11. G. Martin, "Preston blair phoneme series," World wide web electronic publication, 2006. [Online]. Available: http://www.garycmartin.com