Speech-driven lip motion generation for tele-operated humanoid robots

Auditory-Visual Speech Processing 2011, AVSP 2011

Volumn , Issue , 2011, Pages 131-135

  Ishi, Carlos T ^a   Liu, Chaoran ^a   Ishiguro, Hiroshi ^b   Hagita, Norihiro ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b ATR Social Media Research Laboratory Group Hiroshi Ishiguro Laboratory   (Japan)

Author keywords

formant; humanoid robot; lip motion; synchronization; tele operation

Indexed keywords

LINGUISTICS; SPEECH PROCESSING;

FORMANT; GENERATION METHOD; HUMANOID ROBOT; LIP MOTIONS; MOTION GENERATION; OPENING DEGREE; SPEAKER NORMALIZATION; TELE-OPERATIONS; TELEOPERATED; VOWEL SPACE;

ANTHROPOMORPHIC ROBOTS;

EID: 85133324061     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Cohen, M., Massaro, D. (1993). “Modeling coarticulation in synthetic visual speech,” Models and techniques in computer animation, Jan. 1993.
2. Tamura, M., Kondo, S., Masuko, T., Kobayashi, T. (1998). “Text-to-visual speech synthesis based on parameter generation from HMM,” in Proc. ICASSP98, 3745-3748.
3. Hong, P., Wen, Z., Huang, T. (2002). “Real-time speech-driven face animation with expressions using neural networks,” IEEE Trans. on Neural Networks, vol. 13, no. 4, pp. 916-927, Jul. 2002.
4. Beskow, J., Nordenberg, M. (2005). “Data-driven synthesis of expressive visual speech using an MPEG-4 talking head,” Proc. Interspeech2005, 793-796.
5. Hofer, G., Yamagishi, J., Shimodaira, H. (2008). “Speech-driven lip motion generation with a trajectory HMM,” Proc. Interspeech 2008, 2314-2317.
6. Takacs, G., (2009). “Direct, modular and hybrid audio to visual speech conversion methods - a comparative study,” in Proc. Interspeech09, 2267-2270.
7. Hofer, G., Richmond, K. (2010). “Comparison of HMM and TMDN methods for lip synchronization,” Proc. Interspeech 2010, 454-457.
8. Zhuang, X., et al. (2010). “A minimum converted trajectory error (MCTE) approach to high quality speech-to-lips conversion,” Proc. Interspeech 2010, 1726-1739.
9. Wu, J., et al. (2008). “Statistical correlation analysis between lip contour parameters and formant parameters for Mandarin monophthongs,” Proc. AVSP2008, 121-126.
10. Titze, I.R. (1994). Principles of voice production, Prentice Hall, New Jersey, 136-168.