SPEECH-TO-LIP MOVEMENT SYNTHESIS BASED ON THE EM ALGORITHM USING AUDIO-VISUAL HMMS

5th International Conference on Spoken Language Processing, ICSLP 1998

Volumn , Issue , 1998, Pages

  Yamamoto, Eli ^a   Nakamura, Satoshi ^a   Shikano, Kiyohiro ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; DECODING; MAXIMUM PRINCIPLE; PARAMETER ESTIMATION; VITERBI ALGORITHM;

AUDIO-VISUAL; CONVENTIONAL METHODS; DECODING PROCESS; DETERMINISTICS; EXPECTATIONS MAXIMIZATION ALGORITHMS; HIDDEN-MARKOV MODELS; LIP MOVEMENTS; MODEL STATE; SPEECH-TO-LIPS; VITERBI;

HIDDEN MARKOV MODELS;

EID: 84887426467     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Morishima, S. and Harashima, H.: A Media Conversion from Speech to Facial mage for Intelligent Man-Machine Interface, IEEE Journal on sel. areas in Communications, Vol. 9, No. 4, pp. 594-600 (1991).
2. Lavagetto, F.: Converting Speech into Lip Movements: A Multimedia Telephone or Hard of Hearing People, IEEE Trans, on Rehabilitation Engineering, Vol. 3, No. 1, pp. 90-102 (1995).
3. Rao, R.R. and Chen,T., "Cross-Modal Prediction in Audio-Visual Communication", Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, Vol.4, pp.2056-2059(1996)
4. Goldenthal,W., Waters,K., Van Thong,J.M. and Glickman,0. "Driving Synthetic Mouth Gestures: Phonetic Recognition for FaceMe!", Eurospeech'97 Proceedings,Vol.4, pp.1995-1998 1997)
5. Simons, A. and Cox, S.: Generation of Mouthshape for a Synthetic Talking ead, Proc. of the Institute of Acoustics, Vol. 12, No. 10 (1990).
6. Chou, W. and Chen, H.: Speech Recognition for Image Animation and Coding, ICASSP 95, pp. 2253-2256 (1995).
7. Chen, T. and Rao, R.: Audio-Visual Interaction in Multimedia Communication, ICASSP 97, pp. 179-182 (1997).
8. Yamamoto, E., Nakamura, S. and Shikano, K.: Speech-to-Lip Movement Synthesis by HMM, ESCA Workshop of Audio Visual Speech Processing, pp. 37-140 (1997).
9. Guiard-Marigny, T., Adjoudani, T. and Benoit, C: 3D Models of the Lips and Jaw for Visual Speech Synthesis, in "Progress in Speech Synthesis", J. van Santen et al.,Eds, Springer-Verlag (1996).