Speech-to-lip movement synthesis maximizing audio-visual joint probability based on em algorithm

1998 IEEE 2nd Workshop on Multimedia Signal Processing

Volumn 1998-December, Issue , 1998, Pages 53-58

  Nakamura, S ^a   Yamamoto, E ^a   Shikano, K ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

DECODING; HIDDEN MARKOV MODELS; MAPPING; MAXIMUM PRINCIPLE; MULTIMEDIA SIGNAL PROCESSING;

EM ALGORITHMS; ERROR REDUCTION; EXPECTATION-MAXIMIZATION ALGORITHMS; JOINT PROBABILITY; LIP MOVEMENTS; MAPPING METHOD; STATE SEQUENCES; VITERBI DECODING ALGORITHMS;

VITERBI ALGORITHM;

EID: 2942629454     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MMSP.1998.738912     Document Type: Conference Paper

References (9)

1. Morishima, S. and Harashima, H.: A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface, IEEE Journal on set areas in Communications, Vol. 9, No. 4, pp. 594-600 (1991).
2. Lavagetto, F.: Converting Speech into Lip Movements: A Multimedia Telephone for Hard of Hearing People, IEEE Trans, on Rehabilitation Engineering, Vol. 3, No. 1, pp. 90-102 (1995).
3. Rao, R.R. and Chen, T., "Cross-Modal Prediction in Audio-Visual Communication", Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 4, pp.2056-2059(1996)
4. Goldenthal, W., Waters, K., Van Thong, J.M. and Glickman, O. "Driving Synthetic Mouth Gestures: Phonetic Recognition for FaceMe!", Eurospeech'97 Proceedings, Vol. 4, pp.1995-1998 (1997)
5. Simons, A. and Cox, S.: Generation of Mouthshape for a Synthetic Talking Head, Proc. of the Institute of Acoustics, Vol. 12, No. 10 (1990).
6. Chou, W. and Chen, H.: Speech Recognition for Image Animation and Coding, IGASSP 95, pp. 2253-2256 (1995).
7. Chen, T. and Rao, R.: Audio-Visual Interaction in Multimedia Communication, ICASSP 97, pp. 179-182 (1997).
8. Yamamoto, E., Nakamura, S. and Shikano, K.: Speech-to-Lip Movement Synthesis by HMM, ESC A Workshop of Audio Visual Speech Processing, pp. 137-140 (1997).
9. Guiard-Marigny, T., Adjoudani, T. and Benoit, C: 3D Models of the Lips and Jaw for Visual Speech Synthesis, in "Progress in Speech Synthesis", J. van Santen et al. Eds, Springer-Verlag (1996).