Model-based lip synchronization with automatically translated synthetic voice toward a multi-modal translation system

Proceedings - IEEE International Conference on Multimedia and Expo

Volumn , Issue , 2001, Pages 28-31

  Ogata, Shin ^a,b   Murai, Kazumasa ^a,b   Nakamura, Satoshi ^a,b   Morishima, Shigeo ^a,b  

^a SEIKEI UNIVERSITY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

FACIAL EXPRESSIONS; FRAME MODELS; IMAGE SYNTHESIS; LIP SYNCHRONIZATION; MULTI-MODAL; SYNTHETIC VOICES; TRANSLATION SYSTEMS;

EID: 70350254571     PISSN: 19457871     EISSN: 1945788X     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2001.1237647     Document Type: Conference Paper

References (7)

1. T. Takezawa, T. Morimoto, Y. Sagisaka, N. Campbell, H. Iida, F. Sugaya, A. Yokoo, and S. Yamamoto. " A Japanese-to-English speech translation system: ATR-MATRIX" Proc. International Conference of Spoken Language Processing, ICSLP, pp. 957-960, 1998.
2. Hans Peter Graf, Eric Cosatto, and Tony Ezzat "Face Analysis for the Synthesis of Photo-Realistic Talking Heads" Proc. 4th International Conference on Automatic Face and Gesture Recognition, pp. 189-194, 2000
3. Nick Campbell and Alan W. Black "Chatr; a multi-lingual speech re-sequencing synthesis system" IEICE Technical Report, sp96-7, pp. 45, 1995
4. T. Kuratate, H. Yehia, and E. Vatikiotis-Bateson "KINEMATICS-BASED SYNTHESIS OF REALISTIC TRACKING FACE" Proc. International Conference on Auditory-Visual Speech Processing, AVSP'98, pp. 185-190, 1998
5. K. Ito, T. Misawa, J. Muto, and S. Morishima 3D Head Model Generation using Multi-angle Images and Facial Expression Generation" IEICE Technical Report, Vol99, No582, pp. 7-12, 2000
6. K. Ito, T. Misawa, J. Muto, and S. Morishima "3D Lip Expression Generation by using New Lip Parameters" IEICE Technical Report, A-16-24, pp. 328, 2000
7. T. Misawa, S. Nakamura, and S. Morishima "AUTOMATIC FACE TRACKING AND MODEL MATCH MOVE IN VIDEO SEQUENCE USING 3D FACE MODEL" To be appeared in Proc. International Conference of Multi-Media, Expo, ICME 2001, 2001