Co-articulation generation using maximum direction change and apparent motion for Chinese visual speech synthesis

ICS 2010 - International Computer Symposium

Volumn , Issue , 2010, Pages 512-517

  Wu, Chung Hsien ^a   Lee, Chung Han ^a   Chuang, Ze Jing ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Apparent motion; Non uniform rational B spline (NURBS); Talking head

Indexed keywords

APPARENT MOTION; CO-ARTICULATION; DIRECTION CHANGE; FACIAL ANIMATION; LIP SYNCHRONIZATION; MOTION PARAMETERS; NON-UNIFORM RATIONAL B-SPLINE (NURBS); PARAMETER SET; SPEAKING RATE; SPEECH DURATION; SPEECH SIGNALS; SYNCHRONIZATION ALGORITHM; TALKING HEAD; TEXT-TO-SPEECH SYSTEM; VIDEO FOOTAGE; VISUAL SPEECH SYNTHESIS;

ALGORITHMS; ANIMATION; INTELLIGENT CONTROL; SPEECH SYNTHESIS;

SPLINES;

EID: 79851491711     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COMPSYM.2010.5685459     Document Type: Conference Paper

References (20)

1. N. Magnenat-Thalmann, N. E. Primeau, D. Thalmann, "Abstract Muscle Actions Pro-cedures for Human Face Animation," Visual Computer, Vol. 3(5), 1988, pp. 290-297.
2. F.D. Rosis, C. Pelachaud, I. Poggi, V. Carofiglio, B.D. Carolis, "From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent," International Journal of Human-Computer Studies, Vol. 59, 2003, pp. 81-118.
3. C. Lisetti, F. Nasoz, C. LeRouge, O. Ozyer, K. Alvarez, "Developing multimodal in-telligent affective interfaces for tele-home health care," International Journal of Hu-man-Computer Studies, Vol. 59, 2003, pp. 245-255.
4. T. Takahashi, C. Bartneck, Y. Katagiri, N.H. Arai, "TelMeA- Expressive avatars in asynchronous," International Journal of Human-Computer Studies, Vol. 62, 2005, pp. 193-209.
5. G. Breton, C. Bouville, D. Pelé, "FaceEngine: A 3D Facial Animation Engine of Real Time Applications," in: Proceedings of ACM SIGWEB 2001, 2001, pp. 15-22.
6. J.D.R. Wey, J.A. Zuffo, "InterFace: a Real Time Facial Animation System," in Proceedings of International Symposium on Computer Graphics, Image Processing, and Vision. Rio de Janeiro, 1998, pp. 200-207.
7. J. Piesk, G. Trogemann, "Animated Interactive Fiction: Storytelling by a Conversa-tional Virtual Actor," in Proceedings of Virtual Systems and MultiMedia'97, 1997, pp. 100-108.
8. G. Bailly, M. Bérar, F. Elisei, M. Odisio, "Audiovisual speech synthesis," International Journal of Speech Technology, Vol. 6, 2003, p. 331-346.
9. T. Okadome, T. Kaburagi, M. Honda, "Articulatory movement formation by kinematic triphone model," in Proceedings of IEEE International Conference on Systems Man and Cybernetics, 1999, pp. 469-474.
10. M. Tamura, S. Kondo, T. Masuko, T. Kobayashi, "Text-to-audiovisual speech synthe-sis based on parameter generation from HMM," in Proceedings of European Confer-ence on Speech Communication and Technology, 1999, pp. 959-962.
11. T. Kuratate, H. Yehia, E. Vatikiotis-Bateson, "Kinematics-based synthesis of realistic talking faces," in Proceedings of Auditory-Visual Speech Processing Conference, 1998, pp. 185-190.
12. T.F. Cootes, G.J. Edwards, C.J. Taylor, "Active Appearance Models," in Proceedings of European Conference on Computer Vision 1998, 1998, pp. 484-498.
13. L.S. Chen, T.S. Huang, J. Ostermann, "Animated talking head with personalized 3D head model," in Proceedings of IEEE First Workshop on Multimedia Signal, 1997, pp. 274-279.
14. S. Shan, W. Gao, J. Yan, H. Zhang, X. Chen, "Individual 3D face synthesis based on orthogonal photos and speech driven facial animation," in Proceedings of IEEE In-ternational Conference on Image Processing 2000, 2000, pp. 238-241.
15. E. Cosatto, H.P. Graf, "Photo-realistic talking-heads from image samples," IEEE Transaction on Multimedia, Vol. 2(3), 2000, pp. 152-163.
16. T. Guiard-Marigny, A. Adjoudani, C. Benoit, "3D Models of the Lips and Jaw for Visual Speech Synthesis," in Proceedings of Santen, J. et al. (Ed.), Progress in Speech Synthesis, 1996, pp. 247-258.
17. J. Kleiser, "A fast, efficient, accurate way to represent the human face," in Proceed-ings of ACM RAPH '89 Course Notes 22: State of the Art in Facial Animation, 1989, pp. 37-40.
18. M.M. Cohen, D.W. Massaro, "Modeling Coarticulation in Synthetic Visual Speech," in Proceedings of Thalmann, 1993, pp. 139-156.
19. R.H. Bartels, J.C. Beatty, B.A. Barsky, An Introduction to Splines for Use in Com-puter Graphics and Geometric Modelling, Morgan Kaufmann Publishers Inc., San Francisco, CA , 1998.
20. Y. Zhuo, T.G. Zhou, H.Y. Rao, J.J. Wang, M. Meng, M. Chen, C. Zhou, L. Chen, "Contributions of the visual ventral pathway to long-range apparent motion," Science, Vol. 299, 2003, pp. 417-420.