Real-time speech-driven 3D face animation

Proceedings - 1st International Symposium on 3D Data Processing Visualization and Transmission, 3DPVT 2002

Volumn , Issue , 2002, Pages 713-716

  Hong, Pengyu ^a   Wen, Zhen ^b   Huang, T S ^b   Shum, Heung Yeung ^c  

^a University of Illinois at Urbana Champaign   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMATION; DATA HANDLING; DATA VISUALIZATION; DEFORMATION; VISUALIZATION;

AUDIO FEATURES; AUDIO-VISUAL FEATURES; FACIAL DEFORMATIONS; FACIAL MOVEMENTS; LINEAR COMBINATIONS; QUANTITATIVE EVALUATION; REAL-TIME AUDIO; VISUAL FEATURE;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 56749178399     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/TDPVT.2002.1024147     Document Type: Conference Paper

References (21)

1. K. Aizawa and T. S. Huang, "Model-based image coding," Proc. IEEE, vol. 83, pp. 259-271, Aug. 1995.
2. C. S. Choi, F. Kiyoharu, H. Harashima, and T. Takebe, "Analysis and synthesis of facial image sequences in model-based image coding," IEEE Transaction on Circuits and Systems for Video Technology, vol. 4, pp. 257-275, June 1994.
3. T. F. Cootes, C. J. Taylor, et al., "Active shape models - their training and application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
4. th European Conference on Computer Vision, vol. 2, 1998, pp. 484-498.
5. M. Covell and C. Bregler, "Eigen-points", in Proc. IEEE Int. Conf. on Image Processing, vol.3, 1996, pp 471-474.
6. S. Curinga, F. Lavagetto, F. Vignoli, "Lip movements synthesis using time-delay neural networks", in Proc. EUSIPCO-96, Trieste, 1996.
7. B. Guenter, et al. "Making faces", in Proc. SIGGRAPH '98, 1998.
8. P. Hong, T. S. Huang, and X. Lin, "Mouth motion learning and generating from observations," IEEE Workshop on Multimedia Signal Processing, Dec. 7-9, 1998, Los Angeles, California, USA.
9. P. Hong, Z. Wen, and T. S. Huang, "iFACE: A 3D synthetic talking face," International Journal of Image and Graphics, vol. 1, no. 1, pp. 19-26, 2001.
10. P. Hong, Z. Wen, and T. S. Huang, "An integrated framework for face modeling, facial motion analysis and synthesis," ACM Multimedia 2001.
11. I. T. Jolliffe, Principal Component Analysis, Springer-Verlag, 1986.
12. S. Kshirsagar and N. Magnenat-Thalmann, "Lip synchronization using linear predictive analysis," in Proceedings of IEEE International Conference on Multimedia and Expo, New York, August 2000.
13. F. Lavagetto, "Converting speech into lip movements: A multimedia telephone for hard of hearing people," IEEE Transactions on Rehabilitation Engineering, vol. 3, no. 1, March 1995.
14. D. W. Massaro, J. Beskow, et al. "Picture my voice: audio to visual speech synthesis using artificial neural networks", in Proc. AVSP'99, SantaCruz, USA.
15. S. Morishima, "Real-time talking head driven by voice and its application to communication and entertainment," in Proceedings of the International Conference on Auditory-Visual Speech Processing, 1998, Terrigal, Australia.
16. S. Morishima, K. Aizawa and H. Harashima, "An intelligent facial image coding driven by speech and phoneme," Proc. IEEE ICASSP, p.1795. Glasgow, UK, 1989.
17. S. Morishima and H. Harashima, "A media conversion from speech to facial image for intelligent man-machine interface", IEEE J. Selected Areas in Communications, vol. 4, pp. 594-599, 1991.
18. I. Pandzic, J. Ostermann, D. Millen, "User evaluation: Synthetic talking faces for interactive services," The Visual Computer, vol. 15, issue 7/8, pp. 330-340, November 1999.
19. L. Rabiner and B. H. Juang, Fundamentals of Speech Recognition, Prentice Hall, 1993.
20. R. Rao and T. Chen, "Exploiting audio-visual correlation in coding of talking head sequences," in Picutre Coding Symposium' 96, Melbourne, Australia, March 1996.
21. K. Waters, J. M. Rehg, M. Loughlin, et al., "Visual sensing of humans for active public interfaces," Cambridge Research Lab, Technical Report CRL 96-5.