A speech driven talking head system based on a single face image

Proceedings - 7th Pacific Conference on Computer Graphics and Applications, Pacific Graphics 1999

Volumn , Issue , 1999, Pages 50-58

  Lin, I Chen ^a   Hung, Cheng Sheng ^a   Yang, Tzong Jer ^a   Ouhyoung, Ming ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER GRAPHICS; IMAGE COMPRESSION; SPEECH;

FACIAL ANIMATION; FACIAL EXPRESSIONS; JPEG COMPRESSION; SPEAKER-INDEPENDENT SPEECH RECOGNITION; SPEECH RECOGNITION ENGINE; SPEECH-DRIVEN TALKING HEADS; TALKING HEADS; WEB ENABLED;

SPEECH RECOGNITION;

EID: 0005517541     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PCCGA.1999.803347     Document Type: Conference Paper

References (21)

1. MPEG4 Systems Group, "Text for ISO/IEC FCD 14498-1 Systems," ISO/IEC JTC1/SC29/WG11 N2201, 15 May 1998.
2. J. Ostermann, "Animation of Synthetic Faces in MPEG-4", Proc. of Computer Animation, pp.49-51, Philadelphia, Pennsylvania, USA, June 8-10, 1998.
3. Demetri Terzopoulos, Keith Waters, "Analysis and synthesis of Facial Image Sequences using Physical and Anatomical Models," IEEE Tran. On Pattern and Machine Intelligence, 15(6), Jun.1993, pp.569-579.
4. Frédéric Pighin, Jamie Hecker, Dani Lischinski, Pichard Sz eliski, David H. Salesin, "Synthesizeng Realistic Facial Expressions from Photographs," Proceedings of ACM Computer Graphics (SIGGRAPH 98), pp. 75-84 Aug-1998.
5. Thaddeus Beier, Shawn Neely "Feature-Based Image Metamorphosis", Proc.of SIGGRAPH 92. In Computer Graphics, pp. 35-42
6. Steven M.Seitz, Charles R. Dyer, "View Morphing", Proc. SIGGRAPH 96, pp. 21-30.
7. Nur Arad, Nira Dyn, Daniel Resfeld, Yehezkel Yeshurun, "Image Warping by Radial Basis Functions: Application to Facial Expressions", CVGIP: Graphical Models and Image Processing", Vol. 56, No.2, pp.161-172, 1994.
8. Eric Cosatto, Hans Peter Graf, "Sample-Based Synthesis of Photo-Realistic Talking Heads", Proc. of Computer Animation 98, pp. 103-110, Philadelphia, Pennsylvania, June 8-10, 1998.
9. Woei-Luen Perng, Yungkang Wu, Ming Ouhyoung, "Image Talk: A Real Time Synthetic Talking Head Using One Single Image with Chinese Text-To-Speech Capability" Proc. of PacificGraphics 98, pp. 140-148, Singapore, Oct 1998.
10. Lin-Shan Lee, Chiu-Yu Tseng, Ming Ouhyoung, "The Synthesis Rules in a Chinese Text-to-Speech System", IEEE Trans. On Acoustics, Speech and Signal Processing. Pp.1309-1320. Vol.37, No.9, 1989.
11. Microsoft Speech Technology SAPI 4.0 SDK, http://www.microsoft.com/iit/projects/sapisdk.htm
12. Applied Speech Technologies Corporation. http://www.speech.com.tw
13. Tzong-Jer Yang, I-Chen Lin, Cheng-Sheng Hung, Chien-Feng Huang and Ming Ouhyoung, "Speech Driven Facial Animation", to appear in the Proceedings of EuroGraphics CAS'99, Milan, Italy, Sept. 1999.
14. M.Esoher and N.M. Thalmann, "Automatic 3D Cloning and Real-Time Animation of a Human Face", Proc. Computer Animation 97, pp.58-66, 1997.
15. C. Bregler, M.Covell, M.Slaney, "Video Rewrite: Driving Visual Speech with Audio", Proc. SIGGRAPH'97, pp.353-360, 1997.
16. B. Guenter, c. grimm, D. Wood, H. Malvar, F. Pighin, "Making Face", Proc. of Computer Graphics (SIGGRAPH '98), pp. 55-66, Aug. 1998.
17. D. Decaolo, D. Metaxas, M. Stone, "An Antropometric Face Model Using Variational Techniques", Proc. Computer Graphics (SIGGRAPH '98), pp. 67-74, Aug. 1998.
18. T. DeRose, M. Kass, T. Truong, "Subdivision Surfaces in Character Animation", Proc. of Computer Graphics (SIGGRAPH' 98), pp85-94, Aug 1998.
19. P.E Kmon, W.Fresen, "Facial Action Coding System: A Technique for the Measurement of Facial Movement", Consulting Psychologists Press, Palo Alto, CA, 1978.
20. S. Morishima, H.Harashima, "A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface", IEEE J. Selected Areas in communications, 9, pp. 594-600, 1991.
21. M.M. Cohen and D.W. Massaro. "Modeling coarticulation in synthetic visual speech". In N.M. Thalmann and D. Thalmann, editors, Models and Techniques in Computer Animation. Springer-Verlag, 1993.