Real-time speech-driven face animation with expressions using neural networks

IEEE Transactions on Neural Networks

Volumn 13, Issue 4, 2002, Pages 916-927

  Hong, Pengyu ^b   Wen, Zhen ^b   Huang, Thomas S ^a,b  

^a IEEE   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Facial deformation modeling; Facial motion analysis and synthesis; Neural networks; Real time speech driven talking face with expressions

Indexed keywords

MOTION UNITS (MU);

ANIMATION; DATABASE SYSTEMS; FACE RECOGNITION; NEURAL NETWORKS; REAL TIME SYSTEMS;

SPEECH RECOGNITION;

EID: 0036650837     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2002.1021892     Document Type: Article

References (60)

1. Iface: A 3d synthetic talking face
2. Animated conversation: Rule-based generation of facial display, gesture and spoken intonation for multiple conversational agents
3. Speech dialogue with facial displays
4. User evaluation: Synthetic talking faces for interactive services
5. Model-based image coding
6. Networked intelligent collaborative environment (netice)
7. Real-time talking head driven by voice and its application to communication and entertainment
8. Face-to-face communicative avatar driven by voice
9. Adding the affective dimension: A new look in speech analysis and synthesis
10. Recognizing emotion in speech
11. How well can people and computers recognize emotions in speech?
12. Emotion recognition in speech signals: Experimental study, development, and application
13. Recognition of facial expression from optical flow
14. A unified approach to coding and interpreting face images
15. Tracking and recognizing rigid and nonrigid facial motions using local parametric models of image motion
16. Recognizing human facial expressions from long image sequences using optical flow
17. Coding, analysis, interpretation, and recognition of facial expressions
18. Voice puppetry
19. Speech-driven cartoon animation with emotions
20. Animation of a b-spline figure
21. Scattered data modeling
22. Performance-driven facial animation
23. Synthesizing realistic facial expressions from photographs
24. Simulation of facial muscle actions based on rational free form deformations
25. A parameterized model for facial animation
26. Speech and expression: A computer solution to face animation
27. A muscle model for animating three-dimensional facial expressions
28. Techniques for realistic facial modeling and animation
29. Realistic modeling for facial animation
30. 3-D motion estimation in model-based facial image coding
31. Active shape models-Their training and application
32. Optical flow constraints on deformable models with applications to face tracking
33. Audio-visual integration in multimodal communications
34. Real-time lip-synch face animation driven by human voice
35. An intelligent facial image coding driven by speech and phoneme
36. Quantitative association of vocal-tract and facial behavior
37. Exploiting audio-visual correlation in coding of talking head sequences
38. A media conversion from speech to facial image for intelligent man-machine interface
39. Lip synchronization using linear predictive analysis
40. Picture my voice: Audio to visual speech synthesis using artificial neural networks
41. Converting speech into lip movements: A multimedia telephone for hard of hearing people
42. Lip movements synthesis using time-delay
43. Explanation-based facial motion tracking using a piecewise bezier volume deformation model
44. Eigenlips for robust speech recognition
45. Active appearance models
46. Mouth motion learning and generating from observation
47. Good features to track