Audiovisual speech processing: Lip reading and lip synchronization

IEEE Signal Processing Magazine

Volumn 18, Issue 1, 2001, Pages 9-21

  Chen, Tsuhan ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; ACOUSTIC WAVE ABSORPTION; AUDIO ACOUSTICS; COMPUTER VISION; FEATURE EXTRACTION; GRAPHICAL USER INTERFACES; HUMAN COMPUTER INTERACTION; MARKOV PROCESSES; SYNCHRONIZATION; VIDEO SIGNAL PROCESSING; VISUAL COMMUNICATION;

ACOUSTIC WAVEFORMS; AUDIOVISUAL SPEECH PROCESSING; FACIAL IMAGE ANALYSIS; VISUAL SPEECH;

SPEECH PROCESSING;

EID: 85032752352     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/79.911195     Document Type: Article

References (65)

1. Hearing lips and seeing voices
2. Perceptual dominance during lipreading
3. Audiovisual integration in perception of real words
4. Perception of conflicting audiovisual speech: An examination across Spanish and German
5. Auditory-visual speech perception as a direct process: The McGurk effect in infants and across languages
6. Confusions among visually perceived consonants
7. Visemes observed by hearing-impaired and normal-hearing adult viewers
8. Face and 2-D mesh animation in MPEG-4
9. Lipreading and audiovisual speech perception
10. Visual contributions to speech intelligibility in noise
11. Easy to hear, but hard to understand: A lipreading advantage with intact auditory stimuli
12. Improved speech recognition through videotelephony: Experiments with the hard of hearing
13. Frame rate and Viseme analysis for multimedia applications
14. Automatic lipreading to enhance speech recognition
15. Automatic lipreading by optical flow analysis
16. Integration of acoustic and visual speech signals using neural networks
17. Neural network lipreading system for improved speech recognition
18. Computer lipreading for improved accuracy in automatic speech recognition
19. Speaker independent audiovisual database for bimodal ASR
20. A cascade image transform for speaker independent automatic speechreading
21. Nonlinear manifold learning for visual speech recognition
22. Speechreading using shape and intensity information
23. Audio-visual speech modeling for continuous recognition
24. Visual speech recognition with stochastic networks
25. The Lombard reflex and its role on human listeners and automatic speech recognizers
26. Integration of acoustic and visual speech for speaker recognition
27. Speaker identification by lipreading
28. Password-free network security through joint use of audio and video
29. Snakes: Active contour models
30. Feature extraction from faces using deformable templates
31. 'Eigenlips' for robust speech recognition
32. Lipreading from color video
33. A real-time face tracker
34. Computer vision face tracking for use in a perceptual user interface
35. A robust real-time face tracking algorithm
36. Tracking and learning graphs and pose on image sequences of faces
37. Tracking of multiple faces for huan-computer interfaces and virtual environments
38. On merging hidden Markov models with deformable templates
39. Maximum likelihood from incomplete data via the EM Algorithm
40. Neural network based face detection
41. Semantic bandwidth compression: Speechmaker
42. An intelligent facial image coding driven by speech and phoneme
43. A speech-driven 'talking-head' in real time
44. Converting speech into lip movements: A multimedia telephone for hard of hearing people
45. Parameterised models for facial animation
46. Recent developments in facial animation: An inside view
47. Video rewrite: Driving visual speech with audio
48. Lip movement synthesis from speech based on hidden Markov models
49. A new 3D lip model for analysis and synthesis of lip motion in speech production
50. Audiovisual interaction in multimedia communication
51. Lip-synchronization using speech-assisted video processing
52. High-quality digital audio in the entertainment industry: An overview of achievements and challenges
53. Multi-modality coding system for videophone application
54. Cross-modal predictive coding