Extraction of visual features for lipreading

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 24, Issue 2, 2002, Pages 198-213

  Matthews, Iain ^a,b   Cootes, Timothy F ^a,c   Bangham, J Andrew ^a,d   Cox, Stephen ^a,d   Harvey, Richard ^a,d  

^a IEEE   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF MANCHESTER   (United Kingdom)

^d UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

Active appearance model; Audio visual speech recognition; Connected set morphology; Sieve; Statistical methods

Indexed keywords

ACTIVE APPEARANCE MODEL; AUDIO-VISUAL SPEECH RECOGNITION; CONNECTED SET MORPHOLOGY; HIDDEN MARKOV MODELS; LIP IMAGE SEQUENCES; LIP READING; NONLINEAR SCALE-SPACE ANALYSIS; PIXEL INTENSITY; VISUAL STIMULUS;

COMPUTER VISION; FACE RECOGNITION; HUMAN COMPUTER INTERACTION; IMAGE ANALYSIS; MARKOV PROCESSES; MATHEMATICAL MODELS; PRINCIPAL COMPONENT ANALYSIS; SENSORY AIDS; SPEECH ANALYSIS; SPEECH INTELLIGIBILITY; SPEECH RECOGNITION; STATISTICAL METHODS;

FEATURE EXTRACTION;

EID: 0036472941     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.982900     Document Type: Article

References (90)

1. On the integration of auditory and visual parameters in an HMM-based ASR
2. Speech analysis and synthesis by linear prediction of the speech wave
3. Multiscale nonlinear decomposition: The sieve decomposition theorem
4. Morphological scale-space preserving transforms in many dimensions
5. Nonlinear scale-space from n-dimensional sieves
6. A fast ID sieve transform for multiscale signal decomposition
7. Scale-space from nonlinear filters
8. Multiscale recursive medians, scale-space, and transforms with applications to image processing
9. 3D modeling and tracking of human lip motions
10. Suppression of acoustic noise in speech using spectral substraction
11. Using occlusion models to evaluate scale space processors
12. Improving connected letter recognition by lipreading
13. Eigenlips' for robust speech recognition
14. Learning visual models for lipreading
15. Towards a robust speechreading dialog system
16. PCA image coding schemes and visual speech intelligibility
17. Automatic speech recognition that includes visual speech cues
18. Audio-visual integration in multimodal communication
19. Design issues for a digital audio-visual integrated database
20. 2D deformable models for visual speech analysis
21. Comparing active shape models with active appearance models
22. Active appearance models
23. The use of active shape models for locating structures in medical images
24. Active shape models-Their training and application
25. Active shape models: Evaluation of a multiresolution method for improving image search
26. Combining noise compensation with visual information in speech recognition
27. On the effects of varying filter bank parameters on isolated word recognition
28. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences
29. Toward movement invariant automatic lip-reading and speech recognition
30. Face recognition using active appearance models
31. Interpreting face images using active appearance models
32. Auditory-visual perception of speech
33. Speaker independent isolated word recognition using dynamic features of the speech spectrum
34. Continuous automatic speech recognition by lipreading
35. Continuous automatic speech recognition by lipreading
36. The use of auditory and visual information during phonetic processing: Implications for theories of speech perception
37. Robustness of some scale-spaces
38. Lip reading from scale-space measurements
39. A probabilistic fitness measure for deformable template models
40. Audio-visual speech recognition: Preprocessing, learning and sensory integration
41. Visionary speech: Looking ahead to practical speechreading systems
42. Automatic landmark generation for point distribution models
43. Developing a measure of similarity between pixel signatures
44. Accurate, real-time, unadorned lip tracking
45. Real-time lip tracking for audio-visual speech recognition applications
46. The structure of images
47. An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition
48. Visually recognizing speech using eigensequences
49. Visual speech and speaker recognition
50. Speechreading using probabilistic models
51. Speechreading using shape and intensity information
52. Visual influences on speech perception processes
53. Automatic lipreading by optical-flow analysis
54. Features for audio-visual speech recognition
55. A comparison of active shape model and scale decomposition based features for visual speech recognition
56. Hearing lips and seeing voices
57. Preprocessing of visual speech under real world conditions
58. Scale-space trees and applications as filters, for stereo vision and image retrieval
59. Channel seperability in the audio visual integration of speech: A Bayesian approach
60. Effect of visual factors on the intelligibility of speech
61. A simplex method for function minimization
62. Contributions of the visual components of oral symbols to speech comprehension
63. Robust face feature analysis for automatic speechreading and character animation
64. Automatic lipreading to enhance speech recognition
65. An improved automatic lipreading system to enhance speech recognition
66. Morphological shape decomposition
67. Speaker independent audio-visual database for bimodal ASR
68. Statistical chromaticity-based lip tracking with B-splines
69. Ten years after summerfield: A taxonomy of models for audio-visual fusion in speech perception
70. Computational imaging and vision
71. Motion in deformable templates
72. Computer lipreading for improved accuracy in automatic speech recognition
73. Speechreading by humans and machines: Models, systems, and applications
74. Visual contribution to speech intelligibility in noise
75. Some preliminaries to a comprehensive account of audio-visual speech perception
76. Integrating audio and visual information to provide highly robust speech recognition
77. Interpreted multi-state lip models for audio-visual speech recognition
78. Effects of training on the visual recognition of consonants
79. Scale-space filtering
80. Real-time face and facial feature tracking and applications
81. Integration of acoustic and visual speech signals using neural networks
82. Feature extraction from faces using deformable templates