CAN THE VISUAL INPUT MAKE THE AUDIO SIGNAL "POP OUT" IN NOISE? A first study of the enhancement of noisy VCV acoustic sequences by audio-visual fusion

ESCA Workshop on Audio-Visual Speech Processing, AVSP 1997

Volumn , Issue , 1997, Pages 37-40

  Girin, L ^a   Schwartz, J L ^a   Feng, G ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; AUDIO ACOUSTICS; LINGUISTICS; WHITE NOISE;

AUDIO SIGNAL; AUDIO-VISUAL FUSION; DISTANCE MEASURE; GAUSSIAN CLASSIFICATIONS; INFORMAL LISTENING; LISTENING TESTS; NOISY SPEECH; SCENE ANALYSIS; VISUAL INFORMATION;

SPEECH ENHANCEMENT;

EID: 84873567862     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Stork, D.G., & Hennecke, M.E. (Eds.) (1996), Speechreading by humans and machines, NATO ASI series, Springer-Verlag, Berlin.
2. Driver, J., & Grossenbacher, P.G. (1996), Multimodal spatial constraints on tactile selective attention. In T. Inui & J.L. McClelland (Eds.) Attention and Performance XVI: Information Integration in Perception and Communication (pp. 209-236). Cambridge, Mass, Bradford Books, MIT Press.
3. Driver, J. (1996), Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68.
4. Bregman, A.S. (1990), Auditory Scene Analysis: the perceptual organization of sound. Cambridge, Mass, Bradford Books, MIT Press.
5. Girin, L., Feng, G., & Schwartz, J.-L. (1997), Noisy speech enhancement by fusion of auditory and visual information: a study of vowel transitions, Proc. of the 5rd EUROSPEECH Conference, Rhodes, Greece.
6. Adjoudani, A., & Benoît, C. (1996), On the integration of auditory and visual parameters in an HMM-based ASR, in [1], pp. 461-472.
7. Robert-Ribes, J., Piquemal, M., Schwartz, J.L., & Escudier, P. (1996), Exploiting sensor fusion architectures and stimuli complementarity in AV speech recognition, in [1], pp. 193-210.
8. Schwartz, J.L., Robert-Ribes, J., & Escudier, P. (to appear), Ten years after Summerfield... a taxonomy of models for audiovisual fusion in speech perception. In R. Campbell (ed.) Hearing by eye, II. Perspectives and directions in research on audiovisual aspects of language processing. Erlbaum.
9. Schroeter, J., & Sondhi, M.M. (1994), Techniques for estimating vocal-tract shapes from the speech signal. IEEE Trans. Speech and Audio Proc, 2, pp. 133-150.
10. Girin, L., Feng, G., & Schwartz, J.-L. (1995), Noisy speech enhancement with filters estimated from the speaker's lips, Proc. of the 4rd EUROSPEECH Conference, Madrid, Spain, pp. 1559-1562.
11. Markel, J.D., & Gray, A.H. Jr., Linear Prediction of Speech, Springer-Verlag, New-York, 1976.