A SIGNAL PROCESSING SYSTEM FOR HAVING THE SOUND “POP-OUT” IN NOISE THANKS TO THE IMAGE OF THE SPEAKER'S LIPS: NEW ADVANCES USING MULTI-LAYER PERCEPTRONS

5th International Conference on Spoken Language Processing, ICSLP 1998

Volumn , Issue , 1998, Pages

  Girin, L ^a   Varin, L ^a   Feng, G ^a   Schwartz, J L ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS; NETWORK LAYERS; SIGNAL PROCESSING; SPEECH ENHANCEMENT; SPEECH RECOGNITION; WHITE NOISE;

LINEAR PREDICTION FILTER; LINEAR PREDICTION MODELS; MULTILAYERS PERCEPTRONS; NEURAL-NETWORKS; NOISY SPEECH; PROCESS-BASED; SIGNAL PROCESSING SYSTEMS; SPEECH ENHANCEMENT SYSTEM; SYNTHESIS PROCESS; VISUAL INFORMATION;

MULTILAYER NEURAL NETWORKS;

EID: 4243927729     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Adjoudani, A., and Benoît, C. “On the integration of auditory and visual parameters in an HMM-based ASR”, in [11], pp. 461-472.
2. Bregman, A.S., Auditory Scene Analysis: the perceptual organization of sound, Bradford Books, MIT Press, Cambridge, Mass, 1990.
3. Driver, J. (1996), “Enhancement of selective listening by illusory mislocation of speech sounds due to lipreading”, Nature, 381, 66-68.
4. Driver, J., and Grossenbacher, P.G., “Multimodal spatial constraints on tactile selective attention”. In Inui, T., and McClelland, J.L. (Eds.), Attention and Performance XVI: Information Integration in Perception and Communication (pp. 209-236), Bradford Books, MIT Press, Cambridge, Mass, 1996.
5. Girin L., Feng G., and Schwartz J.-L., “Noisy speech enhancement by fusion of auditory and visual information: a study of vowel transitions”, Proc. of the 5rd Euro. Conf. on Speech Communication and Technology, Rhodes, Greece, pp. 2555-2558, 1997.
6. Girin L., Feng G., and Schwartz J.-L., “Can the visual input make the audio signal "pop out" in noise? A first study of the enhancement of noisy VCV acoustic sequences by audiovisual fusion”, Proc. of the 1rst Euro. Tutorial & Research Workshop on Audio-Visual Speech Processing, Rhodes, Greece, pp.37-40, 1997.
7. Lallouache M.T., “Un poste visage-parole”, 18èmes Journées d'Etudes sur la Parole, Montréal, Québec, p. 282-286, 1990.
8. Markel, J.D., and Gray, A.H.Jr., Linear Prediction of Speech, Springer-Verlag, New-York, 1976.
9. Robert-Ribes, J., Piquemal, M., Schwartz, J.L., and Escudier, P., “Exploiting sensor fusion architectures and stimuli complementarity in AV speech recognition”, in [11], pp. 193-210.
10. Rumelhart D.E., Hinton G.E. and Williams, R.J., “Learning representations by back-propagating errors”, Nature, 323, pp. 533-536, 1986.
11. Stork, D.G., and Hennecke, M.E. (Eds.), Speechreading by humans and machines: theories, models and applications, Springer-Verlag, Berlin, 1996.
12. Sumby W.H., and Pollack I., “Visual contribution to speech intelligibility in noise”, J. Acoust. Soc. Am., 26, pp. 212-215, 1954.