Audiovisual speech enhancement based on the association between speech envelope and video features

EUROSPEECH 2003 - 8th European Conference on Speech Communication and Technology

Volumn , Issue , 2003, Pages 1045-1048

  Berthommier, Frédéric ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH; SPEECH ENHANCEMENT;

AUDIO FEATURES; AUDIO-VISUAL SPEECH; COMPARATIVE STUDIES; ENVELOPE FEATURE; LINE SPECTRAL PAIRS; VIDEO FEATURES; VIDEO SEQUENCES;

SPEECH COMMUNICATION;

EID: 84901700762     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Barker, J.P., Berthommier, F., and Schwartz, J.L., Is primitive AV coherence an aid to segment the scene ?, in Proc. AVSP'98, Terrigal, 1998.
2. Barker, J.P., and Berthommier, F., Evidence of correlation between acoustic and visual features of speech, in Proc. ICPhs'99, San Francisco, pp. 199-202, August 1999.
3. Berthommier, F., Audio-visual recognition of spectrally reduced speech, in Proc. AVSP'01, Aalborg, pp. 183-188, 2001.
4. Berthommier, F., and Choi, S., Evaluation of CASA and BSS models for subband cocktail-party speech separation, in Proc. ICA'01, San Diego, pp. 301-306, 2001.
5. Berthommier, F., Direct synthesis of video from speech sounds for new telecommunication applications, in Proc. SOC'03, Grenoble, May 2003.
6. Bourlard, H., and Dupont, S., Subband-based speech recognition, in Proc. ICASSP'97, pp. 1251-1254, 1997.
7. Bregman, A.S., Auditory scene analysis, Cambridge, Mass, MIT Press, 1990.
8. Erber, N.P., Speech-envelope cues as an acoustical aid to lipreading for profoundly deaf children, JASA, 51:1224-1227, 1972.
9. Girin, L., Schwartz, J.L., and Feng., G., Audio-visual enhancement of speech in noise, JASA, 6(109):3007-3020, 2001.
10. Goecke, R., Potamianos, G., and Neti, C., Noisy audio feature enhancement using audio-visual speech data, in Proc. ICASSP'02, 2002.
11. Heckmann, M., Kroschel, K., Savariaux, C., and Berthommier, F., DCT-Based video features for audio-visual speech recognition, in Proc. ICSLP'02, Denver, pp. 1925-1928, 2002.
12. Jiang, J., Alwan, A., Keating, P. A., Auer, E. T., and Bernstein, L. E., On the relationship between face movements, tongue movements, and speech acoustics, EURASIP JASP, 11, 1174-1188, 2002.
13. Shannon, R. V., Zeng, F-G., Kamath, V., Wygonsky, J., and Ekelid, M., Speech recognition with primarily temporal cues, Science, 270, 303-304, 1995.
14. Tessier, E., Berthommier, F., Glotin, H., and Choi, S., A CASA front-end using the localisation cue for segregation and then cocktail-party speech recognition, in Proc. ICSP'99, Seoul, Korea, pp. 97-102, 1999.
15. Yehia, H., Rubin, P., and Vatikiotis-Bateson, E., Quantitative association of vocal tract and facial behavior, Speech Communication, 26(1):23-43, 1998.
16. Yehia, H., Kuratate, T., and Vatikiotis-Bateson, E., Using speech acoustics to drive facial motion, in Proc. ICPhs'99, San Francisco, pp. 631-634, August 1999.