A Phonetically Neutral Model of the Low-level Audiovisual Interaction

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 89-94

  Berthommier, Frédéric ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE ENHANCEMENT; LINGUISTICS; SPEECH PROCESSING; SPEECH RECOGNITION;

AUDIO SIGNAL; AUDIO-VISUAL; AUDIO-VISUAL INTERACTIONS; DEGREE OF CORRELATIONS; DETECTABILITY; NEUTRAL MODELLING; VISIBLE SPEECH; VISUAL COMPONENTS; VISUAL CORRELATIONS; VISUAL SIGNALS;

SPEECH COMMUNICATION;

EID: 4544306338     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Barker, J.P., Berthommier, F., and Schwartz, J.-L., Is primitive AV coherence an aid to segment the scene ?, in Proc. AVSP'98, Terrigal, 1998.
2. Barker, J.P., and Berthommier, F., Estimation of speech acoustics from visual speech features: a comparison of linear and non-linear models, in Proc. AVSP'99, Santa Cruz, pp. 112-117, August 1999.
3. Bernstein, L.E., Auer, E.T., and Moore, J.K., Audiovisual speech binding: Convergence or association ?, in Handbook of Multisensory processes, Calvert, G., et al. (Eds), Cambridge, MIT Press (in press).
4. Berthommier, F., Audio-visual recognition of spectrally reduced speech, in Proc. AVSP'01, Aalborg, pp. 183-188, 2001.
5. Berthommier, F., Direct synthesis of video from speech sounds for new telecommunication applications, in Proc. SOC'03, Grenoble, May 2003.
6. Berthommier, F., Audiovisual Speech Enhancement Based on the Association between Speech Envelope and Video Features, in Proc. Eurospeech'03, Geneva, 2003.
7. Bregman, A.S., Auditory scene analysis, Cambridge, Mass, MIT Press, 1990.
8. Erber, N.P., Speech-envelope cues as an acoustical aid to lipreading for profoundly deaf children, JASA, 51:1224-1227, 1972.
9. Girin, L., Schwartz, J.L., and Feng., G., Audio-visual enhancement of speech in noise, JASA, 109(6):3007-3020, 2001.
10. Goecke, R., Potamianos, G., and Neti, C., Noisy audio feature enhancement using audio-visual speech data, in Proc. ICASSP'02, 2002.
11. Grant, K.W., and Seitz, P.-F., The use of visible speech cues for improving auditory detection of spoken sentences, JASA, 108:1197-1208,2000.
12. Heckmann, M., Kroschel, K., Savariaux, C., and Berthommier, F., DCT-Based video features for audio-visual speech recognition, in Proc. ICSLP'02, Denver, pp. 1925-1928, 2002.
13. Jiang, J., Alwan, A., Keating, P. A., Auer, E.T., and Bernstein, L.E., On the relationship between face movements, tongue movements, and speech acoustics, EURASIP JASP, 11, 1174-1188, 2002.
14. Kim, J., and Davis, C., Visible speech cues and auditory detection of spoken sentences: an effect of degree of correlation between acoustic and visual properties, in Proc. AVSP'01, Aalborg, pp. 127-131, 2001.
15. Massaro, D.W., Perceiving talking faces: From speech perception to a behavioral principle, MIT press, Cambridge, MA, 1998.
16. Schwartz, J.-L., Berthommier, F., and Savariaux, C., Audio-visual scene analysis: evidence for a 'very-early' integration process in audio-visual speech perception, in Proc. ICSLP'02, Denver, pp. 1937-1940, 2002.
17. Shannon, R. V., Zeng, F-G., Kamath, V., Wygonsky, J., and Ekelid, M., Speech recognition with primarily temporal cues, Science, 270, 303-304, 1995.
18. Summerfield, Q., Some preliminaries to a comprehensive account of audio-visual speech perception, in Hearing by Eye: The psychology of lip-reading, Dodd, B. and Campbell, R. (Eds.), Lawrence Erlbaum, Hillsdale, 1987.
19. Yehia, H., Rubin, P., and Vatikiotis-Bateson, E., Quantitative association of vocal tract and facial behavior, Speech Communication, 26(1):23-43, 1998.