A phonetically neutral model of the low-level audio-visual interaction

Speech Communication

Volumn 44, Issue 1-4 SPEC. ISS., 2004, Pages 31-41

  Berthommier, Frédéric ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

Audio visual processing; Modeling; Multimodal interaction; Subband decomposition; Temporal envelope processing

Indexed keywords

AUDIO-VISUAL PROCESSING; MULTIMODAL INTERACTION; SPECTRALLY REDUCED SPEECH (SRS); SUBBAND DECOMPOSITION; TEMPORAL ENVELOPE PROCESSING;

ACOUSTICS; COMPUTATIONAL METHODS; MODULATION; PHYSIOLOGY; SPEECH ANALYSIS; SPEECH RECOGNITION;

SPEECH PROCESSING;

EID: 10344267573     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.10.003     Document Type: Article

References (19)

1. Barker, J.P., Berthommier, F., Schwartz, J.-L., 1998. Is primitive AV coherence an aid to segment the scene? In: Proc. AVSP'98, Terrigal, pp.103-108.
2. Barker, J.P., Berthommier, F., 1999. Estimation of speech acoustics from visual speech features: a comparison of linear and non-linear models. In: Proc. AVSP'99, Santa Cruz, pp. 112-117.
3. Bernstein, L.E., Auer, E.T., Moore, J.K., 2004. Audiovisual speech binding: convergence or association. In: Calvert, G. et al. (Eds.), Handbook of Multisensory Processes. MIT Press, Cambridge.
4. Berthommier, F., 2001. Audio-visual recognition of spectrally reduced speech. In: Proc. AVSP'01, Aalborg, pp. 183-188.
5. Berthommier, F., 2003a. Direct synthesis of video from speech sounds for new telecommunication applications, In: Proc. SOC'03, Grenoble.
6. Berthommier, F., 2003b. Audiovisual speech enhancement based on the association between speech envelope and video features. In: Proc. Eurospeech'03, Geneva.
7. Bregman, A.S., 1990. Auditory Scene Analysis. MIT Press, Cambridge, MA.
8. Erber, N.P., 1972. Speech-envelope cues as an acoustical aid to lip-reading for profoundly deaf children. JASA 51, 1224-1227.
9. Girin, L., Schwartz, J.L., Feng, G., 2001. Audio-visual enhancement of speech in noise. JASA 109 (6), 3007-3020.
10. Goecke, R., Potamianos, G., Neti, C., 2002. Noisy audio feature enhancement using audio-visual speech data. In: Proc. ICASSP'02, Orlando.
11. Grant, K.W., Seitz, P.-F., 2000. The use of visible speech cues for improving auditory detection of spoken sentences. JASA 108, 1197-1208.
12. Heckmann, M., Kroschel, K., Savariaux, C., Berthommier, F., 2002. DCT-Based video features for audio-visual speech recognition. In: Proc. ICSLP'02, Denver, pp. 1925-1928.
13. Jiang, J., Alwan, A., Keating, P.A., Auer, E.T., Bernstein, L.E., 2002. On the relationship between face movements, tongue movements, and speech acoustics. EURASIP JASP 11, 1174-1188.
14. Kim, J., Davis, C., 2001. Visible speech cues and auditory detection of spoken sentences: an effect of degree of correlation between acoustic and visual properties. In: Proc. AVSP'01, Aalborg, pp. 127-131.
15. Massaro, D.W., 1998. Perceiving Talking Faces: From Speech Perception to a Behavioral Principle. MIT Press, Cambridge, MA.
16. Schwartz, J.-L., Berthommier, F., Savariaux, C., 2002. Audio-visual scene analysis: evidence for a "very-early" integration process in audio-visual speech perception. In: Proc. ICSLP'02, Denver, pp. 1937-1940.
17. Shannon, R.V., Zeng, F.-G., Kamath, V., Wygonsky, J., Ekelid, M., 1995. Speech recognition with primarily temporal cues. Science 270, 303-304.
18. Summerfield, Q., 1987. Some preliminaries to a comprehensive account of audio-visual speech perception. In: Dodd, B., Campbell, R. (Eds.), Hearing by Eye: The Psychology of Lip-Reading. Lawrence Erlbaum, Hillsdale, NJ.
19. Yehia, H., Rubin, P., Vatikiotis-Bateson, E., 1998. Quantitative association of vocal tract and facial behavior. Speech Commun. 26 (1), 23-43.