Enhanced Auditory Detection with AV Speech: Perceptual Evidence for Speech and Non-Speech Mechanisms

AVSP 2003 - International Conference on Audio-Visual Speech Processing

Volumn , Issue , 2003, Pages 13-17

  Bernstein, Lynne E ^a   Takayanagi, Sumiko ^a   Auer, Edward T ^a  

^a HOUSE EAR INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; SPEECH PROCESSING; SPEECH RECOGNITION; WHITE NOISE;

AUDIO-VISUAL SPEECH; DETECTION ENHANCEMENT; DETECTION THRESHOLD; ENHANCEMENT EFFECTS; LISSAJOUS FIGURES; NOISY ENVIRONMENT; NON SPEECH; REVERBERANT ENVIRONMENT; SPEECH DETECTION; SPEECH RESEARCH;

ELECTROPHYSIOLOGY;

EID: 85025641992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Levitt, H., "Transformed up-down method in psychoacoustics", J. Acoust. Soc. Am., 49(2 Suppl. 2): 467-477, 1971.
2. Grant, K.W., "The effect of speechreading on masked detection thresholds for filtered speech", Journal of the Acoustical Society of America, 109(5): 2272-2275, 2001.
3. Grant, K.W. and P.F. Seitz, "The use of visible speech cues for improving auditory detection of spoken sentences", J. Acoust. Soc. Am., 108(3 Pt 1): 1197-208, 2000.
4. Sumby, W.H. and I. Pollack, "Visual contribution to speech intelligibility in noise", J. Acoust. Soc. Am., 26: 212-215, 1954.
5. Schroeder, C.E. and J.J. Foxe, "The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex", Cognit. Brain Res., 14: 187-198, 2002.
6. Steinschneider, M., I.O. Volkov, M.D. Noh, P.C. Garell, and M.A. Howard, 3rd, "Temporal encoding of the voice onset time phonetic parameter by field potentials recorded directly from human auditory cortex", J. Neurophysiol., 82(5): 2346-57, 1999.
7. Yvert, B., A. Crouzeix, O. Bertrand, A. Seither-Preisler, and C. Pantev, "Multiple supratemporal sources of magnetic and electric auditory evoked middle latency components in humans", Cereb. Cortex, 11: 411-423, 2001.
8. Naatanen, R., "The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm)", Psychophysiology, 38: 1-21, 2001.
9. Foxe, J.J. and G.V. Simpson, "Flow of activation from V1 to frontal cortex in humans. A framework for defining "early" visual processing", Exp. Brain Res., 142: 139-150, 2002.
10. Krolak-Salmon, P., M.A. Henaff, C. Tallon-Baudry, B. Yvert, C. Fischer, A. Vighetto, O. Betrand, and F. Mauguiere, "How fast can the human lateral geniculate nucleus and visual striate cortex see?" Soc. Neurosci. Abstracts, 27: 913., 2001.
11. Welch, R.B. and D.H. Warren, Intersensory interactions, in Handbook of perception and human performance, volume I: Sensory processes and perception, J.P. Thomas, Editor. Wiley, NY, p. 25-1-25-36, 1986.
12. Stein, B.E. and M.A. Meredith, The Merging of the Senses, Cambridge, MA, MIT, 1993.
13. Calvert, G.A., M.J. Brammer, E.T. Bullmore, R. Campbell, S.D. Iversen, and A.S. David, "Response amplification in sensory-specific cortices during crossmodal binding", Neuroreport, 10(12): 2619-23, 1999.
14. American National Standards Institute, Specification for audiometers (ANSI S3.6-1989), New York, Author, 1989.
15. Nilsson, M., S.D. Soli, and J.A. Sullivan, "Development of the hearing in noise test for the measurement of speech reception thresholds in quiet and in noise", J. Acoust. Soc. Am., 95(1085-1099), 1994.
16. Molholm, S., W. Ritter, M.M. Murray, D.C. Javitt, C.E. Schroeder, and J.J. Foxe, "Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study", Cognit. Brain Res., 14: 115-129, 2002.
17. Fort, A., C. Delpuech, J. Pernier, and M.H. Giard, "Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans", Cereb. Cortex, 12(10): 1031-1039, 2002.
18. Giard, M.H. and F. Peronnet, "Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study", J. Cogn. Neurosci., 11: 473-490, 1999.
19. Teder-Salejarvi, W.A., J.J. McDonald, F. Di Russo, and S.A. Hillyard, "An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings", Brain Res. Cogn. Brain Res., 14(1): 106-114, 2002.
20. Bernstein, L.E., E.T. Auer, and J.K. Moore, Audiovisual Speech Binding: Convergence or Association?, in Handbook of Multisensory Processing, B.E. Stein, Editor. MIT, Cambridge, MA, in press.
21. Friston, K.J., C.J. Price, P. Fletcher, C. Moore, R.S. Frackowiak, and R.J. Dolan, "The trouble with cognitive subtraction", Neuroimage, 4(2): 97-104, 1996.
22. Picton, T.W., S. Bentin, P. Berg, E. Donchin, S.A. Hillyard, R. Johnson, Jr., G.A. Miller, W. Ritter, D.S. Ruchkin, M.D. Rugg, and M.J. Taylor, "Guidelines for using human event-related potentials to study cognition: Recording standards and publication criteria", Psychophysiology, 37(2): 127-152, 2000.