Visual cues can modulate integration and segregation of objects in auditory scene analysis

Brain Research

Volumn 1144, Issue 1, 2007, Pages 127-135

  Rahne, Torsten ^a   Böckmann, Martin ^a   von Specht, Hellmut ^a   Sussman, Elyse S ^b  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

Audiovisual interaction; Auditory perception; Auditory scene analysis; Cross modal perception; Mismatch negativity (MMN)

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY SCREENING; CLINICAL ARTICLE; CONTROLLED STUDY; CORTICAL SYNCHRONIZATION; ELECTROPHYSIOLOGY; FEMALE; FREQUENCY MODULATION; HEARING; HUMAN; HUMAN EXPERIMENT; INTEGRATION; MALE; MISMATCH NEGATIVITY; NORMAL HUMAN; PRIORITY JOURNAL; SEGREGATION ANALYSIS; SOUND; SOUND INTENSITY; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BRAIN MAPPING; CONTINGENT NEGATIVE VARIATION; CUES; DOSE-RESPONSE RELATIONSHIP, RADIATION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; PHOTIC STIMULATION; REACTION TIME; VISUAL PERCEPTION;

EID: 33947314821     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2007.01.074     Document Type: Article

References (30)

1. Alho K. Cerebral generators of mismatch negativity (MMN) and its magnetic counterpart (MMNm) elicited by sound changes. Ear Hear. 16 (1995) 38-51
2. Bertelson P., Vroomen J., de Gelder B., and Driver J. The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62 (2000) 321-332
3. Besle J., Fort A., and Giard M.H. Is the auditory sensory memory sensitive to visual information?. Exp. Brain Res. 166 (2005) 337-344
4. Bregman A.S. Auditory Scene Analysis: The Perceptual Organisation of Sounds (1999), The MIT Press, Cambridge, Massachusetts
5. Czigler I., Weisz J., and Winkler I. ERPs and deviance detection: visual mismatch negativity to repeated visual stimuli. Neurosci. Lett. 401 (2006) 178-182
6. Fort A., and Giard M.H. Multiple electrophysiological mechanisms of audio-visual integration in human perception. In: Calvert G., Spence C., and Stein B. (Eds). The Handbook of Multi-sensory Processing (2004), MIT press, Cambridge
7. Fort A., Delpuech C., Pernier J., and Giard M.H. Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb. Cortex 12 (2002) 1031-1038
8. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioural and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
9. Giard M.H., Perrin F., Pernier J., and Bouchet P. Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. Psychophys 27 (1990) 627-640
10. Guttman S.E., Gilroy L.A., and Blake R. Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol. Sci. 16 (2005) 228-235
11. King A.J., and Calvert G.A. Multisensory integration: perceptual grouping by eye and ear. Curr. Biol. (2001) 11
12. Maekawa T., Goto Y., Kinukawa N., Tanikawa T., Kanba S., and Tobimatsu S. Functional characterization of mismatch negativity to a visual stimulus. Clin. Neurophysiol. 116 (2005) 2392-2402
13. McGurk H., and McDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
14. Müller D., Widmann A., and Schröger E. Auditory streaming affects the processing of successive deviant and standard sounds. Psychophys 42 (2005) 668-676
15. Näätänen R., Tervaniemi M., Sussman E.S., Paavilainen P., and Winkler I. "Primitive intelligence" in the auditory cortex. Trends Neurosci. 24 (2001) 283-288
16. Remijn G.B., Ito H., and Nakajima Y. Audiovisual integration: an investigation of the 'streaming-bouncing' phenomenom. J. Physiol. Anthropol. Appl. Hum. Sci. 23 (2004) 243-247
17. Ritter W., De Sanctis P., Molholm S., Javitt D.C., and Foxe J.J. Preattentively grouped tones do not elicit MMN with respect to each other. Psychophys 43 (2006) 423-430
18. Schröger E., and Widmann A. Speeded responses to audiovisual signal changes result from bimodal integration. Psychophys 35 (1998) 755-759
19. Shams L., Kamitani Y., and Shimojo S. Illusions: what you see is what you hear. Nature 408 (2000) 788
20. Sussman E.S. Integration and segregation in auditory scene analysis. J. Acoust. Soc. Am. 117 (2005) 1285-1298
21. Sussman E., and Steinschneider M. Neurophysiological evidence for context-dependent encoding of sensory input in human auditory cortex. Brain Res. 1075 (2006) 165-174
22. Sussman E.S., Ritter W., and Vaughan Jr. H.G. Attention affects the organisation of auditory input associated with the mismatch negativity system. Brain Res. 789 (1998) 130-138
23. Sussman E.S., Ritter W., and Vaughan Jr. H.G. An investigation of the auditory streaming effect using event-related brain potentials. Psychophysiology 36 (1999) 22-34
24. Sussman E.S., Bregman A.S., Wang W.J., and Khan F.J. Attentional modulation of electrophysiological activity in auditory cortex for unattended sounds within multistream auditory environments. Cogn. Affect. Behav. Neurosci. 5 (2005) 93-110
25. Sussman, E., Wong, R., Horváth, J., Winkler, I., Wang, W., in press. The development of the perceptual organization of sound by frequency separation in 5-11 year-old children. Hear. Res. (Available online 20 January 2007).
26. Tales A., Newton P., Troscianko T., and Butler S. Mismatch negativity in the visual modality. NeuroReport 10 (1999) 3363-3367
27. Vroomen J., Bertelson P., and de Gelder B. The ventriloquist effect does not depend on the direction of automatic visual attention. Percept. Psychophys. 63 (2001) 651-659
28. Watanabe K., and Shimojo S. When sound affects vision: effects of auditory grouping on visual motion perception. Psychol. Sci. 12 (2001) 109-116
29. Watkins S., Shams L., Tanaka S., Haynes J.D., and Rees G. Sound alters activity in human V1 in association with illusory visual perception. NeuroImage 31 (2006) 1247-1256
30. Yabe H., Winkler I., Czigler I., Koyama S., Kakigi R., Sutoh T., Hiruma T., and Kaneko S. Organizing sound sequences in the human brain: the interplay of auditory streaming and temporal integration. Brain Res. 897 (2001) 222-227