Neural Basis of the Ventriloquist Illusion

Current Biology

Volumn 17, Issue 19, 2007, Pages 1697-1703

  Bonath, Bjoern ^a,b   Noesselt, Toemme ^b,c   Martinez, Antigona ^a,d   Mishra, Jyoti ^a   Schwiecker, Kati ^b   Heinze, Hans Jochen ^b   Hillyard, Steven A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

SYSNEURO

Indexed keywords

ADULT; ARTICLE; BRAIN; EVOKED AUDITORY RESPONSE; EVOKED RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HEARING; HISTOLOGY; HUMAN; MALE; NERVE CELL; PHYSIOLOGY; RECREATION; VISION; VISUAL ILLUSION;

ADULT; AUDITORY PERCEPTION; BRAIN; EVOKED POTENTIALS; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; NEURONS; OPTICAL ILLUSIONS; PLAY AND PLAYTHINGS; VISUAL PERCEPTION;

EID: 34848885828     PISSN: 09609822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cub.2007.08.050     Document Type: Article

References (46)

1. Vroomen J., and De Gelder B. Perceptual effects of cross-modal stimulation: ventriloquism and the freezing phenomenon. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The Handbook of Multisensory Processes (2004), The MIT Press, Cambridge, MA 141-150
2. Busse L., Roberts K.C., Crist R.E., Weissman D.H., and Woldorff M.G. The spread of attention across modalities and space in a multisensory object. Proc. Natl. Acad. Sci. USA 102 (2005) 18751-18756
3. Gondan M., Niederhaus B., Rosler F., and Roder B. Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept. Psychophys. 67 (2005) 713-726
4. Teder-Salejarvi W.A., Di Russo F., McDonald J.J., and Hillyard S.A. Effects of spatial congruity on audio-visual multimodal integration. J. Cogn. Neurosci. 17 (2005) 1396-1409
5. Bischoff M., Walter B., Blecker C.R., Morgen K., Vaitl D., and Sammer G. Utilizing the ventriloquism-effect to investigate audio-visual binding. Neuropsychologia 45 (2007) 578-586
6. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14 (2002) 115-128
7. Fort A., Delpuech C., Pernier J., and Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. Cogn. Brain Res. 14 (2002) 20-30
8. Stein B., and Meredith M. The Merging of the Senses (1993), The MIT Press, Cambridge, MA
9. Murray M.M., Molholm S., Michel C.M., Heslenfeld D.J., Ritter W., Javitt D.C., Schroeder C.E., and Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 15 (2005) 963-974
10. Teder-Sälejärvi W.A., McDonald J.J., Di Russo F., and Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn. Brain Res. 14 (2002) 106-114
11. Talsma D., and Woldorff M.G. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17 (2005) 1098-1114
12. Mishra J., Martinez A., Sejnowski T.J., and Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J. Neurosci. 27 (2007) 4120-4131
13. Pavani F., Macaluso E., Warren J.D., Driver J., and Griffiths T.D. A common cortical substrate activated by horizontal and vertical sound movement in the human brain. Curr. Biol. 12 (2002) 1584-1590
14. Recanzone G.H. Spatial processing in the auditory cortex of the macaque monkey. Proc. Natl. Acad. Sci. USA 97 (2000) 11829-11835
15. Krumbholz K., Schonwiesner M., Rubsamen R., Zilles K., Fink G.R., and von Cramon D.Y. Hierarchical processing of sound location and motion in the human brainstem and planum temporale. Eur. J. Neurosci. 21 (2005) 230-238
16. Kaas J.H., and Collins C.E. The resurrection of multisensory cortex in primates. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The Handbook of Multisensory Processes (2004), Bradford, Cambridge, MA 285-294
17. Budinger E., Heil P., Hess A., and Scheich H. Multisensory processing via early cortical stages: connections of the primary auditory cortical field with other sensory systems. Neuroscience 143 (2006) 1065-1083
18. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex 11 (2001) 1110-1123
19. Macaluso E., and Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci. 28 (2005) 264-271
20. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
21. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., and Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 7 (2004) 1190-1192
22. Beauchamp M.S., Lee K.E., Argall B.D., and Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41 (2004) 809-823
23. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 10 (2006) 278-285
24. Schroeder C.E., and Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Curr. Opin. Neurobiol. 15 (2005) 454-458
25. Brosch M., Selezneva E., and Scheich H. Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. J. Neurosci. 25 (2005) 6797-6806
26. Welch R.B., and Warren D.H. Intersensory interactions. In: Kaufman L., Boff K.R., and Thomas J.P. (Eds). Handbook of Perception and Human Performance (1986), Wiley, New York 25.1-25.36
27. Alais D., and Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14 (2004) 257-262
28. Kayser C., Petkov C.I., Augath M., and Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. J. Neurosci. 27 (2007) 1824-1835
29. Lehmann C., Herdener M., Esposito F., Hubl D., di Salle F., Scheffler K., Bach D.R., Federspiel A., Kretz R., Dierks T., and Seifritz E. Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. Neuroimage 31 (2006) 294-300
30. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14 (2002) 187-198
31. Fu K.M., Johnston T.A., Shah A.S., Arnold L., Smiley J., Hackett T.A., Garraghty P.E., and Schroeder C.E. Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23 (2003) 7510-7515
32. Warren J.D., and Griffiths T.D. Distinct mechanisms for processing spatial sequences and pitch sequences in the human auditory brain. J. Neurosci. 23 (2003) 5799-5804
33. Baumgart F., Gaschler-Markefski B., Woldorff M.G., Heinze H.J., and Scheich H. A movement-sensitive area in auditory cortex. Nature 400 (1999) 724-726
34. Warren J.D., Zielinski B.A., Green G.G., Rauschecker J.P., and Griffiths T.D. Perception of sound-source motion by the human brain. Neuron 34 (2002) 139-148
35. DiRusso F., Martinez A., Sereno M., Pitzalis S., and Hillyard S.A. The cortical sources of the early components of the visual evoked potential. Hum. Brain Mapp. 15 (2001) 95-111
36. Tardif E., Murray M.M., Meylan R., Spierer L., and Clarke S. The spatio-temporal brain dynamics of processing and integrating sound localization cues in humans. Brain Res. 1092 (2006) 161-176
37. Mesulam M.M. Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. Philos. Trans. R. Soc. Lond. B Biol. Sci. 354 (1999) 1325-1346
38. Posner M.I. Attention in cognitive neuroscience: an overview. In: Gazzaniga M. (Ed). Handbook of Cognitive Neuroscience (1995), MIT Press, Cambridge, MA 615-624
39. Bertelson P., Vroomen J., de Gelder B., and Driver J. The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept. Psychophys. 62 (2000) 321-332
40. Vroomen J., Bertelson P., and de Gelder B. The ventriloquist effect does not depend on the direction of automatic visual attention. Percept. Psychophys. 63 (2001) 651-659
41. Choe C.S., Welch R.B., Gilford R.M., and Juola J.F. The "ventriloquist effect": visual dominance or response bias?. Percept. Psychophys. 18 (1975) 55-60
42. Bertelson P., and Aschersleben G. Automatic visual bias of auditory location. Psychon. Bull. Rev. 5 (1998) 482-489
43. Recanzone G.H. Rapidly induced auditory plasticity: the ventriloquism aftereffect. Proc. Natl. Acad. Sci. USA 95 (1998) 869-875
44. Talairach J., and Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain (1988), Tieme, New York
45. Kanowski M., Rieger J.W., Noesselt T., Tempelmann C., and Hinrichs H. Endoscopic eye tracking system for fMRI. J. Neurosci. Methods 160 (2007) 10-15
46. Beauchamp M.S. Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 3 (2005) 93-113