Independent mechanisms for ventriloquism and multisensory integration as revealed by theta-burst stimulation

European Journal of Neuroscience

Volumn 31, Issue 10, 2010, Pages 1791-1799

  Bertini, Caterina ^a,b   Leo, Fabrizio ^a,b   Avenanti, Alessio ^a,b   Làdavas, Elisabetta ^a,b  

^a UNIVERSITY OF BOLOGNA   (Italy)

^b Polo Scientifico Didattico di Cesena   (Italy)

Author keywords

Audiovisual integration; Posterior parietal cortex; Temporoparietal cortex; Transcranial magnetic stimulation; Visual bias; Visual cortex

Indexed keywords

ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUDITORY ORIENTATION; AUDITORY STIMULATION; AUDITORY SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; LANGUAGE ABILITY; MALE; NERVE CELL EXCITABILITY; NORMAL HUMAN; OCCIPITAL CORTEX; PARIETAL LOBE; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; TASK PERFORMANCE; THETA RHYTHM; TRANSCRANIAL MAGNETIC STIMULATION; VENTRILOQUISM; VISUAL STIMULATION; VISUAL SYSTEM; ALGORITHM; BRAIN CORTEX; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; HEARING; NERVE CELL NETWORK; PHOTOSTIMULATION; PHYSIOLOGY; SOUND DETECTION; VISION; YOUNG ADULT;

ACOUSTIC STIMULATION; ADULT; ALGORITHMS; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; NERVE NET; PHOTIC STIMULATION; SOUND LOCALIZATION; THETA RHYTHM; TRANSCRANIAL MAGNETIC STIMULATION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77952665315     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2010.07200.x     Document Type: Article

References (83)

1. Alais, D. Burr, D. (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol., 14, 257 262.
2. Amassian, V.E., Cracco, R.Q., Maccabee, P.J., Cracco, J.B., Rudell, A. Eberle, L. (1989) Suppression of visual perception by magnetic coil stimulation of human occipital cortex. Electroencephalogr. Clin. Neurophysiol., 74, 458 462.
3. Avenanti, A., Bolognini, N., Maravita, A. Aglioti, S.M. (2007) Somatic and motor components of action simulation. Curr. Biol., 17, 2129 2135.
4. Azañón, E. Haggard, P. (2009) Somatosensory processing and body representation. Cortex, 45, 1078 1084.
5. Barraclough, N.E., Xiao, D., Baker, C.I., Oram, M.W. Perrett, D.I. (2005) Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J. Cogn. Neurosci., 17, 377 391.
6. Beauchamp, M.S., Lee, K.E., Argall, B.D. Martin, A. (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron, 41, 809 823.
7. Benevento, L.A., Fallon, J., Davis, B.J. Rezak, M. (1977) Auditory - visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp. Neurol., 57, 849 872.
8. Bertelson, P. Radeau, M. (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept. Psychophys., 29, 578 584.
9. Bertelson, P., Pavani, F., Ladavas, E., Vroomen, J. de Gelder, B. (2000) Ventriloquism in patients with unilateral visual neglect. Neuropsychologia, 38, 1634 1642.
10. Bertini, C., Leo, F. Ladavas, E. (2008) Temporo-nasal asymmetry in multisensory integration mediated by the Superior Colliculus. Brain Res., 1242, 37 44.
11. Besle, J., Bertrand, O. Giard, M.H. (2009) Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hear. Res., 258, 143 151.
12. Bizley, J.K., Nodal, F.R., Bajo, V.M., Nelken, I. King, A.J. (2007) Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb. Cortex, 17, 2172 2189.
13. Bolognini, N. Maravita, A. (2007) Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex. Curr. Biol., 17, 1890 1895.
14. Bolognini, N., Frassinetti, F., Serino, A. Làdavas, E. (2005) "Acoustical vision" of below threshold stimuli: interaction among spatially converging audiovisual inputs. Exp. Brain Res., 160, 273 282.
15. Bolognini, N., Leo, F., Passamonti, C., Stein, B.E. Làdavas, E. (2007) Multisensory-mediated auditory localization. Perception, 36, 1477 1485.
16. Bolognini, N., Miniussi, C., Savazzi, S., Bricolo, E. Maravita, A. (2009) TMS modulation of visual and auditory processing in the posterior parietal cortex. Exp. Brain Res., 195, 509 517.
17. Bonath, B., Noesselt, T., Martinez, A., Mishra, J., Schwiecker, K., Heinze, H.J. Hillyard, S.A. (2007) Neural basis of the ventriloquist illusion. Curr. Biol., 17, 1697 1703.
18. Boroojerdi, B., Bushara, K.O., Corwell, B., Immisch, I., Battaglia, F., Muellbacher, W. Cohen, L.G. (2000) Enhanced excitability of the human visual cortex induced by short-term light deprivation. Cereb. Cortex, 10, 529 534.
19. Bremmer, F., Schlack, A., Shah, N.J., Zafiris, O., Kubischik, M., Hoffmann, K., Zilles, K. Fink, G.R. (2001) Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron, 29, 287 296.
20. Bruce, C., Desimone, R. Gross, C.G. (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol., 46, 369 384.
21. Bushara, K.O., Grafman, J. Hallett, M. (2001) Neural correlates of auditory-visual stimulus onset asynchrony detection. J. Neurosci., 21, 300 304.
22. Calvert, G.A. (2001) Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex, 11, 1110 1123.
23. Calvert, G.A., Campbell, R. Brammer, M.J. (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol., 10, 649 657.
24. Calvert, G.A., Hansen, P.C., Iversen, S.D. Brammer, M.J. (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage, 14, 427 438.
25. Colby, C.L., Duhamel, J.R. Goldberg, M.E. (1993) Ventral intraparietal area of the macaque: anatomic location and visual response properties. J. Neurophysiol., 69, 902 914.
26. Corneil, B.D., Van Wanrooij, M., Munoz, D.P. Van Opstal, A.J. (2002) Auditory-visual interactions subserving goal-directed saccades in a complex scene. J. Neurophysiol., 88, 438 454.
27. Cusick, C.G. (1997) The superior temporal polysensory region in monkeys. In Rockland, K.S., Kaas, J.H. Peters, A. (Eds Cerebral Cortex: Extrastriate Cortex in Primates. Plenum Press
28. Desimone, R. Gross, C.G. (1979) Visual areas in the temporal cortex of the macaque. Brain Res., 178, 363 380.
29. Dong, W.K., Chudler, E.H., Sugiyama, K., Roberts, V.J. Hayashi, T. (1994) Somatosensory, multisensory, and task-related neurons in cortical area 7b (PF) of ananesthetized monkeys. J. Neurophysiol., 72, 542 564.
30. Duhamel, J.R., Colby, C.L. Goldberg, M.E. (1998) Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J. Neurophysiol., 79, 126 136.
31. Fernandez, E., Alfaro, A., Tormos, J.M., Climent, R., Martinez, M., Vilanova, H., Walsh, V. Pascual-Leone, A. (2002) Mapping of the human visual cortex using image-guided transcranial magnetic stimulation. Brain Res. Brain Res. Protoc., 10, 115 124.
32. Franca, M., Koch, G., Mochizuki, H., Huang, Y.Z. Rothwell, J.C. (2006) Effects of theta burst stimulation protocols on phosphene threshold. Clin. Neurophysiol., 117, 1808 1813.
33. Frassinetti, F., Bolognini, N., Bottari, D., Bonora, A. Làdavas, E. (2005) Audiovisual integration in patients with visual deficit. J. Cogn. Neurosci., 17, 1442 1452.
34. Hairston, W.D., Laurienti, P.J., Mishra, G., Burdette, J.H. Wallace, M.T. (2003a) Multisensory enhancement of localization under conditions of induced myopia. Exp. Brain Res., 152, 404 408.
35. Hairston, W.D., Wallace, M.T., Vaughan, J.W., Stein, B.E., Norris, J.L. Schirillo, J.A. (2003b) Visual localization ability influences cross-modal bias. J. Cogn. Neurosci., 15, 20 29.
36. Hikosaka, K., Iwai, E., Saito, H. Tanaka, K. (1988) Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J. Neurophysiol., 60, 1615 1637.
37. Howard, I.P. Templeton, W.B. (1966) Human Spatial Orientation. Wiley
38. Huang, Y.Z., Edwards, M.J., Rounis, E., Bhatia, K.P. Rothwell, J.C. (2005) Theta burst stimulation of the human motor cortex. Neuron, 45, 201 206.
39. Jiang, W., Wallace, M.T., Jiang, H., Vaughan, J.W. Stein, B.E. (2001) Two cortical areas mediate multisensory integration in superior colliculus neurons. J. Neurophysiol., 85, 506 522.
40. Jones, E.G. Powell, T.P. (1970) An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain, 93, 793 820.
41. Kadunce, D.C., Vaughan, J.W., Wallace, M.T. Stein, B.E. (2001) The influence of visual and auditory receptive field organization on multisensory integration in the superior colliculus. Exp. Brain Res., 139, 303 310.
42. Kammer, T., Beck, S., Erb, M. Grodd, W. (2001) The influence of current direction on phosphene thresholds evoked by transcranial magnetic stimulation. Clin. Neurophysiol., 112, 2015 2021.
43. Kammer, T., Puls, K., Erb, M. Grodd, W. (2005) Transcranial magnetic stimulation in the visual system. II. Characterization of induced phosphenes and scotomas. Exp. Brain Res., 160, 129 140.
44. Kayser, C., Petkov, C.I. Logothetis, N.K. (2009) Multisensory interactions in primate auditory cortex: fMRI and electrophysiology. Hear. Res., 258, 80 88.
45. Làdavas, E. (2008) Multisensory-based approach to the recovery of unisensory deficit. Ann. N Y Acad. Sci., 1124, 98 110.
46. Laurienti, P.J., Perrault, T.J., Stanford, T.R., Wallace, M.T. Stein, B.E. (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp. Brain Res., 166, 289 297.
47. Lehmann, C., Herdener, M., Esposito, F., Hubl, D., di Salle, F., Scheffler, K., Bach, D.R., Federspiel, A., Kretz, R., Dierks, T. Seifritz, E. (2006) Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. NeuroImage, 31, 294 300.
48. Leo, F., Bertini, C., Di Pellegrino, G. Ladavas, E. (2008a) Multisensory integration for orienting responses in humans requires the activation of the superior colliculus. Exp. Brain Res., 186, 67 77.
49. Leo, F., Bolognini, N., Passamonti, C., Stein, B.E. Ladavas, E. (2008b) Cross-modal localization in hemianopia: new insights on multisensory integration. Brain, 131, 855 865.
50. Lewald, J. Guski, R. (2003) Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Brain Res. Cogn. Brain Res., 16, 468 478.
51. Martuzzi, R., Murray, M.M., Michel, C.M., Thiran, J.P., Maeder, P.P., Clarke, S. Meuli, R.A. (2007) Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex, 17, 1672 1679.
52. Meienbrock, A., Naumer, M.J., Doehrmann, O., Singer, W. Muckli, L. (2007) Retinotopic effects during spatial audio-visual integration. Neuropsychologia, 45, 531 539.
53. Meredith, M.A. Stein, B.E. (1983) Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389 391.
54. Meredith, M.A. Stein, B.E. (1986a) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res., 365, 350 354.
55. Meredith, M.A. Stein, B.E. (1986b) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol., 56, 640 662.
56. Meyer, M., Baumann, S., Marchina, S. Jancke, L. (2007) Hemodynamic responses in human multisensory and auditory association cortex to purely visual stimulation. BMC Neurosci., 8, 14.
57. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.E. Foxe, J.J. (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res., 14, 115 128.
58. Noesselt, T., Rieger, J.W., Schoenfeld, M.A., Kanowski, M., Hinrichs, H., Heinze, H.J. Driver, J. (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J. Neurosci., 27, 11431 11441.
59. Passamonti, C., Frissen, I. Ladavas, E. (2009) Visual recalibration of auditory spatial perception: two separate neural circuits for perceptual learning. Eur. J. Neurosci., 30, 1141 1150.
60. Pekkola, J., Ojanen, V., Autti, T., Jaaskelainen, I.P., Mottonen, R., Tarkiainen, A. Sams, M. (2005) Primary auditory cortex activation by visual speech: an fMRI study at 3 T. Neuroreport, 16, 125 128.
61. Recanzone, G.H. Sutter, M.L. (2008) The biological basis of audition. Annu. Rev. Psychol., 59, 119 142.
62. Romei, V., Murray, M.M., Merabet, L.B. Thut, G. (2007) Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: implications for multisensory interactions. J. Neurosci., 27, 11465 11472.
63. Romei, V., Murray, M.M., Cappe, C. Thut, G. (2009) Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Curr. Biol., 19, 1799 1805.
64. Rozzi, S., Calzavara, R., Belmalih, A., Borra, E., Gregoriou, G.G., Matelli, M. Luppino, G. (2006) Cortical connections of the inferior parietal cortical convexity of the macaque monkey. Cereb. Cortex, 16, 1389 1417.
65. Schlack, A., Hoffmann, K.P. Bremmer, F. (2002) Interaction of linear vestibular and visual stimulation in the macaque ventral intraparietal area (VIP). Eur. J. Neurosci., 16, 1877 1886.
66. Seltzer, B. Pandya, D.N. (1978) Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey. Brain Res., 149, 1 24.
67. Serino, A., Annella, L. Avenanti, A. (2009) Motor properties of peripersonal space in humans. PLoS ONE, 4, e6582.
68. Slutsky, D.A. Recanzone, G.H. (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport, 12, 7 10.
69. Spence, C. Driver, J. (2000) Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism. Neuroreport, 11, 2057 2061.
70. Stein, B.E. Meredith, M.A. (1993) Merging of the Senses. MIT Press
71. Stein, B.E. Stanford, T.R. (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci., 9, 255 266.
72. Stevenson, R.A., Geoghegan, M.L. James, T.W. (2007) Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects. Exp. Brain Res., 79, 85 95.
73. Talairach, J. Tournoux, P. (1988). A Co-Planar Stereotactic Atlas of the Human Brain. Thieme Verlag
74. Thurlow, W.R. Jack, C.E. (1973) Certain determinants of the "ventriloquism effect". Percept. Mot. Skills, 36, 1171 1184.
75. Vroomen, J. de Gelder, B. (2004) Temporal ventriloquism: sound modulates the flash-lag effect. J. Exp. Psychol. Hum. Percept. Perform., 30, 513 518.
76. Wallace, M.T. Stein, B.E. (1994) Cross-modal synthesis in the midbrain depends on input from cortex. J. Neurophysiol., 71, 429 432.
77. Wallace, M.T., Roberson, G.E., Hairston, W.D., Stein, B.E., Vaughan, J.W. Schirillo, J.A. (2004) Unifying multisensory signals across time and space. Exp. Brain Res., 158, 252 258.
78. Wassermann, E.M. (1998) Risk and safety of repetitive transcranial magnetic stimulation: report and suggested guidelines from the International Workshop on the Safety of Repetitive Transcranial Magnetic Stimulation, June 5-7, 1996. Electroencephalogr. Clin. Neurophysiol., 108, 1 16.
79. Welch, R.B. Warren, D.H. (1980) Immediate perceptual response to intersensory discrepancy. Psychol. Bull., 88, 638 667.
80. Werner, S. Noppeney, U. (2010) Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cereb. Cortex (in press).
81. Wilkinson, L.K., Meredith, M.A. Stein, B.E. (1996) The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior. Exp. Brain Res., 112, 1 10.
82. Wright, T.M., Pelphrey, K.A., Allison, T., McKeown, M.J. McCarthy, G. (2003) Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex, 13, 1034 1043.
83. Zhong, Y.M. Rockland, K.S. (2003) Inferior parietal lobule projections to anterior inferotemporal cortex (area TE) in macaque monkey. Cereb. Cortex, 13, 527 540.