Tactile stimulation and hemispheric asymmetries modulate auditory perception and neural responses in primary auditory cortex

NeuroImage

Volumn 79, Issue , 2013, Pages 371-382

  Hoefer, M ^a   Tyll, S ^a   Kanowski, M ^a   Brosch, M ^b   Schoenfeld, M A ^a,b   Heinze, H J ^a,c   Noesselt, T ^a,c  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^c CENTER FOR BEHAVIORAL BRAIN SCIENCES   (Germany)

Author keywords

Audiotactile; FMRI; Human; Multisensory; Temporal integration

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY LATERALIZATION; BRAIN ASYMMETRY; BRAIN NERVE CELL; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROMODULATION; NORMAL HUMAN; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; RIGHT HEMISPHERE; SOMATOSENSORY CORTEX; TACTILE STIMULATION; TASK PERFORMANCE; THALAMUS;

ADULT; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN MAPPING; CUES; HUMANS; MALE; NERVE NET; NEURONAL PLASTICITY; PERCEPTUAL MASKING; PHYSICAL STIMULATION; TOUCH; YOUNG ADULT;

EID: 84878439920     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.04.119     Document Type: Article

References (87)

1. Beauchamp M.S. Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 2005, 3:93-113.
2. Beauchamp M.S., Ro T. Neural substrates of sound-touch synesthesia after a thalamic lesion. J. Neurosci. 2008, 28:13696-13702.
3. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 2004, 7:1190-1192.
4. Beauchamp M.S., Yasar N.E., Frye R.E., Ro T. Touch, sound and vision in human superior temporal sulcus. NeuroImage 2008, 41:1011-1020.
5. Bergenheim M., Johansson H., Granlund B., Pedersen J. Experimental evidence for a synchronization of sensory information to conscious experience. Toward a Science of Consciousness: The First Tucson Discussions and Debates 1996, 303-310. MIT Press, Cambridge, Mass. S. Hameroff, A. Kaszniak, A. Scott (Eds.).
6. Bonath B., Noesselt T., Martinez A., Mishra J., Schwiecker K., Heinze H.-J., Hillyard S.a Neural basis of the ventriloquist illusion. Curr. Biol. 2007, 17:1697-1703.
7. Bonath B., Tyll S., Budinger E., Krauel K., Hopf J.-M., Noesselt T. Task-demands and audio-visual stimulus configurations modulate neural activity in the human thalamus. NeuroImage 2013, 66:110-118.
8. Bruns P., Röder B. Tactile capture of auditory localization: an event-related potential study. Eur. J. Neurosci. 2010, 31:1844-1857.
9. Budinger E., Heil P., Hess A., Scheich H. Multisensory processing via early cortical stages: connections of the primary auditory cortical field with other sensory systems. Neuroscience 2006, 143:1065-1083.
10. Bushara K.O., Grafman J., Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. J. Neurosci. 2001, 21:300-304.
11. Caetano G., Jousmäki V. Evidence of vibrotactile input to human auditory cortex. NeuroImage 2006, 29:15-28.
12. Calvert G.A., Thesen T. Multisensory integration: methodological approaches and emerging principles in the human brain. J. Physiol. Paris 2004, 98:191-205.
13. Cappe C., Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci. 2005, 22:2886-2902.
14. Cappe C., Morel A., Barone P., Rouiller E.M. The thalamocortical projection systems in primate: an anatomical support for multisensory and sensorimotor interplay. Cereb. Cortex 2009, 19:2025-2037.
15. Cappe C., Rouiller E.M., Barone P. Multisensory anatomical pathways. Hear. Res. 2009, 258:28-36.
16. Dale a M. Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 1999, 8:109-114.
17. De la Mothe L.A., Blumell S., Kajikawa Y., Hackett T.A. Thalamic connections of the auditory cortex in marmoset monkeys: core and medial belt regions. J. Comp. Neurol. 2006, 496:72-96.
18. Diederich A., Colonius H. Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time. Percept. Psychophys. 2004, 66:1388-1404.
19. Downar J., Crawley A.P., Mikulis D.J., Davis K.D. A multimodal cortical network for the detection of changes in the sensory environment. Nat. Neurosci. 2000, 3:277-283.
20. Driver J., Noesselt T. Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron 2008, 57:11-23.
21. Eickhoff S.B., Paus T., Caspers S., Grosbras M.-H., Evans A.C., Zilles K., Amunts K. Assignment of functional activations to probabilistic cytoarchitectonic areas revisited. NeuroImage 2007, 36:511-521.
22. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Cogn. Brain Res. 2000, 10:77-83.
23. Foxe J.J., Wylie G.R., Martinez A., Schroeder C.E., Javitt D.C., Guilfoyle D., Ritter W., Murray M.M., C.D. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 2002, 88:540-543.
24. Friston K.J., Buechel C., Fink G.R., Morris J., Rolls E., Dolan R.J. Psychophysiological and modulatory interactions in neuroimaging. NeuroImage 1997, 6:218-229.
25. Friston K.J., Zarahn E., Josephs O., Henson R.N., Dale a M. Stochastic designs in event-related fMRI. NeuroImage 1999, 10:607-619.
26. Fu K.-M.G., Johnston T.A., Shah A.S., Arnold L., Smiley J., Hackett T.A., Garraghty P.E., Schroeder C.E. Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 2003, 23:7510-7515.
27. Ghazanfar A.A., Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 2006, 10:278-285.
28. Giard M.H., Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 1999, 11:473-490.
29. Gillmeister H., Eimer M. Tactile enhancement of auditory detection and perceived loudness. Brain Res. 2007, 1160:58-68.
30. Gobbelé R., Schürmann M., Forss N., Juottonen K., Buchner H., Hari R. Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. NeuroImage 2003, 20:503-511.
31. Green D.M., Swets J.A. Signal Detection Theory and Psychophysics 1966, Wiley, New York.
32. Hackett T.A., Smiley J.F., Ulbert I., Karmos G., Lakatos P., De la Mothe L.A., Schroeder C.E. Sources of somatosensory input to the caudal belt areas of auditory cortex. Perception 2007, 36:1419-1430.
33. Hausmann M., Corballis M.C., Fabri M., Paggi A., Lewald J. Sound lateralization in subjects with callosotomy, callosal agenesis, or hemispherectomy. Brain Res. 2005, 25:537-546.
34. Hinrichs H., Scholz M., Tempelmann C., Woldorff M.G., Dale A.M., Heinze H.J. Deconvolution of event-related fMRI responses in fast-rate experimental designs: tracking amplitude variations. J. Cogn. Neurosci. 2000, 12(Suppl. 2):76-89.
35. Iannetti G., Porro C., Pantano P., Romanelli P., Galeotti F., Cruccu G. Representation of different trigeminal divisions within the primary and secondary human somatosensory cortex. NeuroImage 2003, 19:906-912.
36. Jäncke L., Wüstenberg T., Schulze K., Heinze H.J. Asymmetric hemodynamic responses of the human auditory cortex to monaural and binaural stimulation. Hear. Res. 2002, 170:166-178.
37. Jones E.G. Viewpoint: the core and matrix of thalamic organization. Neuroscience 1998, 85:331-345.
38. Kayser C., Logothetis N.K. Do early sensory cortices integrate cross-modal information?. Brain Struct. Funct. 2007, 212:121-132.
39. Kayser C., Petkov C.I., Augath M., Logothetis N.K. Integration of touch and sound in auditory cortex. Neuron 2005, 48:373-384.
40. Kim S., James T.W. Enhanced effectiveness in visuo-haptic object-selective brain regions with increasing stimulus salience. Hum. Brain Mapp. 2010, 31:678-693.
41. Kriegeskorte N., Simmons W.K., Bellgowan P.S.F., Baker C.I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 2009, 12:535-540.
42. Krumbholz K., Hewson-Stoate N., Schönwiesner M. Cortical response to auditory motion suggests an asymmetry in the reliance on inter-hemispheric connections between the left and right auditory cortices. J. Neurophysiol. 2007, 97:1649-1655.
43. Lakatos P., Chen C.-M., O'Connell M.N., Mills A., Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007, 53:279-292.
44. Lancaster J.L., Rainey L.H., Summerlin J.L., Freitas C.S., Fox P.T., Evans a C., Toga a W., Mazziotta J.C. Automated labeling of the human brain: a preliminary report on the development and evaluation of a forward-transform method. Hum. Brain Mapp. 1997, 5:238-242.
45. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., Kochunov P.V., Nickerson D., Mikiten S.A., Fox P.T. Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 2000, 10:120-131.
46. Leo F., Bolognini N., Passamonti C., Stein B.E., Làdavas E. Cross-modal localization in hemianopia: new insights on multisensory integration. Brain 2008, 131:855-865.
47. Levänen S., Ahonen A., Hari R., McEvoy L., Sams M. Deviant auditory stimuli activate human left and right auditory cortex differently. Cereb. Cortex 1996, 6:288-296.
48. Lewis R., Noppeney U. Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas. J. Neurosci. 2010, 30:12329-12339.
49. Lewis J.W., Van Essen D.C. Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J. Comp. Neurol. 2000, 428:112-137.
50. Macaluso E., Frith C.D., Driver J. Modulation of human visual cortex by crossmodal spatial attention. Science 2000, 289:1206-1208.
51. Maravita A., Bolognini N., Bricolo E., Marzi C.A., Savazzi S. Is audiovisual integration subserved by the superior colliculus in humans?. Neuroreport 2008, 19:271-275.
52. Menning H., Ackermann H., Hertrich I., Mathiak K. Spatial auditory attention is modulated by tactile priming. Exp. Brain Res. 2005, 164:41-47.
53. Meredith M.A., Stein B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol. 1986, 56:640-662.
54. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn. Brain Res. 2002, 14:115-128.
55. Murray M.M., Molholm S., Michel C.M., Heslenfeld D.J., Ritter W., Javitt D.C., Schroeder C.E., Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 2005, 15:963-974.
56. Musacchia G., Schroeder C.E. Neuronal mechanisms, response dynamics and perceptual functions of multisensory interactions in auditory cortex. Hear. Res. 2009, 258:72-79.
57. Musacchia G., Sams M., Nicol T., Kraus N. Seeing speech affects acoustic information processing in the human brainstem. Exp. Brain Res. 2006, 168:1-10.
58. Nguyen B.T., Tran T.D., Hoshiyama M., Inui K., Kakigi R. Face representation in the human primary somatosensory cortex. Neurosci. Res. 2004, 50:227-232.
59. Noesselt T., Rieger J.W., Schoenfeld M.A., Kanowski M., Hinrichs H., Heinze H.-J., Driver J. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J. Neurosci. 2007, 27:11431-11441.
60. Noesselt T., Tyll S., Boehler C.N., Budinger E., Heinze H.-J., Driver J. Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. J. Neurosci. 2010, 30:13609-13623.
61. Odgaard E.C., Arieh Y., Marks L.E. Cross-modal enhancement of perceived brightness: sensory interaction versus response bias. Percept. Psychophys. 2003, 65:123-132.
62. Paraskevopoulos E., Kuchenbuch A., Herholz S.C., Pantev C. Evidence for training-induced plasticity in multisensory brain structures: an MEG study. PLoS One 2012, 7:e36534.
63. Paraskevopoulos E., Kuchenbuch A., Herholz S.C., Pantev C. Musical expertise induces audiovisual integration of abstract congruency rules. J. Neurosci. 2012, 32:18196-18203.
64. Penfield W., Boldrey E. Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain 1937, 60:389-443.
65. Rach S., Diederich A., Colonius H. On quantifying multisensory interaction effects in reaction time and detection rate. Psychol. Res. 2011, 75:77-94.
66. Ramos-Estebanez C., Merabet L.B., Machii K., Fregni F., Thut G., Wagner T.A., Romei V., Amedi A., Pascual-Leone A. Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. J. Neurosci. 2007, 27:4178-4181.
67. Recanzone G.H., Guard D.C., Phan M.L. Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. J. Neurophysiol. 2000, 83:2315-2331.
68. Ro T., Farnè A., Johnson R.M., Wedeen V., Chu Z., Wang Z.J., Hunter J.V., Beauchamp M.S. Feeling sounds after a thalamic lesion. Ann. Neurol. 2007, 62:433-441.
69. Ro T., Hsu J., Yasar N.E., Elmore L.C., Beauchamp M.S. Sound enhances touch perception. Exp. Brain Res. 2009, 195:135-143.
70. Sadaghiani S., Maier J.X., Noppeney U. Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing. J. Neurosci. 2009, 29:6490-6499.
71. Scheffler K., Bilecen D., Schmid N., Tschopp K., Seelig J. Auditory cortical responses in hearing subjects and unilateral deaf patients as detected by functional magnetic resonance imaging. Cereb. Cortex 1998, 8:156-163.
72. Schroeder C.E., Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cogn. Brain Res. 2002, 14:187-198.
73. Schroeder C.E., Lindsley R.W., Specht C., Marcovici A., Smiley J.F., Javitt D.C. Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 2001, 85:1322-1327.
74. Schürmann M., Caetano G., Hlushchuk Y., Jousmäki V., Hari R. Touch activates human auditory cortex. NeuroImage 2006, 30:1325-1331.
75. Shah N.J., Jäncke L., Grosse-Ruyken M.L., Müller-Gärtner H.W. Influence of acoustic masking noise in fMRI of the auditory cortex during phonetic discrimination. J. Magn. Reson. Imaging 1999, 9:19-25.
76. Shams L., Kamitani Y., Shimojo S. Visual illusion induced by sound. Cogn. Brain Res. 2002, 14:147-152.
77. Smiley J.F., Falchier A. Multisensory connections of monkey auditory cerebral cortex. Hear. Res. 2009, 258:37-46.
78. Smiley J.F., Hackett T.A., Ulbert I., Karmas G., Lakatos P., Javitt D.C., Schroeder C.E. Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys. J. Comp. Neurol. 2007, 502:894-923.
79. Stanislaw H., Todorov N. Calculation of signal detection theory measures. Behav. Res. Methods Instrum. Comput. 1999, 31:137-149.
80. Stein B.E., Stanford T.R. Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 2008, 9:255-266.
81. Stevenson R.A., Altieri N.A., Kim S., Pisoni D.B., James T.W. Neural processing of asynchronous audiovisual speech perception. NeuroImage 2010, 49:3308-3318.
82. Stracke H., Okamoto H., Pantev C. Interhemispheric support during demanding auditory signal-in-noise processing. Cereb. Cortex 2009, 19:1440-1447.
83. Tyll S., Bonath B., Schoenfeld M.A., Heinze H.-J., Ohl F.W., Noesselt T. Neural basis of multisensory looming signals. NeuroImage 2013, 65:13-22.
84. Van der Burg E., Awh E., Olivers C.N.L. The capacity of audiovisual integration is limited to one item. Psychol. Sci. 2013, 24:345-351.
85. Wallace M.T., Meredith M.A., Stein B.E. Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. J. Neurophysiol. 1993, 69:1797-1809.
86. Werner S., Noppeney U. Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J. Neurosci. 2010, 30:2662-2675.
87. Werner S., Noppeney U. Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cereb. Cortex 2010, 20:1829-1842.