Crossmodal influences in somatosensory cortex: Interaction of vision and touch

Human Brain Mapping

Volumn 31, Issue 1, 2010, Pages 14-25

  Dionne, Jennifer K ^a   Meehan, Sean K ^a   Legon, Wynn ^a   Staines, W Richard ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Crossmodal interactions; Sensorimotor integration; Somatosensory cortex; Task relevance; Visual tactile

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; OXYGEN BLOOD LEVEL; PRIORITY JOURNAL; SOMATOSENSORY CORTEX; TACTILE STIMULATION; TASK PERFORMANCE; TOUCH; VISION; VISUAL STIMULATION;

ADULT; BRAIN MAPPING; CEREBROVASCULAR CIRCULATION; EVOKED POTENTIALS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTOR CORTEX; NERVE NET; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE; SOMATOSENSORY CORTEX; TOUCH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 74049117603     PISSN: 10659471     EISSN: None     Source Type: Journal    
DOI: 10.1002/hbm.20841     Document Type: Article

References (87)

1. Allison T, McCarthy G, Wood CC (1992): The relationship between human long-latency somatosensory evoked potentials recorded from the cortical surface and from the scalp. Electro-encephalogr Clin Neurophysiol 84:301-314.
2. Alsius A, Navarra J, Campbell R, Soto-Faraco S (2005): Audio-visual integration of speech falters under high attention demands. Curr Biol 15:839-843.
3. Alsius A, Navarra J, Soto-Faraco S (2007): Attention to touch weakens audiovisual speech integration. Exp Brain Res 183:399-404.
4. Andersen RA, Snyder LH, Bradley DC, Xing J (1997): Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu Rev Neurosci 20:303-330.
5. Andersen SK, Hillyard SA, Muller MM (2008): Attention facilitates multiple stimulus features in parallel in human visual cortex. Curr Biol 18:1006-1009.
6. Axmacher N, Schmitz DP, Wagner T, Elger CE, Fell J (2008): Interactions between medial temporal lobe, prefrontal cortex, and inferior temporal regions during visual working memory: a combined intracranial EEG and functional magnetic resonance imaging study. J Neurosci 28:7304-7312.
7. Beauchamp MS, Lee KE, Argall BD, Martin A (2004): Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823.
8. Beauchamp MS, Yasar NE, Frye RE, Ro T (2008): Touch, sound and vision in human superior temporal sulcus. Neuroimage 41:1011-1020.
9. Boynton GM, Engel SA, Glover GH, Heeger DJ (1996): Linear systems analysis of functional magnetic resonance imaging in human V1. J Neurosci 16:4207-4221.
10. Burton H, Abend NS, MacLeod AM, Sinclair RJ, Snyder AZ, Raichle ME (1999): Tactile attention tasks enhance activation in somatosensory regions of parietal cortex: A positron emission tomography study. Cereb Cortex 9:662-674.
11. Burton H, Sinclair RJ, Hong SY, Pruett JR Jr, Whang KC (1997): Tactile-spatial and cross-modal attention effects in the second somatosensory and 7b cortical areas of rhesus monkeys. Somatosens Mot Res 14:237-267.
12. Burton H, Sinclair RJ, McLaren DG (2008): Cortical network for vibrotactile attention: A fMRI study. Hum Brain Mapp 29:207-221.
13. Calvert GA (2001): Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cereb Cortex 11:1110-1123.
14. Cappe C, Barone P (2005): Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur J Neurosci 22:2886-2902.
15. Corbetta M (1998): Frontoparietal cortical networks for directing attention and the eye to visual locations: Identical, independent, or overlapping neural systems?Proc Natl Acad Sci USA 95:831-838.
16. Corbetta M, Akbudak E, Conturo TE, Snyder AZ, Ollinger JM, Drury HA, Linenweber MR, Petersen SE, Raichle ME, Van Essen DC, Shulman GL (1998): A common network of functional areas for attention and eye movements. Neuron 21:761-773.
17. Corbetta M, Miezin FM, Shulman GL, Petersen SE (1991): Selective attention modulates extrastriate visual regions in humans during visual feature discrimination and recognition. Ciba Found Symp 163:165-75; discussion 175-180.
18. Deiber MP, Ibanez V, Sadato N, Hallett M (1996): Cerebral structures participating in motor preparation in humans: A positron emission tomography study. J Neurophysiol 75:233-247.
19. Downar J, Crawley AP, Mikulis DJ, Davis KD (2001): The effect of task relevance on the cortical response to changes in visual and auditory stimuli: An event-related fMRI study. Neuroimage 14:1256-1267.
20. Driver J, Spence C (1998): Crossmodal attention. Curr Opin Neurobiol 8:245-253.
21. Eimer M (2001): Crossmodal links in spatial attention between vision, audition, and touch: Evidence from event-related brain potentials. Neuropsychologia 39:1292-1303.
22. Eimer M, Driver J (2000): An event-related brain potential study of cross-modal links in spatial attention between vision and touch. Psychophysiology 37:697-705.
23. Eimer M, van Velzen J (2005): Spatial tuning of tactile attention modulates visual processing within hemifields: An ERP investigation of crossmodal attention. Exp Brain Res 166:402-410.
24. Fiez JA, Raichle ME, Balota DA, Tallal P, Petersen SE (1996): PET activation of posterior temporal regions during auditory word presentation and verb generation. Cereb Cortex 6:1-10.
25. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995): Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold. Magn Reson Med 33:636-647.
26. Foxe JJ, Schroeder CE (2005): The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419-423.
27. Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM (2002): Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol 88:540-543.
28. Fujiwara N, Imai M, Nagamine T, Mima T, Oga T, Takeshita K, Toma K, Shibasaki H (2002): Second somatosensory area (SII) plays a significant role in selective somatosensory attention. Brain Res Cogn Brain Res 14:389-397.
29. Gazzaley A, Rissman J, Cooney J, Rutman A, Seibert T, Clapp W, D'Esposito M (2007): Functional interactions between prefrontal and visual association cortex contribute to top-down modulation of visual processing. Cereb Cortex 17(Suppl 1):i125-i135.
30. Ghatan PH, Hsieh JC, Petersson KM, Stone-Elander S, Ingvar M (1998): Coexistence of attention-based facilitation and inhibition in the human cortex. Neuroimage 7:23-29.
31. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005): Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 25:5004-5012.
32. Giard MH, Peronnet F (1999): Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J Cogn Neurosci 11:473-490.
33. Graham SJ, Staines WR, Nelson A, Plewes DB, McIlroy WE (2001): New devices to deliver somatosensory stimuli during functional MRI. Magn Reson Med 46:436-442.
34. Grahn JA, Parkinson JA, Owen AM (2008): The cognitive functions of the caudate nucleus. Prog Neurobiol 86:141-155.
35. Haxby JV, Grady CL, Horwitz B, Ungerleider LG, Mishkin M, Carson RE, Herscovitch P, Schapiro MB, Rapoport SI (1991): Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proc Natl Acad Sci USA 88:1621-1625.
36. Jancke L, Mirzazade S, Shah NJ (1999): Attention modulates activity in the primary and the secondary auditory cortex: A functional magnetic resonance imaging study in human subjects. Neurosci Lett 266:125-128.
37. Johansen-Berg H, Christensen V, Woolrich M, Matthews PM (2000): Attention to touch modulates activity in both primary and secondary somatosensory areas. Neuroreport 11:1237-1241.
38. Johnson JA, Zatorre RJ (2005): Attention to simultaneous unrelated auditory and visual events: Behavioral and neural correlates. Cereb Cortex 15:1609-1620.
39. Johnson JA, Zatorre RJ (2006): Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage 31:1673-1681.
40. Kayser C, Logothetis NK (2007): Do early sensory cortices integrate cross-modal information? Brain Struct Funct 212:121-132.
41. Kayser C, Petkov CI, Augath M, Logothetis NK (2005): Integration of touch and sound in auditory cortex. Neuron 48:373-384.
42. Kayser C, Petkov CI, Logothetis NK (2008): Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560-1574.
43. Kennett S, Eimer M, Spence C, Driver J (2001): Tactile-visual links in exogenous spatial attention under different postures: Convergent evidence from psychophysics and ERPs. J Cogn Neurosci 13:462-478.
44. Knight RT, Staines WR, Swick D, Chao LL (1999): Prefrontal cortex regulates inhibition and excitation in distributed neural networks. Acta Psychol (Amst) 101:159-178.
45. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE (2007): Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279-292.
46. Macaluso E, Frith CD, Driver J (2000): Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206-1208.
47. Macaluso E, Frith CD, Driver J (2002): Directing attention to locations and to sensory modalities: Multiple levels of selective processing revealed with PET. Cereb Cortex 12:357-368.
48. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, Clarke S, Meuli RA (2007): Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex 17:1672-1679.
49. McDonald JJ, Teder-Salejarvi WA, Heraldez D, Hillyard SA (2001a): Electrophysiological evidence for the "missing link" in crossmodal attention. Can J Exp Psychol 55:141-149.
50. McDonald JJ, Teder-Salejarvi WA, Ward LM (2001b): Multisensory integration and crossmodal attention effects in the human brain. Science 292:1791.
51. Meehan SK, Staines WR (2007): The effect of task-relevance on primary somatosensory cortex during continuous sensory-guided movement in the presence of bimodal competition. Brain Res 1138:148-158.
52. Mesulam MM (1990): Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Ann Neurol 28:597-613.
53. Miller BT, D'Esposito M (2005a): Searching for "the top" in top-down control. Neuron 48:535-538.
54. Miller LM, D'Esposito M (2005b): Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884-5893.
55. Mima T, Nagamine T, Nakamura K, Shibasaki H (1998): Attention modulates both primary and second somatosensory cortical activities in humans: A magnetoencephalographic study. J Neurophysiol 80:2215-2221.
56. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002): Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Res Cogn Brain Res 14:115-128.
57. Moran J, Desimone R (1985): Selective attention gates visual processing in the extrastriate cortex. Science 229:782-784.
58. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ (2005): Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex 15:963-974.
59. Nakashita S, Saito DN, Kochiyama T, Honda M, Tanabe HC, Sadato N (2008): Tactile-visual integration in the posterior parietal cortex: A functional magnetic resonance imaging study. Brain Res Bull 75:513-525.
60. Nelson AJ, Staines WR, Graham SJ, McIlroy WE (2004): Activation in SI and SII: The influence of vibrotactile amplitude during passive and task-relevant stimulation. Brain Res Cogn Brain Res 19:174-184.
61. Petkov CI, Kang X, Alho K, Bertrand O, Yund EW, Woods DL (2004): Attentional modulation of human auditory cortex. Nat Neurosci 7:658-663.
62. Posner MI, Petersen SE (1990): The attention system of the human brain. Annu Rev Neurosci 13:25-42.
63. Ranganath C, D'Esposito M (2005): Directing the mind's eye: Prefrontal, inferior and medial temporal mechanisms for visual working memory. Curr Opin Neurobiol 15:175-182.
64. Rissman J, Gazzaley A, D'Esposito M (2008): Dynamic adjustments in prefrontal, hippocampal, and inferior temporal interactions with increasing visual working memory load. Cereb Cortex 18:1618-1629.
65. Rushworth MF, Paus T, Sipila PK (2001): Attention systems and the organization of the human parietal cortex. J Neurosci 21:5262-5271.
66. Rushworth MF, Taylor PC (2006): TMS in the parietal cortex: Updating representations for attention and action. Neuropsychologia 44:2700-2716.
67. Schroeder CE, Foxe J (2005): Multisensory contributions to low-level, "unisensory" processing. Curr Opin Neurobiol 15:454-458.
68. Schurmann M, Caetano G, Hlushchuk Y, Jousmaki V, Hari R (2006): Touch activates human auditory cortex. Neuroimage 30:1325-1331.
69. Schurmann M, Kolev V, Menzel K, Yordanova J (2002): Spatial coincidence modulates interaction between visual and somato-sensory evoked potentials. Neuroreport 13:779-783.
70. Shulman GL, Corbetta M, Buckner RL, Raichle ME, Fiez JA, Miezin FM, Petersen SE (1997): Top-down modulation of early sensory cortex. Cereb Cortex 7:193-206.
71. Spence C (2002): Multisensory attention and tactile information- processing. Behav Brain Res 135:57-64.
72. Spence C, Read L (2003): Speech shadowing while driving: on the difficulty of splitting attention between eye and ear. Psychol Sci 14:251-256.
73. Staines WR, Graham SJ, Black SE, McIlroy WE (2002): Task-relevant modulation of contralateral and ipsilateral primary somato-sensory cortex and the role of a prefrontal-cortical sensory gating system. Neuroimage 15:190-199.
74. Steinmetz PN, Roy A, Fitzgerald PJ, Hsiao SS, Johnson KO, Niebur E (2000): Attention modulates synchronized neuronal firing in primate somatosensory cortex. Nature 404:187-190.
75. Sussman ES, Bregman AS, Wang WJ, Khan FJ (2005): Attentional modulation of electrophysiological activity in auditory cortex for unattended sounds within multistream auditory environments. Cogn Affect Behav Neurosci 5:93-110.
76. Talairach J, Tournoux P. 1988. Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging. New York, NY: Stuttgart. 122 p.
77. Teder-Salejarvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005): Effects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17:1396-1409.
78. Teder-Salejarvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002): An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Res Cogn Brain Res 14:106-114.
79. Thoenissen D, Zilles K, Toni I (2002): Differential involvement of parietal and precentral regions in movement preparation and motor intention. J Neurosci 22:9024-9034.
80. Toni I, Shah NJ, Fink GR, Thoenissen D, Passingham RE, Zilles K (2002): Multiple movement representations in the human brain: an event-related fMRI study. J Cogn Neurosci 14:769-784.
81. Toni I, Thoenissen D, Zilles K (2001): Movement preparation and motor intention. Neuroimage 14:S110-S117.
82. van Atteveldt N, Formisano E, Goebel R, Blomert L (2004): Integration of letters and speech sounds in the human brain. Neuron 43:271-282.
83. Van de Winckel A, Sunaert S, Wenderoth N, Peeters R, Van Hecke P, Feys H, Horemans E, Marchal G, Swinnen SP, Perfetti C, De Weerdt W (2005): Passive somatosensory discrimination tasks in healthy volunteers: Differential networks involved in familiar versus unfamiliar shape and length discrimination. Neuroimage 26:441-453.
84. Watanabe T, Sasaki Y, Miyauchi S, Putz B, Fujimaki N, Nielsen M, Takino R, Miyakawa S (1998): Attention-regulated activity in human primary visual cortex. J Neurophysiol 79:2218-2221.
85. Woldorff MG, Gallen CC, Hampson SA, Hillyard SA, Pantev C, Sobel D, Bloom FE (1993): Modulation of early sensory processing in human auditory cortex during auditory selective attention. Proc Natl Acad Sci USA 90:8722-8726.
86. Yamaguchi S, Knight RT (1990): Gating of somatosensory input by human prefrontal cortex. Brain Res 521:281-288.
87. Zhou YD, Fuster JM (2000): Visuo-tactile cross-modal associations in cortical somatosensory cells. Proc Natl Acad Sci USA 97: 9777-9782.