Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli

Neuropsychologia

Volumn 48, Issue 2, 2010, Pages 591-600

  Zangenehpour, Shahin ^a   Zatorre, Robert J ^a,b  

^a MCGILL UNIVERSITY   (Canada)

^b International Laboratory for Brain Music and Sound (BRAMS)   (Canada)

Author keywords

Cortical plasticity; Crossmodal recruitment; Multisensory processing; PET imaging; Primary auditory cortex; Primary visual cortex

Indexed keywords

ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN BLOOD FLOW; BRAIN FUNCTION; CONTROLLED STUDY; EXPOSURE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NEUROPHYSIOLOGICAL RECRUITMENT; NORMAL HUMAN; POSITRON EMISSION TOMOGRAPHY; SENSORY CORTEX; SENSORY STIMULATION; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ASSOCIATION LEARNING; AUDITORY CORTEX; BRAIN MAPPING; CEREBROVASCULAR CIRCULATION; FEMALE; HUMANS; MALE; MODELS, NEUROLOGICAL; PHOTIC STIMULATION; POSITRON-EMISSION TOMOGRAPHY; REACTION TIME; SIGNAL DETECTION, PSYCHOLOGICAL; SPACE PERCEPTION; TIME PERCEPTION; VISUAL CORTEX;

EID: 72449204580     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2009.10.022     Document Type: Article

References (108)

1. Amedi A., Jacobson G., Hendler T., Malach R., and Zohary E. Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex 12 11 (2002) 1202-1212
2. Amedi A., Malach R., Hendler T., Peled S., and Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nature Neuroscience 4 3 (2001) 324-330
3. Amunts K., Malikovic A., Mohlberg H., Schormann T., and Zilles K. Brodmann's areas 17 and 18 brought into stereotaxic space-Where and how variable?. Neuroimage 11 1 (2000) 66-84
4. Banati R.B., Goerres G.W., Tjoa C., Aggleton J.P., and Grasby P. The functional anatomy of visual-tactile integration in man: A study using positron emission tomography. Neuropsychologia 38 2 (2000) 115-124
5. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., and Martin A. Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience 7 11 (2004) 1190-1192
6. Beauchamp M.S., Lee K.E., Haxby J.V., and Martin A. Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34 1 (2002) 149-159
7. Besle J., Fischer C., Bidet-Caulet A., Lecaignard F., Bertrand O., and Giard M.H. Visual activation and audiovisual interactions in the auditory cortex during speech perception: Intracranial recordings in humans. Journal of Neuroscience 28 52 (2008) 14301-14310
8. Besle J., Fort A., Delpuech C., and Giard M.H. Bimodal speech: Early suppressive visual effects in human auditory cortex. European Journal of Neuroscience 20 8 (2004) 2225-2234
9. Bizley J.K., Nodal F.R., Bajo V.M., Nelken I., and King A.J. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cerebral Cortex 17 9 (2007) 2172-2189
10. Blake R., Sobel K.V., and James T.W. Neural synergy between kinetic vision and touch. Psychological science: A Journal of the American Psychological Society/APS 15 6 (2004) 397-402
11. Bremmer F., Schlack A., Duhamel J.R., Graf W., and Fink G.R. Space coding in primate posterior parietal cortex. Neuroimage 14 1 Pt 2 (2001) S46-S51
12. Brosch M., Selezneva E., and Scheich H. Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. Journal of Neuroscience 25 29 (2005) 6797-6806
13. Buchel C., Price C., Frackowiak R.S., and Friston K. Different activation patterns in the visual cortex of late and congenitally blind subjects. Brain 121 Pt 3 (1998) 409-419
14. Burton H., Snyder A.Z., Conturo T.E., Akbudak E., Ollinger J.M., and Raichle M.E. Adaptive changes in early and late blind: A fMRI study of Braille reading. Journal of Neurophysiology 87 1 (2002) 589-607
15. Calvert G.A. Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex 11 12 (2001) 1110-1123
16. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C., McGuire P.K., et al. Activation of auditory cortex during silent lipreading. Science 276 5312 (1997) 593-596
17. Cappe C., and Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. European Journal of Neuroscience 22 11 (2005) 2886-2902
18. Cappe C., Morel A., Barone P., and Rouiller E.M. The thalamocortical projection systems in primate: An anatomical support for multisensory and sensorimotor interplay. Cerebral Cortex 19 9 (2009) 2025-2037
19. Clavagnier S., Falchier A., and Kennedy H. Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness. Cognitive, Affective & Behavioral Neuroscience 4 2 (2004) 117-126
20. Cohen L.G., Weeks R.A., Sadato N., Celnik P., Ishii K., and Hallett M. Period of susceptibility for cross-modal plasticity in the blind. Annals of Neurology 45 4 (1999) 451-460
21. Colombo M., and Gross C.G. Responses of inferior temporal cortex and hippocampal neurons during delayed matching to sample in monkeys (Macaca fascicularis). Behavioral Neuroscience 108 3 (1994) 443-455
22. Driver J., and Noesselt T. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57 1 (2008) 11-23
23. Eckert M.A., Kamdar N.V., Chang C.E., Beckmann C.F., Greicius M.D., and Menon V. A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMRI connectivity analysis. Human Brain Mapping 29 7 (2008) 848-857
24. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience 22 13 (2002) 5749-5759
25. Farah M.J., Soso M.J., and Dasheiff R.M. Visual angle of the mind's eye before and after unilateral occipital lobectomy. Journal of Experimental Psychology: Human Perception and Performance 18 1 (1992) 241-246
26. Finney E.M., Clementz B.A., Hickok G., and Dobkins K.R. Visual stimuli activate auditory cortex in deaf subjects: Evidence from MEG. Neuroreport 14 11 (2003) 1425-1427
27. Finney E.M., Fine I., and Dobkins K.R. Visual stimuli activate auditory cortex in the deaf. Nature Neuroscience 4 12 (2001) 1171-1173
28. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., and Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Research Cognitive Brain Research 10 1-2 (2000) 77-83
29. Frost D.O. Orderly anomalous retinal projections to the medial geniculate, ventrobasal, and lateral posterior nuclei of the hamster. Journal of Comparative Neurology 203 2 (1981) 227-256
30. Frost D.O., Boire D., Gingras G., and Ptito M. Surgically created neural pathways mediate visual pattern discrimination. Proceedings of the National Academy of Sciences of the United States of America 97 20 (2000) 11068-11073
31. Fu K.M., Johnston T.A., Shah A.S., Arnold L., Smiley J., Hackett T.A., et al. Auditory cortical neurons respond to somatosensory stimulation. Journal of Neuroscience 23 20 (2003) 7510-7515
32. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 25 20 (2005) 5004-5012
33. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends in Cognitive Sciences 10 6 (2006) 278-285
34. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11 5 (1999) 473-490
35. Gibson J.R., and Maunsell J.H. Sensory modality specificity of neural activity related to memory in visual cortex. Journal of Neurophysiology 78 3 (1997) 1263-1275
36. Gobbelé R., Schürmann M., Forss N., Juottonen K., Buchner H., and Hari R. Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. Neuroimage 20 1 (2003) 503-511
37. Gougoux F., Zatorre R.J., Lassonde M., Voss P., and Lepore F. A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. PLoS Biology 3 2 (2005) e27
38. Grady C.L., Furey M.L., Pietrini P., Horwitz B., and Rapoport S.I. Altered brain functional connectivity and impaired short-term memory in Alzheimer's disease. Brain 124 Pt 4 (2001) 739-756
39. Hackett T.A., De La Mothe L.A., Ulbert I., Karmos G., Smiley J., and Schroeder C.E. Multisensory convergence in auditory cortex. II. Thalamocortical connections of the caudal superior temporal plane. Journal of Comparative Neurology 502 6 (2007) 924-952
40. Haenny P.E., Maunsell J.H., and Schiller P.H. State dependent activity in monkey visual cortex. II. Retinal and extraretinal factors in V4. Experimental Brain Research 69 2 (1988) 245-259
41. Hagen M.C., Franzén O., McGlone F., Essick G., Dancer C., and Pardo J.V. Tactile motion activates the human middle temporal/V5 (MT/V5) complex. European Journal of Neuroscience 16 5 (2002) 957-964
42. Horwitz B., Rumsey J.M., and Donohue B.C. Functional connectivity of the angular gyrus in normal reading and dyslexia. Proceedings of the National Academy of Sciences of the United States of America 95 15 (1998) 8939-8944
43. James T.W., Humphrey G.K., Gati J.S., Servos P., Menon R.S., and Goodale M.A. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 40 10 (2002) 1706-1714
44. Johnson J.A., and Zatorre R.J. Attention to simultaneous unrelated auditory and visual events: Behavioral and neural correlates. Cerebral Cortex 15 10 (2005) 1609-1620
45. Johnson J.A., and Zatorre R.J. Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage 31 4 (2006) 1673-1681
46. Kawashima R., O'Sullivan B.T., and Roland P.E. Positron-emission tomography studies of cross-modality inhibition in selective attentional tasks: Closing the "mind's eye". Proceedings of the National Academy of Sciences of the United States of America 92 13 (1995) 5969-5972
47. Kayser C., Petkov C.I., Augath M., and Logothetis N.K. Integration of touch and sound in auditory cortex. Neuron 48 2 (2005) 373-384
48. Kayser C., Petkov C.I., and Logothetis N.K. Visual modulation of neurons in auditory cortex. Cerebral Cortex 18 7 (2008) 1560-1574
49. Lehmann S., and Murray M.M. The role of multisensory memories in unisensory object discrimination. Brain Research Cognitive Brain Research 24 2 (2005) 326-334
50. Lewis J.W., Beauchamp M.S., and DeYoe E.A. A comparison of visual and auditory motion processing in human cerebral cortex. Cerebral Cortex 10 9 (2000) 873-888
51. Ludman C.N., Summerfield A.Q., Hall D., Elliott M., Foster J., Hykin J.L., et al. Lip-reading ability and patterns of cortical activation studied using fMRI. British Journal of Audiology 34 4 (2000) 225-230
52. Lütkenhöner B., Lammertmann C., Simões C., and Hari R. Magnetoencephalographic correlates of audiotactile interaction. Neuroimage 15 3 (2002) 509-522
53. MacSweeney M., Amaro E., Calvert G.A., Campbell R., David A.S., McGuire P., et al. Silent speechreading in the absence of scanner noise: An event-related fMRI study. Neuroreport 11 8 (2000) 1729-1733
54. Martuzzi R., Murray M.M., Michel C.M., Thiran J.P., Maeder P.P., Clarke S., et al. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebral Cortex 17 7 (2007) 1672-1679
55. Maunsell J.H., Sclar G., Nealey T.A., and DePriest D.D. Extraretinal representations in area V4 in the macaque monkey. Visual Neuroscience 7 6 (1991) 561-573
56. McIntosh A.R., Cabeza R.E., and Lobaugh N.J. Analysis of neural interactions explains the activation of occipital cortex by an auditory stimulus. Journal of Neurophysiology 80 5 (1998) 2790-2796
57. Meyer M., Baumann S., Marchina S., and Jancke L. Hemodynamic responses in human multisensory and auditory association cortex to purely visual stimulation. BMC Neuroscience 8 (2007) 14
58. Meylan R.V., and Murray M.M. Auditory-visual multisensory interactions attenuate subsequent visual responses in humans. Neuroimage 35 1 (2007) 244-254
59. Mishra J., Martinez A., and Hillyard S.A. Cortical processes underlying sound-induced flash fusion. Brain Research 1242 (2008) 102-115
60. Mishra J., Martinez A., Sejnowski T.J., and Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. Journal of Neuroscience 27 15 (2007) 4120-4131
61. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research Cognitive Brain Research 14 1 (2002) 115-128
62. Morrell F. Visual system's view of acoustic space. Nature 238 5358 (1972) 44-46
63. Murray M.M., Foxe J.J., and Wylie G.R. The brain uses single-trial multisensory memories to discriminate without awareness. Neuroimage 27 2 (2005) 473-478
64. Murray M.M., Michel C.M., Grave de Peralta R., Ortigue S., Brunet D., Gonzalez Andino S., et al. Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage 21 1 (2004) 125-135
65. Nakashita S., Saito D.N., Kochiyama T., Honda M., Tanabe H.C., and Sadato N. Tactile-visual integration in the posterior parietal cortex: A functional magnetic resonance imaging study. Brain Research Bulletin 75 5 (2008) 513-525
66. Noesselt T., Bonath B., Boehler C.N., Schoenfeld M.A., and Heinze H.J. On perceived synchrony-neural dynamics of audiovisual illusions and suppressions. Brain Research 1220 (2008) 132-141
67. Noesselt T., Rieger J.W., Schoenfeld M.A., Kanowski M., Hinrichs H., Heinze H.J., et al. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. Journal of Neuroscience 27 42 (2007) 11431-11441
68. Nyberg L., Habib R., McIntosh A.R., and Tulving E. Reactivation of encoding-related brain activity during memory retrieval. Proceedings of the National Academy of Sciences of the United States of America 97 20 (2000) 11120-11124
69. O'Leary D.S., Block R.I., Koeppel J.A., Flaum M., Schultz S.K., Andreasen N.C., et al. Effects of smoking marijuana on brain perfusion and cognition. Neuropsychopharmacology 26 6 (2002) 802-816
70. Paus T., Perry D.W., Zatorre R.J., Worsley K.J., and Evans A.C. Modulation of cerebral blood flow in the human auditory cortex during speech: Role of motor-to-sensory discharges. European Journal of Neuroscience 8 11 (1996) 2236-2246
71. Pekkola J., Ojanen V., Autti T., Jaaskelainen I.P., Mottonen R., Tarkiainen A., et al. Primary auditory cortex activation by visual speech: An fMRI study at 3 T. Neuroreport 16 2 (2005) 125-128
72. Petitto L.A., Zatorre R.J., Gauna K., Nikelski E.J., Dostie D., and Evans A.C. Speech-like cerebral activity in profoundly deaf people processing signed languages: Implications for the neural basis of human language. Proceedings of the National Academy of Sciences of the United States of America 97 25 (2000) 13961-13966
73. Petkov C.I., Kang X., Alho K., Bertrand O., Yund E.W., and Woods D.L. Attentional modulation of human auditory cortex. Nature Neuroscience 7 6 (2004) 658-663
74. Pietrini P., Furey M.L., Ricciardi E., Gobbini M.I., Wu W.H., Cohen L., et al. Beyond sensory images: Object-based representation in the human ventral pathway. Proceedings of the National Academy of Sciences of the United States of America 101 15 (2004) 5658-5663
75. Poremba A., Saunders R.C., Crane A.M., Cook M., Sokoloff L., and Mishkin M. Functional mapping of the primate auditory system. Science 299 5606 (2003) 568-572
76. Pribram K.H., Rosner B.S., and Rosenblith W.A. Electrical responses to acoustic clicks in monkey: Extent of neocortex activated. Journal of Neurophysiology 17 4 (1954) 336-344
77. Ptito M., Moesgaard S.M., Gjedde A., and Kupers R. Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain 128 Pt 3 (2005) 606-614
78. Ramos-Estebanez C., Merabet L.B., Machii K., Fregni F., Thut G., Wagner T.A., et al. Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. Journal of Neuroscience 27 15 (2007) 4178-4181
79. Rockland K.S., and Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology 50 1-2 (2003) 19-26
80. Romei V., Murray M.M., Merabet L.B., and Thut G. Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory interactions. Journal of Neuroscience 27 43 (2007) 11465-11472
81. Sadato N., Pascual-Leone A., Grafman J., Ibanez V., Deiber M.P., Dold G., et al. Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380 6574 (1996) 526-528
82. Sathian K., and Zangaladze A. Feeling with the mind's eye: Contribution of visual cortex to tactile perception. Behavioural Brain Research 135 1-2 (2002) 127-132
83. Schacter D.L., Alpert N.M., Savage C.R., Rauch S.L., and Albert M.S. Conscious recollection and the human hippocampal formation: Evidence from positron emission tomography. Proceedings of the National Academy of Sciences of the United States of America 93 1 (1996) 321-325
84. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Research Cognitive Brain Research 14 1 (2002) 187-198
85. Schroeder C.E., Lindsley R.W., Specht C., Marcovici A., Smiley J.F., and Javitt D.C. Somatosensory input to auditory association cortex in the macaque monkey. Journal of Neurophysiology 85 3 (2001) 1322-1327
86. Senkowski D., Schneider T.R., Foxe J.J., and Engel A.K. Crossmodal binding through neural coherence: Implications for multisensory processing. Trends in Neurosciences 31 8 (2008) 401-409
87. Shams L., Kamitani Y., and Shimojo S. Illusions. What you see is what you hear. Nature 408 6814 (2000) 788
88. Slotnick S.D., and Schacter D.L. A sensory signature that distinguishes true from false memories. Nature Neuroscience 7 6 (2004) 664-672
89. Slotnick S.D., and Schacter D.L. The nature of memory related activity in early visual areas. Neuropsychologia 44 14 (2006) 2874-2886
90. Slotnick S.D., Thompson W.L., and Kosslyn S.M. Visual mental imagery induces retinotopically organized activation of early visual areas. Cerebral Cortex 15 10 (2005) 1570-1583
91. Smiley J.F., Hackett T.A., Ulbert I., Karmas G., Lakatos P., Javitt D.C., et al. Multisensory convergence in auditory cortex. I. Cortical connections of the caudal superior temporal plane in macaque monkeys. Journal of Comparative Neurology 502 6 (2007) 894-923
92. Stein B.E., and Meredith M.A. The merging of the senses (1993), MIT Press, Cambridge, MA
93. Stein B.E., Meredith M.A., Huneycutt W.S., and McDade L. Behavioral indices of multisensory integration: Orientation to visual cues is affected by auditory stimuli. Journal of Cognitive Neuroscience 1 (1989) 12-24
94. Sur M., Garraghty P.E., and Roe A.W. Experimentally induced visual projections into auditory thalamus and cortex. Science 242 4884 (1988) 1437-1441
95. Tanabe H.C., Honda M., and Sadato N. Functionally segregated neural substrates for arbitrary audiovisual paired-association learning. Journal of Neuroscience 25 27 (2005) 6409-6418
96. Uecker A., Reiman E.M., Schacter D.L., Polster M.R., Cooper L.A., Yun L.S., et al. Neuroanatomical correlates of implicit and explicit memory for structurally possible and impossible visual objects. Learning & Memory 4 4 (1997) 337-355
97. van Atteveldt N., Formisano E., Goebel R., and Blomert L. Integration of letters and speech sounds in the human brain. Neuron 43 2 (2004) 271-282
98. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 102 4 (2005) 1181-1186
99. von Kriegstein K., Kleinschmidt A., Sterzer P., and Giraud A.L. Interaction of face and voice areas during speaker recognition. Journal of Cognitive Neuroscience 17 3 (2005) 367-376
100. Watkins S., Shams L., Josephs O., and Rees G. Activity in human V1 follows multisensory perception. Neuroimage 37 2 (2007) 572-578
101. Watkins S., Shams L., Tanaka S., Haynes J.D., and Rees G. Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31 3 (2006) 1247-1256
102. Weeks R., Horwitz B., Aziz-Sultan A., Tian B., Wessinger C.M., Cohen L.G., et al. A positron emission tomographic study of auditory localization in the congenitally blind. Journal of Neuroscience 20 7 (2000) 2664-2672
103. Wheeler M.E., Petersen S.E., and Buckner R.L. Memory's echo: Vivid remembering reactivates sensory-specific cortex. Proceedings of the National Academy of Sciences of the United States of America 97 20 (2000) 11125-11129
104. Wohlschlager A.M., Specht K., Lie C., Mohlberg H., Wohlschlager A., Bente K., et al. Linking retinotopic fMRI mapping and anatomical probability maps of human occipital areas V1 and V2. Neuroimage 26 1 (2005) 73-82
105. Woodruff P.W., Benson R.R., Bandettini P.A., Kwong K.K., Howard R.J., Talavage T., et al. Modulation of auditory and visual cortex by selective attention is modality-dependent. Neuroreport 7 12 (1996) 1909-1913
106. Worsley K.J., Evans A.C., Marrett S., and Neelin P. A three-dimensional statistical analysis for CBF activation studies in human brain. Journal of Cerebral Blood Flow and Metabolism 12 6 (1992) 900-918
107. Zatorre R.J., Bouffard M., Ahad P., and Belin P. Where is 'where' in the human auditory cortex?. Nature Neuroscience 5 9 (2002) 905-909
108. Zatorre R.J., Mondor T.A., and Evans A.C. Auditory attention to space and frequency activates similar cerebral systems. Neuroimage 10 5 (1999) 544-554