Multisensory interactions in primate auditory cortex: fMRI and electrophysiology

Hearing Research

Volumn 258, Issue 1-2, 2009, Pages 80-88

  Kayser, Christoph ^a   Petkov, Christopher I ^a   Logothetis, Nikos K ^a,b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Audio visual; Auditory cortex; Cross modal; Functional imaging; Monkey; Sensory integration

Indexed keywords

ANIMAL CELL; ANIMAL TISSUE; ARTICLE; AUDITORY CORTEX; AUDITORY DISCRIMINATION; CONTROLLED STUDY; ELECTRIC POTENTIAL; FUNCTIONAL MAGNETIC RESONANCE IMAGING; INFORMATION PROCESSING; NERVE CELL; NONHUMAN; PRIMATE; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SENSORY SYSTEM ELECTROPHYSIOLOGY; SIGNAL PROCESSING; SOMATOSENSORY STIMULATION; SYNAPSE; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ACOUSTICS; ANIMALS; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN MAPPING; ELECTROPHYSIOLOGY; HAPLORHINI; HEARING; HUMANS; MAGNETIC RESONANCE IMAGING; MODELS, BIOLOGICAL; MODELS, NEUROLOGICAL; NEURONS; PRIMATES;

EID: 65449161883     PISSN: 03785955     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.heares.2009.02.011     Document Type: Article

References (102)

1. Attwell D., and Iadecola C. The neural basis of functional brain imaging signals. Trends Neurosci. 25 (2002) 621-625
2. Bartels A., Logothetis N.K., and Moutoussis K. FMRI and its interpretations: an illustration on directional selectivity in area V5/MT. Trends Neurosci. 31 (2008) 444-453
3. Belitski A., Gretton A., Magri C., Murayama Y., Montemurro M.A., Logothetis N.K., and Panzeri S. Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. Neurosci. 28 (2008) 5696-5709
4. Benevento L.A., Fallon J., Davis B.J., and Rezak M. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp. Neurol. 57 (1977) 849-872
5. Bernstein L.E., Auer Jr. E.T., Moore J.K., Ponton C.W., Don M., and Singh M. Visual speech perception without primary auditory cortex activation. Neuroreport 13 (2002) 311-315
6. Bizley, J.K., Nodal, F.R., Bajo, V.M., Nelken, I., King, A.J. 2006. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb Cortex. Epub doi:10.1093/cercor/bhl128.
7. Borst A., and Theunissen F.E. Information theory and neural coding. Nat. Neurosci. 2 (1999) 947-957
8. Bruce C., Desimone R., and Gross C.G. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46 (1981) 369-384
9. Calvert G.A., and Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15 (2003) 57-70
10. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., and David A.S. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10 (1999) 2619-2623
11. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C., McGuire P.K., Woodruff P.W., Iversen S.D., and David A.S. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
12. Cappe C., Loquet G., Barone P., and Rouiller E.M. Neuronal Responses to Visual Stimuli in Auditory Cortical Areas of Monkeys Performing an Audio-visual Detection Task (2007), European Brain and Behaviour Society, Trieste
13. Chechik G., Anderson M.J., Bar-Yosef O., Young E.D., Tishby N., and Nelken I. Reduction of information redundancy in the ascending auditory pathway. Neuron 51 (2006) 359-368
14. Chiry O., Tardif E., Magistretti P.J., and Clarke S. Patterns of calcium-binding proteins support parallel and hierarchical organization of human auditory areas. Eur. J. Neurosci. 17 (2003) 397-410
15. Clarke S., and Rivier F. Compartments within human primary auditory cortex: evidence from cytochrome oxidase and acetylcholinesterase staining. Eur. J. Neurosci. 10 (1998) 741-745
16. Crivello F., Schormann T., Tzourio-Mazoyer N., Roland P.E., Zilles K., and Mazoyer B.M. Comparison of spatial normalization procedures and their impact on functional maps. Hum. Brain Mapp. 16 (2002) 228-250
17. Desai R., Liebenthal E., Possing E.T., Waldron E., and Binder J.R. Volumetric vs. surface-based alignment for localization of auditory cortex activation. Neuroimage 26 (2005) 1019-1029
18. Driver J., and Spence C. Crossmodal attention. Curr. Opin. Neurobiol. 8 (1998) 245-253
19. Engel S.A., Rumelhart D.E., Wandell B.A., Lee A.T., Glover G.H., Chichilnisky E.J., and Shadlen M.N. fMRI of human visual cortex. Nature 369 (1994) 525
20. Ernst M.O., and Bulthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 8 (2004) 162-169
21. Felleman D.J., and Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1 (1991) 1-47
22. Fergus A., and Lee K.S. GABAergic regulation of cerebral microvascular tone in the rat. J. Cereb. Blood Flow Metab. 17 (1997) 992-1003
23. Formisano E., Kim D.S., Di Salle F., van de Moortele P.F., Ugurbil K., and Goebel R. Mirror-symmetric tonotopic maps in human primary auditory cortex. Neuron 40 (2003) 859-869
24. Foxe J.J., and Schroeder C.E. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16 (2005) 419-423
25. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., and Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res. 10 (2000) 77-83
26. Foxe J.J., Wylie G.R., Martinez A., Schroeder C.E., Javitt D.C., Guilfoyle D., Ritter W., and Murray M.M. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 88 (2002) 540-543
27. Fullerton B.C., and Pandya D.N. Architectonic analysis of the auditory-related areas of the superior temporal region in human brain. J. Comp. Neurol. 504 (2007) 470-498
28. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 10 (2006) 278-285
29. Ghazanfar A.A., Chandrasekaran C., and Logothetis N.K. Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J. Neurosci. 28 (2008) 4457-4469
30. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25 (2005) 5004-5012
31. Goense J., and Logothetis N. Neurophysiology of the BOLD fMRI Signal in Awake Monkeys. Curr. Biol. 18 8 (2008) 631-640
32. Hackett T.A., Stepniewska I., and Kaas J.H. Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. J. Comp. Neurol. 394 (1998) 475-495
33. Harris K.D. Neural signatures of cell assembly organization. Nat. Rev. Neurosci. 6 (2005) 399-407
34. Hershenson M. Reaction time as a measure of intersensory facilitation. J. Exp. Psychol. 63 (1962) 289-293
35. Hikosaka K., Iwai E., Saito H., and Tanaka K. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J. Neurophysiol. 60 (1988) 1615-1637
36. Hyvarinen J., and Shelepin Y. Distribution of visual and somatic functions in the parietal associative area 7 of the monkey. Brain Res. 169 (1979) 561-564
37. Jones E.G., and Powell T.P. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 93 (1970) 793-820
38. Kaas J.H., and Hackett T.A. Subdivisions of auditory cortex and processing streams in primates. Proc. Natl. Acad. Sci. USA 97 (2000) 11793-11799
39. Kayser C., Petkov C.I., and Logothetis N.K. Visual modulation of neurons in auditory cortex. Cereb. Cortex 18 (2008) 1560-1574
40. Kayser C., Petkov C.I., Augath M., and Logothetis N.K. Integration of touch and sound in auditory cortex. Neuron 48 (2005) 373-384
41. Kayser C., Petkov C.I., Augath M., and Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex. J. Neurosci. 27 (2007) 1824-1835
42. Kayser C., Montemurro M.A., Logothetis N., and Panzeri S. Spike-phase coding boosts and stabilizes the information carried by spatial and temporal spike patterns. Neuron 61 4 (2009) 597-608
43. Kikuchi, Y., Rauschecker, J.P., Mishkin, M., Augath, M., Logothetis, N., Petkov, C., 2008. Voice region connectivity in the monkey assessed with microstimulation and functional imaging. Program No. 850.2. 2008 Neuroscience Meeting Planner. Society for Neuroscience, Washington, DC, Online.
44. Kosaki H., Hashikawa T., He J., and Jones E.G. Tonotopic organization of auditory cortical fields delineated by parvalbumin immunoreactivity in macaque monkeys. J. Comp. Neurol. 386 (1997) 304-316
45. Lakatos P., Chen C.M., O'Connell M.N., Mills A., and Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53 (2007) 279-292
46. Laurienti P.J., Perrault T.J., Stanford T.R., Wallace M.T., and Stein B.E. On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp. Brain Res. 166 (2005) 297-298
47. Lauritzen M. Reading vascular changes in brain imaging: is dendritic calcium the key?. Nat. Rev. Neurosci. 6 (2005) 77-85
48. Lauritzen M., and Gold L. Brain function and neurophysiological correlates of signals used in functional neuroimaging. J. Neurosci. 23 (2003) 3972-3980
49. Lehmann C., Herdener M., Esposito F., Hubl D., di Salle F., Scheffler K., Bach D.R., Federspiel A., Kretz R., Dierks T., and Seifritz E. Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. Neuroimage 31 (2006) 294-300
50. Lehmann S., and Murray M.M. The role of multisensory memories in unisensory object discrimination. Brain Res. Cogn. Brain Res. 24 (2005) 326-334
51. Logothetis N.K. The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. Philos. Trans. R Soc. Lond. B Biol. Sci. 357 (2002) 1003-1037
52. Logothetis N.K. What we can do and what we cannot do with fMRI. Nature 453 (2008) 869-878
53. Logothetis N.K., Pauls J., Augath M., Trinath T., and Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 412 (2001) 150-157
54. Lutkenhoner B., Lammertmann C., Simoes C., and Hari R. Magnetoencephalographic correlates of audiotactile interaction. Neuroimage 15 (2002) 509-522
55. Martuzzi R., Murray M.M., Michel C.M., Thiran J.P., Maeder P.P., Clarke S., and Meuli R.A. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex 17 (2006) 1672-1679
56. Mathiesen C., Caesar K., and Lauritzen M. Temporal coupling between neuronal activity and blood flow in rat cerebellar cortex as indicated by field potential analysis. J. Physiol. 523 Pt 1 (2000) 235-246
57. Mathiesen C., Caesar K., Akgoren N., and Lauritzen M. Modification of activity-dependent increases of cerebral blood flow by excitatory synaptic activity and spikes in rat cerebellar cortex. J. Physiol. 512 Pt. 2 (1998) 555-566
58. McDonald J.J., Teder-Salejarvi W.A., and Hillyard S.A. Involuntary orienting to sound improves visual perception. Nature 407 (2000) 906-908
59. Merzenich M.M., and Brugge J.F. Representation of the cochlear partition of the superior temporal plane of the macaque monkey. Brain Res. 50 (1973) 275-296
60. Morel A., Garraghty P.E., and Kaas J.H. Tonotopic organization, architectonic fields, and connections of auditory cortex in macaque monkeys. J. Comp. Neurol. 335 (1993) 437-459
61. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., and Malach R. Coupling between neuronal firing, field potentials, and FMRI in human auditory cortex. Science 309 (2005) 951-954
62. Murray M.M., Molholm S., Michel C.M., Heslenfeld D.J., Ritter W., Javitt D.C., Schroeder C.E., and Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 15 (2005) 963-974
63. Nelken I., and Chechik G. Information theory in auditory research. Hear. Res. 229 (2007) 94-105
64. Nelken I., Chechik G., Mrsic-Flogel T.D., King A.J., and Schnupp J.W. Encoding stimulus information by spike numbers and mean response time in primary auditory cortex. J. Comput. Neurosci. 19 (2005) 199-221
65. Niessing J., Ebisch B., Schmidt K.E., Niessing M., Singer W., and Galuske R.A. Hemodynamic signals correlate tightly with synchronized gamma oscillations. Science 309 (2005) 948-951
66. Nir Y., Fisch L., Mukamel R., Gelbard-Sagiv H., Arieli A., Fried I., and Malach R. Coupling between neuronal firing rate, gamma LFP, and BOLD fMRI is related to interneuronal correlations. Curr. Biol. 17 (2007) 1275-1285
67. Norup Nielsen A., and Lauritzen M. Coupling and uncoupling of activity-dependent increases of neuronal activity and blood flow in rat somatosensory cortex. J. Physiol. 533 (2001) 773-785
68. Oakland T., Black J.L., Stanford G., Nussbaum N.L., and Balise R.R. An evaluation of the dyslexia training program: a multisensory method for promoting reading in students with reading disabilities. J. Learn. Disabil. 31 (1998) 140-147
69. Pekkola J., Ojanen V., Autti T., Jaaskelainen I.P., Mottonen R., and Sams M. Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale. Hum. Brain Mapp. 27 (2005) 471-477
70. Petkov, C., Kayser, C., Ghazanfar, A.A., Patterson, R.D., Logothetis, N., 2008a. Functional imaging of sensitivity to components of the voice in monkey auditory cortex, Program No. 851.19. 2008 Neuroscience Meeting Planner. Society for Neuroscience, Washington, DC, Online.
71. Petkov C., Kayser C., Steudel T., Whittingstall K., Augath M., and Logothetis N. A voice region in the monkey brain. Nat. Neurosci. 11 (2008) 367-374
72. Petkov C.I., Kayser C., Augath M., and Logothetis N.K. Functional imaging reveals numerous fields in the monkey auditory cortex. PLOS Biol. 4 (2006) e215
73. Poirazi P., Brannon T., and Mel B.W. Pyramidal neuron as two-layer neural network. Neuron 37 (2003) 989-999
74. Rademacher J., Caviness Jr. V.S., Steinmetz H., and Galaburda A.M. Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping, and neurobiology. Cereb. Cortex 3 (1993) 313-329
75. Rasch M.J., Gretton A., Murayama Y., Maass W., and Logothetis N.K. Inferring spike trains from local field potentials. J. Neurophysiol. 99 (2008) 1461-1476
76. Rauschecker J.P. Cortical processing of complex sounds. Curr. Opin. Neurobiol. 8 (1998) 516-521
77. Rauschecker J.P., and Tian B. Processing of band-passed noise in the lateral auditory belt cortex of the rhesus monkey. J. Neurophysiol. 91 (2004) 2578-2589
78. Rauschecker J.P., Tian B., Pons T., and Mishkin M. Serial and parallel processing in rhesus monkey auditory cortex. J. Comp. Neurol. 382 (1997) 89-103
79. Recanzone G.H., Guard D.C., and Phan M.L. Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. J. Neurophysiol. 83 (2000) 2315-2331
80. Rivier F., and Clarke S. Cytochrome oxidase, acetylcholinesterase, and NADPH-diaphorase staining in human supratemporal and insular cortex: evidence for multiple auditory areas. Neuroimage 6 (1997) 288-304
81. Ross L.A., Saint-Amour D., Leavitt V.M., Javitt D.C., and Foxe J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17 (2007) 1147-1153
82. Schnupp J.W., Hall T.M., Kokelaar R.F., and Ahmed B. Plasticity of temporal pattern codes for vocalization stimuli in primary auditory cortex. J. Neurosci. 26 (2006) 4785-4795
83. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14 (2002) 187-198
84. Schroeder C.E., Molholm S., Lakatos P., Ritter W., and Foxe J.J. Human-simian correspondence in the early cortical processing of multisensory cues. Cogn. Process 5 (2004) 140-151
85. Schroeder C.E., Lindsley R.W., Specht C., Marcovici A., Smiley J.F., and Javitt D.C. Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 85 (2001) 1322-1327
86. Schroeder C.E., Smiley J., Fu K.G., McGinnis T., O'Connell M.N., and Hackett T.A. Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int. J. Psychophysiol. 50 (2003) 5-17
87. Schurmann M., Caetano G., Hlushchuk Y., Jousmaki V., and Hari R. Touch activates human auditory cortex. Neuroimage 30 (2006) 1325-1331
88. Seitz A.R., Kim R., and Shams L. Sound facilitates visual learning. Curr. Biol. 16 (2006) 1422-1427
89. Shmuel A., Augath M., Oeltermann A., and Logothetis N.K. Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1. Nat. Neurosci. 9 (2006) 569-577
90. Stein B.E., and Meredith M.A. Merging of the Senses (1993), MIT Press, Cambridge
91. Sumby W.H., and Polack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
92. Talavage T.M., Sereno M.I., Melcher J.R., Ledden P.J., Rosen B.R., and Dale A.M. Tonotopic organization in human auditory cortex revealed by progressions of frequency sensitivity. J. Neurophysiol. 91 (2004) 1282-1296
93. Thomsen K., Offenhauser N., and Lauritzen M. Principal neuron spiking: neither necessary nor sufficient for cerebral blood flow in rat cerebellum. J. Physiol. 560 (2004) 181-189
94. van Atteveldt N., Formisano E., Goebel R., and Blomert L. Integration of letters and speech sounds in the human brain. Neuron 43 (2004) 271-282
95. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. USA 102 (2005) 1181-1186
96. Vatakis A., and Spence C. Audiovisual synchrony perception for music, speech, and object actions. Brain Res. 1111 (2006) 134-142
97. Vroomen J., and de Gelder B. Sound enhances visual perception: cross-modal effects of auditory organization on vision. J. Exp. Psychol. Hum. Percept. Perform. 26 (2000) 1583-1590
98. Walker K.M., Ahmed B., and Schnupp J.W. Linking cortical spike pattern codes to auditory perception. J. Cogn. Neurosci. 20 (2008) 135-152
99. Wallace M.T., Wilkinson L.K., and Stein B.E. Representation and integration of multiple sensory inputs in primate superior colliculus. J. Neurophysiol. 76 (1996) 1246-1266
100. Warnking J., Dojat M., Guerin-Dugue A., Delon-Martin C., Olympieff S., Richard N., Chehikian A., and Segebarth C. FMRI retinotopic mapping - step by step. Neuroimage 17 (2002) 1665-1683
101. Wessinger C.M., Buonocore M.H., Kussmaul C.L., and Mangun G.R. Tonotopy in human auditory cortex examined with functional magnetic resonance imaging. Neuroimage 5 (1997) 18-25
102. Zampini M., Guest S., Shore D.I., and Spence C. Audio-visual simultaneity judgments. Percept. Psychophys. 67 (2005) 531-544