Visual modulation of neurons in auditory cortex

Cerebral Cortex

Volumn 18, Issue 7, 2008, Pages 1560-1574

  Kayser, Christoph ^a   Petkov, Christopher I ^a   Logothetis, Nikos K ^a,b  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Audiovisual; Cross modal; Electrophysiology; Local field potential; Macaque monkey; Multisensory

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; AUDITORY CORTEX; AUDITORY RESPONSE; AUDITORY STIMULATION; CONTROLLED STUDY; MONKEY; NERVE CELL; NEUROMODULATION; NONHUMAN; PRIORITY JOURNAL; VISION; VISUAL STIMULATION;

ADAPTATION, PHYSIOLOGICAL; ANIMALS; AUDITORY CORTEX; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; MACACA MULATTA; NEURAL PATHWAYS; NEURONS, AFFERENT; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION;

EID: 45849135548     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhm187     Document Type: Article

References (95)

1. Arrighi R, Alais D, Burr D. 2006. Perceptual synchrony of audiovisual streams for natural and artificial motion sequences. J Vis. 6:260-268.
2. Avillac M, Ben Hamed S, Duhamel JR. 2007. Multisensory integration in the ventral intraparietal area of the macaque monkey. J Neurosci. 27:1922-1932.
3. Bell AH, Corneil BD, Munoz DP, Meredith MA. 2003. Engagement of visual fixation suppresses sensory responsiveness and multisensory integration in the primate superior colliculus. Eur J Neurosci. 18:2867-2873.
4. Benevento LA, Fallon J, Davis BJ, Rezak M. 1977. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol. 57:849-872.
5. Bernstein LE, Auer ET, Jr, Moore JK, Ponton CW, Don M, Singh M. 2002. Visual speech perception without primary auditory cortex activation. Neuroreport. 13:311-315.
6. Bieser A, Muller-Preuss P. 1996. Auditory responsive cortex in the squirrel monkey: neural responses to amplitude-modulated sounds. Exp Brain Res. 108:273-284.
7. Bizley JK, Nodal FR, Bajo VM, Nelken I, King AJ. 2006. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb Cortex. doi: 10.1093/cercor/bhl128.
8. Brosch M, Selezneva E, Scheich H. 2005. Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. J Neurosci. 25:6797-6806.
9. Bruce C, Desimone R, Gross CG. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol. 46:369-384.
10. Calvert GA. 2001. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 11:1110-1123.
11. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS. 1997. Activation of auditory cortex during silent lipreading. Science. 276:593-596.
12. Calvert GA, Campbell R. 2003. Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci. 15:57-70.
13. Calvert GA, Hansen PC, Iversen SD, Brammer MJ. 2001. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage. 14:427-438.
14. Creutzfeldt O, Hellweg FC, Schreiner C. 1980. Thalamocortical transformation of responses to complex auditory stimuli. Exp Brain Res. 39:87-104.
15. Disbrow EA, Slutsky DA, Roberts TP, Krubitzer LA. 2000. Functional MRI at 1.5 tesla: a comparison of the blood oxygenation level-dependent signal and electrophysiology. Proc Natl Acad Sci USA. 97:9718-9723.
16. Driver J, Spence C. 1998. Crossmodal attention. Curr Opin Neurobiol. 8:245-253.
17. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE. 2000. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res. 10:77-83.
18. Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM. 2002. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J Neurophysiol. 88:540-543.
19. Fritz J, Elhilali M, Shamma S. 2007. Adaptive changes in cortical receptive fields induced by attention to complex sounds. J Neurophysiol. 98(4):2337-2346.
20. Fu KM, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garraghty PE, Schroeder CE. 2003. Auditory cortical neurons respond to somatosensory stimulation. J Neurosci. 23:7510-7515.
21. Fu KM, Shah AS, O'Connell MN, McGinnis T, Eckholdt H, Lakatos P, Smiley J, Schroeder CE. 2004. Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. J Neurophysiol. 92:3522-3531.
22. Ghazanfar AA, Chandrasekaran CF. 2007. Paving the way forward: integrating the senses through phase-resetting of cortical oscillations. Neuron. 53:162-164.
23. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK. 2005. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci. 25:5004-5012.
24. Ghazanfar AA, Schroeder CE. 2006. Is neocortex essentially multisensory? Trends Cogn Sci. 10:278-285.
25. Giard MH, Peronnet F. 1999. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci. 11:473-490.
26. Gillmeister H, Eimer M. 2007. Tactile enhancement of auditory detection and perceived loudness. Brain Res. 1160:58-68.
27. Heinke W, Schwarzbauer C. 2001. Subanesthetic isoflurane affects task-induced brain activation in a highly specific manner: a functional magnetic resonance imaging study. Anesthesiology. 94:973-981.
28. Hershenson M. 1962. Reaction time as a measure of intersensory facilitation. J Exp Psychol. 63:289-293.
29. Hikosaka K, Iwai E, Saito H, Tanaka K. 1988. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J Neurophysiol. 60:1615-1637.
30. Hillyard SA, Anllo-Vento L. 1998. Event-related brain potentials in the study of visual selective attention. Proc Natl Acad Sci USA. 95:781-787.
31. Hyvarinen J, Shelepin Y. 1979. Distribution of visual and somatic functions in the parietal associative area 7 of the monkey. Brain Res. 169:561-564.
32. Johnson JA, Zatorre RJ. 2006. Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage. 31:1673-1681.
33. Jones EG, Powell TP. 1970. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain. 93:793-820.
34. Jousmaki V, Hari R. 1998. Parchment-skin illusion: sound-biased touch. Curr Biol. 8:R190.
35. Kayser C, Logothetis NK. 2007. Do early sensory cortices integrate cross-modal information? Brain Struct Funct. 212:121-132.
36. Kayser C, Petkov CI, Augath M, Logothetis NK. 2005. Integration of touch and sound in auditory cortex. Neuron. 48:373-384.
37. Kayser C, Petkov CI, Augath M, Logothetis NK. 2007. Functional imaging reveals visual modulation of specific fields in auditory cortex. J Neurosci. 27:1824-1835.
38. Kayser C, Petkov CI, Logothetis N. 2007. Tuning to sound frequency in auditory field potentials. J Neurophysiol. 212:121-132.
39. Kosaki H, Hashikawa T, He J, Jones EG. 1997. Tonotopic organization of auditory cortical fields delineated by parvalbumin immunoreactivity in macaque monkeys. J Comp Neurol. 386:304-316.
40. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE. 2007. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron. 53:279-292.
41. Lakatos P, Pincze Z, Fu KM, Javitt DC, Karmos G, Schroeder CE. 2005. Timing of pure tone and noise-evoked responses in macaque auditory cortex. Neuroreport. 16:933-937.
42. Lakatos P, Shah AS, Knuth KH, Ulbert I, Karmos G, Schroeder CE. 2005. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J Neurophysiol. 94:1904-1911.
43. Laurienti PJ, Burdette JH, Wallace MT, Yen YF, Field AS, Stein BE. 2002. Deactivation of sensory-specific cortex by cross-modal stimuli. J Cogn Neurosci. 14:420-429.
44. Lehmann C, Herdener M, Esposito F, Hubl D, di Salle F, Scheffler K, Bach DR, Federspiel A, Kretz R, Dierks T, et al. 2006. Differential patterns of multisensory interactions in core and belt areas of human auditory cortex. Neuroimage. 31:294-300.
45. Leinonen L, Hyvarinen J, Sovijarvi AR. 1980. Functional properties of neurons in the temporo-parietal association cortex of awake monkey. Exp Brain Res. 39:203-215.
46. Liang L, Lu T, Wang X. 2002. Neural representations of sinusoidal amplitude and frequency modulations in the primary auditory cortex of awake primates. J Neurophysiol. 87:2237-2261.
47. Logothetis NK, Guggenberger H, Peled S, Pauls J. 1999. Functional imaging of the monkey brain. Nat Neurosci. 2:555-562.
48. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A. 2001. Neurophysiological investigation of the basis of the fMRI signal. Nature. 412:150-157.
49. Lutkenhoner B, Lammertmann C, Simoes C, Hari R. 2002. Magnetoencephalographic correlates of audiotactile interaction. Neuroimage. 15:509-522.
50. Macaluso E, Frith C, Driver J. 2000. Selective spatial attention in vision and touch: unimodal and multimodal mechanisms revealed by PET. J Neurophysiol. 83:3062-3075.
51. Makeig S, Westerfield M, Jung TP, Enghoff S, Townsend J, Courchesne E, Sejnowski TJ. 2002. Dynamic brain sources of visual evoked responses. Science. 295:690-694.
52. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, Clarke S, Meuli RA. 2006. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex. 17:1672-1679.
53. Mazza V, Turatto M, Rossi M, Umilta C. 2007. How automatic are audiovisual links in exogenous spatial attention? Neuropsychologia. 45:514-522.
54. McDonald JJ, Teder-Salejarvi WA, Hillyard SA. 2000. Involuntary orienting to sound improves visual perception. Nature. 407:906-908.
55. McGurk H, MacDonald J. 1976. Hearing lips and seeing voices. Nature. 264:746-748.
56. Merzenich MM, Brugge JF. 1973. Representation of the cochlear partition of the superior temporal plane of the macaque monkey. Brain Res. 50:275-296.
57. Mesulam MM. 1998. From sensation to cognition. Brain. 121(Pt 6):1013-1052.
58. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res. 14:115-128.
59. Murray MM, Molholm S, Michel CM, Heslenfeld DJ, Ritter W, Javitt DC, Schroeder CE, Foxe JJ. 2005. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb Cortex. 15:963-974.
60. Odgaard EC, Arieh Y, Marks LE. 2004. Brighter noise: sensory enhancement of perceived loudness by concurrent visual stimulation. Cogn Affect Behav Neurosci. 4:127-132.
61. Pekkola J, Ojanen V, Autti T, Jaaskelainen IP, Mottonen R, Sams M. 2005. Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale. Hum Brain Mapp. 27:471-477.
62. Pekkola J, Ojanen V, Autti T, Jaaskelainen IP, Mottonen R, Tarkiainen A, Sams M. 2005. Primary auditory cortex activation by visual speech: an fMRI study at 3 T. Neuroreport. 16:125-128.
63. Perrault TJ Jr, Vaughan JW, Stein BE, Wallace MT. 2005. Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. J Neurophysiol. 93:2575-2586.
64. Pouget P, Emeric EE, Stuphorn V, Reis K, Schall JD. 2005. Chronometry of visual responses in frontal eye field, supplementary eye field, and anterior cingulate cortex. J Neurophysiol. 94:2086-2092.
65. Rauschecker JP, Tian B. 2000. Mechanisms and streams for processing of what and where in auditory cortex. Proc Natl Acad Sci USA. 97:11800-11806.
66. Rauschecker JP, Tian B. 2004. Processing of band-passed noise in the lateral auditory belt cortex of the rhesus monkey. J Neurophysiol. 91:2578-2589.
67. Rauschecker JP, Tian B, Hauser M. 1995. Processing of complex sounds in the macaque nonprimary auditory cortex. Science. 268:111-114.
68. Recanzone GH. 2000. Spatial processing in the auditory cortex of the macaque monkey. Proc Natl Acad Sci USA. 97:11829-11835.
69. Recanzone GH, Guard DC, Phan ML. 2000. Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. J Neurophysiol. 83:2315-2331.
70. Recanzone GH, Guard DC, Phan ML, Su TK. 2000. Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. J Neurophysiol. 83:2723-2739.
71. Reynolds JH, Chelazzi L, Desimone R. 1999. Competitive mechanisms subserve attention in macaque areas V2 and V4. J Neurosci. 19: 1736-1753.
72. Rizzolatti G, Scandolara C, Gentilucci M, Camarda R. 1981. Response properties and behavioral modulation of "mouth" neurons of the postarcuate cortex (area 6) in macaque monkeys. Brain Res. 225:421-424.
73. Schroeder CE, Foxe J. 2005. Multisensory contributions to low-level, 'unisensory' processing. Curr Opin Neurobiol. 15:454-458.
74. Schroeder CE, Foxe JJ. 2002. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res Cogn Brain Res. 14:187-198.
75. Schroeder CE, Lindsley RW, Specht C, Marcovici A, Smiley JF, Javitt DC. 2001. Somatosensory input to auditory association cortex in the macaque monkey. J Neurophysiol. 85:1322-1327.
76. Schurmann M, Caetano G, Hlushchuk Y, Jousmaki V, Hari R. 2006. Touch activates human auditory cortex. Neuroimage. 30:1325-1331.
77. Schurmann M, Caetano G, Jousmaki V, Hari R. 2004. Hands help hearing: facilitatory audiotactile interaction at low sound-intensity levels. J Acoust Soc Am. 115:830-832.
78. Shams L, Kamitani Y, Shimojo S. 2000. Illusions. What you see is what you hear. Nature. 408:788.
79. Spence C, Driver J. 1997. Audiovisual links in exogenous covert spatial orienting. Percept Psychophys. 59:1-22.
80. Spence C, Nicholls ME, Gillespie N, Driver J. 1998. Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Percept Psychophys. 60:544-557.
81. Stanford TR, Quessy S, Stein BE. 2005. Evaluating the operations underlying multisensory integration in the cat superior colliculus. J Neurosci. 25:6499-6508.
82. Stein BE. 1998. Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp Brain Res. 123:124-135.
83. Stein BE, Meredith MA. 1993. Merging of the senses. Cambridge: MIT Press.
84. Stein BE, Meredith MA, Huneycutt WS, McDade L. 1989. Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J Cogn Neurosci. 1:12-24.
85. Sugihara T, Diltz MD, Averbeck BB, Romanski LM. 2006. Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J Neurosci. 26:11138-11147.
86. Sumby WH, Polack I. 1954. Visual contribution to speech intelligibility in noise. J Acoust Soc Am. 26:212-215.
87. Tallon-Baudry C, Bertrand O, Peronnet F, Pernier J. 1998. Induced gamma-band activity during the delay of a visual short-term memory task in humans. J Neurosci. 18:4244-4254.
88. Talsma D, Doty TJ, Woldorff MG. 2006. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb Cortex. 17:679-690.
89. van Atteveldt N, Formisano E, Goebel R, Blomert L. 2004. Integration of letters and speech sounds in the human brain. Neuron. 43: 271-282.
90. van Wassenhove V, Grant KW, Poeppel D. 2005. Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci USA. 102:1181-1186.
91. Vatakis A, Spence C. 2006. Audiovisual synchrony perception for music, speech, and object actions. Brain Res. 1111:134-142.
92. Weissman DH, Warner LM, Woldorff MG. 2004. The neural mechanisms for minimizing cross-modal distraction. J Neurosci. 24: 10941-10949.
93. Werner-Reiss U, Kelly KA, Trause AS, Underhill AM, Groh JM. 2003. Eye position affects activity in primary auditory cortex of primates. Curr Biol. 13:554-562.
94. Zampini M, Shore DI, Spence C. 2003. Audiovisual temporal order judgments. Exp Brain Res. 152:198-210.
95. Zatorre RJ, Bouffard M, Ahad P, Belin P. 2002. Where is 'where' in the human auditory cortex? Nat Neurosci. 5:905-909.