Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing

International Journal of Psychophysiology

Volumn 50, Issue 1-2, 2003, Pages 5-17

  Schroeder, Charles E ^a,b   Smiley, John ^a   Fu, Kaiming G ^a,b   McGinnis, Tammy ^a   O'Connell, Monica N ^a   Hackett, Troy A ^c  

^a NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^c VANDERBILT UNIVERSITY   (United States)

Author keywords

Current source density; Event related potential; Feedback; Multisensory convergence; Temporal coincidence

Indexed keywords

ASSOCIATION CORTEX; AUDITORY CORTEX; AUDITORY RESPONSE; AUDITORY SYSTEM; BEHAVIOR; BINOCULAR CONVERGENCE; BRAIN CORTEX; BRAIN FUNCTION; CINGULATE GYRUS; COGNITION; CONFERENCE PAPER; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; HUMAN; INFORMATION; LATENT PERIOD; MACACA; MAGNETOENCEPHALOGRAPHY; MEDIAL LEMNISCUS; MEDIAN NERVE; MODEL; NEOCORTEX; NERVE CELL; NERVE ENDING; NERVE FIBER; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PROPRIOCEPTION; SENSORY NERVE; SENSORY STIMULATION; SENSORY SYSTEM; SIGNAL TRANSDUCTION; SOMATOSENSORY SYSTEM; STIMULUS RESPONSE; SUPRACHIASMATIC NUCLEUS; TEMPORAL CORTEX; THALAMUS; VIBRATION; VISUAL STIMULATION;

EID: 0348077580     PISSN: 01678760     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8760(03)00120-X     Document Type: Conference Paper

References (63)

1. Benevento M.L., Fallon J., Davis B.J., Rezak A. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp. Neurol. 57:(3):1977;849-872.
2. Bruce C., Desimone R., Gross C.G. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46:(2):1981;369-384.
3. Bullier J. Feedback connections and conscious vision. Trends Cogn. Sci. 5:(9):2001;369-370.
4. Burton H., Sinclair R. Somatosensory cortex and tactile perceptions. Pain and Touch. 1996;Academic Press. Chapter 3.
5. Calvert G., Brammer M., Bullmore E., Campbell R., Iverson L., David A. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport. 10:1999;2619-2623.
6. Calvert G., Bullmore E.T., Brammer M.J., et al. Activation of auditory cortex during silent lipreading. Science. 276:(5312):1997;593-596.
7. Duhamel J.R., Colby C.L., Goldberg M.E. Ventral intraparietal area of the macaque:convergent visual and somatic response properties. J. Neurophysiol. 79:1998;126-136.
8. Falchier A., Renaud L., Barone H., Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22:(13):2002;5749-5759.
9. Falchier, A., Renaud, L., Barone, H., Kennedy, H., 2001. Extensive projections from primary auditory cortex and area STP to peripheral V1 in the macaque. Soc. Neurosci. (Abstract) 27: program no. 511.21.
10. Felleman D.J., Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex. 1:1991;1-47.
11. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res. 10:(1-2):2000;77-83.
12. Foxe J.J., Wylie G.R., Martinez A., et al. Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 88:(1):2002;540-543.
13. Fu, K., Johnston, T.A., Shah, A.S., et al., 2001. Characterization of somatosensory input to auditory association cortex in macaques. Soc. Neurosci. (Abstract): p. 390.
14. Fu, K., Johnston, T.A., Shah, A.S., et al. Auditory cortical neurons respond to somatosensory input. J. Neuorsci., in press.
15. Giard M., Peronet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11:1999;473-490.
16. Givre S.J., Schroeder C.E., Arezzo J.C. Contribution of extrastriate area V4 to the surface-recorded flash VEP in the awake macaque. Vision Res. 34:(4):1994;415-428.
17. Graziano M.S., Hu X.T., Gross C.G. Visuospatial properties of ventral premotor cortex. J. Neurophysiol. 77:(5):1997;2268-2292.
18. Graziano M.S., Yap G.S., Gross C.G. Coding of visual space by premotor neurons. Science. 266:(5187):1994;1054-1057.
19. Hackett T.A., Stepniewska I., Kaas J.H. Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. J. Comp. Neurol. 394:(4):1998;475-495.
20. Hackett T.A., Stepniewska I., Kaas J.H. Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. J. Comp. Neurol. 394:1998;475-495.
21. Hackett T.A., Preuss T.M., Kaas J.H. Architectonic identification of the core region in auditory cortex of macaques, chimpanzees, and humans. J. Comp. Neurol. 441:(3):2001;197-222.
22. Hikosaka K., Iwai E., Saito H., Tanaka K. Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J. Neurophysiol. 60:(5):1988;1615-1637.
23. Hyvarinen J., Shelepin Y. Distribution of visual and somatic functions in the parietal associative area 7 of the monkey. Brain Res. 169:(3):1979;561-564.
24. Jiang W., Wallace M.T., Jiang H., Vaughan J.W., Stein B.E. Two cortical areas mediate multisensory integration in superior colliculus neurons. J. Neurophysiol. 85:2001;506-522.
25. Jones E. Viewpoint: the core and matrix of thalamic organization. Neuroscience. 85:(2):1998;331-345.
26. Jones E.G., Powell T.P. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain. 93:(4):1970;793-820.
27. Kosaki H., Hashikawa T., He J., Jones E.G. Tonotopic organization of auditory cortical fields delineated by parvalbumin immunoreactivity in macaque monkeys. J. Comp. Neurol. 386:1997;304-316.
28. Krubitzer L., Clarey J., Tweedale R., Elston G., Calford M. A re-definition of somatosensory areas in the lateral sulcus of macaque monkeys. J. Neurosci. 15:1995;3821-3839.
29. Lamme V. The neurophysiology of figure-ground segregation in primary visual cortex. J. Neurosci. 15:1995;1605-1615.
30. Lamme V., Zipser K., Spekreisje H. Figure-ground activity in primary visual cortex is suppressed by anesthesia. Proc. Natl. Acad. Sci. USA. 95:1998;3263-3268.
31. Leinonen L. Functional properties of neurones in the parietal retroinsular cortex in awake monkey. Acta Physiol. Scand. 108:(4):1980;381-384.
32. Leinonen L., Hyvarinen J., Sovijarvi A.R. Functional properties of neurons in the temporo-parietal association cortex of awake monkey. Exp. Brain Res. 39:(2):1980;203-215.
33. Levanen S., Jousmaki V., Hari R. Vibration-induced auditory cortex activation in a congenitally deaf adult. Curr. Biol. 8:1998;869-872.
34. Lewis J.W., Van Essen D.C. Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J. Comp. Neurol. 428:(1):2000;112-137.
35. Mazzoni P., Bracewell R.M., Barash S., Andersen R.A. Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. J. Neurophysiol. 75:(3):1996;1233-1241.
36. Mehta A.D., Ulbert I., Schroederr C.E. Intermodal selective attention in monkeys I: Distribution and timing of effects across visual areas. Cereb. Cortex. 10:2000a;343-358.
37. Mehta A.D., Ulbert I., Schroeder C.E. Intermodal selective attention in monkeys. II: Physiological mechanisms of modulation. Cereb. Cortex. 10:(4):2000b;359-370.
38. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14:(1):2002;115-128.
39. Pallas S.L., Roe A.W., Sur M. Visual projections induced into the auditory pathway of ferrets. I. Novel inputs to primary auditory cortex (AI) from the LP/pulvinar complex and the topography of the MGN-AI projection. J. Comp. Neurol. 298:(1):1990;50-68.
40. Pandya D.N., Hallett M., Kmukherjee S.K. Intra- and interhemispheric connections of the neocortical auditory system in the rhesus monkey. Brain Res. 14:(1):1969;49-65.
41. Rauschecker J.P., Tian B. Mechanisms and streams for processing of 'what' and 'where' in auditory cortex. Proc. Natl. Acad. Sci. USA. 97:(22):2000;11800-11806.
42. Rauschecker J.P., Tian B., Pons T., Mishkin M. Serial and parallel processing in rhesus monkey auditory cortex. J. Comp. Neurol. 382:1997;89-103.
43. Rausell E., Jones E.G. Chemically distinct compartments of the thalamic VPM nucleus in monkeys relay principal and spinal trigeminal pathways to different layers of the somatosensory cortex. J. Neurosci. 11:(1):1991;226-237.
44. Rausell E.B., Vinuela A., Huntley G.W., Jones E.G. Calbindin and parvalbumin cells in monkey VPL thalamic nucleus: distribution, laminar cortical projections, and relations to spinothalamic terminations. J. Neurosci. 12:(10):1992;4088-4111.
45. Rizzolatti G., Scandolara C., Gentilucci M., Camarda R. Response properties and behavioral modulation of 'mouth' neurons of the postarcuate cortex (area 6) in macaque monkeys. Brain Res. 225:(2):1981;421-424.
46. Rizzolatti G., Scandolara C., Gentilucci M., Camarda R. Afferent properties of periarcuate neurons in macaque monkeys. I. Somatosensory responses. Behav. Brain Res. 2:(2):1981;125-146.
47. Rizzolatti G., Scandolara C., Gentilucci M., Camarda R. Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses. Behav. Brain Res. 2:(2):1981;147-163.
48. Robinson C.J., Burton H. Organization of somatosensory fields in areas 7b, retroinsula, postauditoru, and granular insula of M. fascicularis. J. Comp. Neurol. 192:1980;69-92.
49. Rockland, K.S., Ojima K., 2001. Calcarine area V1 as a multimodal convergence area. Soc. Neurosci. (Abstract) 27: program no. 511.20.
50. Rockland, K.S., Ojima, H., 2003. Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 50(1-2), 19-26.
51. Rockland K.S., Pandya D.N. Laminar origins and terminations of cortical connections in the occipital lobe in the rhesus monkey. Brain Res. 179:1979;3-20.
52. Roe A.W., Pallas S.L., Sur M. A map of visual space induced in primary auditory cortex. Science. 250:(4982):1990;818-820.
53. Romanski L.M., Bates J.F., Goldman-Rakic P.S. Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkeys. J. Comp. Neurol. 403:1999;141-157.
54. Romanski L.M., Tian B., Fritz J., Mishkin M., Goldman-Rakic P.S., Rauschecker J.P. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat. Neurosci. 2:(12):1999;1131-1136.
55. Schroeder C.E., Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14:(1):2002;187-198.
56. Schroeder C.E., Lindsley R.W., Specht C., Marcovici A., Smiley J.F., Javitt D.C. Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 85:(3):2001;1322-1327.
57. Schroeder C.E., Mehta A.D., Foxe J. Determinants and mechanisms of attentional modulation of neural processing. Front. Biosci. 6:2001;D672-D684.
58. Schroeder C.E., Mehta A.D., Givre S.J. A spatiotemporal profile of visual system activation revealed by current source density analysis in the awake macaque. Cereb. Cortex. 8:(7):1998;575-592.
59. Schroeder C.E., Seto S., Arezzo J.C., Garraghty P.E. Electrophysiologic evidence for overlapping dominant and latent inputs to somatosensory cortex in squirrel monkeys. J. Neurophysiol. 74:(2):1995;722-732.
60. Seltzer B., Pandya D.N. Converging visual and somatic sensory cortical input to the intraparietal sulcus of the rhesus monkey. Brain. Res. 192:(2):1980;339-351.
61. Stein B.E., Meredith M.A. The Merging of the Senses. 1993;MIT Press, Boston.
62. Sur M., Pallas S.L., Roe A.W. Cross-modal plasticity in cortical development: differentiation and specification of sensory neocortex. Trends Neurosci. 13:(6):1990;227-233.
63. Zipzer K., Lamme P., Schiller P. Contextual modulation in primary visual cortex. J. Neurosci. 16:1996;7376-7389.