Is neocortex essentially multisensory?

Trends in Cognitive Sciences

Volumn 10, Issue 6, 2006, Pages 278-285

  Ghazanfar, Asif A ^a   Schroeder, Charles E ^b  

^a PRINCETON UNIVERSITY   (United States)

^b NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; COMPUTATIONAL METHODS; INFORMATION ANALYSIS; INTEGRATION; NEUROLOGY; NEUROPHYSIOLOGY;

NEOCORTEX; NEUROBIOLOGY; SENSORY PERCEPTIONS; UNIMODAL SENSORY;

SENSORY PERCEPTION;

AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN CORTEX; BRAIN REGION; CAT; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; LATENT PERIOD; MOTOR CORTEX; NEOCORTEX; NEUROANATOMY; NEUROBIOLOGY; NEUROMODULATION; NONHUMAN; OSCILLATION; PREFRONTAL CORTEX; REVIEW; SENSORY CORTEX; SOMATOSENSORY CORTEX; SUPERIOR COLLICULUS; TACTILE DISCRIMINATION; TACTILE STIMULATION; VISUAL CORTEX; VOCALIZATION;

ANIMALS; BRAIN MAPPING; HUMANS; MENTAL PROCESSES; NEOCORTEX; NEURAL PATHWAYS; SENSATION;

EID: 33745044194     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2006.04.008     Document Type: Review

References (80)

1. Adrian E.D. The Sherrington Lectures: I. Sensory Integration (1949), University of Liverpool Press
2. Felleman D.J., and Van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1 (1991) 1-47
3. Kuypers H.G., et al. Occipitotemporal corticocortical connections in the rhesus monkey. Exp. Neurol. 11 (1965) 245-262
4. Massopust L.C., et al. Auditory frequency discrimination in cortically ablated monkeys. J. Aud. Res. 5 (1965) 85-93
5. Cappe C., and Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci. 22 (2005) 2886-2902
6. Falchier A., et al. Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22 (2002) 5749-5759
7. Rockland K.S., and Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 50 (2003) 19-26
8. Katz D.B., et al. Dynamic and multimodal responses of gustatory cortical neurons in awake rats. J. Neurosci. 21 (2001) 4478-4489
9. Calvert G.A., et al. The Handbook of Multisensory Processes (2004), MIT Press
10. Jones E.G. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 93 (1970) 793-820
11. Bruce C., et al. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46 (1981) 369-384
12. Hikosaka K. The polysensory region in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. Biomed. Res. (Tokyo) 14 (1993) 41-45
13. Teuber, H.L. (1966) Alterations of perception after brain injury. In Brain and Conscious Experience. (Eccles, J.C., ed), 182-216, Springer
14. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 15 (2005) 145-153
15. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14 (2002) 187-198
16. Benevento L.A., et al. Auditory-visual interactions in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp. Neurol. 57 (1977) 849-872
17. Barraclough N.E., et al. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J. Cogn. Neurosci. 17 (2005) 377-391
18. Andersen R.A., et al. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu. Rev. Neurosci. 20 (1997) 303-330
19. Mazzoni P., et al. Spatially-tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. J. Neurophysiol. 75 (1996) 1233-1241
20. Linden J.F., et al. Responses to auditory stimuli in macaque lateral intraparietal area II. behavioral modulation. J. Neurophysiol. 82 (1999) 343-358
21. Gifford G.W., and Cohen Y.E. Effect of a central fixation light on auditory spatial responses in area LIP. J. Neurophysiol. 91 (2004) 2929-2933
22. Avillac M., et al. Reference frames for representing visual and tactile locations in parietal cortex. Nat. Neurosci. 8 (2005) 941-949
23. Bremmer F., et al. Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). Eur. J. Neurosci. 16 (2002) 1569-1586
24. Duhamel J.-R., et al. Ventral intraparietal area of the macaque: congruent visual and somatic response properties. J. Neurophysiol. 79 (1998) 126-136
25. Schlack A., et al. Multisensory space representations in the macaque ventral intraparietal area. J. Neurosci. 25 (2005) 4616-4625
26. Leinonen L., et al. Functional properties of neurons in the temporo-parietal association cortex of awake monkey. Exp. Brain Res. 39 (1980) 203-215
27. Fuster J.M., et al. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405 (2000) 347-351
28. Fogassi L., et al. Coding of peripersonal space in inferior premotor cortex (area F4). J. Neurophysiol. 76 (1996) 141-157
29. Graziano M.S.A., et al. A neuronal representation of the location of nearby sounds. Nature 397 (1999) 428-430
30. Graziano M.S.A., et al. Coding of visual space by premotor neurons. Science 266 (1994) 1054-1057
31. Schiff W., et al. Persistent fear responses in rhesus monkeys to the optical stimulus of 'looming'. Science 136 (1962) 982-983
32. Ghazanfar A.A., et al. Auditory looming perception in rhesus monkeys. Proc. Natl. Acad. Sci. U. S. A. 99 (2002) 15755-15757
33. Maier J.X., et al. Multisensory integration of looming signals by Rhesus monkeys. Neuron 43 (2004) 177-181
34. Graziano M.S., et al. Complex movements evoked by microstimulation of precentral cortex. Neuron 34 (2002) 841-851
35. Merchant H., et al. Effects of optic flow in motor cortex and area 7a. J. Neurophysiol. 86 (2001) 1937-1954
36. Wallace M.T., and Stein B.E. Cross-modal synthesis in the midbrain depends on input from cortex. J. Neurophysiol. 71 (1994) 429-432
37. Jiang W., et al. Two corticotectal areas facilitate multisensory orientation behavior. J. Cogn. Neurosci. 14 (2002) 1240-1255
38. Calvert G.A., et al. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
39. Foxe J.J., et al. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res. 10 (2000) 77-83
40. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
41. Molholm S., et al. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14 (2002) 115-128
42. Besle J., et al. Bimodal speech: early suppressive visual effects in human auditory cortex. Eur. J. Neurosci. 20 (2004) 2225-2234
43. van Wassenhove V., et al. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 1181-1186
44. Gobbele R., et al. Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. Neuroimage 20 (2003) 503-511
45. Lutkenhoner B., et al. Magnetoencephalographic correlates of audiotactile interaction. Neuroimage 15 (2002) 509-522
46. Pekkola J., et al. Primary auditory cortex activation by visual speech: an fMRI study at 3 T. Neuroreport 16 (2005) 125-128
47. van Atteveldt N., et al. Integration of letters and speech sounds in the human brain. Neuron 43 (2004) 271-282
48. Ghazanfar A.A., et al. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25 (2005) 5004-5012
49. Schroeder C.E., et al. Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 85 (2001) 1322-1327
50. Brosch M., et al. Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. J. Neurosci. 25 (2005) 6797-6806
51. Fu K.M.G., et al. Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23 (2003) 7510-7515
52. Kayser C., et al. Integration of touch and sound in auditory cortex. Neuron 48 (2005) 373-384
53. Fu K.M.G., et al. Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. J. Neurophysiol. 92 (2004) 3522-3531
54. Werner-Reiss U., et al. Eye position affects activity in primary auditory cortex of primates. Curr. Biol. 13 (2003) 554-562
55. Bernstein L.E., et al. Auditory speech detection in noise enhanced by lipreading. Speech Commun. 44 (2004) 5-18
56. Schwartz J.-L., et al. Seeing to hear better: evidence for early audio-visual interactions in speech identification. Cognition 93 (2004) B69-B78
57. Morrell F. Visual system's view of acoustic space. Nature 238 (1972) 44-46
58. Poremba A., et al. Functional mapping of the primate auditory system. Science 299 (2003) 568-572
59. Pribram K.H., et al. Electrical responses to acoustic clicks in monkey: extent of neocortex activated. J. Neurophysiol. 17 (1954) 336-344
60. Gibson J.R., and Maunsell J.H.R. Sensory modality specificity of neural activity related to memory in visual cortex. J. Neurophysiol. 78 (1997) 1263-1275
61. von Kriegstein K., et al. Interaction of face and voice areas during speaker recognition. J. Cogn. Neurosci. 17 (2005) 367-376
62. Sathian K., and Zangaladze A. Feeling with the mind's eye: contribution of visual cortex to tactile perception. Behav. Brain Res. 135 (2002) 127-132
63. Amedi A., et al. Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 4 (2001) 324-330
64. James T.W., et al. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 40 (2002) 1706-1714
65. Pietrini P., et al. Beyond sensory images: Object-based representation in the human ventral pathway. Proc. Natl. Acad. Sci. U. S. A. 101 (2004) 5658-5663
66. Blake R., et al. Neural synergy between kinetic vision and touch. Psychol. Sci. 15 (2004) 397-402
67. Hagen M.C., et al. Tactile motion activates the human middle temporal/V5 (MT/VT) complex. Eur. J. Neurosci. 16 (2002) 957-964
68. Zhou Y.D., and Fuster J.M. Somatosensory cell responses to an auditory cue in a haptic memory task. Behav. Brain Res. 153 (2004) 573-578
69. Zhou Y.D., and Fuster J.M. Visuo-tactile cross-modal associations in cortical somatosensory cells. Proc. Natl. Acad. Sci. U. S. A. 97 (2000) 9777-9782
70. Lewkowicz D.J., and Ghazanfar A.A. The decline of cross-species intermodal perception in human infants. Proc. Natl. Acad. Sci. U. S. A. 103 (2006) 6771-6774
71. Stein B.E. Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp. Brain Res. 123 (1998) 124-135
72. Jiang W., et al. Two cortical areas mediate multisensory integration in superior colliculus neurons. J. Neurophysiol. 85 (2001) 506-522
73. Bell A.H., et al. Engagement of visual fixation suppresses sensory responsiveness and multisensory integration in the primate superior colliculus. Eur. J. Neurosci. 18 (2003) 2867-2873
74. Frens M.A., and Van Opstal A.J. Visual-auditory interactions modulate saccade-related activity in monkey superior colliculus. Brain Res. Bull. 46 (1998) 211-224
75. Nishijo H., et al. Topographic distribution of modality-specific amygdalar neurons in alert monkey. J. Neurosci. 8 (1988) 3556-3569
76. Komura Y., et al. Auditory thalamus integrates visual inputs into behavioral gains. Nat. Neurosci. 8 (2005) 1203-1209
77. Wallace M.T., et al. A revised view of sensory cortical parcellation. Proc. Natl. Acad. Sci. U. S. A. 101 (2004) 2167-2172
78. Menzel, R.R. and Barth, D.S. Multisensory and secondary somatosensory cortex in the rat. Cereb. Cortex (in press)
79. Brett-Green B., et al. A multisensory zone in rat parietotemporal cortex: intra- and extracellular physiology and thalamocortical connections. J. Comp. Neurol. 460 (2003) 223-237
80. Beauchamp M.S., et al. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 7 (2004) 1190-1192