Multisensory contributions to low-level, 'unisensory' processing

Current Opinion in Neurobiology

Volumn 15, Issue 4, 2005, Pages 454-458

  Schroeder, Charles E ^a   Foxe, John ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY CORTEX; BRAIN CORTEX; BRAIN FUNCTION; BRAIN REGION; EVOKED SOMATOSENSORY RESPONSE; EVOKED VISUAL RESPONSE; FEEDBACK SYSTEM; HUMAN; NERVOUS SYSTEM FUNCTION; NEUROANATOMY; NEUROPHYSIOLOGY; NONHUMAN; PERCEPTION; PRIMATE; PRIORITY JOURNAL; REVIEW; SENSORY SYSTEM; SIGNAL TRANSDUCTION; SOMATOSENSORY SYSTEM;

ANIMALS; AUDITORY PATHWAYS; AUDITORY PERCEPTION; HUMANS; SOMATOSENSORY CORTEX;

EID: 23044480166     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2005.06.008     Document Type: Review

References (58)

1. S. Levanen, V. Jousmaki, and R. Hari Vibration-induced auditory cortex activation in a congenitally deaf adult Curr Biol 8 1998 869 872
2. G. Calvert, M. Brammer, E. Bullmore, R. Campbell, L. Iverson, and A. David Response amplification in sensory-specific cortices during crossmodal binding Neuroreport 10 1999 2619 2623
3. M. Giard, and F. Peronet Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J Cogn Neurosci 11 1999 473 490
4. C.E. Schroeder, R.W. Lindsley, C. Specht, A. Marcovici, J.F. Smiley, and D.C. Javitt Somatosensory input to auditory association cortex in the macaque monkey J Neurophysiol 85 2001 1322 1327
5. C.E. Schroeder, and J.J. Foxe The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex Brain Res Cogn Brain Res 14 2002 187 198
6. J.J. Foxe, G.R. Wylie, A. Martinez, C.E. Schroeder, D.C. Javitt, D. Guilfoyle, W. Ritter, and M.M. Murray Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study J Neurophysiol 88 2002 540 543
7. S. Molholm, W. Ritter, M.M. Murray, D.C. Javitt, C.E. Schroeder, and J.J. Foxe Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Brain Res Cogn Brain Res 14 2002 115 128
8. K. Fu, T. Johnston, A. Shah, L. Arnold, J. Smiley, T. Hackett, P. Garraghty, and C. Schroeder Auditory cortical neurons respond to somatosensory input J Neurosci 23 2003 7510 7515
9. C.E. Schroeder, and J.J. Foxe Multisensory convergence in early cortical processing G.A. Calvert The Handbook of Multisensory Processes 2004 MIT Press 295 309
10. C.E. Schroeder, S. Molholm, P. Lakatos, W. Ritter, and J.J. Foxe Human-simian correspondence in the early cortical processing of multisensory cues Cognitive Processing 5 2004 140 151
11. J. Pekkola, V. OJanen, T. Autti, I.P. Jaaskelainen, A. Tarkiainen, and M. Sams Primary auditory cortex driven by visual speech: an fMRI study at 3T Neuroreport 16 2005 125 128 Although it could be argued that the results of Levanen et al. [1] reflect adaptive re-wiring of auditory cortex during development, this argument would not apply to any of the ERP or fMRI studies conducted in normal humans.
12. M. Meredith On the neuronal basis for multisensory convergence: a brief overview Brain Res Cogn Brain Res 14 2002 31 40
13. M. Meredith Cortico-cortical connectivity and the architecture of cross-modal circuits C. Spence Handbook of Multisensory Processes 2004 MIT Press 343 357
14. Bizley J, Nodal F, Nelken I, King A: Investigating auditory-visual interactions in ferret auditory cortex [abstract]. 28th Midwinter research meeting Association for Research in Otolaryngology 2005: 351.
15. A. Falchier, S. Clavagnier, P. Barone, and H. Kennedy Anatomical evidence of multimodal integration in primate striate cortex J Neurosci 22 2002 5749 5759
16. Rockland KS, Ojima K: Calcarine area V1 as a multimodal convergence area [abstract]. Soc Neurosci 2001, 27: Program no. 511.520.
17. U. Werner-Reiss, K.A. Kelly, A.S. Trause, A.M. Underhill, and J.M. Groh Eye position affects activity in primary auditory cortex of primates Curr Biol 13 2003 554 562
18. K.M. Fu, A.S. Shah, M.N. O'Connell, T. McGinnis, H. Eckholdt, J. Smiley, and C.E. Schroeder Timing and laminar profile of eye position effects on auditory responses in primate auditory cortex J Neurophysiol 92 2004 3522 3531
19. C.E. Schroeder Defining the neural bases of visual selective attention: conceptual and empirical issues Int J Neurosci 80 1995 65 78
20. J.J. Foxe, and C.E. Schroeder The case for a feedforward component in multisensory integration mechanisms Neuroreport 16 2005 419 423
21. J.J. Foxe, I.A. Morocz, M.M. Murray, B.A. Higgins, D.C. Javitt, and C.E. Schroeder Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping Brain Res Cogn Brain Res 10 2000 77 83
22. M.M. Murray, S. Molholm, C.M. Michel, W. Ritter, D.J. Heslenfeld, C.E. Schroeder, D.C. Javitt, and J.J. Foxe Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment Cereb Cortex 15 2004 963 974
23. B. Lutkenhoner, C. Lammertmann, C. Simoes, and R. Hari Magnetoencephalographic correlates of audiotactile interaction Neuroimage 15 2002 509 522
24. R. Gobbele, M. Schurmann, N. Forss, K. Juottonen, H. Buchner, and R. Hari Activation of the human posterior parietal and temperopariatal cortices during audiotactile interaction Neuroimage 20 2003 503 511
25. G.A. Calvert, E.T. Bullmore, M.J. Brammer, R. Campbell, S.C. Williams, P.K. McGuire, P.W. Woodruff, S.D. Iversen, and A.S. David Activation of auditory cortex during silent lipreading Science 276 1997 593 596
26. A.A. Ghazanfar, J.X. Maier, K.L. Hoffman, and N.K. Logothetis Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex J Neurosci 25 2005 504 512
27. C.E. Schroeder, J.F. Smiley, K-G. Fu, T. McGinnis, M.N. O'Connell, and T.A. Hackett Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing Int J Psychophysiol 50 2003 5 17 (Special Issue on Multisensory Integration)
28. L. Leinonen, J. Hyvarinen, and A.R. Sovijarvi Functional properties of neurons in the temperopariatal association area of the awake monkey Exp Brain Res 39 1980 203 215
29. C.J. Robinson, and H. Burton Organization of somatosensory fields in areas 7b, retroinsula, postauditory, and granular insula of M. fascicularis J Comp Neurol 192 1980 69 92
30. L. Krubitzer, J. Clarey, R. Tweedale, G. Elston, and M. Calford A re-definition of somatosensory areas in the lateral sulcus of macaque monkeys J Neurosci 15 1995 3821 3839
31. C.J. Robinson, and H. Burton Somatic submodality distribution within the second somatosensory (SII), 7b, retroinsular, postauditory, and granular insular cortical areas of M. fascicularis J Comp Neurol 192 1980 93 108
32. C.E. Schroeder, S. Seto, J.C. Arezzo, and P.E. Garraghty Electrophysiological evidence for overlapping dominant and latent inputs to somatosensory cortex in squirrel monkeys J Neurophysiol 74 1995 722 732
33. H. Burton, and R. Sinclair Somatosensory cortex and tactile perceptions L. Kruger E.C. Carterette M.P. Friedman Pain and Touch 1996 Academic Press 105 169
34. J.W. Lewis, and D.C. Van Essen Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey J Comp Neurol 428 2000 112 137
35. T.A. Hackett, I. Stepniewska, and J.H. Kaas Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys J Comp Neurol 394 1998 475 495
36. L.M. Romanski, J.F. Bates, and P.S. Goldman-Rakic Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkeys J Comp Neurol 403 1999 141 157
37. D.N. Pandya, M. Hallett, and S.K. Kmukherjee Intra- and interhemispheric connections of the neocortical auditory system in the rhesus monkey Brain Res 14 1969 49 65
38. L.M. Romanski, B. Tian, J. Fritz, M. Mishkin, P.S. Goldman-Rakic, and J.P. Rauschecker Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex Nat Neurosci 2 1999 1131 1136
39. Falchier A, Renaud L, Barone H, Kennedy H: Extensive projections from primary auditory cortex and area STP to peripheral V1 in the macaque. Soc Neurosci (Abstract) 2001, 27: Program no. 511.521.
40. K.S. Rockland, and D.N. Pandya Laminar origins and terminations of cortical connections in the occipital lobe in the rhesus monkey Brain Res 179 1979 3 20
41. E. Jones Viewpoint: The core and matrix of thalamic organization Neuroscience 85 1998 331 345
42. E.G. Jones The thalamic matrix and thalamocortical synchrony Trends Neurosci 24 2001 595 601
43. R. Linke, and H. Schwegler Convergent and complementary projections of the caudal paralaminar thalamic nuclei to rat temporal and insular cortex Cereb Cortex 10 2000 753 771
44. J.P. Rauschecker Parallel processing in the auditory cortex of primates Audiol Neurootol 3 1998 86 103
45. G.H. Recanzone, D.C. Guard, M.L. Phan, and T.K. Su Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey J Neurophysiol 83 2000 2723 2739
46. V. Lamme, K. Zipser, and H. Spekreisje Figure - ground activity in primary visual cortex is suppressed by anesthesia Proc Natl Acad Sci USA 95 1998 3263 3268
47. C.E. Schroeder, A.D. Mehta, and J.J. Foxe Determinants and mechanisms of attentional modulation of neural processing Front Biosci 6 2001 D672 D684
48. B.E. Stein, and M.A. Meredith The merging of the senses 1993 MIT Press Boston
49. Lakatos P, Shah AS, Knuth KH, Karmos G, Schroeder CE: An oscillatory hierarchy controlling cortical excitability and stimulus integration in auditory cortex. J Neurophysiol in press. The authors identify three reasons why the organized structure of ambient activity in cortex might correspond to an 'auditory response amplifier'. First, ongoing oscillatory activity across all of the prominent electroencephalographic (EEG) bands in auditory cortex (i.e. delta, theta and gamma) has organized hierarchical structure, with the gamma amplitude controlled by theta phase, and theta amplitude controlled by delta phase. Second, this 'oscillatory hierarchy' determines momentary neuronal excitability in the local neuronal ensemble; thus relative enhancement or depression of the cortical response to an unpredictable (random phase) stimulus depends on the phase of the local oscillation during which the stimulus arrives in auditory cortex. Third, delta oscillation phase and frequency (and thus theta phase and in turn, gamma phase) are reset by the onset of a sustained rhythmic auditory input.
50. Lakatos P, O'Connell MN, Mills A, Rajkai C, Karmos G, Schroeder CE: Role of oscillations in multisensory enhancement of auditory processing. Soc Neurosci Abs, 2005, in press.
51. D.J. Felleman, and D.C. Van Essen Distributed hierarchical processing in the primate cerebral cortex Cereb Cortex 1 1991 1 47
52. J.P. Rauschecker, B. Tian, and M. Hauser Processing of complex sounds in the macaque nonprimary auditory cortex Science 268 1995 111 114
53. V. Lamme The neurophysiology of figure-ground segregation in primary visual cortex J Neurosci 15 1995 1605 1615
54. A. Martinez, L. Anllo-Vento, M.I. Sereno, L.R. Frank, R.B. Buxton, D.J. Dubowitz, E.C. Wong, H. Hinrichs, H.J. Heinze, and S.A. Hillyard Involvement of striate and extrastriate visual cortical areas in spatial attention Nat Neurosci 2 1999 364 369
55. A. Martinez, F. DiRusso, L. Anllo-Vento, M. Sereno, R. Buxton, and S. Hillyard Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas Vision Res 41 2001 1437 1457
56. A.D. Mehta, I. Ulbert, and C.E. Schroeder Intermodal selective attention in monkeys I: Distribution and timing of effects across visual areas Cereb Cortex 10 2000 343 358
57. A.D. Mehta, and C.E. Schroeder Intermodal selective attention in monkeys II: Physiologic mechanisms of modulation Cereb Cortex 10 2000 359 370
58. J. Fiser, C. Chiu, and M. Weliky Small modulation of ongoing cortical dynamics by sensory input during natural vision Nature 431 2004 573 578