Subcortical, modality-specific pathways contribute to multisensory processing in humans

Cerebral Cortex

Volumn 24, Issue 8, 2014, Pages 2169-2177

  Van Den Brink, R L ^a   Cohen, M X ^a   Van Der Burg, E ^b   Talsma, D ^c   Vissers, M E ^a   Slagter, H A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF SYDNEY   (Australia)

^c GHENT UNIVERSITY   (Belgium)

Author keywords

Brain; Diffusion tensor imaging; Multisensory; Multisensory integration; Structural connectivity

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL INTEGRATION TASK; AUDITORY INFORMATION; AUDITORY NERVOUS SYSTEM; AUDITORY SYSTEM PARAMETERS; AUDITORY THALAMUS; BEHAVIOR; BRAIN CORTEX; BRAIN REGION; CLINICAL ARTICLE; COCHLEAR NUCLEUS; DIFFUSION TENSOR IMAGING; ECHO PLANAR IMAGING; EYE MOVEMENT; FEMALE; GRAY MATTER; HUMAN; MALE; MULTISENSORY PROCESSING; NEUROANATOMY; NEUROLOGIC EXAMINATION; NUCLEAR MAGNETIC RESONANCE SCANNER; PARIETAL OPERCULUM; PERCEPTION; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; SENSORY SYSTEM; SENSORY SYSTEM PARAMETERS; THALAMUS; VISUAL AREA V4; VISUAL INFORMATION; VISUAL STIMULATION; WHITE MATTER; ANATOMY AND HISTOLOGY; AUDITORY STIMULATION; BRAIN; ELECTROOCULOGRAPHY; HEARING; NERVE TRACT; NEUROPSYCHOLOGICAL TEST; PHOTOSTIMULATION; PHYSIOLOGY; VISION; YOUNG ADULT;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; BRAIN; DIFFUSION TENSOR IMAGING; ELECTROOCULOGRAPHY; EYE MOVEMENTS; FEMALE; HUMANS; MALE; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; VISUAL PERCEPTION; WHITE MATTER; YOUNG ADULT;

EID: 84904343790     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bht069     Document Type: Article

References (53)

1. Anderson LA, Malmierca MS, Wallace MN, Palmer AR. 2006. Evidence for a direct, short latency projection from the dorsal cochlear nucleus to the auditory thalamus in the guinea pig. Eur J Neurosci. 24:491-498.
2. Baier B, Kleinschmidt A, Muller NG. 2006. Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information. J Neurosci. 26:12260-12265.
3. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A. 2004. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci. 7:1190-1192.
4. Beckmann CF, Jenkinson M, Smith SM. 2003. General multilevel linear modeling for group analysis in FMRI. Neuroimage. 20:1052-1063.
5. Behrens TEJ, Berg HJ, Jbabdi S, Rushworth MFS, Woolrich MW. 2007. Probabilistic diffusion tractography with multiple fibre orientations: what can we gain? Neuroimage. 34:144-155.
6. Benevento LL, Fallon JH. 1975. The Ascending projections of the Superior Colliculus in the Rhesus monkey (macaca mulatta). J Comp Neurol. 160.
7. Busse L, Roberts KC, Crist RE, Weissman DH, Woldorff MG. 2005. The spread of attention across modalities and space in a multisensory object. Proc Natl Acad Sci U S A. 102:18751-18756.
8. Cappe C, Rouiller EM, Barone P. 2009. Multisensory anatomical pathways. Hear Res. 258:28-36.
9. Cohen MX. 2011. Hippocampal-prefrontal connectivity predicts midfrontal oscillations and long-term memory performance. Curr Biol. 21:1900-1905.
10. Cohen MX, Elger CE, Weber B. 2008. Amygdala tractography predicts functional connectivity and learning during feedback-guided decision-making. Neuroimage. 39:1396-1407.
11. Cohen MX, Schoene-Bake JC, Elger CE, Weber B. 2009. Connectivitybased segregation of the human striatum predicts personality characteristics. Nat Neurosci. 12:32-34.
12. Delorme A, Makeig S. 2004. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 134:9-21.
13. Devlin JT, Sillery EL, Hall DA, Hobden P, Behrens TEJ, Nunes RG, Clare S, Matthews PM, Moore DR, Johansen-Berg H. 2006. Reliable identification of the auditory thalamus using multi-modal structural analyses. Neuroimage. 30:1112-1120.
14. de Wit S, Watson P, Harsay HA, Cohen MX, van de Vijver I, Ridderinkhof KR. 2012. Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J Neurosci. 32:12066-12075.
15. Driver J, Noesselt T. 2008. Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron. 57:11-23.
16. Fairhall SL, Macaluso E. 2009. Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. Eur J Neurosci. 29:1247-1257.
17. Fort A, Delpuech C, Pernier J, Giard MH. 2002. Dynamics of corticosubcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex. 12:1031-1039.
18. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK. 2005. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci. 25:5004-5012.
19. Ghazanfar AA, Schroeder CE. 2006. Is neocortex essentially multisensory? Trends Cogn Sci. 10:278-285.
20. Giard MH, Péronnet F. 1999. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci. 11:473-490.
21. Itaya SK, Van Hoesen GW. 1982. Retinal innervation of the inferior colliculus in rat and monkey. Brain Res. 233:45-52.
22. Jenkinson M, Bannister P, Brady M, Smith S. 2002. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage. 17:825-841.
23. Johansen-Berg H, Rushworth MF. 2009. Using diffusion imaging to study human connectional anatomy. Annu Rev Neurosci. 32:75-94.
24. Jones EG. 2007. The Thalamus. Cambridge (MA): Cambrigde University Press.
25. Kayser C, Logothetis NK. 2007. Do early sensory cortices integrate cross-modal information? Brain Struct Funct. 212:121-132.
26. Kayser C, Petkov CI, Logothetis NK. 2008. Visual modulation of neurons in auditory cortex. Cereb Cortex. 18:1560-1574.
27. Komura Y, Tamura R, Uwano T, Nishijo H, Ono T. 2005. Auditory thalamus integrates visual inputs into behavioral gains. Nat Neurosci. 8:1203-1209.
28. Lakatos P, Chen C-M, O'Connell MN, Mills A, Schroeder CE. 2007. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron. 53:279-292.
29. Linke R. 1999. Differential projection patterns of superior and inferior colliculus neurons onto posterior paralaminar nuclei of the thalamus surrounding the medial geniculate body in the rat. Eur J Neurosci. 11:187-203.
30. Macaluso E. 2006. Multisensory processing in sensory-specific cortical areas. Neuroscientist. 12:327-338.
31. Malmierca MS, Merchán MA, Henkel CK, Oliver DL. 2002. Direct projections from cochlear nuclear complex to auditory thalamus in the rat. J Neurosci. 22:10891-10897.
32. Martuzzi R, Murray MM, Michel CM, Thiran JP, Maeder PP, Clarke S, Meuli RA. 2006. Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb Cortex. 17:1672-1679.
33. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ. 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res. 14:115-128.
34. Mori S, Zhang J. 2006. Principles of diffusion tensor imaging and its applications to basic neuroscience research. Neuron. 51:527-539.
35. Musacchia G, Sams M, Nicol T, Kraus N. 2006. Seeing speech affects acoustic information processing in the human brainstem. Exp Brain Res. 168:1-10.
36. Naue N, Rach S, Struber D, Huster RJ, Zaehle T, Korner U, Herrmann CS. 2011. Auditory event-related response in visual cortex modulates subsequent visual responses in humans. J Neurosci. 31:7729-7736.
37. Nichols TE, Holmes AP. 2002. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum Brain Mapp. 15:1-25.
38. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, Heinze HJ, Driver J. 2007. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. J Neurosci. 27:11431-11441.
39. Noesselt T, Tyll S, Boehler CN, Budinger E, Heinze HJ, Driver J. 2010. Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. J Neurosci. 30:13609-13623.
40. Schroeder CE, Foxe J. 2005. Multisensory contributions to low-level, "unisensory" processing. Curr Opin Neurobiol. 15:454-458.
41. Schroeder CE, Foxe JJ. 2002. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cogn Brain Res. 14:187-198.
42. Seehaus AK, Roebroeck A, Chiry O, Kim DS, Ronen I, Bratzke H, Goebel R, Galuske RAW. 2013. Histological validation of DW-MRI tractography in human postmortem tissue. Cereb Cortex. 23 (2):442-450.
43. Smith SM. 2002. Fast robust automated brain extraction. Hum Brain Mapp. 17:143-155.
44. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TEJ, Johansen-Berg H, Bannister PR, De Luca M, Drobnjak I, Flitney DE et al. 2004. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage. 23:S208-S219.
45. Stein BE, Stanford TR. 2008. Multisensory integration: Current issues from the perspective of the single neuron. Nat Rev Neurosci. 9:255-266.
46. Thorne JD, De Vos M, Viola FC, Debener S. 2011. Cross-modal phase reset predicts auditory task performance in humans. J Neurosci. 31:3853-3861.
47. Tomasi D, Chang L, Caparelli EC, Ernst T. 2008. Sex differences in sensory gating of the thalamus during auditory interference of visual attention tasks. Neuroscience. 151:1006-1015.
48. van Atteveldt NM, Blau VC, Blomert L, Goebel R. 2010. fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex. BMC Neurosci. 11:1-11.
49. van der Burg E, Olivers CNL, Bronkhorst AW, Theeuwes J. 2008a. Audiovisual events capture attention: evidence from temporal order judgments. J Vis. 8(5):1-10.
50. van der Burg E, Olivers CNL, Bronkhorst AW, Theeuwes J. 2008b. Pip and pop: nonspatial auditory signals improve spatial visual search. J Exp Psychol Hum Percept Perform. 34:1053-1065.
51. van der Burg E, Talsma D, Olivers CNL, Hickey C, Theeuwes J. 2011. Early multisensory interactions affect the competition among multiple visual objects. Neuroimage. 55:1208-1218.
52. Wolfe JM, Horowitz TS. 2004. What attributes guide the deployment of visual attention and how do they do it? Nat Rev Neurosci. 5:1-7.
53. Woolrich MW, Ripley BD, Brady M, Smith SM. 2001. Temporal autocorrelation in univariate linear modeling of fMRI data. Neuroimage. 14:1370-1386.