Dissecting neural circuits for multisensory integration and crossmodal processing

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 370, Issue 1677, 2015, Pages

  Yau, Jeffrey M ^a   DeAngelis, Gregory C ^b   Angelaki, Dora E ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Causal; Interactions; Microstimulation; Modulation; Network; Perception

Indexed keywords

BEHAVIOR; BIOTECHNOLOGY; BRAIN; DRUG; NERVOUS SYSTEM; SENSORY SYSTEM;

ANATOMY AND HISTOLOGY; ANIMAL; BIOLOGICAL MODEL; BRAIN; HUMAN; NERVE CELL NETWORK; NEUROIMAGING; PERCEPTION; PHYSIOLOGY; SENSATION; SOMATOSENSORY CORTEX; SYSTEM ANALYSIS; SYSTEMS THEORY;

ANIMALS; BRAIN; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEUROIMAGING; PERCEPTION; SENSATION; SOMATOSENSORY CORTEX; SYSTEMS INTEGRATION; SYSTEMS THEORY;

EID: 84938535534     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2014.0203     Document Type: Review

References (144)

1. Britten KH, Newsome WT, Shadlen MN, Celebrini S, Movshon JA. 1996 A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis. Neurosci. 13, 87–100. (doi:10.1017/S095252380000715X)
2. Nienborg H, Cumming BG. 2014 Decision-related activity in sensory neurons may depend on the columnar architecture of cerebral cortex. J. Neurosci. 34, 3579–3585. (doi:10.1523/JNEUROSCI.2340-13.2014)
3. Hallett M. 2007 Transcranial magnetic stimulation: a primer. Neuron 55, 187–199. (doi:10.1016/j.neuron.2007.06.026)
4. Nitsche MA. et al. 2008 Transcranial direct current stimulation: state of the art 2008. Brain Stimul. 1, 206–223. (doi:10.1016/j.brs.2008.06.004)
5. Bolognini N, Maravita A. 2011 Uncovering multisensory processing through non-invasive brain stimulation. Front. Psychol. 2, 46. (doi:10.3389/fpsyg.2011.00046)
6. Walsh V, Cowey A. 2000 Transcranial magnetic stimulation and cognitive neuroscience. Nat. Rev. Neurosci. 1, 73–79. (doi:10.1038/35036239)
7. Priori A. 2003 Brain polarization in humans: a reappraisal of an old tool for prolonged noninvasive modulation of brain excitability. Clin. Neurophysiol. 114, 589–595. (doi:10.1016/S1388-2457(02)00437-6)
8. Bolognini N, Olgiati E, Rossetti A, Maravita A. 2010 Enhancing multisensory spatial orienting by brain polarization of the parietal cortex. Eur. J. Neurosci. 31, 1800–1806. (doi:10.1111/j.1460-9568.2010.07211.x)
9. Chambers CD, Payne JM, Mattingley JB. 2007 Parietal disruption impairs reflexive spatial attention within and between sensory modalities. Neuropsychologia 45, 1715–1724. (doi:10.1016/j.neuropsychologia.2007.01.001)
10. Kamke MR, Vieth HE, Cottrell D, Mattingley JB. 2012 Parietal disruption alters audiovisual binding in the sound-induced flash illusion. Neuroimage 62, 1334–1341. (doi:10.1016/j.neuroimage.2012.05.063)
11. Chambers CD, Stokes MG, Mattingley JB. 2004 Modality-specific control of strategic spatial attention in parietal cortex. Neuron 44, 925–930. (doi:10.1016/j.neuron.2004.12.009)
12. Bolognini N, Fregni F, Casati C, Olgiati E, Vallar G. 2010 Brain polarization of parietal cortex augments training-induced improvement of visual exploratory and attentional skills. Brain Res. 1349, 76–89. (doi:10.1016/j.brainres.2010.06.053)
13. Bolognini N, Maravita A. 2007 Proprioceptive alignment of visual and somatosensory maps in the posterior parietal cortex. Curr. Biol. 17, 1890–1895. (doi:10.1016/j.cub.2007.09.057)
14. Merabet LB, Theoret H, Pascual-Leone A. 2003 Transcranial magnetic stimulation as an investigative tool in the study of visual function. Optom. Vis. Sci. 80, 356–368. (doi:10.1097/00006324-200305000-00010)
15. Azanon E, Longo MR, Soto-Faraco S, Haggard P. 2010 The posterior parietal cortex remaps touch into external space. Curr. Biol. 20, 1304–1309. (doi:10.1016/j.cub.2010.05.063)
16. Ghazanfar AA, Schroeder CE. 2006 Is neocortex essentially multisensory? Trends Cogn. Sci. 10, 278–285. (doi:10.1016/j.tics.2006.04.008)
17. Kaas JH, Gharbawie OA, Stepniewska I. 2011 The organization and evolution of dorsal stream multisensory motor pathways in primates. Front. Neuroanat. 5, 34. (doi:10.3389/fnana.2011.00034)
18. Sereno MI, Huang RS. 2014 Multisensory maps in parietal cortex. Curr. Opin. Neurobiol. 24, 39–46. (doi:10.1016/j.conb.2013.08.014)
19. Macaluso E, Driver J. 2005 Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci. 28, 264–271. (doi:10.1016/j.tins.2005.03.008)
20. Pasalar S, Ro T, Beauchamp MS. 2010 TMS of posterior parietal cortex disrupts visual tactile multisensory integration. Eur. J. Neurosci. 31, 1783–1790. (doi:10.1111/j.1460-9568.2010.07193.x)
21. Fiorio M, Haggard P. 2005 Viewing the body prepares the brain for touch: effects of TMS over somatosensory cortex. Eur. J. Neurosci. 22, 773–777. (doi:10.1111/j.1460-9568.2005.04267.x)
22. Konen CS, Haggard P. 2014 Multisensory parietal cortex contributes to visual enhancement of touch in humans: a single-pulse TMS study. Cereb. Cortex 24, 501–507. (doi:10.1093/cercor/bhs331)
23. Ro T, Wallace R, Hagedorn J, Farne A, Pienkos E. 2004 Visual enhancing of tactile perception in the posterior parietal cortex. J. Cogn. Neurosci. 16, 24–30. (doi:10.1162/089892904322755520)
24. Serino A, Canzoneri E, Avenanti A. 2011 Frontoparietal areas necessary for a multisensory representation of peripersonal space in humans: an rTMS study. J. Cogn. Neurosci. 23, 2956–2967. (doi:10.1162/jocn_a_00006)
25. McGurk H, MacDonald J. 1976 Hearing lips and seeing voices. Nature 264, 746–748. (doi:10.1038/264746a0)
26. Beauchamp MS. 2005 See me, hear me, touch me: multisensory integration in lateral occipitaltemporal cortex. Curr. Opin. Neurobiol. 15, 145–153. (doi:10.1016/j.conb.2005.03.011)
27. Perrodin C, Kayser C, Logothetis NK, Petkov CI. 2014 Auditory and visual modulation of temporal lobe neurons in voice-sensitive and association cortices. J. Neurosci. 34, 2524–2537. (doi:10.1523/JNEUROSCI.2805-13.2014)
28. Beauchamp MS, Nath AR, Pasalar S. 2010 fMRIGuided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J. Neurosci. 30, 2414–2417. (doi:10.1523/JNEUROSCI.4865-09.2010)
29. Marques LM, Lapenta OM, Merabet LB, Bolognini N, Boggio PS. 2014 Tuning and disrupting the brainmodulating the McGurk illusion with electrical stimulation. Front. Hum. Neurosci. 8, 533. (doi:10.3389/fnhum.2014.00533)
30. Jones JA, Callan DE. 2003 Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. Neuroreport 14, 1129–1133. (doi:10.1097/00001756-200306110-00006)
31. Kilian-Hutten N, Vroomen J, Formisano E. 2011 Brain activation during audiovisual exposure anticipates future perception of ambiguous speech. Neuroimage 57, 1601–1607. (doi:10.1016/j.neuroimage.2011.05.043)
32. Bolognini N, Rossetti A, Casati C, Mancini F, Vallar G. 2011 Neuromodulation of multisensory perception: a tDCS study of the sound-induced flash illusion. Neuropsychologia 49, 231–237. (doi:10.1016/j.neuropsychologia.2010.11.015)
33. Shams L, Kamitani Y, Shimojo S. 2000 Illusions. What you see is what you hear. Nature 408, 788. (doi:10.1038/35048669)
34. Watkins S, Shams L, Josephs O, Rees G. 2007 Activity in human V1 follows multisensory perception. Neuroimage 37, 572–578. (doi:10.1016/j.neuroimage.2007.05.027)
35. Watkins S, Shams L, Tanaka S, Haynes JD, Rees G. 2006 Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31, 1247–1256. (doi:10.1016/j.neuroimage.2006.01.016)
36. Driver J, Noesselt T. 2008 Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57, 11–23. (doi:10.1016/j.neuron.2007.12.013)
37. Connor CE, Brincat SL, Pasupathy A. 2007 Transformation of shape information in the ventral pathway. Curr. Opin. Neurobiol. 17, 140–147. (doi:10.1016/j.conb.2007.03.002)
38. Kourtzi Z, Connor CE. 2011 Neural representations for object perception: structure, category, and adaptive coding. Annu. Rev. Neurosci. 34, 45–67. (doi:10.1146/annurev-neuro-060909-153218)
39. Amedi A, Malach R, Hendler T, Peled S, Zohary E. 2001 Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 4, 324–330. (doi:10.1038/85201)
40. James TW, Humphrey GK, Gati JS, Servos P, Menon RS, Goodale MA. 2002 Haptic study of threedimensional objects activates extrastriate visual areas. Neuropsychologia 40, 1706–1714. (doi:10.1016/S0028-3932(02)00017-9)
41. Haenny PE, Maunsell JH, Schiller PH. 1988 State dependent activity in monkey visual cortex II. Retinal and extraretinal factors in V4. Exp. Brain Res. 69, 245–259. (doi:10.1007/BF00247570)
42. Merabet LB, Hamilton R, Schlaug G, Swisher JD, Kiriakopoulos ET, Pitskel NB, Kauffman T, Pascual- Leone A. 2008 Rapid and reversible recruitment of early visual cortex for touch. PLoS ONE 3, e3046. (doi:10.1371/journal.pone.0003046)
43. Pascual-Leone A, Hamilton R. 2001 The metamodal organization of the brain. Prog. Brain Res. 134, 427–445.
44. Merabet L, Thut G, Murray B, Andrews J, Hsiao S, Pascual-Leone A. 2004 Feeling by sight or seeing by touch? Neuron 42, 173–179. (doi:10.1016/S0896-6273(04)00147-3)
45. Yau JM, Celnik P, Hsiao SS, Desmond JE. 2014 Feeling better: separate pathways for targeted enhancement of spatial and temporal touch. Psychol. Sci. 25, 555–565. (doi:10.1177/0956797613511467)
46. Antal A, Nitsche MA, Paulus W. 2001 External modulation of visual perception in humans. Neuroreport 12, 3553–3555. (doi:10.1097/00001756-200111160-00036)
47. Zangaladze A, Epstein CM, Grafton ST, Sathian K. 1999 Involvement of visual cortex in tactile discrimination of orientation. Nature 401, 587–590. (doi:10.1038/44139)
48. Lacey S, Tal N, Amedi A, Sathian K. 2009 A putative model of multisensory object representation. Brain Topogr. 21, 269–274. (doi:10.1007/s10548-009-0087-4)
49. Mancini F, Bolognini N, Bricolo E, Vallar G. 2011 Cross-modal processing in the occipito-temporal cortex: a TMS study of the Muller-Lyer illusion. J. Cogn. Neurosci. 23, 1987–1997. (doi:10.1162/jocn.2010.21561)
50. Blake R, Sobel KV, James TW. 2004 Neural synergy between kinetic vision and touch. Psychol. Sci. 15, 397–402. (doi:10.1111/j.0956-7976.2004.00691.x)
51. van Kemenade BM, Seymour K, Wacker E, Spitzer B, Blankenburg F, Sterzer P. 2014 Tactile and visual motion direction processing in hMTþ/V5. Neuroimage 84, 420–427. (doi:10.1016/j.neuroimage.2013.09.004)
52. Wacker E, Spitzer B, Lutzkendorf R, Bernarding J, Blankenburg F. 2011 Tactile motion and pattern processing assessed with high-field fMRI. PLoS ONE 6, e24860. (doi:10.1371/journal.pone.0024860)
53. Basso D, Pavan A, Ricciardi E, Fagioli S, Vecchi T, Miniussi C, Pietrini P. 2012 Touching motion: rTMS on the human middle temporal complex interferes with tactile speed perception. Brain Topogr. 25, 389–398. (doi:10.1007/s10548-012-0223-4)
54. Kayser C, Petkov CI, Augath M, Logothetis NK. 2005 Integration of touch and sound in auditory cortex. Neuron 48, 373–384. (doi:10.1016/j.neuron.2005.09.018)
55. Fu KM, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garrahty PE, Shroeder CE. 2003 Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23, 7510–7515.
56. Butler JS, Foxe JJ, Fiebelkorn IC, Mercier MR, Molholm S. 2012 Multisensory representation of frequency across audition and touch: high density electrical mapping reveals early sensory-perceptual coupling. J. Neurosci. 32, 15 338–15 344. (doi:10.1523/JNEUROSCI.1796-12.2012)
57. Renier LA, Anurova I, De Volder AG, Carlson S, VanMeter J, Rauschecker JP. 2009 Multisensory integration of sounds and vibrotactile stimuli in processing streams for ‘what’ and ‘where’. J. Neurosci. 29, 10 950–10 960. (doi:10.1523/JNEUROSCI.0910-09.2009)
58. Nordmark PF, Pruszynski JA, Johansson RS. 2012 BOLD responses to tactile stimuli in visual and auditory cortex depend on the frequency content of stimulation. J. Cogn. Neurosci. 24, 2120–2134. (doi:10.1162/jocn_a_00261)
59. Ladeira A, Fregni F, Campanha C, Valasek CA, De Ridder D, Brunoni AR, Boggio PS. 2011 Polaritydependent transcranial direct current stimulation effects on central auditory processing. PLoS ONE 6, e25399. (doi:10.1371/journal.pone.0025399)
60. Bolognini N, Papagno C, Moroni D, Maravita A. 2010 Tactile temporal processing in the auditory cortex. J. Cogn. Neurosci. 22, 1201–1211. (doi:10.1162/jocn.2009.21267)
61. Bolognini N, Cecchetto C, Geraci C, Maravita A, Pascual-Leone A, Papagno C. 2011 Hearing shapes our perception of time: temporal discrimination of tactile stimuli in deaf people. J. Cogn. Neurosci. 24, 276–286. (doi:10.1162/jocn_a_00135)
62. Niedenthal PM. 2007 Embodying emotion. Science 316, 1002–1005. (doi:10.1126/science.1136930)
63. Pitcher D, Garrido L, Walsh V, Duchaine BC. 2008 Transcranial magnetic stimulation disrupts the perception and embodiment of facial expressions. J. Neurosci. 28, 8929–8933. (doi:10.1523/JNEUROSCI.1450-08.2008)
64. Pourtois G, Sander D, Andres M, Grandjean D, Reveret L, Olivier E, Vuilleumier P. 2004 Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals. Eur. J. Neurosci. 20, 3507–3515. (doi:10.1111/j.1460-9568.2004.03794.x)
65. Bolognini N, Rossetti A, Maravita A, Miniussi C. 2011 Seeing touch in the somatosensory cortex: a TMS study of the visual perception of touch. Hum. Brain. Mapp. 32, 2104–2114. (doi:10.1002/hbm.21172)
66. Ray PG, Meador KJ, Epstein CM, Loring DW, Day LJ. 1998 Magnetic stimulation of visual cortex: factors influencing the perception of phosphenes. J. Clin. Neurophysiol. 15, 351–357. (doi:10.1097/00004691-199807000-00007)
67. Ramos-Estebanez C, Merabet LB, Machii K, Fregni F, Thut G, Wagner TA, Romei V, Amedi A, Pascual- Leone A. 2007 Visual phosphene perception modulated by subthreshold crossmodal sensory stimulation. J. Neurosci. 27, 4178–4181. (doi:10.1523/JNEUROSCI.5468-06.2007)
68. Romei V, Murray MM, Merabet LB, Thut G. 2007 Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: implications for multisensory interactions. J. Neurosci. 27, 11 465–11 472. (doi:10.1523/JNEUROSCI.2827-07.2007)
69. Romei V, Murray MM, Cappe C, Thut G. 2009 Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Curr. Biol. 19, 1799–1805. (doi:10.1016/j.cub.2009.09.027)
70. Convento S, Vallar G, Galantini C, Bolognini N. 2013 Neuromodulation of early multisensory interactions in the visual cortex. J. Cogn. Neurosci. 25, 685–696. (doi:10.1162/jocn_a_00347)
71. Lomber SG, Payne BR, Horel JA. 1999 The cryoloop: an adaptable reversible cooling deactivation method for behavioral or electrophysiological assessment of neural function. J. Neurosci. Methods 86, 179–194. (doi:10.1016/S0165-0270(98)00165-4)
72. Malpeli JG. 1999 Reversible inactivation of subcortical sites by drug injection. J. Neurosci. Methods 86, 119–128. (doi:10.1016/S0165-0270(98)00161-7)
73. Histed MH, Ni AM, Maunsell JH. 2013 Insights into cortical mechanisms of behavior from microstimulation experiments. Prog. Neurobiol. 103, 115–130. (doi:10.1016/j.pneurobio.2012.01.006)
74. Fenno L, Yizhar O, Deisseroth K. 2011 The development and application of optogenetics. Annu. Rev. Neurosci. 34, 389–412. (doi:10.1146/annurevneuro-061010-113817)
75. Krueger J, Royal DW, Fister MC, Wallace MT. 2009 Spatial receptive field organization of multisensory neurons and its impact on multisensory interactions. Hear. Res. 258, 47–54. (doi:10.1016/j.heares.2009.08.003)
76. Stein BE, Rowland BA. 2011 Organization and plasticity in multisensory integration: early and late experience affects its governing principles. Prog. Brain Res. 191, 145–163. (doi:10.1016/b978-0-444-53752-2.00007-2)
77. Stein BE. 1998 Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp. Brain Res. 123, 124–135. (doi:10.1007/s002210050553)
78. Stein BE, Stanford TR, Rowland BA. 2014 Development of multisensory integration from the perspective of the individual neuron. Nat. Rev. Neurosci. 15, 520–535. (doi:10.1038/nrn3742)
79. Stein BE, Meredith MA. 2004 The merging of the senses. Cambridge, MA: MIT Press.
80. Stein BE, Stanford TR. 2008 Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 9, 255–266. (doi:10.1038/nrn2331)
81. Beauchamp MS. 2005 Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics 3, 93–113. (doi:10.1385/NI:3:2:093)
82. Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE. 2005 On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp. Brain Res. 166, 289–297. (doi:10.1007/s00221-005-2370-2)
83. Burnett LR, Stein BE, Chaponis D, Wallace MT. 2004 Superior colliculus lesions preferentially disrupt multisensory orientation. Neuroscience 124, 535–547. (doi:10.1016/j.neuroscience.2003.12.026)
84. Meredith MA. 1999 The frontal eye fields target multisensory neurons in cat superior colliculus. Exp. Brain Res. 128, 460–470. (doi:10.1007/s002210050869)
85. Rowland BA, Stanford TR, Stein BE. 2007 A model of the neural mechanisms underlying multisensory integration in the superior colliculus. Perception 36, 1431–1443. (doi:10.1068/p5842)
86. Wallace MT, Meredith MA, Stein BE. 1993 Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. J. Neurophysiol. 69, 1797–1809.
87. Wilkinson LK, Meredith MA, Stein BE. 1996 The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior. Exp. Brain Res. 112, 1–10. (doi:10.1007/BF00227172)
88. Jiang W, Wallace MT, Jiang H, Vaughan JW, Stein BE. 2001 Two cortical areas mediate multisensory integration in superior colliculus neurons. J. Neurophysiol. 85, 506–522.
89. Alvarado JC, Stanford TR, Rowland BA, Vaughan JW, Stein BE. 2009 Multisensory integration in the superior colliculus requires synergy among corticocollicular inputs. J. Neurosci. 29, 6580–6592. (doi:10.1523/JNEUROSCI.0525-09.2009)
90. Rowland BA, Jiang W, Stein BE. 2014 Brief cortical deactivation early in life has long-lasting effects on multisensory behavior. J. Neurosci. 34, 7198–7202. (doi:10.1523/JNEUROSCI.3782-13.2014)
91. Reynolds JH, Chelazzi L. 2004 Attentional modulation of visual processing. Annu. Rev. Neurosci. 27, 611–647. (doi:10.1146/annurev.neuro.26.041002.131039)
92. Moore T, Armstrong KM. 2003 Selective gating of visual signals by microstimulation of frontal cortex. Nature 421, 370–373. (doi:10.1038/nature01341)
93. Armstrong KM, Fitzgerald JK, Moore T. 2006 Changes in visual receptive fields with microstimulation of frontal cortex. Neuron 50, 791–798. (doi:10.1016/j.neuron.2006.05.010)
94. Winkowski DE, Knudsen EI. 2006 Top-down gain control of the auditory space map by gaze control circuitry in the barn owl. Nature 439, 336–339. (doi:10.1038/nature04411)
95. Winkowski DE, Knudsen EI. 2007 Top-down control of multimodal sensitivity in the barn owl optic tectum. J. Neurosci. 27, 13 279–13 291. (doi:10.1523/JNEUROSCI.3937-07.2007)
96. Mysore SP, Knudsen EI. 2013 A shared inhibitory circuit for both exogenous and endogenous control of stimulus selection. Nat. Neurosci. 16, 473–478. (doi:10.1038/nn.3352)
97. Reches A, Gutfreund Y. 2009 Auditory and multisensory responses in the tectofugal pathway of the barn owl. J. Neurosci. 29, 9602–9613. (doi:10.1523/JNEUROSCI.6117-08.2009)
98. Oertel D, Young ED. 2004 What’s a cerebellar circuit doing in the auditory system? Trends Neurosci. 27, 104–110. (doi:10.1016/j.tins.2003.12.001)
99. Young ED, Nelken I, Conley RA. 1995 Somatosensory effects on neurons in dorsal cochlear nucleus. J. Neurophysiol. 73, 743–765.
100. Davis KA, Miller RL, Young ED. 1996 Effects of somatosensory and parallel-fiber stimulation on neurons in dorsal cochlear nucleus. J. Neurophysiol. 76, 3012–3024.
101. Shore SE. 2005 Multisensory integration in the dorsal cochlear nucleus: unit responses to acoustic and trigeminal ganglion stimulation. Eur. J. Neurosci. 21, 3334–3348. (doi:10.1111/j.1460-9568.2005.04142.x)
102. Kanold PO, Young ED. 2001 Proprioceptive information from the pinna provides somatosensory input to cat dorsal cochlear nucleus. J. Neurosci. 21, 7848–7858.
103. Shore SE, Zhou J. 2006 Somatosensory influence on the cochlear nucleus and beyond. Hear. Res. 216–217, 90–99. (doi:10.1016/j.heares.2006.01.006)
104. Lomber SG, Meredith MA, Kral A. 2010 Cross-modal plasticity in specific auditory cortices underlies visual compensations in the deaf. Nat. Neurosci. 13, 1421–1427. (doi:10.1038/nn.2653)
105. Meredith MA, Kryklywy J, McMillan AJ, Malhotra S, Lum-Tai R, Lomber SG. 2011 Crossmodal reorganization in the early deaf switches sensory, but not behavioral roles of auditory cortex. Proc. Natl Acad. Sci. USA 108, 8856–8861. (doi:10.1073/pnas.1018519108)
106. Bavelier D, Tomann A, Hutton C, Mitchell T, Corina D, Liu G, Neville H. 2000 Visual attention to the periphery is enhanced in congenitally deaf individuals. J. Neurosci. 20, RC93.
107. Angelaki DE, Gu Y, DeAngelis GC. 2009 Multisensory integration: psychophysics, neurophysiology, and computation. Curr. Opin. Neurobiol. 19, 452–458. (doi:10.1016/j.conb.2009.06.008)
108. Ernst MO, Bulthoff HH. 2004 Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162–169. (doi:10.1016/j.tics.2004.02.002)
109. Ernst MO, Banks MS. 2002 Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429–433. (doi:10.1038/415429a)
110. Hillis JM, Ernst MO, Banks MS, Landy MS. 2002 Combining sensory information: mandatory fusion within, but not between, senses. Science 298, 1627–1630. (doi:10.1126/science.1075396)
111. Alais D, Burr D. 2004 The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257–262. (doi:10.1016/j.cub.2004.01.029)
112. Landy MS, Kojima H. 2001 Ideal cue combination for localizing texture-defined edges. J. Opt. Soc. Am A 18, 2307–2320. (doi:10.1364/JOSAA.18.002307)
113. Landy MS, Maloney LT, Johnston EB, Young M. 1995 Measurement and modeling of depth cue combination: in defense of weak fusion. Vis. Res. 35, 389–412. (doi:10.1016/0042-6989(94)00176-M)
114. Ma WJ, Zhou X, Ross LA, Foxe JJ, Parra LC. 2009 Lip-reading aids word recognition most in moderate noise: a Bayesian explanation using highdimensional feature space. PLoS ONE 4, e4638. (doi:10.1371/journal.pone.0004638)
115. Fetsch CR, DeAngelis GC, Angelaki DE. 2013 Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat. Rev. Neurosci. 14, 429–442. (doi:10.1038/nrn3503)
116. Gu Y, Angelaki DE, DeAngelis GC. 2008 Neural correlates of multisensory cue integration in macaque MSTd. Nat. Neurosci. 11, 1201–1210. (doi:10.1038/nn.2191)
117. Gu Y, DeAngelis GC, Angelaki DE. 2012 Causal links between dorsal medial superior temporal area neurons and multisensory heading perception. J. Neurosci. 32, 2299–2313. (doi:10.1523/JNEUROSCI.5154-11.2012)
118. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE. 2012 Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 15, 146–154. (doi:10.1038/nn.2983)
119. Chen A, DeAngelis GC, Angelaki DE. 2010 Macaque parieto-insular vestibular cortex: responses to selfmotion and optic flow. J. Neurosci. 30, 3022–3042. (doi:10.1523/JNEUROSCI.4029-09.2010)
120. Chen A, DeAngelis GC, Angelaki DE. 2011 Convergence of vestibular and visual self-motion signals in an area of the posterior sylvian fissure. J. Neurosci. 31, 11 617–11 627. (doi:10.1523/JNEUROSCI.1266-11.2011)
121. Chen A, DeAngelis GC, Angelaki DE. 2011 Representation of vestibular and visual cues to selfmotion in ventral intraparietal cortex. J. Neurosci. 31, 12 036–12 052. (doi:10.1523/JNEUROSCI.0395-11.2011)
122. Chen A, DeAngelis GC, Angelaki DE. 2013 Functional specializations of the ventral intraparietal area for multisensory heading discrimination. J. Neurosci. 33, 3567–3581. (doi:10.1523/JNEUROSCI.4522-12.2013)
123. Avillac M, Deneve S, Olivier E, Pouget A, Duhamel JR. 2005 Reference frames for representing visual and tactile locations in parietal cortex. Nat. Neurosci 8, 941–949. (doi:10.1038/nn1480)
124. Bremmer F, Klam F, Duhamel JR, Ben Hamed S, Graf W. 2002 Visual-vestibular interactive responses in the macaque ventral intraparietal area (VIP). Eur. J. Neurosci. 16, 1569–1586. (doi:10.1046/j.1460-9568.2002.02206.x)
125. Schlack A, Sterbing-D’Angelo SJ, Hartung K, Hoffmann KP, Bremmer F. 2005 Multisensory space representations in the macaque ventral intraparietal area. J. Neurosci. 25, 4616–4625. (doi:10.1523/JNEUROSCI.0455-05.2005)
126. Cooke DF, Taylor CS, Moore T, Graziano MS. 2003 Complex movements evoked by microstimulation of the ventral intraparietal area. Proc. Natl Acad. Sci. USA 100, 6163–6168. (doi:10.1073/pnas.1031751100)
127. Raposo D, Kaufman MT, Churchland AK. 2014 A category-free neural population supports evolving demands during decision-making. Nat. Neurosci. 17, 1784–1792. (doi:10.1038/nn.3865)
128. Dadarlat MC, O’Doherty JE, Sabes PN. 2014 A learning-based approach to artificial sensory feedback leads to optimal integration. Nat. Neurosci. 18, 138–144. (doi:10.1038/nn.3883)
129. Olcese U, Iurilli G, Medini P. 2013 Cellular and synaptic architecture of multisensory integration in the mouse neocortex. Neuron 79, 579–593. (doi:10.1016/j.neuron.2013.06.010)
130. Driver J, Blankenburg F, Bestmann S, Vanduffel W, Ruff CC. 2009 Concurrent brain-stimulation and neuroimaging for studies of cognition. Trends Cogn. Sci. 13, 319–327. (doi:10.1016/j.tics.2009.04.007)
131. Yau JM, Hua J, Liao DA, Desmond JE. 2013 Efficient and robust identification of cortical targets in concurrent TMS-fMRI experiments. Neuroimage 76, 134–144. (doi:10.1016/j.neuroimage.2013.02.077)
132. Miniussi C, Thut G. 2010 Combining TMS and EEG offers new prospects in cognitive neuroscience. Brain Topogr. 22, 249–256. (doi:10.1007/s10548-009-0083-8)
133. Buzsaki G, Draguhn A. 2004 Neuronal oscillations in cortical networks. Science 304, 1926–1929. (doi:10.1126/science.1099745)
134. Senkowski D, Schneider TR, Foxe JJ, Engel AK. 2008 Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 31, 401–409. (doi:10.1016/j.tins.2008.05.002)
135. Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG. 2010 The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. 14, 400–410. (doi:10.1016/j.tics.2010.06.008)
136. van Atteveldt N, Murray MM, Thut G, Schroeder CE. 2014 Multisensory integration: flexible use of general operations. Neuron 81, 1240–1253. (doi:10.1016/j.neuron.2014.02.044)
137. Thut G, Miniussi C, Gross J. 2012 The functional importance of rhythmic activity in the brain. Curr. Biol. 22, R658–R663. (doi:10.1016/j.cub.2012.06.061)
138. Silvanto J, Pascual-Leone A. 2008 State-dependency of transcranial magnetic stimulation. Brain Topogr. 21, 1–10. (doi:10.1007/s10548-008-0067-0)
139. Diester I, Kaufman MT, Mogri M, Pashaie R, Goo W, Yizhar O, Ramakrishnan C, Deisseroth K, Shenoy KV. 2011 An optogenetic toolbox designed for primates. Nat. Neurosci. 14, 387–397. (doi:10.1038/nn.2749)
140. Gerits A, Vanduffel W. 2013 Optogenetics in primates: a shining future? Trends Genet 29, 403–411. (doi:10.1016/j.tig.2013.03.004)
141. Ozden I. et al. 2013 A coaxial optrode as multifunction write-read probe for optogenetic studies in non-human primates. J. Neurosci. Methods 219, 142–154. (doi:10.1016/j.jneumeth.2013.06.011)
142. Ruiz O, Lustig BR, Nassi JJ, Cetin A, Reynolds JH, Albright TD, Callaway EM, Stoner GR, Roe AW. 2013 Optogenetics through windows on the brain in the nonhuman primate. J. Neurophysiol. 110, 1455–1467. (doi:10.1152/jn.00153.2013)
143. Dai J, Brooks DI, Sheinberg DL. 2014 Optogenetic and electrical microstimulation systematically bias visuospatial choice in primates. Curr. Biol. 24, 63–69. (doi:10.1016/j.cub.2013.11.011)
144. Lakshminarasimhan K, Liu S, Klier EM, Gu Y, Pitkow X, DeAngelis GC. et al. 2014 Dissecting the contributions of area MSTd and VIP to heading perception. Computational and Systems Neuroscience Meeting (Cosyne), 27 February–2 March, Salt Lake City, UT.