Multisensory integration through neural coherence

The Neural Bases of Multisensory Processes

Volumn , Issue , 2011, Pages 115-130

  Engel, Andreas K ^a   Senkowski, Daniel ^a   Schneider, Till R ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85059454032     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (106)

1. Amedi, A., K. von Kriegstein, N.M. van Atteveldt, M.S. Beauchamp, M.J. Naumer. 2005. Functional imaging of human crossmodal identification and object recognition. Experimental Brain Research 166:559-571.
2. Bauer, M., R. Oostenveld, M. Peeters, P. Fries. 2006. Tactile spatial attention enhances gamma-band activ-ity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas. Journal of Neuroscience 26:490-501.
3. Baumann, O., and M.W. Greenlee. 2007. Neural correlates of coherent audiovisual motion perception. Cerebral Cortex 17:1433-1443.
4. Bavelier, D., and H.J. Neville. 2002. Cross-modal plasticity: Where and how? Nature Reviews. Neuroscience 3:443-452.
5. Bhattacharya, J., L. Shams, S. Shimojo. 2002. Sound-induced illusory flash perception: Role of gamma band responses. Neuroreport 13:1727-1730.
6. Bi, G.-Q., and M.-M. Poo. 2001. Synaptic modification by correlated activity: Hebb's postulate revisited. Annual Review of Neuroscience 24:139-166.
7. Bressler, S.L., and W.J. Freeman. 1980. Frequency analysis of olfactory system EEG in cat, rabbit, and rat. Electroencephalography and Clinical Neurophysiology 50:19-24.
8. Brosch, M., E. Budinger, H. Scheich. 2002. Stimulus-related gamma oscillations in primate auditory cortex. Journal of Neurophysiology 87:2715-2725.
9. Calvert, G.A. 2001. Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex 11:1110-1123.
10. Castelo-Branco, M., R. Goebel, S. Neuenschwander, W. Singer. 2000. Neural synchrony correlates with surface segregation rules. Nature 405:685-689.
11. Csicsvari, J., B. Jamieson, K.D. Wise, G. Buzsaki. 2003. Mechanisms of gamma oscillations in the hippocam-pus of the behaving rat. Neuron 37:311-322.
12. Chandrasekaran, C., and A.A. Ghazanfar. 2009. Different neural frequency bands integrate faces and voices differently in the superior temporal sulcus. Journal of Neurophysiology 101:773-788.
13. Debener, S., C.S. Herrmann, C. Kranczioch, D. Gembris, A.K. Engel. 2003. Top-down attentional processing enhances auditory evoked gamma band activity. Neuroreport 14:683-686.
14. Debener, S., M. Ullsperger, M. Siegel, A.K. Engel. 2006. Single-trial EEG-fMRI reveals the dynamics of cog-nitive function. Trends in Cognitive Sciences 10:558-563.
15. Doesburg, S.M., L.L. Emberson, A. Rahi, D. Cameron, L.M. Ward. 2007. Asynchrony from synchrony: Long-range gamma-band neural synchrony accompanies perception of audiovisual speech asynchrony. Experimental Brain Research 185:11-20.
16. Driver, J., and C. Spence. 2000. Multisensory perception: Beyond modularity and convergence. Current Biology 10:R731-R735.
17. Engel, A.K., P. König, W. Singer. 1991a. Direct physiological evidence for scene segmentation by temporal cod-ing. Proceedings of the National Academy of Sciences of the United States of America 88:9136-9140.
18. Engel, A.K., P. König, A.K. Kreiter, Singer, W. 1991b. Interhemispheric synchronization of oscillatory neu-ronal responses in cat visual cortex. Science 252:1177-1179.
19. Engel, A.K., P. König, A.K. Kreiter, T.B. Schillen, W. Singer. 1992. Temporal coding in the visual cortex: New vistas on integration in the nervous system. Trends in Neurosciences 15:218-226.
20. Engel, A.K., P. Fries, W. Singer. 2001. Dynamic predictions: Oscillations and synchrony in top-down process-ing. Nature Reviews. Neuroscience 2:704-716.
21. Farmer, S.F. 1998. Rhythmicity, synchronization and binding in human and primate motor systems. Journal of Physiology 509:3-14.
22. Foxe, J.J., and C.E. Schroeder. 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16:419-423.
23. Foxe, J.J., G.R. Wylie, A. Martinez et al. 2002. Auditory-somatosensory multisensory processing in auditory association cortex: An fMRI study. Journal of Neurophysiology 88:540-543.
24. Foxe, J.J., G.V. Simpson, S.P. Ahlfors, C.D. Saron. 2005. Biasing the brain's attentional set: I. cue driven deployments of intersensory selective attention. Experimental Brain Research 166:370-392.
25. Fries, P. 2005. A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends in Cognitive Sciences 9:474-480.
26. Fries, P., P.R. Roelfsema, A.K. Engel, P. König, W. Singer. 1997. Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry. Proceedings of the National Academy of Sciences of the United States of America 94:12699-12704.
27. Fries, P., S. Neuenschwander, A.K. Engel, R. Goebel, W. Singer. 2001. Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291:1560-1563.
28. Fries, P., D. Nikolic, W. Singer. 2007. The gamma cycle. Trends in Neurosciences 30:309-316.
29. Fries, P., R. Scheeringa, R. Oostenveld. 2008. Finding gamma. Neuron 58:303-305.
30. Ghazanfar, A.A., and C.E. Schroeder. 2006. Is neocortex essentially multisensory? Trends in Cognitive Sciences 10:278-285.
31. Gray, C.M., P. König, A.K. Engel, W. Singer. 1989. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338:334-337.
32. Gross, J., J. Kujala, M. Hamalainen et al. 2001. Dynamic imaging of coherent sources: Studying neural inter-actions in the human brain. Proceedings of the National Academy of Sciences of the United States of America 98:694-699.
33. Gruber, T., and M.M. Müller. 2005. Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. Cerebral Cortex 15:109-116.
34. Herrmann, C.S., M.H. Munk, A.K. Engel. 2004a. Cognitive functions of gamma-band activity: Memory match and utilization. Trends in Cognitive Sciences 8:347-355.
35. Herrmann, C.S., D. Lenz, S. Junge, N.A. Busch, B. Maess. 2004b. Memory-matches evoke human gamma-responses. BMC Neuroscience 5:13.
36. Hubbard, E.M., and V.S. Ramachandran. 2005. Neurocognitive mechanisms of synesthesia. Neuron 48: 509-520.
37. Hummel, F., and C. Gerloff. 2005. Larger interregional synchrony is associated with greater behavioral success in a complex sensory integration task in humans. Cerebral Cortex 15:670-678.
38. Iarocci, G., and J. McDonald. 2006. Sensory integration and the perceptual experience of persons with autism. Journal of Autism and Developmental Disorders 36:77-90.
39. Kaiser, J., W. Lutzenberger, H. Ackermann, N. Birbaumer. 2002. Dynamics of gamma-band activity induced by auditory pattern changes in humans. Cerebral Cortex 12:212-221.
40. Kaiser, J., I. Hertrich, H. Ackermann, K. Mathiak, W. Lutzenberger. 2005. Hearing lips: Gamma-band activity during audiovisual speech perception. Cerebral Cortex 15:646-653.
41. Kaiser, J., I. Hertrich, W. Ackermann, W. Lutzenberger. 2006. Gamma-band activity over early sensory areas predicts detection of changes in audiovisual speech stimuli. NeuroImage 30:1376-1382.
42. Kanayama, N., A. Sato, H. Ohira. 2007. Crossmodal effect with rubber hand illusion and gamma-band activity. Psychophysiology 44:392-402.
43. Kayser, C., and N.K. Logothetis. 2007. Do early sensory cortices integrate crossmodal information? Brain Structure and Function 212:121-132.
44. Kayser, C., and N.K. Logothetis. 2009. Directed interactions between auditory and superior temporal cortices and their role in sensory integration. Frontiers in Integrative Neuroscience 3:7.
45. Kayser, C., C.I. Petkov, M. Augath, N.K. Logothetis. 2005. Integration of touch and sound in auditory cortex. Neuron 48:373-384.
46. Kayser, C., C.I. Petkov, N.K. Logothetis. 2008. Visual modulation of neurons in auditory cortex. Cerebral Cortex 18:1560-1574.
47. Kisley, M.A., and Z.M. Cornwell. 2006. Gamma and beta neural activity evoked during a sensory gating paradigm: Effects of auditory, somatosensory and cross-modal stimulation. Clinical Neurophysiology 117:2549-2563.
48. Komura, Y., R. Tamura, T. Uwano, H. Nishijo, T. Ono. 2005. Auditory thalamus integrates visual inputs into behavioral gains. Nature Neuroscience 8:1203-1209.
49. König, P., A.K. Engel, W. Singer. 1995. Relation between oscillatory activity and long-range synchronization in cat visual cortex. Proceedings of the National Academy of Sciences of the United States of America 92:290-294.
50. König, P., A.K. Engel, W. Singer. 1996. Integrator or coincidence detector? The role of the cortical neuron revisited. Trends in Neurosciences 19:130-137.
51. Lachaux, J.P., D. Rudrauf, P. Kahane. 2003. Intracranial EEG and human brain mapping. Journal of Physiology 97:613-628.
52. Lakatos, P., C.M. Chen, M.N. O'Connell, A. Mills, C.E. Schroeder. 2007. Neuronal oscillations and multisen-sory interaction in primary auditory cortex. Neuron 53:279-292.
53. Macaluso, E., and J. Driver. 2005. Multisensory spatial interactions: A window onto functional integration in the human brain. Trends in Neurosciences 28:264-271.
54. Macaluso, E., C.D. Frith, J. Driver. 2000. Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206-1208.
55. Maier, J.X., C. Chandrasekaran, A.A. Ghazanfar. 2008. Integration of bimodal looming signals through neu-ronal coherence in the temporal lobe. Current Biology 18:963-968.
56. Markram, H., J. Lübke, M. Frotscher, B. Sakmann. 1997. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Nature 275:213-215.
57. McGurk, H., and J. MacDonald. 1976. Hearing lips and seeing voices. Nature 264:746-748.
58. Meredith, M.A. 2002. On the neuronal basis for multisensory convergence: A brief overview. Brain Research. Cognitive Brain Research 14:31-40.
59. Meredith, M.A., and B.E. Stein. 1983. Interactions among converging sensory inputs in the superior colliculus. Science 221:389-391.
60. Meredith, M.A., and B.E. Stein. 1985. Descending efferents from the superior colliculus relay integrated mul-tisensory information. Science 227:657-659.
61. Mishra, J., A. Martinez, T.J. Sejnowski, S.A. Hillyard. 2007. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. Journal of Neuroscience 27:4120-4131.
62. Müller, M.M., T. Gruber, A. Keil. 2000. Modulation of induced gamma band activity in the human EEG by attention and visual information processing. International Journal of Psychophysiology 38:283-299.
63. Nagy, A., G. Eördegh, Z. Paroczy, Z. Markus, G. Benedek. 2006. Multisensory integration in the basal ganglia. European Journal of Neuroscience 24:917-924.
64. Nishijo, H., T. Ono, H. Nishino. 1988. Topographic distribution of modality-specific amygdalar neurons in alert monkey. Journal of Neuroscience 8:3556-3569.
65. Roelfsema, P.R., P. König, A.K. Engel, R. Sireteanu, W. Singer. 1994. Reduced synchronization in the visual cortex of cats with strabismic amblyopia. European Journal of Neuroscience 6:1645-1655.
66. Roelfsema, P.R., A.K. Engel, P. König, W. Singer. 1997. Visuomotor integration is associated with zero time-lag synchronization among cortical areas. Nature 385:157-161.
67. Ross, L.A., D. Saint-Amour, V.M. Leavitt, S. Molholm, D.C. Javitt, J.J. Foxe. 2007. Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophrenia Research 97:173-183.
68. Rowland B.A., S. Quessy, T.R. Stanford, B.E. Stein. 2007. Multisensory integration shortens physiological response latencies. Journal of Neuroscience 27:5879-5884.
69. Sakowitz, O.W., M. Schürmann, E. Basar. 2000. Oscillatory frontal theta responses are increased upon bisen-sory stimulation. Clinical Neurophysiology 111:884-893.
70. Sakowitz, O.W., R.Q. Quiroga, M. Schürmann, E. Basar. 2001. Bisensory stimulation increases gamma-responses over multiple cortical regions. Brain Research. Cognitive Brain Research. 11:267-279.
71. Sakowitz, O.W., R.Q. Quiroga, M. Schürmann, E. Basar. 2005. Spatio-temporal frequency characteristics of intersensory components in audiovisual evoked potentials. Brain Research. Cognitive Brain Research 23:316-326.
72. Salinas, E., and T.J. Sejnowski. 2001. Correlated neuronal activity and the flow of neural information. Nature Reviews Neuroscience 2:539-550.
73. Sanes, J.N., and J.P. Donoghue. 1993. Oscillations in local field potentials of the primate motor cortex during voluntary movement. Proceedings of the National Academy of Sciences of the United States of America 90:4470-4474.
74. Schnitzler, A., and J. Gross. 2005. Normal and pathological oscillatory communication in the brain. Nature Reviews Neuroscience 6:285-296.
75. Schneider, T.R., S. Debener, R. Oostenveld, A.K. Engel. 2008. Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. NeuroImage 42:1244-1254.
76. Senkowski, D., D. Talsma, C.S. Herrmann, M.G. Woldorff. 2005. Multisensory processing and oscil-latory gamma responses: Effects of spatial selective attention. Experimental Brain Research 3-4:411-426.
77. Senkowski, D., S. Molholm, M. Gomez-Ramirez, J.J. Foxe. 2006. Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: A high-density electrical mapping study. Cerebral Cortex 16:1556-1565.
78. Senkowski, D., D. Talsma, M. Grigutsch, C.S. Herrmann, M.G. Woldorff. 2007. Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 45:561-571.
79. Senkowski, D., T.R. Schneider, J.J. Foxe, A.K. Engel. 2008. Crossmodal binding through neural coherence: Implications for multisensory processing. Trends in Neurosciences 31:401-409.
80. Senkowski, D., T.R. Schneider, R. Tandler, A.K. Engel. 2009. Gamma-band activity reflects multisensory matching in working memory. Experimental Brain Research 198:363-372.
81. Shams, L., Y. Kamitani, S. Shimojo. 2000. Illusions. What you see is what you hear. Nature 408:788.
82. Shimojo, S., and L. Shams. 2001. Sensory modalities are not separate modalities: Plasticity and interactions. Current Opinion in Neurobiology 11:505-509.
83. Siegel, M., T.H. Donner, R. Oostenveld, P. Fries, A.K. Engel. 2007. High-frequency activity in human visual cortex is modulated by visual motion strength. Cerebral Cortex 17:732-741.
84. Siegel, M., T.H. Donner, R. Oostenveld, P. Fries, A.K. Engel. 2008. Neuronal synchronization along the dorsal visual pathway reflects the focus of spatial attention. Neuron 60:709-719.
85. Singer, W. 1999. Neuronal synchrony: A versatile code for the definition of relations? Neuron 24:49-65.
86. Singer, W., and C.M. Gray. 1995. Visual feature integration and the temporal correlation hypothesis. Annual Review of Neuroscience 18:555-586.
87. Stanford, T.R., S. Quessy, B.E. Stein. 2005. Evaluating the operations underlying multisensory integration in the cat superior colliculus. Journal of Neuroscience 25:6499-6508.
88. Stein, B.E., and M.A. Meredith. 1993. The Merging of the Senses. Cambridge, MA: MIT Press.
89. Stein, B.E., M.W. Wallace, T.R. Stanford, W. Jiang. 2002. Cortex governs multisensory integration in the mid-brain. Neuroscientist 8:306-314.
90. Supp, G.G., A. Schlögl, N. Trujillo-Barreto, M.M. Müller, T. Gruber. 2007. Directed cortical information flow during human object recognition: Analyzing induced EEG gamma-band responses in brain's source space. PLoS ONE 2:e684.
91. Sur, M., S.L. Pallas, A.W. Roe. 1990. Cross-modal plasticity in cortical development: Differentiation and speci-fication of sensory neocortex. Trends in Neurosciences 13:227-233.
92. Tallon-Baudry, C., and O. Bertrand. 1999. Oscillatory gamma activity in humans and its role in object repre-sentation. Trends in Cognitive Sciences 3:151-162.
93. Tallon-Baudry, C., O. Bertrand, C. Delpuech, J. Pernier. 1996. Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. Journal of Neuroscience 16:4240-4249.
94. Talsma, D., and M.G. Woldorff. 2005. Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience 17:1098-1114.
95. Uhlhaas, P.J., and W. Singer. 2006. Neural synchrony in brain disorders: Relevance for cognitive dysfunctions and pathophysiology. Neuron 52:155-168.
96. Van Veen, B.D., W. van Drongelen, M. Yuchtman, A. Suzuki. 1997. Localization of brain electrical activity via linearly constrained minimum variance spatial filtering. IEEE Transactions on Bio-Medical Engineering 44:867-880.
97. Varela, F., J.P. Lachaux, E. Rodriguez, J. Martinerie. 2001. The brainweb: Phase synchronization and large-scale integration. Nature Reviews. Neuroscience 2:229-239.
98. von der Malsburg, C., and W. Schneider. 1986. A neural cocktail-party processor. Biological Cybernetics 54:29-40.
99. von Stein, A., P. Rappelsberger, J. Sarnthein, H. Petsche. 1999. Synchronization between temporal and parietal cortex during multimodal object processing in man. Cerebral Cortex 9:137-150.
100. Vroomen, J., and M. Keetels. 2010. Perception of intersensory synchrony: A tutorial review. Attention, Perception, & Psychophysics 72:871-884.
101. Wehr, M., and G. Laurent. 1996. Odour encoding by temporal sequences of firing in oscillating neural assem-blies. Nature 384:162-166.
102. Widmann, A., T. Gruber, T. Kujala, M. Tervaniemi, E. Schröger. 2007. Binding symbols and sounds: Evidence from event-related oscillatory gamma-band activity. Cerebral Cortex 17:2696-2702.
103. Womelsdorf, T., P. Fries, P.P. Mitra, R. Desimone. 2006. Gamma-band synchronization in visual cortex predicts speed of change detection. Nature 439:733-736.
104. Womelsdorf, T., J.M. Schoffelen, R. Oostenveld et al. 2007. Modulation of neuronal interactions through neu-ronal synchronization. Science 316:1609-1612.
105. Yuval-Greenberg, S., and L.Y. Deouell. 2007. What you see is not (always) what you hear: Induced gamma band responses reflect cross-modal interactions in familiar object recognition. Journal of Neuroscience 27:1090-1096.
106. Yuval-Greenberg, S., O. Tomer, A.S. Keren, I. Nelken, L.Y. Deouell. 2008. Transient induced gamma-band response in EEG as a manifestation of miniature saccades. Neuron 58:429-441.