Predictive coding and multisensory integration: An attentional account of the multisensory mind

Frontiers in Integrative Neuroscience

Volumn 9, Issue MAR, 2015, Pages

  Talsma, Durk ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Attention; Bottom up; Mental model; Multisensory integration; Predictive coding; Top down

Indexed keywords

ATTENTIONAL BIAS; AUDITORY CORTEX; FEEDBACK SYSTEM; HUMAN; ILLUSION; IMAGERY; MENTAL TASK; MINDFULNESS; MULTISENSORY INTEGRATION; NERVOUS SYSTEM FUNCTION; PREDICTION; RECALL; REVIEW; SPEECH PERCEPTION; TASK PERFORMANCE; THEORY OF MIND; VISUAL CORTEX; VISUAL MEMORY;

EID: 84927597069     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2015.00019     Document Type: Review

References (109)

1. Alais, D., and Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257-262. doi: 10.1016/j.cub.2004.01.029
2. Alsius, A., Mottonen, R., Sams, M. E., Soto-Faraco, S., and Tiippana, K. (2014). Effect of attentional load on audiovisual speech perception: evidence from ERPs. Front. Psychol. 5:727. doi: 10.3389/fpsyg.2014.00727
3. Alsius, A., Navarra, J., Campbell, R., and Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15, 839-843. doi: 10.1016/j.cub.2005.03.046
4. Alsius, A., Navarra, J., and Soto-Faraco, S. (2007). Attention to touch weakens audiovisual speech integration.Exp. Brain Res. 183, 399-404. doi: 10.1007/s00221-007-1110-1
5. Anastasio, T. J., Patton, P. E., and Belkacem-Boussaid, K. (2000). Using Bayes' Rule to model multisensory enhancement in the superior colliculus. Neural Comput. 12, 1165-1187. doi: 10.1162/089976600300015547
6. Baart, M., Stekelenburg, J., and Vroomen, J. (2014). Electrophysiological evidence for speech-specific audiovisual integration. Neuropsychologia 65, 115-121. doi: 10.1016/j.neuropsychologia.2013.11.011i
7. Badre, D. (2008). Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends Cogn. Sci. 12, 193-200. doi: 10.1016/j.tics.2008.02.004
8. Baess, P., Horváth, J., Jacobsen, T., and Schröger, E. (2011). Selective suppression of self-initiated sounds in an auditory stream: an ERP study. Psychophysiology 48, 1276-1283. doi: 10.1111/j.1469-8986.2011.01196.x
9. Beauchamp, M. S., Nath, A. R., and Pasalar, S. (2010). fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the mcGurk effect. J. Neurosci. 30, 2414-2417. doi: 10.1523/jneurosci.4865-09.2010
10. Berger, C. C., and Ehrsson, H. H. (2013). Mental imagery changes multisensory perception. Curr. Biol. 23, 1367-1372. doi: 10.1016/j.cub.2013.06.012
11. Berger, C. C., and Ehrsson, H. H. (2014). The fusion of mental imagery and sensation in the temporal association cortex. J. Neurosci. 34, 13684-13692. doi: 10.1523/jneurosci.0943-14.2014
12. Bloom, F. E., and Lazeron, A. (1988). Brain, Mind, and Behavior. New York, NY: W. H. Freeman and Company.
13. Busse, L., Roberts, K. C., Crist, R. E., Weissman, D. H., and Woldorff, M. G. (2005). The spread of attention across modalities and space in a multisensory object. Proc. Natl. Acad. Sci. U.S.A. 102, 18751-18756. doi: 10.1073/pnas.0507704102
14. Butler, J. S., Foxe, J. J., Fiebelkorn, I. C., Mercier, M. R., and Molholm, S. (2012). Multisensory representation of frequency across audition and touch: high density electrical mapping reveals early sensory-perceptual coupling. J. Neurosci. 32, 15338-15344. doi: 10.1523/JNEUROSCI.1796-12.2012
15. Butler, J. S., Molholm, S., Fiebelkorn, I. C., Mercier, M. R., Schwartz, T. H., and Foxe, J. J. (2011). Common or redundant neural circuits for duration processing across audition and touch. J. Neurosci. 31, 3400-3406. doi: 10.1523/JNEUROSCI.3296-10.2011
16. Calvert, G. A., Campbell, R., and Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649-657. doi: 10.1016/S0960-9822(00)00513-3
17. Calvert, G. A., and Thesen, T. (2004). Multisensory integration: methodological approaches and emerging principles in the human brain. J. Physiol. Paris 98, 191-205. doi: 10.1016/j.jphysparis.2004.03.018
18. Cappe, C., Thelen, A., Romei, V., Thut, G., and Murray, M. M. (2012). Looming signals reveal synergistic principles of multisensory integration. J. Neurosci. 32, 1171-1182. doi: 10.1523/jneurosci.5517-11.2012
19. Chikkerur, S., Serre, T., Tan, C., and Poggio, T. (2010). What and where: a Bayesian inference theory of attention.Vision Res. 50, 2233-2247. doi: 10.1016/j.visres.2010.05.013
20. Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201-215. doi: 10.1038/nrn755
21. Dahl, C. D., Logothetis, N. K., and Kayser, C. (2009). Spatial organization of multisensory responses in temporal association cortex. J. Neurosci. 29, 11924-11932. doi: 10.1523/JNEUROSCI.3437-09.2009
22. Deneve, S., and Pouget, A. (2004). Bayesian multisensory integration and cross-modal spatial links. J. Physiol. Paris 98, 249-258. doi: 10.1016/j.jphysparis.2004.03.011
23. Donohue, S. E., Todisco, A. E., and Woldorff, M. G. (2014). The rapid distraction of attentional resources toward the Source of incongruent stimulus input during multisensory conflict. J. Cogn. Neurosci. 25, 623-635. doi: 10.1162/jocn_a_00336
24. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57, 11-23. doi: 10.1016/j.neuron.2007.12.013
25. Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. J. Vis. 7, 1-14. doi: 10.1167/7.5.7
26. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433. doi: 10.1038/415429a
27. Fairhall, S. L., and Macaluso, E. (2009). Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. Eur. J. Neurosci. 29, 1247-1257. doi: 10.1111/j.1460-9568.2009.06688.x
28. Falchier, A., Clavagnier, S., Barone, P., and Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22, 5749-5759.
29. Fiebelkorn, I. C., Foxe, J. J., Butler, J. S., Mercier, M. R., Snyder, A. C., and Molholm, S. (2011). Ready, set, reset: stimulus-locked periodicity in behavioral performance demonstrates the consequences of cross-sensory phase reset. J. Neurosci. 31, 9971-9981. doi: 10.1523/JNEUROSCI.1338-11.2011
30. Fiebelkorn, I. C., Foxe, J. J., and Molholm, S. (2010). Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter? Cereb. Cortex 20, 109-120. doi: 10.1093/cercor/bhp083
31. Foxe, J. J., Molholm, S., Del Bene, V. A., Frey, H. P., Russo, N. N., Blanco, D.,et al. (2015). Severe multisensory speech integration deficits in high-functioning school-aged children with autism spectrum disorder (ASD) and their resolution during early adolescence. Cereb. Cortex 25, 298-312. doi: 10.1093/cercor/bht213
32. Friston, K. (2005). A theory of cortical responses. Philos. Trans. R. Soc. B Biol. Sci. 360, 815-836. doi: 10.1098/rstb.2005.1622
33. Friston, K. (2010). The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127-138. doi: 10.1038/nrn2787
34. Ghazanfar, A. A., Chandrasekaran, C., and Logothetis, N. K. (2008). Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J. Neurosci. 28, 4457-4469. doi: 10.1523/JNEUROSCI.0541-08.2008
35. Ghazanfar, A. A., and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Cogn. Sci. 10, 278-285. doi: 10.1016/j.tics.2006.04.008
36. Giard, M. H., and Péronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11, 473-490. doi: 10.1162/089892999563544
37. Hackett, T. A., De La Mothe, L. A., Ulbert, I., Karmos, G., Smiley, J., and Schroeder, C. E. (2007). Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane. J. Comp. Neurol. 502, 924-952. doi: 10.1002/cne.21326
38. Helbig, H. B., and Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Exp. Brain Res. 179, 595-606. doi: 10.1007/s00221-006-0814-y
39. Holmes, N. P. (2009). The principle of inverse effectiveness in multisensory integration: some statistical considerations. Brain Topogr. 21, 168-176. doi: 10.1007/s10548-009-0097-2
40. Hugenschmidt, C. E., Mozolic, J. L., and Laurienti, P. J. (2009). Suppression of multisensory integration by modality-specific attention in aging. Neuroreport 20, 349-353. doi: 10.1097/WNR.0b013e328323ab07
41. Klemen, J., and Chambers, C. D. (2011). Current perspectives and methods in studying neural mechanisms of multisensory interactions. Neurosci. Biobehav. Rev. 36, 111-133. doi: 10.1016/j.neubiorev.2011.04.015
42. Koelewijn, T., Bronkhorst, A., and Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol. 134, 372-384. doi: 10.1016/j.actpsy.2010.03.010
43. Kok, P., Jehee, J. F. M., and de Lange, F. P. (2012). Less is more: expectation sharpens representations in the primary visual cortex. Neuron 75, 265-270. doi: 10.1016/j.neuron.2012.04.034
44. Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C., and de Lange, F. P. (2011). Attention Reverses the effect of prediction in silencing sensory signals. Cereb. Cortex 22, 2197-2206. doi: 10.1093/cercor/bhr310
45. Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., and Shams, L. (2007). Causal inference in multisensory perception. PLoS ONE 2:e943. doi: 10.1371/journal.pone.0000943
46. LaBerge, D. (1995). Attentionl Processing: The Brain's Art of Mindfulness. Cambridge, MA: Harvard University Press. doi: 10.4159/harvard.9780674183940
47. Lakatos, P., Chen, C., O'Connell, M. N., Mills, A., and Schroeder, C. E. (2007). Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53, 279-292. doi: 10.1016/j.neuron.2006.12.011
48. Lewald, J., and Guski, R. (2003). Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cogn. Brain Res. 16, 468-478. doi: 10.1016/s0926-6410(03)00074-0
49. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., and Studdert-Kennedy, M. (1967). Perception of the speech code. Psychol. Rev. 74, 431-461. doi: 10.1037/h0020279
50. Luck, S. J. (1994). Cognitive and neural mechanisms of visual search. Curr. Opin. Neurobiol. 4, 183-188. doi: 10.1016/0959-4388(94)90070-1
51. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748. doi: 10.1038/264746a0
52. Mercier, M. R., Foxe, J. J., Fiebelkorn, I. C., Butler, J. S., Schwartz, T. H., and Molholm, S. (2013). Auditory-driven phase reset in visual cortex: human electrocorticography reveals mechanisms of early multisensory integration.Neuroimage 79, 19-29. doi: 10.1016/j.neuroimage.2013.04.060
53. Miller, L. M., and D'Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci. 25, 5884-5893. doi: 10.1523/jneurosci.0896-05.2005
54. Molholm, S., Martinez, A., Shpaner, M., and Foxe, J. J. (2007). Object-based attention is multisensory: co-activation of an object's representations in ignored sensory modalities. Eur. J. Neurosci. 26, 499-509. doi: 10.1111/j.1460-9568.2007.05668.x
55. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., and Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study.Cogn. Brain Res. 14, 115-128. doi: 10.1016/S0926-6410(02)00066-6
56. Morris, R. G. M., Garrud, P., Rawlins, J. N. P., and O'Keefe, J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683. doi: 10.1038/297681a0
57. Motter, B. C. (1994). Neural correlates of attentive selection for color or luminance in extrastriate area V4. J. Neurosci. 14, 2178-2189.
58. Mozolic, J. L., Hugenschmidt, C. E., Peiffer, A. M., and Laurienti, P. J. (2008). Modality-specific selective attention attenuates multisensory integration. Exp. Brain Res. 184, 39-52. doi: 10.1007/s00221-007-1080-3
59. Nahorna, O., Bethommier, F., and Schwartz, J.-L. (2012). Binding and unbinding the auditory and visual streams in the McGurk effect. J. Acoust. Soc. Am. 132, 1061-1077. doi: 10.1121/1.4728187
60. Nath, A. R., and Beauchamp, M. S. (2012). A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage 59, 781-787. doi: 10.1016/j.neuroimage.2011.07.024
61. Navarra, J., Alsius, A., Velasco, I., Soto-Faraco, S., and Spence, C. (2010). Perception of audiovisual speech synchrony for native and non-native language. Brain Res. 1323, 84-93. doi: 10.1016/j.brainres.2010.01.059
62. Ngo, N. K., and Spence, C. (2010). Auditory, tactile, and multisensory cues can facilitate search for dynamic visual stimuli. Atten. Percept. Psychophys. 72, 1654-1665. doi: 10.3758/APP.72.6.1654
63. Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H. J.,et al. (2007). Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices.J. Neurosci. 27, 11431-11441. doi: 10.1523/JNEUROSCI.2252-07.2007
64. Noesselt, T., Tyll, S., Boehler, C. N., Budinger, E., Heinze, H. J., and Driver, J. (2010). Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity. J. Neurosci. 30, 13609-13623. doi: 10.1523/jneurosci.4524-09.2010
65. Rach, S., Diederich, A., and Colonius, H. (2011). On quantifying multisensory interaction effects in reaction time and detection rate. Psychol. Res. 75, 77-94. doi: 10.1007/s00426-010-0289-0
66. Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
67. Remez, R. E., Rubin, P. E., Pisoni, D. B., and Carrell, T. D. (1981). Speech perception without traditional speech cues.Science 212, 947-950. doi: 10.1126/science.7233191
68. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Molholm, S., Javitt, D. C., and Foxe, J. J. (2007). Impaired multisensory processing in schizophrenia: deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophr. Res. 97, 173-183. doi: 10.1016/j.schres.2007.08.008
69. Scott, G. D., Karns, C. M., Dow, M. W., Stevens, C., and Neville, H. J. (2014). Enhanced peripheral visual processing in congenitally deaf humans is supported by multiple brain regions, including primary auditory cortex. Front. Hum. Neurosci. 8:177. doi: 10.3389/fnhum.2014.00177
70. Sekuler, R., Sekuler, A. B., and Lau, R. (1997). Sound alters visual motion perception. Nature 385:308. doi: 10.1038/385308a0
71. Senkowski, D., Talsma, D., Grigutsch, M., Herrmann, C. S., and Woldorff, M. G. (2007). Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations.Neuropsychologia 45, 561-571. doi: 10.1016/j.neuropsychologia.2006.01.013
72. Senkowski, D., Talsma, D., Herrmann, C. S., and Woldorff, M. G. (2005). Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp. Brain Res. 166, 411-426. doi: 10.1007/s00221-005-2381-z
73. Staufenbiel, M., Van der Lubbe, R. H. J., and Talsma, D. (2011). Spatially uninformative sounds increase sensitivity for visual motion change. Exp. Brain Res. 213, 457-464. doi: 10.1007/s00221-011-2797-6
74. Stein, B. E., Burr, D., Constantinidis, C., Laurienti, P. J., Meredith, A. M., Perrault, T. J.,et al. (2010). Semantic confusion regarding the development of multisensory integration: a practical solution. Eur. J. Neurosci. 31, 1713-1720. doi: 10.1111/j.1460-9568.2010.07206.x
75. Stein, B. E., London, N., Wilkinson, L. K., and Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J. Cogn. Neurosci. 8, 497-506. doi: 10.1162/jocn.1996.8.6.497
76. Stein, B. E., and Meredith, M. A. (1993). The Merging of the Senses. Cambridge, MA: MIT Press.
77. Stein, B. E., and Rowland, B. A. (2011). Organization and plasticity in multisensory integration. Prog. Brain Res.191, 145-163. doi: 10.1016/b978-0-444-53752-2.00007-2
78. Stein, B. E., and Stanford, T. R. (2008). Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 9, 255-266. doi: 10.1038/nrn2331
79. Stevenson, R. A., Segers, M., Ferber, S., Barense, M. D., and Wallace, M. T. (2014). The impact of multisensory integration deficits on speech perception in children with autism spectrum disorders. Front. Psychol. 5:379. doi: 10.3389/fpsyg.2014.00379
80. Stevenson, R. A., and Wallace, M. T. (2013). Multisensory temporal integration: task and stimulus dependencies.Exp. Brain Res. 227, 249-261. doi: 10.1007/s00221-013-3507-3
81. Talsma, D., Doty, T. J., and Woldorff, M. G. (2007). Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb. Cortex 17, 679-690. doi: 10.1093/cercor/bhk016
82. Talsma, D., Senkowski, D., Soto-Faraco, S., and Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends Cogn. Sci. (Regul. Ed.) 14, 400-410. doi: 10.1016/j.tics.2010.06.008
83. Talsma, D., and Woldorff, M. G. (2005). Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17, 1098-1114. doi: 10.1162/0898929054475172
84. Thelen, A., Cappe, C., and Murray, M. M. (2012). Electrical neuroimaging of memory discrimination based on single-trial multisensory learning. Neuroimage 62, 1478-1488. doi: 10.1016/j.neuroimage.2012.05.027
85. Thelen, A., Talsma, D., and Murray, M. M. (2015). Single-trial multisensory memories affect later auditory and visual object discrimination. Cognition 138, 148-160. doi: 10.1016/j.cognition.2015.02.003
86. Tiippana, K., Andersen, T. S., and Sams, M. (2004). Visual attention modulates audiovisual speech perception. Eur. J. Cogn. Psychol. 16, 457-472. doi: 10.1080/09541440340000268
87. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychol. Rev. 55, 189-208. doi: 10.1037/h0061626
88. Treisman, A. M., and Gelade, G. (1980). A feature-integration theory of attention. Cogn. Psychol. 12, 97-136. doi: 10.1016/0010-0285(80)90005-5
89. Tuomainen, J., Andersen, T. S., Tiippana, K., and Sams, M. (2005). Audio-visual speech perception is special.Cognition 96, B13-B22. doi: 10.1016/j.cognition.2004.10.004
90. van Atteveldt, N. M., Formisano, E., Goebel, R., and Blomert, L. (2007). Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36, 1345-1360. doi: 10.1016/j.neuroimage.2007.03.065
91. van Atteveldt, N. M., Murray, M. M., Thut, G., and Schroeder, C. E. (2014). Multisensory integration: flexible use of general operations. Neuron 81, 1240-1253. doi: 10.1016/j.neuron.2014.02.044
92. van den Brink, R. L., Cohen, M. X., van der Burg, E., Talsma, D., Vissers, M. E., and Slagter, H. A. (2014). Subcortical, modality-specific pathways contribute to multisensory processing in humans. Cereb. Cortex 24, 2169-2177. doi: 10.1093/cercor/bht069
93. Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., and Theeuwes, J. (2008). Pip and pop: nonspatial auditory signals improve spatial visual search. J. Exp. Psychol. Hum. Percept. Perform. 34, 1053-1065. doi: 10.1037/0096-1523.34.5.1053
94. Van der Burg, E., Talsma, D., Olivers, C. N. L., Hickey, C., and Theeuwes, J. (2011). Early multisensory interactions affect the competition among multiple visual objects. Neuroimage 55, 1208-1218. doi: 10.1016/j.neuroimage.2010.12.068
95. van Ee, R., Van Boxtel, J. J. A., Parker, A. L., and Alais, D. (2009). Multisensory congruency as a mechanism for attentional control over perceptual selection. J. Neurosci. 29, 11641-11649. doi: 10.1523/JNEUROSCI.0873-09.2009
96. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U.S.A. 102, 1181-1186. doi: 10.1073/pnas.0408949102
97. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2007). Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45, 598-607. doi: 10.1016/j.neuropsychologia.2006.01.001
98. Vatakis, A., and Spence, C. (2007). Crossmodal binding: evaluating the "unity assumption" using audiovisual speech stimuli. Percept. Psychophys. 69, 744-756. doi: 10.3758/BF03193776
99. Vetter, P., Smith, F. W., and Muckli, L. (2014). Decoding sound and imagery content in early visual cortex. Curr. Biol. 24, 1256-1262. doi: 10.1016/j.cub.2014.04.020
100. Vroomen, J., and Baart, M. (2009). Phonetic recalibration only occurs in speech mode. Cognition 110, 254-259. doi: 10.1016/j.cognition.2008.10.015
101. Vroomen, J., and Stekelenburg, J. J. (2011). Perception of intersensory synchrony in audiovisual speech: not that special. Cognition 118, 75-83. doi: 10.1016/j.cognition.2010.10.002
102. Wallace, M. T., Meredith, M. A., and Stein, B. E. (1998). Multisensory integration in the superior colliculus of the alert cat. J. Neurophysiol. 80, 1006-1010.
103. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., and Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Exp. Brain Res. 158, 252-258. doi: 10.1007/s00221-004-1899-9
104. Wallace, M. T., and Stein, B. E. (2001). Sensory and multisensory responses in the newborn monkey superior colliculus. J. Neurosci. 21, 8886-8894.
105. Welch, R. B. (1999). "Meaning, attention, and the unity assumption in the intersensory bias of spatial and temporal perceptions," in Cognitive Contributions to the Perception of Spatial and Temporal Events, eds G. Aschersleben, T. Bachmann, and J. Müsseler (Amsterdam: Elsevier), 371-387.
106. Welch, R. B., and Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychol. Bull.88, 638-667. doi: 10.1037/0033-2909.88.3.638
107. Yau, J. M., Olenczak, J. B., Dammann, J. F., and Bensmaia, S. J. (2009). Temporal frequency channels are linked across audition and touch. Curr. Biol. 19, 561-566. doi: 10.1016/j.cub.2009.02.013
108. Yau, J. M., Weber, A. I., and Bensmaia, S. J. (2010). Separate mechanisms for audio-tactile pitch and loudness interactions. Front. Psychol. 1:160. doi: 10.3389/fpsyg.2010.00160
109. Yu, J. Y., and Frank, L. M. (2015). Hippocampal-cortical interaction in decision making. Neurobiol. Learn. Mem.117, 34-41. doi: 10.1016/j.nlm.2014.02.002