Early, low-level auditory-somatosensory multisensory interactions impact reaction time speed

Frontiers in Integrative Neuroscience

Volumn 3, Issue MAR, 2009, Pages

  Sperdin, Holger F ^a   Cappe, Céline ^a   Foxe, John J ^b,c   Murray, Micah M ^a,d  

^a LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^b NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^c CITY COLLEGE OF NEW YORK   (United States)

^d EEG Brain Mapping Core   (Switzerland)

Author keywords

Auditory; Crossmodal; Event related potential; Multisensory; Reaction time; Redundant signals effect; Somatosensory; Tactile

Indexed keywords

EID: 70450223246     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.07.002.2009     Document Type: Article

References (72)

1. American Electroencephalographic Society. (1994). American Electroencephalographic Society. Guideline thirteen: guidelines for standard electrode position nomenclature. J. Clin. Neurophysiol. 11, 111-113.
2. Beauchamp, M. S., Yasar, N. E., Frye, R. E., and Ro, T. (2008). Touch, sound and vision in human superior temporal sulcus. Neuroimage 41, 1011-1020.
3. Brett-Green, B. A., Miller, L. J., Gavin, W. J., and Davies, P. L. (2008). Multisensory integration in children: a preliminary ERP study. Brain Res. 1242, 283-290.
4. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., Woodruff, P. W., Iversen, S. D., and David, A. S. (1997). Activation of auditory cortex during silent lipreading. Science 276, 593-596.
5. Calvert, G. A., Spence, C., and Stein, B. E. (2004). The Handbook of Multisensory Processing. Cambridge, MA, MIT Press.
6. Cappe, C., and Barone, P. (2005). Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur. J. Neurosci. 22, 2886-2902.
7. Cappe, C., Morel, A., Barone, P., and Rouiller, E. M. (2009). The thalamocortical projection systems in primate: an anatomical support for multisensory and sensorimotor integrations. Cereb. Cortex. doi:10.1093/cercor/bhn228.
8. Cappe, C., Morel, A., and Rouiller, E. M. (2007). Thalamocortical and the dual pattern of corticothalamic projections of the posterior parietal cortex in macaque monkeys. Neuroscience 146, 1371-1387.
9. Cappe, C., Thut, G., Romei, V., and Murray, M. M. (2008). Selective integration of auditory-visual looming cues by humans. Neuropsychologia 47, 1045-1052.
10. Desimone, R. (1996). Neural mechanisms for visual memory and their role in attention. Proc. Natl. Acad. Sci. USA 93, 13494-13499.
11. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57, 11-23.
12. Driver, J., and Spence, C. (2004). Crossmodal Space and Crossmodal Attention. Oxford, Oxford University Press.
13. Falchier, A., Clavagnier, S., Barone, P., and Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. J. Neurosci. 22, 5749-5759.
14. Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., and Schroeder, C. E. (2000). Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res. Cogn. Brain Res. 10, 77-83.
15. Foxe, J. J., and Schroeder, C. E. (2005). The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16, 419-423.
16. Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., and Murray, M. M. (2002). Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. J. Neurophysiol. 88, 540-543.
17. Fu, K. M., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., Garraghty, P. E., and Schroeder, C. E. (2003). Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23, 7510-7515.
18. Ghazanfar, A. A., and Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends Cogn. Sci. 10, 278-285.
19. Giard, M. H., and Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11, 473-490.
20. Gonzalez Andino, S. L., Murray, M. M., Foxe, J. J., and de Peralta Menendez, R. G. (2005). How singletrial electrical neuroimaging contributes to multisensory research. Exp. Brain Res. 166, 298-304.
21. Grave de Peralta, R., Gonzalez Andino, S., Lantz, G., Michel, C., and Landis, T. (2001). Noninvasive localization of electromagnetic epileptic activity. I. Method descriptions and simulations. Brain Topogr. 14, 131-137.
22. Grave de Peralta, R., Murray, M. M., Michel, C. M., Martuzzi, R., and Gonzalez Andino, S. L. (2004). Electrical neuroimaging based on biophysical constraints. Neuroimage 21, 527-539.
23. Grill-Spector, K., Henson, R.N., and Martin, A. (2006). Repetition and the brain, neural models of stimulusspecific effects. Trends Cogn. Sci. 10, 14-23.
24. Hackett, T. A., De La Mothe, L. A., Ulbert, I., Karmos, G., Smiley, J., and Schroeder, C. E. (2007a). Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane. J. Comp. Neurol. 502, 924-952.
25. Hackett, T. A., Smiley, J. F., Ulbert, I., Karmos, G., Lakatos, P., de la Mothe, L. A., and Schroeder, C. E. (2007b). Sources of somatosensory input to the caudal belt areas of auditory cortex. Perception 36, 1419-1430.
26. Hall, A. J., and Lomber, S. G. (2008). Auditory cortex projections target the peripheral field representation of primary visual cortex. Exp. Brain Res. 190, 413-430.
27. Kayser, C., and Logothetis, N. K. (2007). Do early sensory cortices integrate cross-modal information? Brain Struct. Funct. 212, 121-132.
28. Kayser, C., Petkov, C. I., Augath, M., and Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron 48, 373-384.
29. Lakatos, P., Chen, C. M., O'Connell, M. N., Mills, A., and Schroeder, C. E. (2007). Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53, 279-292.
30. Lehmann, D. (1987). Principles of spatial analysis. In Handbook of Electroencephalography and Clinical Neurophysiology, Vol. 1: Methods of Analysis of Brain Electrical and Magnetic Signals, A. S. Gevins and A. Remond, eds (Amsterdam, Elsevier), pp. 309-405.
31. Lehmann, D., and Skrandies, W. (1980). Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalogr. Clin. Neurophysiol. 48, 609-621.
32. Lehmann, S., and Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination. Brain Res. Cogn. Brain Res. 24, 326-334.
33. Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J. P., Maeder, P. P., Clarke, S., and Meuli, R. A. (2007). Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cereb. Cortex 17, 1672-1679.
34. Meredith, M. A., Keniston, L. R., Dehner, L. R., and Clemo, H. R. (2006). Crossmodal projections from somatosensory area SIV to the auditory field of the anterior ectosylvian sulcus (FAES) in Cat: further evidence for subthreshold forms of multisensory processing. Exp. Brain Res. 172, 472-484.
35. Michel, C. M., Murray, M. M., Lantz, G., Gonzalez, S., Spinelli, L., and Grave de Peralta, R. (2004). EEG source imaging. Clin. Neurophysiol. 115, 2195-2222.
36. Miller, J. (1982). Divided attention: evidence for coactivation with redundant signals. Cogn. Psychol. 14, 247-279.
37. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., and Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res. Cogn. Brain Res. 14, 115-128.
38. Murray, M. M., Brunet, D., and Michel, C. M. (2008). Topographic ERP analyses: a step-by-step tutorial review. Brain Topogr. 20, 249-264.
39. Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., and Schroeder, C. E. (2001). Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study. Neuropsychologia 39, 828-844.
40. Murray, M. M., Foxe, J. J., and Wylie, G. R. (2005a). The brain uses single-trial multisensory memories to discriminate without awareness. Neuroimage 27, 473-478.
41. Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D.J., Ritter, W., Javitt, D. C., Schroeder, C. E., and Foxe, J. J. (2005b). Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cereb. Cortex 15, 963-974.
42. Murray, M. M., Imber, M. L., Javitt, D. C., and Foxe, J. J. (2006). Boundary completion is automatic and dissociable from shape discrimination. J. Neurosci. 26, 12043-12054.
43. Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., and Schnider, A. (2004). Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage 21, 125-135.
44. Oldfield, R. C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97-113.
45. Perrin, F., Pernier, J., Bertrand, O., Giard, M. H., and Echallier, J. F. (1987). Mapping of scalp potentials by surface spline interpolation. Electroencephalogr. Clin. Neurophysiol. 66, 75-81.
46. Pourtois, G., Delplanque, S., Michel, C., and Vuilleumier, P. (2008). Beyond conventional event-related brain potential (ERP): exploring the timecourse of visual emotion processing using topographic and principal component analyses. Brain Topogr. 20, 265-277.
47. Raab, D. H. (1962). Statistical facilitation of simple reaction times. Trans. NY Acad. Sci. 24, 574-590.
48. Rockland, K. S., and Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 50, 19-26.
49. Romei, V., Brodbeck, V., Michel, C., Amedi, A., Pascual-Leone, A., and Thut, G. (2008a). Spontaneous fluctuations in posterior alpha-band EEG activity reflect variability in excitability of human visual areas. Cereb. Cortex 18, 2010-2018.
50. Romei, V., Rihs, T., Brodbeck, V., and Thut, G. (2008b). Resting electroencephalogram alpha-power over posterior sites indexes baseline visual cortex excitability. Neuroreport 19, 203-208.
51. Romei, V., Murray, M. M., Merabet, L. B., and Thut, G. (2007). Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: implications for multisensory interactions. J. Neurosci. 27, 11465-11472.
52. Schroeder, C. E., and Foxe, J. J. (2002). The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res. Cogn. Brain Res. 14, 187-198.
53. Schroeder, C. E., Lindsley, R. W., Specht, C., Marcovici, A., Smiley, J. F., and Javitt, D. C. (2001). Somatosensory input to auditory association cortex in the macaque monkey. J. Neurophysiol. 85, 1322-1327.
54. Schroeder, C. E., Smiley, J., Fu, K. G., McGinnis, T., O'Connell, M. N., and Hackett, T. A. (2003). Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. Int. J. Psychophysiol. 50, 5-17.
55. Schroger, E., and Widmann, A. (1998). Speeded responses to audiovisual signal changes result from bimodal integration. Psychophysiology 35, 755-759.
56. Senkowski, D., Molholm, S., Gomez-Ramirez, M., and Foxe, J. J. (2006). Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study. Cereb. Cortex 16, 1556-1565.
57. Senkowski, D., Schneider, T. R., Foxe, J. J., and Engel, A. K. (2008). Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 31, 401-409.
58. Shams, L., and Seitz, A. R. (2008). Benefits of multisensory learning. Trends Cogn. Sci. 12, 411-417.
59. Smiley, J. F., Hackett, T. A., Ulbert, I., Karmas, G., Lakatos, P., Javitt, D. C., and Schroeder, C. E. (2007). Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys. J. Comp. Neurol. 502, 894-923.
60. Spierer, L., Murray, M. M., Tardif, E., and Clarke, S. (2008). The path to success in auditory spatial discrimination: electrical neuroimaging responses within the supratemporal plane predict performance outcome. Neuroimage 41, 493-503.
61. Spierer, L., Tardif, E., Sperdin, H., Murray, M. M., and Clarke, S. (2007). Learning-induced plasticity in auditory spatial representations revealed by electrical neuroimaging. J. Neurosci. 27, 5474-5483.
62. Stein, B. E., and Meredith, M. A. (1993). The Merging of the Senses. Cambridge, MA, MIT Press.
63. Stein, B. E., and Stanford, T. R. (2008). Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 9, 255-266.
64. Tajadura-Jimenez, A., Kitagawa, N., Valjamae, A., Zampini, M., Murray, M. M., and Spence, C. (2008). Auditory-somatosensory multisensory interactions are spatially modulated by stimulated body surface and acoustic spectra. Neuropsychologia 47, 195-203.
65. Talairach, J., and Tournoux, P. (1988). Co-Planar Stereotaxic Atlas of the Human Brain. New York, Thieme.
66. Talsma, D., Doty, T. J., and Woldorff, M. G. (2007). Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cereb. Cortex 17, 679-690.
67. Talsma, D., and Woldorff, M. G. (2005). Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17, 1098-1114.
68. Toepel, U., Knebel, J. F., Hudry, J., le Coutre, J., and Murray, M. M. (2009). The brain tracks the energetic value in food images. Neuroimage 44, 967-974.
69. Wallace, M. T., Ramachandran, R., and Stein, B. E. (2004). A revised view of sensory cortical parcellation. Proc. Natl. Acad. Sci. USA 101, 2167-2172.
70. Wang, Y., Celebrini, S., Trotter, Y., and Barone, P. (2008). Visuo-auditory interactions in the primary visual cortex of the behaving monkey: electrophysiological evidence. BMC Neurosci. 9, 79.
71. Welch, R. B., and Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 88, 638-667.
72. Zampini, M., Torresan, D., Spence, C., and Murray, M. M. (2007). Auditory-somatosensory multisensory interactions in front and rear space. Neuropsychologia 45, 1869-1877.