Integration of touch and sound in auditory cortex

Neuron

Volumn 48, Issue 2, 2005, Pages 373-384

  Kayser, Christoph ^a   Petkov, Christopher I ^a   Augath, Mark ^a   Logothetis, Nikos K ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; MACACA; NOISE; NONHUMAN; PRIORITY JOURNAL; SENSORY STIMULATION; SOUND; TACTILE STIMULATION; TOUCH;

ANIMALS; AUDITORY CORTEX; AUDITORY PERCEPTION; BEHAVIOR, ANIMAL; BRAIN MAPPING; IMAGE PROCESSING, COMPUTER-ASSISTED; MACACA MULATTA; MAGNETIC RESONANCE IMAGING; OXYGEN; PHYSICAL STIMULATION; SOUND; TOUCH;

EID: 26944458089     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2005.09.018     Document Type: Article

References (76)

1. S. Akbarian, O.J. Grusser, and W.O. Guldin Corticofugal connections between the cerebral cortex and brainstem vestibular nuclei in the macaque monkey J. Comp. Neurol. 339 1994 421 437
2. M.S. Beauchamp See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex Curr. Opin. Neurobiol. 15 2005 145 153
3. M.S. Beauchamp Statistical criteria in FMRI studies of multisensory integration Neuroinformatics 3 2005 93 114
4. L.A. Benevento, J. Fallon, B.J. Davis, and M. Rezak Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey Exp. Neurol. 57 1977 849 872
5. J. Bhattacharya, L. Shams, and S. Shimojo Sound-induced illusory flash perception: role of gamma band responses Neuroreport 13 2002 1727 1730
6. C. Bruce, R. Desimone, and C.G. Gross Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque J. Neurophysiol. 46 1981 369 384
7. E.T. Bullmore, J. Suckling, S. Overmeyer, S. Rabe-Hesketh, E. Taylor, and M.J. Brammer Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain IEEE Trans. Med. Imaging 18 1999 32 42
8. D.E. Callan, J.A. Jones, K. Munhall, C. Kroos, A.M. Callan, and E. Vatikiotis-Bateson Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information J. Cogn. Neurosci. 16 2004 805 816
9. G. Calvert, C. Spence, and B.E. Stein The handbook of multisensory processes 2004 MIT Press Cambridge, MA
10. G.A. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies Cereb. Cortex 11 2001 1110 1123
11. G.A. Calvert, E.T. Bullmore, M.J. Brammer, R. Campbell, S.C. Williams, P.K. McGuire, P.W. Woodruff, S.D. Iversen, and A.S. David Activation of auditory cortex during silent lipreading Science 276 1997 593 596
12. G.A. Calvert, P.C. Hansen, S.D. Iversen, and M.J. Brammer Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect Neuroimage 14 2001 427 438
13. J. Driver, and C. Spence Crossmodal attention Curr. Opin. Neurobiol. 8 1998 245 253
14. J.R. Duhamel, C.L. Colby, and M.E. Goldberg Ventral intraparietal area of the macaque: congruent visual and somatic response properties J. Neurophysiol. 79 1998 126 136
15. A. Falchier, S. Clavagnier, P. Barone, and H. Kennedy Anatomical evidence of multimodal integration in primate striate cortex J. Neurosci. 22 2002 5749 5759
16. D.J. Felleman, and D.C. Van Essen Distributed hierarchical processing in the primate cerebral cortex Cereb. Cortex 1 1991 1 47
17. J.J. Foxe, and C.E. Schroeder The case for feedforward multisensory convergence during early cortical processing Neuroreport 16 2005 419 423
18. J.J. Foxe, I.A. Morocz, M.M. Murray, B.A. Higgins, D.C. Javitt, and C.E. Schroeder Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping Brain Res. Cogn. Brain Res. 10 2000 77 83
19. J.J. Foxe, G.R. Wylie, A. Martinez, C.E. Schroeder, D.C. Javitt, D. Guilfoyle, W. Ritter, and M.M. Murray Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study J. Neurophysiol. 88 2002 540 543
20. K.M. Fu, T.A. Johnston, A.S. Shah, L. Arnold, J. Smiley, T.A. Hackett, P.E. Garraghty, and C.E. Schroeder Auditory cortical neurons respond to somatosensory stimulation J. Neurosci. 23 2003 7510 7515
21. K.M. Fu, A.S. Shah, M.N. O'Connell, T. McGinnis, H. Eckholdt, P. Lakatos, J. Smiley, and C.E. Schroeder Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex J. Neurophysiol. 92 2004 3522 3531
22. A.A. Ghazanfar, J.X. Maier, K.L. Hoffman, and N.K. Logothetis Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex J. Neurosci. 25 2005 5004 5012
23. M.H. Giard, and F. Peronnet Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study J. Cogn. Neurosci. 11 1999 473 490
24. R. Gobbele, M. Schurmann, N. Forss, K. Juottonen, H. Buchner, and R. Hari Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction Neuroimage 20 2003 503 511
25. B. Gordon Receptive fields in deep layers of cat superior colliculus J. Neurophysiol. 36 1973 157 178
26. W.O. Guldin, and O.J. Grusser Is there a vestibular cortex? Trends Neurosci. 21 1998 254 259
27. T.A. Hackett, I. Stepniewska, and J.H. Kaas Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys J. Comp. Neurol. 394 1998 475 495
28. T.A. Hackett, I. Stepniewska, and J.H. Kaas Thalamocortical connections of the parabelt auditory cortex in macaque monkeys J. Comp. Neurol. 400 1998 271 286
29. T.A. Hackett, T.M. Preuss, and J.H. Kaas Architectonic identification of the core region in auditory cortex of macaques, chimpanzees, and humans J. Comp. Neurol. 441 2001 197 222
30. S. Hayasaka, and T.E. Nichols Combining voxel intensity and cluster extent with permutation test framework Neuroimage 23 2004 54 63
31. W. Heinke, and C. Schwarzbauer Subanesthetic isoflurane affects task-induced brain activation in a highly specific manner: a functional magnetic resonance imaging study Anesthesiology 94 2001 973 981
32. M.T. Herrero, C. Barcia, and J.M. Navarro Functional anatomy of thalamus and basal ganglia Childs Nerv. Syst. 18 2002 386 404
33. M. Hershenson Reaction time as a measure of intersensory facilitation J. Exp. Psychol. 63 1962 289 293
34. J. Hyvarinen, and Y. Shelepin Distribution of visual and somatic functions in the parietal associative area 7 of the monkey Brain Res. 169 1979 561 564
35. V. Jousmaki, and R. Hari Parchment-skin illusion: sound-biased touch Curr. Biol. 8 1998 R190
36. J.H. Kaas, and T.A. Hackett Subdivisions of auditory cortex and processing streams in primates Proc. Natl. Acad. Sci. USA 97 2000 11793 11799
37. J.H. Kaas, T.A. Hackett, and M.J. Tramo Auditory processing in primate cerebral cortex Curr. Opin. Neurobiol. 9 1999 164 170
38. H. Kosaki, T. Hashikawa, J. He, and E.G. Jones Tonotopic organization of auditory cortical fields delineated by parvalbumin immunoreactivity in macaque monkeys J. Comp. Neurol. 386 1997 304 316
39. L. Krubitzer, J. Clarey, R. Tweedale, G. Elston, and M. Calford A redefinition of somatosensory areas in the lateral sulcus of macaque monkeys J. Neurosci. 15 1995 3821 3839
40. P.J. Laurienti, T.J. Perrault, T.R. Stanford, M.T. Wallace, and B.E. Stein On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies Exp. Brain Res. 2005 in press. Published online June 30, 2005. 10.1007/s00221-005-2370-2
41. S.J. Lederman Auditory texture perception Perception 8 1979 93 103
42. S.J. Lederman, R.L. Klatzky, C. Hamilton, and T. Morgan Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources Proceedings of the 10th Annual Symposium on Haptic Interfaces for Teleoperators and Virtual Environment Systems 2002 97 104
43. L. Leinonen Functional properties of neurones in the parietal retroinsular cortex in awake monkey Acta Physiol. Scand. 108 1980 381 384
44. S. Levanen, V. Jousmaki, and R. Hari Vibration-induced auditory-cortex activation in a congenitally deaf adult Curr. Biol. 8 1998 869 872
45. N.K. Logothetis, H. Guggenberger, S. Peled, and J. Pauls Functional imaging of the monkey brain Nat. Neurosci. 2 1999 555 562
46. B. Lutkenhoner, C. Lammertmann, C. Simoes, and R. Hari Magnetoencephalographic correlates of audiotactile interaction Neuroimage 15 2002 509 522
47. E. Macaluso, and J. Driver Multisensory spatial interactions: a window onto functional integration in the human brain Trends Neurosci. 28 2005 264 271
48. E. Macaluso, C.D. Frith, and J. Driver Modulation of human visual cortex by crossmodal spatial attention Science 289 2000 1206 1208
49. M.A. Meredith, and B.E. Stein Spatial determinants of multisensory integration in cat superior colliculus neurons J. Neurophysiol. 75 1996 1843 1857
50. S. Molholm, W. Ritter, M.M. Murray, D.C. Javitt, C.E. Schroeder, and J.J. Foxe Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Brain Res. Cogn. Brain Res. 14 2002 115 128
51. M.M. Murray, S. Molholm, C.M. Michel, D.J. Heslenfeld, W. Ritter, D.C. Javitt, C.E. Schroeder, and J.J. Foxe Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment Cereb. Cortex 15 2004 963 974
52. T.E. Nichols, and A.P. Holmes Nonparametric permutation tests for functional neuroimaging: a primer with examples Hum. Brain Mapp. 15 2002 1 25
53. C.R. Olson, and A.M. Graybiel Sensory maps in the claustrum of the cat Nature 288 1980 479 481
54. S. Ortigue, D. Jabaudon, T. Landis, C.M. Michel, A. Maravita, and O. Blanke Preattentive interference between touch and audition: a case study on multisensory alloesthesia Neuroreport 16 2005 865 868
55. J. Padberg, B. Seltzer, and C.G. Cusick Architectonics and cortical connections of the upper bank of the superior temporal sulcus in the rhesus monkey: an analysis in the tangential plane J. Comp. Neurol. 467 2003 418 434
56. J. Pekkola, V. Ojanen, T. Autti, I.P. Jaaskelainen, R. Mottonen, A. Tarkiainen, and M. Sams Primary auditory cortex activation by visual speech: an fMRI study at 3 T Neuroreport 16 2005 125 128
57. J.P. Rauschecker, and B. Tian Mechanisms and streams for processing of "what" and "where" in auditory cortex Proc. Natl. Acad. Sci. USA 97 2000 11800 11806
58. J.P. Rauschecker, and B. Tian Processing of band-passed noise in the lateral auditory belt cortex of the rhesus monkey J. Neurophysiol. 91 2004 2578 2589
59. J.P. Rauschecker, B. Tian, and M. Hauser Processing of complex sounds in the macaque nonprimary auditory cortex Science 268 1995 111 114
60. J.P. Rauschecker, B. Tian, T. Pons, and M. Mishkin Serial and parallel processing in rhesus monkey auditory cortex J. Comp. Neurol. 382 1997 89 103
61. G.H. Recanzone, D.C. Guard, and M.L. Phan Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey J. Neurophysiol. 83 2000 2315 2331
62. G. Rizzolatti, C. Scandolara, M. Gentilucci, and R. Camarda Response properties and behavioral modulation of "mouth" neurons of the postarcuate cortex (area 6) in macaque monkeys Brain Res. 225 1981 421 424
63. C.J. Robinson, and H. Burton Organization of somatosensory receptive fields in cortical areas 7b, retroinsula, postauditory and granular insula of M. fascicularis J. Comp. Neurol. 192 1980 69 92
64. K.S. Rockland, and H. Ojima Multisensory convergence in calcarine visual areas in macaque monkey Int. J. Psychophysiol. 50 2003 19 26
65. C.E. Schroeder, and J. Foxe Multisensory contributions to low-level, 'unisensory' processing Curr. Opin. Neurobiol. 15 2005 454 458
66. C.E. Schroeder, and J.J. Foxe The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex Brain Res. Cogn. Brain Res. 14 2002 187 198
67. C.E. Schroeder, R.W. Lindsley, C. Specht, A. Marcovici, J.F. Smiley, and D.C. Javitt Somatosensory input to auditory association cortex in the macaque monkey J. Neurophysiol. 85 2001 1322 1327
68. C.E. Schroeder, J. Smiley, K.G. Fu, T. McGinnis, M.N. O'Connell, and T.A. Hackett Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing Int. J. Psychophysiol. 50 2003 5 17
69. L. Shams, Y. Kamitani, S. Thompson, and S. Shimojo Sound alters visual evoked potentials in humans Neuroreport 12 2001 3849 3852
70. H. Sherk The claustrum and the cerebral cortex E.G. Jones A. Peters Cerebral Cortex, Volume 5 1986 Plenum New York
71. C. Spence, and J. Driver Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism Neuroreport 11 2000 2057 2061
72. B.E. Stein, and M.A. Meredith Merging of the Senses. 1993 MIT Press Cambridge, MA
73. B.E. Stein, M.A. Meredith, and M.T. Wallace The visually responsive neuron and beyond: multisensory integration in cat and monkey Prog. Brain Res. 95 1993 79 90
74. N. van Atteveldt, E. Formisano, R. Goebel, and L. Blomert Integration of letters and speech sounds in the human brain Neuron 43 2004 271 282
75. V. van Wassenhove, K.W. Grant, and D. Poeppel Visual speech speeds up the neural processing of auditory speech Proc. Natl. Acad. Sci. USA 102 2005 1181 1186
76. U. Werner-Reiss, K.A. Kelly, A.S. Trause, A.M. Underhill, and J.M. Groh Eye position affects activity in primary auditory cortex of primates Curr. Biol. 13 2003 554 562