Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings

Journal of Neurophysiology

Volumn 96, Issue 2, 2006, Pages 721-729

  Molholm, Sophie ^a,d   Sehatpour, Pejman ^a   Mehta, Ashesh D ^b   Shpaner, Marina ^a,d   Gomez Ramirez, Manuel ^a,d   Ortigue, Stephanie ^c   Dyke, Jonathan P ^b   Schwartz, Theodore H ^b   Foxe, John J ^a,d  

^a NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^b NEW YORK PRESBYTERIAN HOSPITAL   (United States)

^c DARTMOUTH COLLEGE   (United States)

^d CITY COLLEGE OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; CASE REPORT; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EPILEPSY; HUMAN; INTEGRATION; MATHEMATICAL ANALYSIS; MEASUREMENT; MORPHOLOGY; NEUROSCIENCE; PARIETAL LOBE; PRIORITY JOURNAL; RECORDING; SENSORIMOTOR INTEGRATION; STIMULATION; STIMULUS; TASK PERFORMANCE; VISION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; ELECTRODES, IMPLANTED; ELECTROENCEPHALOGRAPHY; EPILEPSY; FEMALE; HUMANS; MALE; MIDDLE AGED; PARIETAL LOBE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; VISUAL PERCEPTION;

EID: 33746646378     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.00285.2006     Document Type: Article

References (71)

1. Andersen RA, Brotchie PR, and Mazzoni P. Evidence for the lateral intraparietal area as the parietal eye field. Curr Opin Neurobiol 2: 840-846, 1992.
2. Andersen RA, Snyder LH, Bradley DC, and Xing J. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu Rev Neurosci 20: 303-330, 1997.
3. Astafiev SV, Shulman GL, Stanley CM, Snyder AZ, Van E, and Corbetta M. Functional organization of human intraparietal and frontal cortex for attending, looking, and pointing. J Neurosci 23: 4689-4699, 2003.
4. Avillac M, Deneve S, Olivier E, Pouget A, and Duhamel JR. Reference frames for representing visual and tactile locations in parietal cortex. Nat Neurosci 8: 941-949, 2005.
5. Barth DS, Goldberg N, Brett B, and Di S. The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex. Brain Res 678: 177-190, 1995.
6. Bremmer F. Navigation in space-the role of the macaque ventral intraparietal area. J Physiol 566: 29-35, 2005.
7. Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann K, Zilles K, and Fink GR. Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29: 287-296, 2001.
8. Brett-Green B, Paulsen M, Staba RJ, Fifkova E, and Barth DS. Two distinct regions of secondary somatosensory cortex in the rat: topographical organization and multisensory responses. J Neurophysiol 91: 1327-1336, 2004.
9. Bushara KO, Weeks RA, Ishii K, Catalan MJ, Tian B, Rauschecker JP, and Hallett M. Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans. Nat Neurosci 2: 759-766, 1999.
10. Calvert GA, Hansen PC, Iversen SD, and Brammer MJ. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 14: 427-438, 2001.
11. Celesia GG. Organization of auditory cortical areas in man. Brain 99: 403-414, 1976.
12. Celesia GG and Puletti F. Auditory cortical areas of man. Neurology 19: 211-220, 1969.
13. Celesia GG and Puletti F. Auditory input to the human cortex during states of drowsiness and surgical anesthesia. Electroencephalogr Clin Neurophysiol 31: 603-609, 1971.
14. Clark VP and Hillyard SA. Spatial selective attention affects early extrastriate but not striate components of the visual evoked potential. J Cogn Neurosci 8: 387-402, 1996.
15. Cohen YE and Andersen RA. Multimodal spatial representations in the primate parietal lobe. In: Crossmodal Space and Crossmodal Attention, edited by Spence C and Driver J. New York: Oxford, 2004, p. 99-121.
16. Cohen YE, Cohen IS, and Gifford GW III.Modulation of LIP activity by predictive auditory and visual cues. Cereb Cortex 14: 1287-1301, 2004.
17. Corbetta M, Miezin FM, Shulman GL, and Petersen SE. A PET study of visuospatial attention. J Neurosci 13: 1202-1226, 1993.
18. Di S, Brett B, and Barth DS. Polysensory evoked potentials in rat parietotemporal cortex: combined auditory and somatosensory responses. Brain Res 642: 267-280, 1994.
19. Driver J and Spence C. Crossmodal attention. Curr Opin Neurobiol 8: 245-253, 1998.
20. Ebeling U and Steinmetz H. Anatomy of the parietal lobe: mapping the individual pattern. Acta Neurochir (Wien) 136: 8-11, 1995.
21. Eimer M. Crossmodal links in spatial attention between vision, audition, and touch: evidence from event-related brain potentials. Neuropsychologia 39: 1292-1303, 2001.
22. Evans KK and Treisman A. Perception of objects in natural scenes: is it really attention free? J Exp Psychol Hum Percept Perform 31: 1476-1492, 2005.
23. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, and Schroeder CE. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10: 77-83, 2000.
24. Foxe JJ and Schroeder CE. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16: 419-423, 2005.
25. Foxe JJ and Simpson GV. Flow of activation from V1 to frontal cortex in humans: a framework for defining "early" visual processing. Exp Brain Res 142: 139-150, 2002.
26. Geyer S, Matelli M, Luppino G, and Zilles K. Functional neuroanatomy of the primate isocortical motor system. Anat Embryol (Berl) 202: 443-474, 2000.
27. Giard MH and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11: 473-490, 1999.
28. Gifford GW III and Cohen YE. Effect of a central fixation light on auditory spatial responses in area LIP. J Neurophysiol 91: 2929-2933, 2004.
29. Grunewald A, Linden JF, and Andersen RA. Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. J Neurophysiol 82: 330-342, 1999.
30. Hillyard SA, Simpson GV, Woods DL, Van Voorhis ST, and Munte TF. Event-related brain potentials and selective attention to different modalities. In: Cortical Integration, edited by Reinoso-Suarez F. New York: Ravel Press, 1984, p. 395-414.
31. Hyvarinen J. Regional distribution of functions in parietal association area 7 of the monkey. Brain Res 206: 287-303, 1981.
32. Iacoboni M, Woods RP, and Mazziotta JC. Bimodal (auditory and visual) left frontoparietal circuitry for sensorimotor integration and sensorimotor learning. Brain 121: 2135-2143, 1998.
33. Lacquaniti F and Caminiti R. Visuo-motor transformations for arm reaching. Eur J Neurosci 10: 195-203, 1998.
34. Leinonen L. Functional properties of neurones in the posterior part of area 7 in awake monkey. Acta Physiol Scand 108: 301-308, 1980.
35. Lewis JW, Beauchamp MS, and DeYoe EA. A comparison of visual and auditory motion processing in human cerebral cortex. Cereb Cortex 10: 873-888, 2000.
36. Linden JF, Grunewald A, and Andersen RA. Responses to auditory stimuli in macaque lateral intraparietal area. II. Behavioral modulation. J Neurophysiol 82: 343-358, 1999.
37. Macaluso E and Driver J. Spatial attention and crossmodal interactions between vision and touch. Neuropsychologia 39: 1304-1316, 2001.
38. Macaluso E and Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain. Trends Neurosci 28: 264-271, 2005.
39. Mazzoni P, Bracewell RM, Barash S, and Andersen RA. Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. J Neurophysiol 75: 1233-1241, 1996.
40. McDonald JJ and Ward LM. Involuntary listening aids seeing: evidence from human electrophysiology. Psychol Sci 11: 167-171, 2000.
41. Miller J. Divided attention: evidence for coactivation with redundant signals. Cogn Psychol 14: 247-279, 1982.
42. Miller LM and D'Esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25: 5884-5893, 2005.
43. Molholm S, Ritter W, Javitt DC, and Foxe JJ. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14: 452-465, 2004.
44. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, and Foxe JJ. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14: 115-128, 2002.
45. Mullette-Gillman OA, Cohen YE, and Groh JM. Eye-centered, head-centered, and complex coding of visual and auditory targets in the intraparietal sulcus. J Neurophysiol 94: 2331-2352, 2005.
46. Murray MM, Foxe JJ, Higgins BA, Javitt DC, and Schroeder CE. Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study. Neuropsychologia 39: 828-844, 2001.
47. Ojanen V, Mottonen R, Pekkola J, Jaaskelainen IP, Joensuu R, Autti T, and Sams M. Processing of audiovisual speech in Broca's area. Neuroimage 25: 333-338, 2005.
48. Pardo JV, Fox PT, and Raichle ME. Localization of a human system for sustained attention by positron emission tomography. Nature 349: 61-64, 1991.
49. Rizzuto DS, Mamelak AN, Sutherling WW, Fineman I, and Andersen RA. Spatial selectivity in human ventrolateral prefrontal cortex. Nat Neurosci 8: 415-417, 2005.
50. Schlack A, Sterbing-D'Angelo SJ, Hartung K, Hoffmann KP, and Bremmer F. Multisensory space representations in the macaque ventral intraparietal area. J Neurosci 25: 4616-4625, 2005.
51. Schroeder CE and Foxe JJ. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Res Cogn Brain Res 14: 187-198, 2002.
52. Schroeder CE and Foxe JJ. Multisensory contributions to low-level, 'unisensory' processing. Curr Opin Neurobiol 15: 454-458, 2005.
53. Schroeder CE, Mehta AD, and Foxe JJ. Determinants and mechanisms of attentional modulation of neural processing. Front Biosci 6: 672-684, 2001.
54. Schroeder CE, Mehta AD, and Givre SJ. A spatiotemporal profile of visual system activation revealed by current source density analysis in the awake macaque. Cereb Cortex 8: 575-592, 1998.
55. Schroeder CE, Molholm S, Lakatos P, Ritter W, and Foxe JJ. Humansimian correspondence in the early cortical processing of multisensory cues. Cogn Process 5: 140-151, 2004.
56. Sereno MI and Huang RS. Mapping the ventral intraparietal area (VIP) in humans. Soc Neurosci Abstr 2005.
57. Sereno MI and Tootell RB. From monkeys to humans: what do we now know about brain homologies? Curr Opin Neurobiol 15: 135-144, 2005.
58. Shomstein S and Yantis S. Control of attention shifts between vision and audition in human cortex. J Neurosci 24: 10702-10706, 2004.
59. Spence C and Driver J. On measuring selective attention to an expected sensory modality. Percept Psychophys 59: 389-403, 1997.
60. Stanford TR, Quessy S, and Stein BE. Evaluating the operations underlying multisensory integration in the cat superior colliculus. J Neurosci 25: 6499-6508, 2005.
61. Stein BE and Meredith MA. The Merging of the Senses. Cambridge, MA: MIT Press, 1993.
62. Stricanne B, Andersen RA, and Mazzoni P. Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J Neurophysiol 76: 2071-2076, 1996.
63. William Sealey Gosset (Student). The probable error of the mean. Biometrika 6: 1-25, 1908.
64. Tanabe HC, Kato M, Miyauchi S, Hayashi S, and Yanagida T. The sensorimotor transformation of cross-modal spatial information in the anterior intraparietal sulcus as revealed by functional MRI. Brain Res Cogn Brain Res 22: 385-396, 2005.
65. Teder-Salejarvi WA, Munte TF, Sperlich F, and Hillyard SA. Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An even-trelated brain potential study. Brain Res Cogn Brain Res 8: 327-343, 1999.
66. Treisman A. Perceptual grouping and attention in visual search for features and for objects. J Exp Psychol Hum Percept Perform 8: 194-214, 1982.
67. Treisman AM and Gelade G. A feature-integration theory of attention. Cogn Psychol 12: 97-136, 1980.
68. Vandenberghe R, Gitelman DR, Parrish TB, and Mesulam MM. Locationor feature-based targeting of peripheral attention. Neuroimage 14: 37-47, 2001.
69. Wallace MT, Meredith MA, and Stein BE. Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. J Neurophysiol 69: 1797-1809, 1993.
70. Wallace MT, Ramachandran R, and Stein BE. A revised view of sensory cortical parcellation. Proc Natl Acad Sci USA 101: 2167-2172, 2004.
71. Watson RT, Valenstein E, Day A, and Heilman KM. Posterior neocortical systems subserving awareness and neglect. Neglect associated with superior temporal sulcus but not area 7 lesions. Arch Neurol 51: 1014-1021, 1994.