Cross-modal processing of auditory-visual stimuli in a no-task paradigm: A topographic event-related potential study

Clinical Neurophysiology

Volumn 119, Issue 4, 2008, Pages 763-771

  Vidal, J ^a,b,c   Giard, M H ^a,d,e   Roux, S ^a,b,c   Barthelemy C ^a,b,c   Bruneau, N ^a,b,c  

^a INSERM   (France)

^b UNIVERSITÉ DE TOURS   (France)

^c CHU BRETONNEAU   (France)

^d Institut Federatif des Neurosciences   (France)

^e UNIVERSITÉ LYON 1   (France)

Author keywords

Auditory visual integration; Cross modal interactions; Event related potentials (ERPs); Human; No task conditions; Potential and scalp current density (SCD) mapping

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BRAIN CORTEX; BRAIN REGION; CORRELATION ANALYSIS; ELECTROPHYSIOLOGY; EVENT RELATED POTENTIAL; FEMALE; FRONTAL CORTEX; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; SENSORY STIMULATION; TASK PERFORMANCE; TEMPORAL CORTEX; VISUAL STIMULATION;

ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; VISUAL PERCEPTION;

EID: 40649129199     PISSN: 13882457     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.clinph.2007.11.178     Document Type: Article

References (48)

1. Barth D.S., Goldberg N., Brett B., and Di S. The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex. Brain Res 678 (1995) 177-190
2. Benevento L.A., Fallon J., Davis B.J., and Rezak M. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol 57 (1977) 849-872
3. Besle J., Fort A., Delpuech C., and Giard M.H. Bimodal speech: early suppressive visual effects in human auditory cortex. Eur J Neurosci 20 (2004) 2225-2234
4. Besle J., Fort A., and Giard M.H. Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn Process 5 (2004) 189-192
5. Bushara K.O., Grafman J., and Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci 21 (2001) 300-304
6. Bushara K.O., Hanakawa T., Immisch I., Toma K., Kansaku K., and Hallett M. Neural correlates of cross-modal binding. Nat Neurosci 6 (2003) 190-195
7. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11 (2001) 1110-1123
8. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., and David A.S. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10 (1999) 2619-2623
9. Calvert G.A., Hansen P.C., Iversen S.D., and Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the bold effect. Neuroimage 14 (2001) 427-438
10. Coburn K.L., Amoss R.T., Arruda J.E., Kizer L.D., and Marshall Y.S. Effects of flash mode and intensity on p2 component latency and amplitude. Int J Psychophysiol 55 (2005) 323-331
11. Crowley K.E., and Colrain I.M. A review of the evidence for p2 being an independent component process: age, sleep and modality. Clin Neurophysiol 115 (2004) 732-744
12. Downar J., Crawley A.P., Mikulis D.J., and Davis K.D. A multimodal cortical network for the detection of changes in the sensory environment. Nat Neurosci 3 (2000) 277-283
13. Falchier A., Clavagnier S., Barone P., and Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22 (2002) 5749-5759
14. Fort A. Corrélats électrophysiologiques de l'intégration des informations auditives et visuelles dans la perception intermodale chez l'homme. Unpublished PhD, Université Lumière Lyon II, Lyon; 2002.
15. Fort A., Delpuech C., Pernier J., and Giard M.H. Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex 12 (2002) 1031-1039
16. Fort A., Delpuech C., Pernier J., and Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res Cogn Brain Res 14 (2002) 20-30
17. Fort A., and Giard M.H. Multiple electrophysiological mechanisms of audio-visual integration in human perception. In: Calvert G.A., Spence C., and Stein B.E. (Eds). The handbook of multisensory processes (2004), MIT Press, Cambridge 503-514
18. Foxe J.J., Morocz I.A., Murray M.M., Higgins B.A., Javitt D.C., and Schroeder C.E. Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Brain Res Cogn Brain Res 10 (2000) 77-83
19. Foxe J.J., Wylie G.R., Martinez A., Schroeder C.E., Javitt D.C., Guilfoyle D., et al. Auditory-somatosensory multisensory processing in auditory association cortex: an fmri study. J Neurophysiol 88 (2002) 540-543
20. Fuster J.M., Bodner M., and Kroger J.K. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405 (2000) 347-351
21. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11 (1999) 473-490
22. Godey B., Schwartz D., de Graaf J.B., Chauvel P., and Liegeois-Chauvel C. Neuromagnetic source localization of auditory evoked fields and intracerebral evoked potentials: a comparison of data in the same patients. Clin Neurophysiol 112 (2001) 1850-1859
23. Guthrie D., and Buchwald J.S. Significance testing of difference potentials. Psychophysiology 28 (1991) 240-244
24. Hadjikhani N., and Roland P.E. Cross-modal transfer of information between the tactile and the visual representations in the human brain: a positron emission tomographic study. J Neurosci 18 (1998) 1072-1084
25. Halit H., de Haan M., and Johnson M.H. Modulation of event-related potentials by prototypical and atypical faces. Neuroreport 11 (2000) 1871-1875
26. Hari R., Pelizzone M., Makela J.P., Hallstrom J., Leinonen L., and Lounasmaa O.V. Neuromagnetic responses of the human auditory cortex to on- and offsets of noise bursts. Audiology 26 (1987) 31-43
27. Itier R.J., and Taylor M.J. Inversion and contrast polarity reversal affect both encoding and recognition processes of unfamiliar faces: a repetition study using erps. Neuroimage 15 (2002) 353-372
28. Johnson J.A., and Zatorre R.J. Attention to simultaneous unrelated auditory and visual events: behavioral and neural correlates. Cereb Cortex 15 (2005) 1609-1620
29. Jones E.G., and Powell T.P. An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 93 (1970) 793-820
30. Latinus M., and Taylor M.J. Holistic processing of faces: learning effects with mooney faces. J Cogn Neurosci 17 (2005) 1316-1327
31. Laurienti P.J., Burdette J.H., Wallace M.T., Yen Y.F., Field A.S., and Stein B.E. Deactivation of sensory-specific cortex by cross-modal stimuli. J Cogn Neurosci 14 (2002) 420-429
32. Mangun G.R. Neural mechanisms of visual selective attention. Psychophysiology 32 (1995) 4-18
33. Molholm S., Ritter W., Javitt D.C., and Foxe J.J. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14 (2004) 452-465
34. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res Cogn Brain Res 14 (2002) 115-128
35. Oldfield R.C. The assessment and analysis of handedness: the edinburgh inventory. Neuropsychologia 9 (1971) 97-113
36. Paulesu E., Harrison J., Baron-Cohen S., Watson J.D., Goldstein L., Heather J., et al. The physiology of coloured hearing. A pet activation study of colour-word synaesthesia. Brain 118 Pt 3 (1995) 661-676
37. Perrault N., and Picton T.W. Event-related potentials recorded from the scalp and nasopharynx. I. N1 and p2. Electroencephalogr Clin Neurophysiol 59 (1984) 177-194
38. Perrin F., Pernier J., Bertrand O., and Echallier J.F. Spherical splines for scalp potential and current density mapping. Electroencephalogr Clin Neurophysiol 72 (1989) 184-187
39. Rockland K.S., and Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50 (2003) 19-26
40. Schroger E., and Widmann A. Speeded responses to audiovisual signal changes result from bimodal integration. Psychophysiology 35 (1998) 755-759
41. Spreckelmeyer K.N., Kutas M., Urbach T.P., Altenmuller E., and Munte T.F. Combined perception of emotion in pictures and musical sounds. Brain Res 1070 (2006) 160-170
42. Stein B.E., and Meredith M.A. The merging of the senses (1993), The MIT Press, Cambridge, London
43. Teder-Salejarvi W.A., McDonald J.J., Di Russo F., and Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (erp) recordings. Brain Res Cogn Brain Res 14 (2002) 106-114
44. Theunissen E.L., Alain C., Chevalier H., and Taylor M.J. Binding occurs at early stages of processing in children and adults. Neuroreport 12 (2001) 1949-1954
45. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci USA 102 (2005) 1181-1186
46. Verkindt C., Bertrand O., Thevenet M., and Pernier J. Two auditory components in the 130-230 ms range disclosed by their stimulus frequency dependence. Neuroreport 5 (1994) 1189-1192
47. Vogel E.K., and Luck S.J. The visual n1 component as an index of a discrimination process. Psychophysiology 37 (2000) 190-203
48. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb Cortex 13 (2003) 1034-1043