Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans

Cerebral Cortex

Volumn 12, Issue 10, 2002, Pages 1031-1039

  Fort, Alexandra ^a   Delpuech, Claude ^a   Pernier, Jacques ^a   Giard, Marie Hélène ^a  

^a INSERM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY NERVOUS SYSTEM; BRAIN CORTEX; BRAIN REGION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FEMALE; FRONTAL CORTEX; HUMAN; INFORMATION PROCESSING; MALE; NERVE PROJECTION; NERVE TRACT; OCCIPITAL CORTEX; PARIETAL LOBE; PRIORITY JOURNAL; SCALP; SPEECH; SUPERIOR COLLICULUS; TASK PERFORMANCE; TEMPORAL CORTEX; VISION;

EID: 0036785462     PISSN: 10473211     EISSN: None     Source Type: Journal    
DOI: 10.1093/cercor/12.10.1031     Document Type: Article

References (62)

1. Andersen RA (1997) Multimodal integration for the representation of space in the posterior parietal cortex. Philos Trans R Soc Lond Biol 352:1421-1428.
2. Barth DS, Goldberg N, Brett B, Di S (1995) The spatiotemporal organization of auditory, visual and auditory-visual evoked potentials in rat cortex. Brain Res 678:177-190.
3. Benevento LA, Fallon J, Davis BJ, Rezak M (1977) Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol 57:849-872.
4. Bremmer F, Schlack A, Shah NJ, Zafiris O, Kubischik M, Hoffmann KP, Zilles K, Fink GR (2001) Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29:287-296.
5. Bruce C, Desimone R, Gross CG (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46:369-383.
6. Bushara KO, Grafman J, Hallett M (2001) Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci 21:300-304.
7. Callan DE, Callan AM, Kroos C, Vatikiotis-Bateson E (2001) Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Cogn Brain Res 10:349-353.
8. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS (1999) Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10:2619-2623.
9. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649-657.
10. Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 14:427-438.
11. Clark VP, Fan S, Hillyard SA (1995) Identification of early visual evoked potential generators by retinotopic and topographic analyses. Hum Brain Mapp 2:170-187.
12. Downar J, Crawley AP, Mikulis DJ, Davis KD (2000) A multimodal cortical network for the detection of changes in the sensory environment. Nat Neurosci 3:277-283.
13. Echallier JF, Perrin F, Pernier J (1992) Computer-assisted placement of electrodes on the human head. Electroencephalogr Clin Neurophysiol 82:160-163.
14. Ettlinger G, Garcha HS (1980) Cross-modal recognition by the monkey: the effects of cortical removals. Neuropsychologia 18:685-692.
15. Falchier A, Renaud L, Barone P, Kennedy H (2001) Extensive projections from the primary auditory cortex and polysensory area STP to peripheral area V1 in the macaque. Soc Neurosci Abstr 27:511.21.
16. Fort A, Delpuech C, Pernier J, Giard MH (2002) Early auditory-visual interactions in human cortex during nonredundant target identification. Cogn Brain Res 14:20-30.
17. Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE (2000) Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Cogn Brain Res 10:77-83.
18. Foxe JJ, Simpson GV (2002) Flow of activation from V1 to frontal cortex in humans: a framework for defining 'early' visual processing. Exp Brain Res 142:139-150.
19. Fu KG, Johnston TA, Shah AS, Arnold L, Smiley J, Hackett TA, Garraghty PE, Schroeder CE (2001) Characterization of somatosensory input to auditory association cortex in macaques. Soc Neurosci Abstr 27:681.3.
20. Füster JM, Bodner M, Kroger JK (2000) Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405:347-351.
21. Gaffan D, Harrison S (1991) Auditory-visual associations, hemispheric specialization and temporo-frontal interaction in the rhesus monkey. Brain 114:2133-2144.
22. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473-490.
23. Giard MH, Perrin F, Echallier JF, Thevenet M, Froment JC, Pernier J (1994) Dissociation of temporal and frontal components in the human auditory N1 wave: a scalp current density and dipole model analysis. Electroencephalogr Clin Neurophysiol 92:238-252.
24. Giray M, Ulrich R (1993) Motor coactivation revealed by response force in divided and focused attention. J Exp Psychol Hum Percept Perform 19:1278-1291.
25. Gonzalo D, Shallice T, Dolan R (2000) Time-dependent changes in learning audiovisual associations: a single-trial fMRI study. Neuroimage 11:243-255.
26. Hadjikhani N, Roland PE (1998) Cross-modal transfer of information between the tactile and the visual representations in the human brain: a positron emission tomographic study. J Neurosci 18:1072-1084.
27. Hershenson M (1962) Reaction time as a measure of intersensory facilitation. J Exp Psychol 63:289-293.
28. Hikosaka K, Iwai E, Saito H, Tanaka K (1988) Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. J Neurophysiol 60:1615-1637.
29. Hughes HC, Reuter-Lorenz PA, Nozawa G, Fendrich R (1994) Visual-auditory interactions in sensorimotor processing - saccades versus manual responses. J Exp Psychol Hum Percept Perf 20:131-153.
30. Jiang W, Wallace MT, Jiang H, Vaughan W, Stein BE (2001) Two cortical areas mediate multisensory integration in superior colliculus neurons. J Neurophysiol 85:506-522.
31. Jones EG, Powell TPS (1970) An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 93:793-820.
32. Lewis JW, van Essen DC (2000) Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J Comp Neurol 428:112-137.
33. Miller JO (1982) Divided attention: evidence for coactivation with redundant signals. Cognit Psychol 14:247-279.
34. Miller JO (1986) Time course of coactivation in bimodal divided attention. Percept Psychophys 40:331-343.
35. Miller JO (1991) Channel interaction and the redundant targets effect in bimodal divided attention. J Exp Psychol Hum Percept Perform 17:160-169.
36. Paulesu E, Harrison J, Baron Cohen S, Watson JDG, Goldstein L, Heather J, Frackowiak RSJ, Frith CD (1995) The physiology of coloured hearing. A PET activation study of colour-word synaesthesia. Brain 118:661-676.
37. Pernier J, Perrin F, Bertrand O (1988) Scalp current density fields: concept and properties. Electroencephalogr Clin Neurophysiol 69:385-389.
38. Perrin F, Pernier J, Bertrand O, Giard MH (1987) Mapping of scalp potentials by surface spline interpolation. Electroencephalogr Clin Neurophysiol 66:75-81.
39. Perrin F, Pernier J, Bertrand O, Echallier JF (1989) Spherical splines for scalp potential and current density mapping Electroencephalogr Clin Neurophysiol 72:184-187.
40. Raab DH (1962) Statistical facilitation of simple reaction times. Trans NY Acad Sci 24:574-590.
41. Raij T, Uutela K, Hari R (2000) Audiovisual integration of letters in the human brain. Neuron 28:617-625.
42. Rockland KS, Ojima H (2001) Calcarine area V1 as a multimodal convergence area. Soc Neurosci Abstr 27:511.20.
43. Rugg MD, Doyle MC, Wells T (1995) Word and nonword repetition within- and across-modality: an event-related potential study. J Cogn Neurosci 7:209-227.
44. Sakowitz OW, Quiroga RQ, Schürmann M, Basar E (2001) Bisensory stimulation increases gamma-responses over multiple cortical regions. Cogn Brain Res 11:267-279.
45. Sams M, Aulanko R, Hamalainen H, Hari R, Lounasmaa OV, Lu ST, Simola J (1991) Seeing speech: visual information from lip movements modify activity in the human auditory cortex. Neurosci Lett 127:141-145.
46. Scherg M (1990) Fundamentals of dipole source potential analysis. In: Auditory evoked magnetic fields and electric potentials. Advances in audiology, vol. 5 (Grandori F, Hoke M, Romani GL, eds), pp. 40-69. Karger: Basel.
47. Scherg M, von Cramon D (1986) Evoked dipole source potentials of the human auditory cortex. Electroencephalogr Clin Neurophysiol 65:344-360.
48. Schroeder CE, Foxe JJ (2002) Timing and laminar profile of converging inputs in multisensory areas of macaque neocortex. Cogn Brain Res 14:187-198.
49. Schroeder CE, Mehta AD, Ulbert I, Steinschneider M, Vaughan HG (1995) Visual responses in auditory cortex and their modulation by attention. Soc Neurosci Abstr 21:694.
50. Schroeder CE, Lindsley RW, Specht C, Marcovici A, Smiley JF, Javitt DC (2001) Somatosensory input to auditory association cortex in the macaque monkey. J Neurophysiol 8:1322-1327.
51. Stein BE, Meredith MA (1993) The merging of the senses. Cambridge, MA, USA: The MIT Press.
52. Stein BE, Wallace MT (1996) Comparison of cross-modality integration in midbrain and cortex. In: Progress in brain research, vol. 112 (Norita M, Bando T, Stein B, eds), pp. 289-299. Elsevier Science: Amsterdam.
53. Stein BE, Meredith MA, Wallace MT (1993) The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog Brain Res 95:79-90.
54. Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of potential (ERP) recordings. Cogn Brain Res 14:106-114.
55. Thorpe S, Fize D, Marlot C (1996) Speed of processing in the human visual system. Nature 381:520-522.
56. Toldi J, Fehér O, Wolff JR (1986) Sensory interactive zones in the rat cerebral cortex. Neuroscience 18:461-465.
57. Vaughan HG, Ritter W (1970) The sources of auditory evoked responses recorded from the human scalp. Electroencephalogr Clin Neurophysiol 28:360-367.
58. Vogel EK, Luck SJ (2000) The visual N1 component as an index of a discrimination process. Psychophysiology 37:190-203.
59. Wallace MT, Meredith MA, Stein BE (1993) Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. J Neurophysiol 69:1797-1809.
60. Watanabe J, Iwai E (1991) Neuronal activity in visual, auditory and polysensory areas in the monkey temporal cortex during a visual fixation task. Brain Res Bull 26:583-592.
61. Welch, RB, Warren, DH (1986) Intersensory interactions. In: Handbook of perception and human performance, vol. I: Sensory processes and perception (Boff KR, Kaufman L, Thomas JP, eds), pp. 25/1-25/36. New York: Wiley.
62. Yvert B, Bertrand O, Thevenet M, Echallier JF, Pernier J (1997) A systematic evaluation of the spherical model accuracy in EEG dipole localization. Electroencephalogr Clin Neurophysiol 102:452-459.