Effects of spatial congruity on audio-visual multimodal integration

Journal of Cognitive Neuroscience

Volumn 17, Issue 9, 2005, Pages 1396-1409

  Teder Salejarvi W A ^a   Di Russo, F ^b   McDonald, J J ^c   Hillyard, Steven A ^a,d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF ROME FORO ITALICO   (Italy)

^c SIMON FRASER UNIVERSITY   (Canada)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; AUDITORY STIMULATION; BEHAVIOR; ELECTROPHYSIOLOGY; EVENT RELATED POTENTIAL; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; OCCIPITAL CORTEX; PRIORITY JOURNAL; SENSORY NERVE; TEMPORAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; COGNITION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; PHOTIC STIMULATION; PROBABILITY; REACTION TIME; VISUAL PERCEPTION;

EID: 24744434602     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/0898929054985383     Document Type: Article

References (40)

1. American Electroencephalographic Society. (1994). Guidelines for standard electrode position nomenclature. Journal of Clinical Neurophysiology, 11, 111-113.
2. Arnott, S. R., Pratt, J., Shore, D. I., & Alain, C. (2001). Attentional set modulates visual areas: An event-related potential study of attentional capture. Cognitive Brain Research, 12, 383-395.
3. Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004). Integration of auditory and visual information about objects in superior temporal sulcus. Neuron, 41, 809-823.
4. Bernstein, I. H., & Edelsein, B. A. (1973). Effects of some variations in auditory input upon visual choice reaction time. Journal of Experimental Psychology, 87, 241-247.
5. Bertelson, P., & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29, 578-584.
6. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
7. Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001). Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the bold effect. Neuroimage, 14, 427-438.
8. Corneil, B. D., & Munoz, D. P. (1996). The influence of auditory and visual distractors on human orienting gaze shifts. Journal of Neuroscience, 16, 8193-8207.
9. Di Russo, F., Martinez, A., & Hillyard, S. A. (2003). Source analysis of event-related cortical activity during visuo-spatial attention. Cerebral Cortex, 13, 486-499.
10. Fort, A., Delpuech, C., Pernier, J., & Giard, M. H. (2002). Early auditory-visual interactions in human cortex during nonredundant target identification. Cognitive Brain Research, 14, 20-30.
11. Frens, M. A., Van Opstal, O. A., & Van der Willigen, W. R. (1995). Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception & Psychophysics, 57, 802-816.
12. Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000). Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. Cognitive Brain Research, 10, 77-83.
13. Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., & Murray, M. M. (2002). Auditory-somatosensory multisensory processing in auditory association cortex: An fMRI study. Journal of Neurophysiology, 88, 540-543.
14. Frassinetti, F., Bolognini, N., & Làdavas, E. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Experimental Brain Research, 147, 332-343.
15. Giard, M.-H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473-490.
16. Gondan, M., Niederhaus, B., Röder, B., & Rösler, F. (in press). Multisensory processing in the redundant target effect: A behavioral and ERP study. Perception & Psychophysics.
17. Harrington, L. K., & Peck, C. K. (1998). Spatial disparity affects visual-auditory interactions in human sensorimotor processing. Experimental Brain Research, 122, 247-252.
18. Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994). Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance, 20, 131-153.
19. Kaas, J. H., Hackett, T. A., & Tramo, M. J. (1999). Auditory processing in the primate cerebral cortex. Current Opinion in Neurobiology, 9, 164-170.
20. Laurienti, P. J., Burdette, J. H., Wallace, M. T., Yen, Y. F., Field, A. S., & Stein, B. E. (2002). Deactivation of sensory-specific cortex by cross-modal stimuli. Journal of Cognitive Neuroscience, 14, 420-429.
21. Loveless, N. E., Brebner, J., & Hamilton, P. (1970). Bisensory presentation of information. Psychological Bulletin, 73, 161-199.
22. Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289, 1206-1208.
23. Macaluso, E., Frith, C. D., & Driver, J. (2001). Reply to McDonald, Teder-Sälejärvi, & Ward. Science, 292, 1791.
24. Mangun, G. R. (1995). Neural mechanisms of visual selective attention. Psychophysiology, 32, 4-18.
25. McDonald, J. J., Teder-Sälejärvi, W. A., Di Russo, F., & Hillyard, S. A. (2003). Neural substrates of perceptual enhancement by crossmodal spatial attention. Journal of Cognitive Neuroscience, 15, 10-19.
26. McDonald, J. J., Teder-Sälejärvi, W. A., & Ward, L. M. (2001). Multisensory integration and cross-modal attention effects in the human brain. Science, 292, 1791.
27. Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247-279.
28. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research, 14, 115-128.
29. Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2005). Grabbing your ear: Auditory-somatosensory multisensory interactions in early sensory cortices are not constrained by stimulus alignment. Cerebral Cortex, 15, 963-974.
30. Raij, T., Uutela, K., & Hari, R. (2000). Audiovisual integration of letters in the human brain. Neuron, 28, 617-625.
31. Scherg, M. (1990). Fundamentals of dipole source potential analysis. In: F. Grandori, M. Hoke, & G. L. Romani, (Eds.), Auditory evoked magnetic fields and electric potentials. Advances in audiology (Vol. 5, pp. 40-69). Basel: Karger.
32. Schröger, E., & Widman, A. (1998). Speeded responses to audiovisual signal changes result from bimodal integration. Psychophysiology, 35, 755-759.
33. Schürmann, M., Kolev, V., Menzel, K., & Yordanova, J. (2002). Spatial coincidence modulates interaction between visual and somatosensory evoked potentials. NeuroReport, 13, 779-783.
34. Simon, J. R., & Craft, J. L. (1969). Effects of an irrelevant auditory stimulus on visual choice reaction time. Journal of Experimental Psychology, 86, 272-274.
35. Stein, B. E. (1998). Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Experimental Brain Research, 123, 124-135.
36. Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neuroscience, 1, 12-24.
37. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses (pp. 123-156). Cambridge: MIT Press.
38. Stein, B. E., Meredith, M. A., Huneycutt, W. S., & McDade, L. W. (1989). Behavioral indices of multisensory integration: Orientation to visual cues is affected by auditory stimuli. Journal of Cognitive Neuroscience, 1, 12-24.
39. Teder-Sälejärvi, W. A., McDonald, J. J., Di Russo, F., & Hillyard, S. A. (2002). An analysis of audio-visual crossmodal integration by means of event-related potentials. Cognitive Brain Research, 14, 106-114.
40. Welsh, R. B., & Warren D. H. (1986). Intersensory interactions. In: K. R. Kaufman & J. P. Thomas (Eds.), Handbook of perception and human performance, Volume 1: Sensory processes and perception (pp. 1-36). New York: Wiley.