Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity

Journal of Cognitive Neuroscience

Volumn 17, Issue 7, 2005, Pages 1098-1114

  Talsma, Durk ^a   Woldorff, Marty G ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; CONTROLLED STUDY; DEPTH PERCEPTION; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; EVOKED RESPONSE; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SELECTIVE ATTENTION; VISION;

ADOLESCENT; ADULT; ATTENTION; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; PERCEPTION; PHYSICAL STIMULATION; REACTION TIME; TIME FACTORS;

EID: 22944458572     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/0898929054475172     Document Type: Article

References (71)

1. Bertelson, P. (1999). Ventriloquism: A case of crossmodal perceptual grouping. In G. Achersleben, T. Bachman, & J. Müsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events. Amsterdam: Elsevier.
2. Bertelson, P., Vroomen, J., De Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception and Psychophysics, 62, 321-332.
3. Brookhuis, K. A., Mulder, G., Mulder, L. J. M., & Gloerig, A. B. M. (1983). The P3 complex as an index of information processing: The effects of response probability. Biological Psychology, 17, 277-296.
4. Buckner, R. L, Goodman, J., Burock, M., Rotte, M., Koutstaal, W., Schacter, D., Rosen, B., & Dale, A. M. (1998). Functional-anatomic correlates of object priming in humans revealed by rapid presentation event-related fMRI. Neuron, 20, 285-296.
5. Burock, M. A., Buckner, R. L., Woldorff, M. G., Rosen, B. R., & Dale, A. M. (1998). Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI. NeuroReport, 9, 3735-3739.
6. Busse, L., & Woldorff, M. G. (2003a). Attention-related brain mechanisms underlying the auditory-visual perceptual grouping in the ventriloquism effect. Cognitive Neurosciences Abstracts, D6, 123.
7. Busse, L., & Woldorff, M. G. (2003b). The ERP omitted stimulus response to "no-stim" events and its implications for fast-rate fMRI. Neuroimage, 18, 856-864.
8. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
9. Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammers, M. J. (2001). Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage, 14, 427-438.
10. Downar, J., Crawley, A. P., Mikulis, D. J., & Davis, K. D. (2000). A multimodal cortical network for the detection of changes in the sensory environment. Nature Neuroscience, 3, 277-283.
11. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68.
12. Eason, R. G. (1981). Visual evoked potential correlates of early neural filtering during selective attention. Bulletin of the Psychonomic Society, 18, 203-206.
13. Eimer, M., Cockburn, D., Smedley, B., & Driver, J. (2001). Cross-modal links in endogenous spatial attention are mediated by common external locations: Evidence from event-related brain potentials. Experimental Brain Research, 139, 398-411.
14. Eimer, M., & Driver, J. (2001). Crossmodal links in endogenous and exogenous spatial attention: Evidence from event-related brain potential studies. Neuroscience and Biobehavioural Reviews, 25, 497-511.
15. Eimer, M., & Schröger, E. (1998). Effects of intermodal attention and cross-modal attention in spatial attention. Psychophysiology, 35, 313-327.
16. Eimer, M., van Velzen, J., & Driver, J. (2002). Cross-modal interactions between audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. Journal of Cognitive Neuroscience, 14, 254-271.
17. Fort, A., Delpuech, C., Pernier, J., & Giard, M.-H. (2002a). Early auditory-visual interactions in human cortex during nonredundant target identification. Cognitive Brain Research, 15, 20-30.
18. Fort, A., Delpuech, C., Pernier, J., & Giard, M.-H. (2002b) Dynamics of cortico-subcortical operations involved in audio-visual object detection in humans. Cerebral Cortex, 12, 1031-1039.
19. Foxe, J. J., & Schroeder, C. E. (2002). Preface. Cognitive Brain Research, 14, 1.
20. Giard, M.-H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473-490.
21. Goldberg, M. E., & Wurtz, R. H. (1972). Activity of superior colliculus in behaving monkey: II. Effects of attention in neural responses. Journal of Neurophysiology, 35, 560-574.
22. Heinze, H.-J., Mangun, G. R., Burchert, W., Hinrichs, H., Scholz, M., Münte, T. F., Cos, A., Scherg, M., Johannes, S., Hundeshagen, H., Gazzaniga, M. S., & Hillyard, S. A. (1994). Combined spatial and temporal imaging of brain activity during visual selective attention in humans. Nature, 372, 543-546.
23. Hillyard, S. A., Mangun, G. R., Woldorff, M. G., & Luck, S. J. (1995). Neural systems mediating selective attention. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (pp. 661-681). Cambridge: MIT Press.
24. Hillyard, S. A., & Münte, T. F. (1984). Selective attention to color and location: An analysis with event-related brain potentials. Perception and Psychophysics, 36, 185-198.
25. Hillyard, S. A., Simpson, G. V., Woods, D. L., Van Voorhis, S., & Münte, T. F. (1984). Event-related brain potentials and selective attention to different modalities. In F. Renoso-Suarez & C. Ajmone-Marsan (Eds.), Cortical integration (pp. 395-414). New York: Raven Press.
26. Jiang, W., Wallace, M. T., Jiang, H., Vaughan, J. W., & Stein, B. E. (2001). Two cortical areas mediate multisensory integration in superior colliculus neurons. Journal of Neurophysiology, 85, 506-522.
27. LaBerge, D. (1995). Attentional processing: The brain's art of mindfulness. Cambridge: Harvard University Press.
28. Lewald, J., & Guski, R. (2003). Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive Brain Research, 16, 468-478.
29. Mangun, G. R. (1995). Neural mechanisms of visual selective attention. Psychophysiology, 32, 4-18.
30. Mangun, G. R., Hansen, J. C., & Hillyard, S. A. (1987). The spatial orienting of attention: Sensory facilitation or response bias? In R. Johnson Jr., W. Rohrbaugh, & R. Parasuraman (Eds.), Current trends in event-related potential research, electroencephalography and clinical neurophysiology (pp. 118-124). Amsterdam: Elsevier.
31. Mangun, G. R., & Hillyard, S. A. (1988). Spatial gradients of visual attention: Behavioral and electrophysiological evidence. Electroencephalography and clinical neurophysiology, 70, 417-428.
32. Mangun, G. R., & Hillyard, S. A. (1990a). Allocation of visual attention to spatial locations: Tradeoff functions for event-related brain potentials and detection performance. Perception and Psychophysics, 47, 532-550.
33. Mangun, G. R., & Hillyard, S. A. (1990b). Electrophysiological studies of visual selective attention in humans. In A. B. Schleibel & A. Wechsler (Eds.), The neurobiological foundations of higher cognitive function (pp. 271-295). New York: Guilford Press.
34. Mangun, G. R., & Hillyard, S. A. (1991). Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. Journal of Experimental Psychology: Human Perception and Performance, 17, 1057-1074.
35. Mangun, G. R., & Hillyard, S. A. (1995). Mechanisms and models of selective attention. In M. D. Rugg & M. G. H. Coles (Eds.), Electrophysiology of mind (pp. 40-85). Oxford: Oxford University Press.
36. Mangun, G. R., Hillyard, S. A., & Luck, S. J. (1992). Electrocortical substrates of visual selective attention. In D. A. Meyer & S. Kornblum (Eds.), Attention and performance: XIV. Synergies in experimental psychology, artificial intelligence and cognitive neuroscience (pp. 219-243). Cambridge: Birkhauser.
37. McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature, 407, 906-908.
38. McDonald, J. J., & Ward, L. M. (1999). Spatial relevance determines facilitatory and inhibitory effects of auditory covert spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 25, 1234-1252.
39. McDonald, J. J., & Ward, L. M. (2000). Involuntary listening aids seeing: Evidence from human electrophysiology. Psychological Science, 11, 167-171.
40. McGurk, H., & MacDonald, J. W. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
41. Meredith, M. A., & Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662.
42. Miller, J. O. (1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247-279.
43. Miller, J. O. (1986). Time course of coactivation in bimodal divided attention. Perception and Psychophysics, 40, 331-343.
44. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cognitive Brain Research, 14, 115-128.
45. Näätänen, R. (1982). Processing negativity: An evoked potential reflection of selective attention. Psychological Bulletin, 92, 605-640.
46. Näätänen, R. (1992). Attention and brain function. Hillsdale, NJ: Erlbaum.
47. Pick, H. L., Warren, D. H., & Hay, J. C. (1969). Sensory conflict in judgments of spatial direction. Perception and Psychophysiology, 6, 203-205.
48. Platt, B. B., & Warren, D. H. (1972). Auditory localization: The importance of eye movements and a textured visual environment. Perception and Psychophysiology, 12, 245-248.
49. Saldaña, H. M., & Rosenblum, L. D. (1993). Visual influence on auditory pluck and bow judgments. Perception and Psychophysics, 54, 406-416.
50. Shams, L., Kamitani, Y., & Shimojo, S. (2000). What you see is what you hear. Nature, 408, 788.
51. Spence, C. J., & Driver, J. (1996). Audiovisual links in endogenous covert spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 22, 1005-1030.
52. Spence, C. J., & Driver, J. (1997). Audiovisual links in exogenous covert spatial attention. Perception and Psychophysics, 59, 1-22.
53. Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neuroscience, 8, 497-506.
54. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge: MIT Press.
55. Talsma, D., & Kok, A. (2001). Non-spatial intermodal selective attention is meditated by sensory brain areas: Evidence from event related potentials. Psychophysiology, 38, 736-751.
56. Talsma, D., & Kok, A. (2002). Intermodal spatial attention differs between vision and audition: An event-related potential analysis. Psychophysiology, 39, 689-706.
57. Talsma, D., Wijers, A. A., Klaver, P., & Mulder, G. (2001). Working memory processes show different degrees of lateralization: Evidence from event related potentials. Psychophysiology, 38, 425-438.
58. Teder-Sälejärvi, W. A., McDonald, J. J., Di Russo, F., & Hillyard, S. A. (2002). An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cognitive Brain Research, 14, 106-114.
59. Vroomen, J., Bertelson, P., & De Gelder, B. (2001a). Directing spatial attention towards the illusory location of a ventriloquized sound. Acta Psychologica, 108, 21-33.
60. Vroomen, J., Bertelson, P., & De Gelder, B. (2001b). The ventriloquist does not depend on the direction of automatic visual attention. Perception and Psychophysics, 63, 651-659.
61. Wallace, M. T., Meredith, M. A., & Stein, B. E. (1992). Integration of multiple sensory modalities in cat cortex. Experimental Brain Research, 91, 484-488.
62. Wallace, M. T., Meredith, M. A., & Stein, B. E. (1998). Multisensory integration in the superior colliculus of the alert cat. Journal of Neurophysiology, 80, 1006-1010.
63. Wallace, M. T., & Stein, B. E. (1997). Development of multisensory neurons and multisensory integration in cat superior colliculus. Journal of Neuroscience, 17, 2429-2444.
64. Wallace, M. T., & Stein, B. E. (2001). Sensory and multisensory responses in the newborn monkey superior colliculus. Journal of Neuroscience, 21, 8886-8894.
65. Walter, W. G., Cooper, R., Aldridge, V. J., McCallum, W. C., & Winter, C. V. (1964). Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature, 203, 380-384.
66. Wijers, A. A., Mulder, G., Gunter, T. C., & Smid, H. G. O. M. (1996). Brain potential analysis of selective attention. In O. Neumann & A. F. Sanders (Eds.), Handbook of perception and action (Vol. 3, pp. 333-387). London: Academic Press.
67. Woldorff, M. G. (1993). Distortion of ERP averages due to overlap from temporally adjacent ERPs: Analysis and correction. Psychophysiology, 30, 98-119.
68. Woldorff, M. G. (1999). Auditory attention. In R. Wilson & F. Keil (Eds.), The MIT encyclopedia of the cognitive sciences (pp. 50-52). Cambridge: MIT Press.
69. Woldorff, M. G., Fox, P. T., Matzke, M., Lancaster, J. L., Veeraswamy, S., Zamarripa, F., Seabolt, M., Glass, T., Gao, J. H., Martin, C. C., & Jerabek, P. (1997). Retinotopic organization of early visual spatial attention effects as revealed by PET and ERPs. Human Brain Mapping, 5, 280-286.
70. Woldorff, M. G., Gallen, C. C., Hampson, S. A., Hillyard, S. A., Pantev, C., Sobel, D., & Bloom, F. E. (1993). Modulation of early sensory processing in human auditory cortex during auditory selective attention. Proceedings of the National Academy of Sciences, U.S.A., 90, 8722-8726.
71. Woldorff, M. G., & Hillyard, S. A. (1991). Modulation of early auditory processing during selective listening to rapidly presented tones. Electroencephalography and Clinical Neurophysiology, 79, 170-191.