Dynamic crossmodal links revealed by steady-state responses in auditory-visual divided attention

International Journal of Psychophysiology

Volumn 75, Issue 1, 2010, Pages 3-15

  de Jong, Ritske ^a   Toffanin, Paolo ^a   Harbers, Marten ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

ASSR; Crossmodal links; Intermodal attention; Multisensory integration; VSSR

Indexed keywords

ADULT; AMPLITUDE MODULATION; ARTICLE; AUDITORY STIMULATION; COGNITION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EVOKED AUDITORY RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; SELECTIVE ATTENTION; SIGNAL NOISE RATIO; STEADY STATE; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ANALYSIS OF VARIANCE; ATTENTION; AUDITORY PATHWAYS; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; DISCRIMINATION (PSYCHOLOGY); ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, AUDITORY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; REACTION TIME; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL PATHWAYS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 73249128973     PISSN: 01678760     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijpsycho.2009.09.013     Document Type: Article

References (83)

1. Bidet-Caulet A., Fischer C., Besle J., Aguera P.-E., Giard M.H., and Bertrand O. Effects of selective attention on the electrophysiological representation of concurrent sounds in the human auditory cortex. The Journal of Neuroscience 27 (2007) 9252-9261
2. Bonnel A.M., and Hafter E.R. Divided attention between simultaneous auditory and visual signals. Perception and Psychophysics 60 (1998) 179-190
3. Bonnel A.M., Stein J.F., and Bertucci P. Does attention modulate the perception of luminance changes?. Quarterly Journal of Experimental Psychology A 44 (1992) 601-626
4. Bohorquez J., and Ozdamar O. Generation of the 40-Hz auditory steady-state response (ASSR) explained using convolution. Clinical Neurophysiology 119 (2008) 2598-2607
5. Brainard D.H. The psychophysics toolbox. Spatial Vision 10 (1997) 433-436
6. Brawn P.T., and Snowden R.J. Attention to overlapping objects: detection and discrimination of luminance changes. Journal of Experimental Psychology: Human Perception and Performance 26 (2000) 342-358
7. Deco G., and Zihl J. The neurodynamics of visual search. Visual Cognition 14 (2006) 1006-1024
8. Desimone R., and Duncan J. Neural mechanisms of selective visual attention. Annual Review Neuroscience 18 (1995) 193-222
9. Ding J., Sperling G., and Srinivasan R. Attentional modulation of SSVEP power depends on the network tagged by the flicker frequency. Cerebral Cortex 16 (2006) 1016-1029
10. Downing C.J. Expectancy and visual-spatial attention: effects on perceptual quality. Journal of Experimental Psychology Human Perception and Performance 14 (1988) 188-202
11. Driver J., and Noesselt T. Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57 (2008) 11-23
12. Duncan J. The locus of interference in the perception of simultaneous stimuli. Psychological Review 87 (1980) 272-300
13. Duncan J. Directing attention in the visual field. Perception and Psychophysics 30 (1981) 90-93
14. Eimer M., and Schroger E. ERP effects of intermodal attention and cross-modal links in spatial attention. Psychophysiology 35 (1998) 313-327
15. Fell J., Fernndez G., Klaver P., Elger C.E., and Fries P. Is synchronized neuronal gamma activity relevant for selective attention?. Brain Research: Brain Research Review 42 (2003) 265-272
16. Galambos R., Makeig S., and Talmacho P.J. A 40-Hz auditory potential recorded from the human scalp. Proceedings of the National Academy of Sciences U.S.A. 78 (1981) 2643-2647
17. Gander P.E., Bosnyak R., Wolek R., and Roberts L.E. Modulation of the 40-Hz auditory steady-state response by attention during acoustic training. International congress series 1300 (2007) 37-40
18. Ghazanfar A.A., and Schroeder C.E. Is neocortex essentially multisensory?. Trends in Cognitive Sciences 10 (2006) 278-285
19. Giard M.H., Fort A., Mouchetant-Rostaing Y., and Pernier J. Neurophysiological mechanisms of auditory selective attention in humans. Frontiers in Bioscience 5 (2000) D84-D94
20. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11 (1999) 473-490
21. Gladwin T.E., Lindsen J.P., and de Jong R. Pre-stimulus EEG effects related to response speed, task switching and upcoming response hand. Biological Psychology 72 (2006) 15-34
22. Gratton G., Coles M.G., and Donchin E. A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology 55 (1983) 468-484
23. Gutschalk A., Mase R., Roth R., Ille N., Rupp A., Hahnel S., Picton T.W., and Scherg M. Deconvolution of 40 Hz steady-state fields reveals two overlapping source activities of the human auditory cortex. Clinical Neurophysiology 110 (1999) 856-868
24. Hawkins H.L., Hillyard S.A., Luck S.J., Mouloua M., Downing C.J., and Woodward D.P. Visual attention modulates signal detectability. Journal of Experimental Psychology: Human Perception and Performance 16 (1990) 802-811
25. Herrmann C.S. Human EEG responses to 1-100 Hz flicker: Resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Experimental Brain Research 137 (2001) 346-353
26. Hillyard S.A., Teder-Salejarvi W.A., and Munte T.F. Temporal dynamics of early perceptual processing. Current Opinion in Neurobiology 8 (1998) 202-210
27. Hoffman J.E. A two-stage model of visual search. Perception and Psychophysics 25 (1979) 319-327
28. Hoffman J.E., Houck M.R., MacMillan F.W., Simons R.F., and Oatman L.C. Event-related potentials elicited by automatic targets: a dual-task analysis. Journal of Experimental Psychology: Human Perception and Performance 11 (1985) 50-61
29. Isreal J.B., Chesney G.L., Wickens C.D., and Donchin E. P300 and tracking difficulty: evidence for multiple resources in dual-task performance. Psychophysiology 17 (1980) 259-273
30. Johnson J.A., and Zatorre R.J. Attention to simultaneous unrelated auditory and visual events: behavioral and neural correlates. Cerebral Cortex 15 (2005) 1609-1620
31. Johnson J.A., and Zatorre R.J. Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage 31 (2006) 1673-1681
32. Johnson R. P300: A model of the variables controlling its amplitude. Annals New York Academy of Sciences 425 (1984) 223-229
33. Johnson R. A triarchic model of p300 amplitude. Psychophysiology 23 (1986) 367-384
34. Kastner S., Weerd P.D., Desimone R., and Ungerleider L.G. Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. Science 282 (1998) 108-111
35. Kawahara J., Lollo V.D., and Enns J.T. Attentional requirements is visual detection and identification: evidence from the attentional blink. Journal of Experimental Psychology: Human Perception and Performance 27 (2001) 969-984
36. Kim Y.J., Grabowecky M., Paller K.A., Muthu K., and Suzuki S. Attention induces synchronization-based response gain in steady-state visual evoked potentials. Nature Neuroscience 10 (2007) 117125
37. Lappin J.S., and Uttal W.R. Does prior knowledge facilitate the detection of visual targets in random noise?. Perception and Psychophysics 20 (1976) 367-374
38. Linden R.D., Picton T.W., Hamel G., and Campbell K.B. Human auditory steady-state evoked potentials during selective attention. Electroencephalography and Clinical Neurophysiology 66 (1987) 145-159
39. Macaluso E., and Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain. Trends in Neurosciences 28 (2005) 264-271
40. Macmillan N.A., and Creelman C.D. Detection Theory: A User's Guide. 2nd ed. (2005), Lawrence Erlbaum Associates, Mahwah, N.J.
41. Malinowski P., Fuchs S., and Muller M.M. Sustained division of spatial attention to multiple locations within one hemifield. Neuroscience Letters 414 (2007) 65-70
42. Mangun G.R., and Hillyard S.A. Allocation of visual attention to spatial locations: tradeoff functions for event-related brain potentials and detection performance. Perception and Psychophysics 47 (1990) 532-550
43. McCarthy G., and Wood C.C. Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. Electroencephalography Clinical Neurophysiology 62 (1985) 203-208
44. McDonald J.J., Teder-Salejarvi W.A., Russo F.D., and Hillyard S.A. Neural substrates of perceptual enhancement by cross-modal spatial attention. Journal of Cognitive Neuroscience 15 (2003) 10-19
45. Morgan S.T., Hansen J.C., and Hillyard S.A. Selective attention to stimulus location modulates the steady-state visual evoked potential. Proceedings of the National Academy of Sciences U.S.A. 93 (1996) 4770-4774
46. Muller H.J., and Humphreys G.W. Luminance-increment detection: capacity-limited or not?. Journal of Experimental Psychology: Human Perception and Performance 17 (1991) 107-124
47. Muller M.M., and Hillyard S. Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention. Clinical Neurophysiology 111 (2000) 1544-1552
48. Muller M.M., Picton T.W., Valdes-Sosa P., Riera J., Teder-Salejarvi W.A., and Hillyard S.A. Effects of spatial selective attention on the steady-state visual evoked potential in the 20-28 Hz range. Brain Research: Cognitive Brain Research 6 (1998) 249-261
49. Muller M.M., Teder-Salejarvi W., and Hillyard S.A. The time course of cortical facilitation during cued shifts of spatial attention. Nature Neuroscience 1 (1998) 631-634
50. Navon D. Attention and performance XI. In: Posner I., and Marin O.S.M. (Eds) (1985), Erlbaum, Hillsdale, NJ 133-146
51. Navon D., and Miller J. Queuing or sharing? a critical evaluation of the single-bottleneck notion. Cognitive Psychology 44 (2002) 193-251
52. Norman D., and Bobrow D. On data-limited and resource-limited processing. Journal of Cognitive Psychology 7 (1975) 44-60
53. 15 study. Cerebral Cortex 17 (2007) 1899-1905
54. Pei F., Pettet M.W., and Norcia A.M. Neural correlates of object-based attention. Journal of Vision 2 (2002) 588-596
55. Pelli D.G. The videotoolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision 10 (1997) 437-442
56. Raymond J.E., Shapiro K.L., and Arnell K.M. Temporary suppression of visual processing in an RSVP task: an attentional blink?. Journal of Experimental Psychology Human Perception and Performance 18 (1992) 849-860
57. Regan D. Human Brain Electrophysiology: Evoked Potentials and Evoked Magnetic Fields in Science and Medicine (1989), Elsevier, Amsterdam
58. Reyes S.A., Lockwood A.H., Salvi R.J., Coad M.L., Wack D.S., and Burkard R.F. Mapping the 40-Hz auditory steady-state response using current density reconstructions. Hearing Research 204 (2005) 1-15
59. Ross B., Herdman A.T., and Pantev C. Right hemispheric laterality of human 40 Hz auditory steady-state responses. Cerebral Cortex 15 (2005) 2029-2039
60. Ross B., Herdman A.T., and Pantev C. Stimulus induced desynchronization of human auditory 40-Hz steady-state responses. Journal of Neurophysiology 94 (2005) 4082-4093
61. Ross B., Herdman A.T., Wollbrink A., and Pantev C. Auditory cortex responses to the transition from monophonic to pseudo-stereo sound. Neurology and Clinical Neurophysiology 2004 (2004) 18
62. Ross B., Picton T.W., Herdman A.T., and Pantev C. The effect of attention on the auditory steady-state response. Neurology and Clinical Neurophysiology 2004 (2004) 22
63. Ross B., Picton T.W., and Pantev C. Temporal integration in the human auditory cortex as represented by the development of the steady-state magnetic field. Hearing Research 165 (2002) 68-84
64. Russo F.D., Martinez A., and Hillyard S.A. Source analysis of event-related cortical activity during visuo-spatial attention. Cerebral Cortex 13 (2003) 486-499
65. Russo F.D., Pitzalis S., Aprile T., Spitoni G., Patria F., Stella A., Spinelli D., and Hillyard S.A. Spatiotemporal analysis of the cortical sources of the steady-state visual evoked potential. Human Brain Mapping 28 (2007) 323-334
66. Saupe K., Widmann A., Bendixen A., Muller M.M., and Schroger E. Effects of intermodal attention on the auditory steady-state response and the event-related potential. Psychophysiology 46 2 (2009) 321-327 2009
67. Sharbrough F., Chatrian G., Lesser R., Luders H., Nuwer M., and Picton T. American Electroencephalographic Society guidelines for standard electrode position nomenclature. Journal of Clinical Neurophysiology 8 (1991) 200-202
68. Shomstein S., and Yantis S. Control of attention shifts between vision and audition in human cortex. Journal of Neuroscience 24 (2004) 10702-10706
69. Simpson M.I.G., Hadjipapas A., Barnes G.R., Furlong P.L., and Witton C. Imaging the dynamics of the auditory steady-state evoked response. Neuroscience Letters 385 (2005) 195-197
70. Skosnik P.D., Krishnan G.P., and O'Donnell B.F. The effect of selective attention on the gamma-band auditory steady-state response. Neuroscience Letters 420 (2007) 223-228
71. Sperling G., and Melcher M.J. The attention operating characteristic: examples form visual search. Science 202 (1978) 315-318
72. Stein B.E., and Stanford T.R. Multisensory integration: current issues from the perspective of the single neuron. Nature Review Neuroscience 9 (2008) 255-266
73. Tallon-Baudry, and Bertrand. Oscillatory gamma activity in humans and its role in object representation. Trends in Cognitive Sciences 3 (1999) 151-162
74. Talsma D., Doty T.J., Strowd R.E., and Woldorff M.G. Attentional capacity for processing concurrent stimuli is larger across sensory modalities than within a modality. Psychophysiology 43 (2006) 541-549
75. Talsma D., Doty T.J., and Woldorff M.G. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?. Cerebral Cortex 17 (2007) 679-690
76. Talsma D., and Kok A. Nonspatial intermodal selective attention is mediated by sensory brain areas: evidence from event-related potentials. Psychophysiology 38 (2001) 736-751
77. Talsma D., and Woldorff M.G. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience 17 (2005) 1098-1114
78. Teder-Salejarvi W.A., McDonald J.J., Russo F.D., and Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Brain Research: Cognitive Brain Research 14 (2002) 106-114
79. Toffanin P., de Jong R., Johnson A., and Martens S. Using frequency tagging to quantify attentional deployment in a visual divided attention task. International Journal of Psychophysiology 72 (2009) 289-298
80. Tootell R.B., Hadjikhani N.K., Vandu_el W., Liu A.K., Mendola J.D., Sereno M.I., et al. Functional analysis of primary visual cortex (V1) in humans. Proceedings of the National Academy of Sciences U.S.A. 95 (1998) 811-817
81. Van der Burg E., Olivers C.N.L., Bronkhorst A.W., and Theeuwes J. Pip and pop: non-spatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance 34 (2008) 1053-1065
82. Wickens C., Kramer A., Vanasse L., and Donchin E. Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. Science 221 (1983) 1080-1082
83. Wu C.T., Weissman D.H., Roberts K.C., and Woldorff M.G. The neural circuitry of the executive control of auditory spatial attention. Brain Research 1134 (2007) 187-198