Salient sounds activate human visual cortex automatically

Journal of Neuroscience

Volumn 33, Issue 21, 2013, Pages 9194-9201

  McDonald, John J ^a   Störmer, Viola S ^b   Martinez, Antigona ^c,d   Feng, Wenfeng ^c   Hillyard, Steven A ^c  

^a SIMON FRASER UNIVERSITY   (Canada)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; ELECTROPHYSIOLOGY; EVOKED BRAIN STEM AUDITORY RESPONSE; EYE FIXATION; FEMALE; HUMAN; HUMAN EXPERIMENT; LOUDNESS; MALE; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; SENSORIMOTOR FUNCTION; SOUND; TOPOGRAPHY; VISUAL CORTEX; VISUAL STIMULATION; WAVEFORM;

ACOUSTIC STIMULATION; ADULT; BRAIN MAPPING; CUES; ELECTROOCULOGRAPHY; EVOKED POTENTIALS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; PHOTIC STIMULATION; SOUND; VISUAL CORTEX; YOUNG ADULT;

EID: 84877992309     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5902-12.2013     Document Type: Article

References (46)

1. Bueti D, Macaluso E (2010) Auditory temporal expectations modulate ac- tivity in visual cortex. Neuroimage 51:1168-1183.
2. Cappe C, Thut G, Romei V, Murray MM (2010) Auditory-visual multisen- sory interactions in humans: timing, topography, directionality and sources. J Neurosci 30:12572-12580.
3. Cappe C, Rouiller EM, Barone P (2012) Cortical and thalamic pathways for multisensoryandsensorimotorinterplay. In:Frontiersintheneuralbases of multisensory processes (Murray MM, Wallace, MT, eds), pp 15-30. Boca Ratan, FL: CRC.
4. Carrasco M (2011) Visual attention: the past 25 years. Vision Res 51:1484-1525.
5. Cate AD, Herron TJ, Yund EW, Stecker GC, Rinne T, Kang X, Petkov CI, Disbrow EA, Woods DL (2009) Auditory attention activates peripheral visual cortex. PLoS ONE 4:e4645.
6. Cox RW (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162-173.
7. Di Russo F, Martínez A, Hillyard SA (2003) Source analysis of event-related corticalactivityduringvisuo-spatialattention. CerebCortex 13:486-499.
8. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influ ences on "sensory-specific" brain regions, neural responses, and judg-ments. Neuron 57:11-23.
9. Eimer M, van Velzen J, Driver J (2002) Cross-modal interactions be- tween audition, touch, and vision in endogenous spatial attention: ERP evidence on preparatory states and sensory modulations. J Cogn Neurosci 14:254-271.
10. Falchier A, Clavagnier S, Barone P, Kennedy H (2002) Anatomical evi- dence of multimodal integration in primate striate cortex. J Neurosci 22:5749-5759.
11. Frassinetti F, Bolognini N, Làdavas E (2002) Enhancement of visual per- ception by crossmodal visuo-auditory interaction. Exp Brain Res 147: 332-343.
12. Grave de Peralta Menendez R, Murray MM, Michel CM, Martuzzi R, Gon- zalez Andino SL (2004) Electrical neuroimaging based on biophysical constraints. Neuroimage 21:527-539.
13. Green JJ, Teder-Sälejärvi WA, McDonald JJ (2005) Control mechanisms mediating shifts of attention in auditory and visual space: a spatio- temporal ERP analysis. Exp Brain Res 166:358-369.
14. Green JJ, Conder JA, McDonald JJ (2008) Lateralizedfrontalactivityelicited by attention-directing visual and auditory cues. Psychophysiology 45: 579-587.
15. Itti L, Koch C (2001) Computational modeling of visual attention. Nat Rev Neurosci 2:194-203.
16. Johnson JA, Zatorre RJ (2005) Attention to simultaneous unrelated audi- tory and visual events: behavioral and neural correlates. Cereb Cortex 15:1609-1620.
17. Macaluso E, Frith C, Driver J (2001) Response to McDonald, Teder- Sälejärvi, and Ward. In: Multisensory integration and crossmodal atten- tion effects in the human brain. Science 292:1791.
18. McDonald JJ, Ward LM (1999) Spatialrelevancedeterminesfacilitatoryand inhibitory effects of auditory covert spatial orienting. J Exp Psychol Hum Percept Perform 25:1234-1252.
19. McDonald JJ, Teder-Sälejärvi WA, Hillyard SA (2000) Involuntary orient- ing to sound improves visual perception. Nature 407:906-908.
20. McDonald JJ, Teder-Sälejärvi WA, Ward LM (2001) Multisensory integra- tion and crossmodal attention effects in the human brain. Science 292: 1791.
21. McDonald JJ, Teder-Sälejärvi WA, Di Russo F, Hillyard SA (2003) Neural substrates of perceptual enhancement by cross-modal spatial attention. J Cogn Neurosci 15:10-19.
22. McDonald JJ, Teder-Sälejärvi WA, Di Russo F, Hillyard SA (2005) Neural basisofauditory-inducedshiftsinvisualtime-orderperception. NatNeu- rosci 8:1197-1202.
23. McDonald JJ, Green JJ, Störmer VS, Hillyard SA (2012) Cross-modalspatial cueing of attention influences visual perception. In: Frontiers in the neu- ral bases of multisensory processes (Murray MM, Wallace, MT, eds.), pp 509-527. Boca Ratan, FL: CRC.
24. Näätänen R. (1992) Attention and brain function. Hillsdale, NJ:Lawrence Erlbaum.
25. Naue N, Rach S, Struber D, Huster RJ, Zaehle T, Körner U, Herrmann CS (2011) Auditory event-related response in visual cortex modulates sub- sequent visual responses in humans. J Neurosci 31:7729-7736.
26. Perrin F, Pernier J, Bertrand O, Echallier JF (1989) Spherical splines for scalp potential and current density mapping. Electroencephalogr Clin Neurophysiol 72:184-187.
27. Picton TW (2011) Human auditory evoked potentials. San Diego: Plural Publishing.
28. Praamstra P, Stegeman DF, Horstink MW, Cools AR (1996) Dipole source analysis suggests selective modulation of the supplementary motor area contribution to the readiness potential. Electroencephalogr Clin Neuro- physiol 98:468-477.
29. Raij T, Ahveninen J, Lin FH, Witzel T, Jääskeläinen IP, Letham B, Israeli E, Sahyoun C, Vasios C, Stufflebeam S, Hämäläinen M, Belliveau JW, et al. (2010) Onset timing of cross-sensory activations and multisen-sory interactions in auditory and visual sensory cortices. Eur J Neuro-sci 31:1772-1782.
30. Reynolds JH, Chelazzi L (2004) Attentional modulation of visual process- ing. Annu Rev Neurosci 27:611-647.
31. Rockland KS, Ojima H (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50:19-26.
32. Rorden C, Brett M (2000) Stereotaxic display of brain lesions. Behav Neurol 12:191-200.
33. Sabri M, Binder JR, Desai R, Medler DA, Leitl MD, Liebenthal E. (2008) Attentional and linguistic interactions in speech perception. Neuroimage 39:1444-1456.
34. Saito DN, Yoshimura K, Kochiyama T, Okada T, Honda M, Sadato N (2005) Cross-modal binding and activated attentional networks during audio- visual speech integration: a functional MRI study. Cereb Cortex 15: 1750-1760.
35. Seiss E, Gherri E, Eardley AF, Eimer M (2007) Do ERP components trig- gered during attentional orienting represent supramodal attentional con- trol? Psychophysiology 44:987-990.
36. Senkowski D, Saint-Amour D, Höfle M, Foxe J (2011) Multisensory inter- actions in early evoked brain activity follow the principle of inverse effec- tiveness. Neuroimage 56:2200-2208.
37. Stein BE, Meredith MA (1993) The merging of the sense. Cambridge, MA: MIT.
38. Störmer VS, Green JJ, McDonald JJ (2009a) Tracking the voluntary control of auditory spatial attention with event-related brain potentials. Psycho- physiology 46:357-366.
39. Störmer VS, McDonald JJ, Hillyard SA (2009b) Cross-modal cueing of at- tention alters appearance and early cortical processing of visual stimuli. Proc Natl Acad Sci U S A 106:22456-22461.
40. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain, vol 147. New York: Thieme.
41. Talsma D, Doty TJ, Woldorff MG (2007) Selective attention and audiovi- sual integration: is attending to both modalities a prerequisite for early integration? Cereb Cortex 17:679-690.
42. Van der Burg E, Talsma D, Olivers CN, Hickey C, Theeuwes J (2011) Early multisensory interactions affect the competition among multiple objects. Neuroimage 55:1208-1218.
43. von Kriegstein K, Eger E, Kleinschmidt A, Giraud AL (2003) Modulation of neural responses to speech by directing attention to voices or verbal con- tent. Brain Res Cogn Brain Res 17:48-55.
44. Wright RD, Ward LM (2008) Orientingofattention. NewYork:OxfordUP.
45. Wu CT, Weissman DH, Roberts KC, Woldorff MG (2007) The neural cir-cuitry underlying the executive control of auditory spatial attention. Brain Res 1134:187-198.
46. Zimmer U, Lewald J, Erb M, Grodd W, Karnath HO (2004) Is there a role of visual cortex in spatial hearing? Eur J Neurosci 20:3148-3156.