Human brain activity associated with audiovisual perception and attention

NeuroImage

Volumn 34, Issue 4, 2007, Pages 1683-1691

  Degerman, Alexander ^a,b   Rinne, Teemu ^a   Pekkola, Johanna ^b,c   Autti, Taina ^c   Jääskeläinen, Iiro P ^b   Sams, Mikko ^b   Alho, Kimmo ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

^b AALTO UNIVERSITY   (Finland)

^c HELSINKI UNIVERSITY CENTRAL HOSPITAL   (Finland)

Author keywords

Attention; Audiovisual integration; Functional magnetic resonance imaging (fMRI)

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDIOVISUAL EQUIPMENT; CLINICAL ARTICLE; ELECTROENCEPHALOGRAM; FEMALE; HEARING; HUMAN; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SOUND; STIMULUS RESPONSE; TEMPORAL CORTEX; VISION;

ADOLESCENT; ADULT; ATTENTION; AUDITORY PERCEPTION; BRAIN; COLOR; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; REFERENCE VALUES; SOUND; VISUAL PERCEPTION;

EID: 33846597947     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2006.11.019     Document Type: Article

References (47)

1. Alho K., Medvedev S.V., Pakhomov S.V., Roudas M.S., Tervaniemi M., Reinikainen K., Zeffiro T., and Näätänen R. Selective tuning of the left and right auditory cortices during spatially directed attention. Brain Res. 7 (1999) 335-341
2. Alsius A., Navarra J., Campbell R., and Soto-Faraco S. Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15 (2005) 839-843
3. Bushara K.O., Weeks R.A., Ishii K., Catalan M.J., Tian B., Rauschecker J.P., and Hallett M. Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans. Nat. Neurosci. 2 (1999) 759-766
4. Busse L., Roberts K.C., Crist R.E., Weissman D.H., and Woldorff M.G. The spread of attention across modalities and space in a multisensory object. Proc. Natl. Acad. Sci. U. S. A. 102 (2005) 18751-18756
5. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., and David A.S. Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport 10 (1999) 2619-2623
6. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10 (2000) 649-657
7. Calvert G.A., Hansen P.C., Iversen S.D., and Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage 14 (2001) 427-438
8. Corbetta M., Miezin F.M., Shulman G.L., and Petersen S.E. A PET study of visuospatial attention. J. Neurosci. 13 (1993) 1202-1226
9. Degerman A., Rinne T., Salmi J., Salonen O., and Alho K. Selective attention to sound location or pitch studied with fMRI. Brain Res. 1077 (2006) 123-134
10. Driver J., and Spence C. Attention and the crossmodal construction of space. Trends Cogn. Sci. 2 (1998) 254-262
11. Driver J., and Spence C. Multisensory perception: beyond modularity and convergence. Curr. Biol. 10 (2000) R731-R735
12. Eimer M., and Schröger E. ERP effects of intermodal attention and cross-modal links in spatial attention. Psychophysiology 35 (1998) 313-327
13. Fort A., Delpuech C., Pernier J., and Giard M.H. Dynamics of cortico-subcortical cross-modal operations involved in audio-visual object detection in humans. Cereb Cortex 12 (2002) 1031-1039
14. Fort A., Delpuech C., Pernier J., and Giard M.H. Early auditory-visual interactions in human cortex during nonredundant target identification. Brain Res. 14 (2002) 20-30
15. Fuster J.M., Bodner M., and Kroger J.K. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405 (2000) 347-351
16. Ghatan P.H., Hsieh J.C., Petersson K.M., Stone-Elander S., and Ingvar M. Coexistence of attention-based facilitation and inhibition in the human cortex. NeuroImage 7 (1998) 23-29
17. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
18. Gonzalo D., Shallice T., and Dolan R. Time-dependent changes in learning audiovisual associations: a single-trial fMRI study. NeuroImage 11 (2000) 243-255
19. Haxby J.V., Horwitz B., Ungerleider L.G., Maisog J.M., Pietrini P., and Grady C.L. The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J. Neurosci. 14 (1994) 6336-6353
20. Hillyard S.A., Simpson G.V., Woods D.L., Van Voorhis S., and Münte T.F. Event-related brain potentials and selective attention to different modalities. In: Reinoso-Suarez F., and Ajmone-Marsan C. (Eds). Cortical Integration (1984), Raven Press, New York 395-414
21. Hopfinger J.B., Buonocore M.H., and Mangun G.R. The neural mechanisms of top-down attentional control. Nat. Neurosci. 3 (2000) 284-291
22. Johnson J.A., and Zatorre R.J. Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage 31 (2006) 1673-1681
23. Kawashima R., Imaizumi S., Mori K., Okada K., Goto R., Kiritani S., Ogawa A., and Fukuda H. Selective visual and auditory attention toward utterances-A PET study. NeuroImage 10 (1999) 209-215
24. Klucharev V., Möttönen R., and Sams M. Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Brain Res. 18 (2003) 65-75
25. Laurienti P.J., Burdette J.H., Wallace M.T., Yen Y.F., Field A.S., and Stein B.E. Deactivation of sensory-specific cortex by cross-modal stimuli. J. Cogn. Neurosci. 14 (2002) 420-429
26. Macaluso E., George N., Dolan R., Spence C., and Driver J. Spatial and temporal factors during processing of audiovisual speech: a PET study. NeuroImage 21 (2004) 725-732
27. Mazzoni P., Bracewell R.M., Barash S., and Andersen R.A. Spatially tuned auditory responses in area LIP of macaques performing delayed memory saccades to acoustic targets. J. Neurophysiol. 75 (1996) 1233-1241
28. McDonald J.J., Teder-Sälejärvi W.A., and Hillyard S.A. Involuntary orienting to sound improves visual perception. Nature 407 (2000) 906-908
29. Molholm S., Sehatpour P., Mehta A.D., Shpaner M., Gomez-Ramirez M., Ortigue S., Dyke J.P., Schwartz T.H., and Foxe J.J. Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. J. Neurophysiol. 96 (2006) 721-729
30. Mountcastle V.B. Brain mechanisms for directed attention. J. R. Soc. Med. 71 (1978) 14-28
31. Petkov C.I., Kang X., Alho K., Bertrand O., Yund E.W., and Woods D.L. Attentional modulation of human auditory cortex. Nat. Neurosci. 7 (2004) 658-663
32. Rinne T., Pekkola J., Degerman A., Autti T., Jääskeläinen I.P., Sams M., and Alho K. Modulation of auditory cortex activation by sound presentation rate and attention. Hum. Brain Mapp. 26 (2005) 94-99
33. Saito D.N., Yoshimura K., Kochiyama T., Okada T., Honda M., and Sadato N. Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study. Cereb. Cortex 15 (2005) 1750-1760
34. Sekiyama K., Kanno I., Miura S., and Sugita Y. Auditory-visual speech perception examined by fMRI and PET. Neurosci. Res. 47 (2003) 277-287
35. Shomstein S., and Yantis S. Control of attention shifts between vision and audition in human cortex. J. Neurosci. 24 (2004) 10702-10706
36. Smith S.M., Jenkinson M., Woolrich M.W., Beckmann C.F., Behrens T.E., Johansen-Berg H., Bannister P.R., De Luca M., Drobnjak I., Flitney D.E., Niazy R.K., Saunders J., Vickers J., Zhang Y., De Stefano N., Brady J.M., and Matthews P.M. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage 23 Suppl. 1 (2004) S208-S219
37. Talairach J., and Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain. Three-Dimensional Proportional System: An Approach to Cerebral Imaging (1988), Thieme, Stuttgart
38. Talsma D., and Woldorff M.G. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17 (2005) 1098-1114
39. Teder-Sälejärvi W.A., Münte T.F., Sperlich F., and Hillyard S.A. Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. Brain Res. 8 (1999) 327-343
40. Tiippana K., Andersen T.S., and Sams M. Visual attention modulates audiovisual speech perception. Eur. J. Cogn. Psychol. 16 (2004) 457-472
41. Treisman A.M., and Gelade G. A feature-integration theory of attention. Cogn. Psychol. 12 (1980) 97-136
42. Tuomainen J., Andersen T.S., Tiippana K., and Sams M. Audio-visual speech perception is special. Cognition 96 (2005) B13-B22
43. Vaadia E., Benson D.A., Hienz R.D., and Goldstein Jr. M.H. Unit study of monkey frontal cortex: active localization of auditory and of visual stimuli. J. Neurophysiol. 56 (1986) 934-952
44. Woodruff P.W., Benson R.R., Bandettini P.A., Kwong K.K., Howard R.J., Talavage T., Belliveau J., and Rosen B.R. Modulation of auditory and visual cortex by selective attention is modality-dependent. NeuroReport 7 (1996) 1909-1913
45. Woolrich M.W., Ripley B.D., Brady M., and Smith S.M. Temporal autocorrelation in univariate linear modeling of FMRI data. NeuroImage 14 (2001) 1370-1386
46. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex 13 (2003) 1034-1043
47. Zatorre R.J., Mondor T.A., and Evans A.C. Auditory attention to space and frequency activates similar cerebral systems. NeuroImage 10 (1999) 544-554