Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale

Human Brain Mapping

Volumn 27, Issue 6, 2006, Pages 471-477

  Pekkola, Johanna ^a,b   Ojanen, Ville ^a   Autti, Taina ^b   Jääskeläinen, Iiro P ^a,c   Möttönen, Riikka ^a   Sams, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

^b HELSINKI UNIVERSITY CENTRAL HOSPITAL   (Finland)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Attention; Audiovisual; Auditory cortex; Crossmodal; Planum temporale; Speech perception

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GESTURE; HEMODYNAMICS; HUMAN; HUMAN EXPERIMENT; LIP READING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SPEECH; SPEECH PERCEPTION; TEMPORAL LOBE; VISUAL STIMULATION;

ADULT; ATTENTION; AUDITORY CORTEX; BRAIN MAPPING; FEMALE; FUNCTIONAL LATERALITY; GESTURES; HUMANS; LIPREADING; MAGNETIC RESONANCE IMAGING; MALE; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 33745178109     PISSN: 10659471     EISSN: None     Source Type: Journal    
DOI: 10.1002/hbm.20190     Document Type: Article

References (35)

1. Alho K, Medvedev SV, Pakhomov SV, Roudas MS, Tervaniemi M, Reinikainen K, Zeffiro T, Näätänen R (1999): Selective tuning of the left and right auditory cortices during spatially directed attention. Brain Res Cogn Brain Res 7:335-341.
2. Bernstein LE, Auer ET Jr, Moore JK, Ponton CW, Don M, Singh M (2002): Visual speech perception without primary auditory cortex activation. Neuroreport 13:311-315.
3. Besle J, Fort A, Delpuech C, Giard MH (2004): Bimodal speech: early suppressive visual effects in human auditory cortex. Eur J Neurosci 20:2225-2234.
4. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Wooodruff PW, Iversen SD, David AS (1997): Activation of auditory cortex during silent lipreading. Science 276:593-596.
5. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS (1999): Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10:2619-2623.
6. Campbell R, MacSweeney M, Surguladze S, Calvert G, McGuire P, Suckling J, Brammer MJ, David AS (2001): Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Brain Res Cogn Brain Res 12:233-243.
7. Grady CL, Van Meter JW, Maisog JM, Pietrini P, Krasuski J, Rauschecker JP (1997): Attention-related modulation of activity in primary and secondary auditory cortex. Neuroreport 8:2511-2516.
8. Griffiths TD, Warren JD (2002): The planum temporale as a computational hub. Trends Neurosci 25:348-353.
9. Hashimoto R, Homae F, Nakajima K, Miyashita Y, Sakai KL (2000): Functional differentiation in the human auditory and language areas revealed by a dichotic listening task. Neuroimage 12:147-158.
10. Jääskeläinen IP, Ojanen V, Ahveninen J, Auranen T, Levänen S, Möttönen R, Tarnanen I, Sams M (2004): Adaptation of neuromagnetic N1 responses to phonetic stimuli by visual speech in humans. Neuroreport 15:2741-2744.
11. Jäncke L, Mirzazade S, Shah NJ (1999): Attention modulates activity in the primary and the secondary auditory cortex: a functional magnetic resonance imaging study in human subjects. Neurosci Lett 266:125-128.
12. Jenkinson M, Bannister P, Brady M, Smith S (2002): Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17:825-841.
13. Klucharev V, Möttönen R, Sams M (2003): Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Brain Res Cogn Brain Res 18:65-75.
14. Lipschutz B, Kolinsky R, Damhaut P, Wikler D, Goldman S (2002): Attention-dependent changes of activation and connectivity in dichotic listening. Neuroimage 17:643-656.
15. MacSweeney M, Amaro E, Calvert GA, Campbell R, David AS, McGuire P, Williams SC, Woll B, Brammer MJ (2000): Silent speechreading in the absence of scanner noise: an event-related fMRI study. Neuroreport 11:1729-1733.
16. McGurk H, MacDonald J (1976): Hearing lips and seeing voices. Nature 264:746-748.
17. Möttönen R, Krause CM, Tiippana K, Sams M (2002): Processing of changes in visual speech in the human auditory cortex. Brain Res Cogn Brain Res 13:417-425.
18. Möttönen R, Schurmann M, Sams M (2004): Time course of multisensory interactions during audiovisual speech perception in humans: a magnetoencephalographic study. Neurosci Lett 363:112-115.
19. Nobre AC (2001): The attentive homunculus: now you see it, now you don't. Neurosci Biobehav Rev 25:477-496.
20. Ogawa S, Lee TM, Kay AR, Tank DW (1990): Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc Natl Acad Sci U S A 87:9868-9872.
21. Ojanen V, Möttönen R, Pekkola J, Jääskeläinen IP, Joensuu R, Autti T, Sams M (2005): Processing of audiovisual speech in Broca's area. Neuroimage 25:333-338.
22. O'Leary DS, Andreason NC, Hurtig RR, Hichwa RD, Watkins GL, Ponto LL, Rogers M, Kirchner PT (1996): A positron emission tomography study of binaurally and dichotically presented stimuli: effects of level of language and directed attention. Brain Lang 53:20-39.
23. Paulesu E, Perani D, Blasi V, Silani G, Borghese NA, De Giovanni U, Sensolo S, Fazio F (2003): A functional-anatomical model for lipreading. J Neurophysiol 90:2005-2013.
24. Pekkola J, Ojanen V, Autti T, Jääskeläinen IP, Möttönen R, Tarkiainen A, Sams M (2005): Primary auditory cortex activation by visual speech: an fMRI study at 3T. Neuroreport 16:125-128.
25. Penhune VB, Zatorre RJ, MacDonald JD, Evans AC (1996): Interhemispheric anatomical differences in human primary auditory cortex: probabilistic mapping and volume measurement from magnetic resonance scans. Cereb Cortex 6:661-672.
26. Pugh KR, Shaywitz BA, Shaywitz SE, Fulbright RK, Byrd D, Skudlarski P, Shankweiler DP, Katz L, Constable RT, Fletcher J, Lacadie C, Marchione K, Gore JC (1996): Auditory selective attention: an fMRI investigation. Neuroimage 4:159-173.
27. Rademacher J, Caviness VS Jr, Steinmetz H, Galaburda AM (1993): Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping and neurobiology. Cereb Cortex 3:313-329.
28. Rinne T, Pekkola J, Degerman A, Autti T, Jäääskelä inen IP, Sams M, Alho K (2005): Modulation of auditory cortex activation by sound presentation rate and attention. Hum Brain Mapp 26:94-99.
29. Sams M, Aulanko R, Hämäläinen M, Hari R, Lounasmaa OV, Lu ST, Simola J (1991): Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci Lett 127:141-145.
30. Sumby WH, Pollack I (1954): Visual contribution to speech intelligibility in noise. J Acoustic Soc Am 26:212-215.
31. Tiippana K, Andersen TS, Sams M (2004): Visual attention modulates audiovisual speech perception. Eur J Cogn Psychol 16:457-472.
32. Van Wassenhove V, Grant KW, Poeppel D (2005): Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci U S A 102:1181-1186.
33. Woldorff MG, Gallen CC, Hampson SA, Hillyard SA, Pantev C, Sobel D, Bloom FE (1993): Modulation of early sensory processing in human auditory cortex during auditory selective attention. Proc Natl Acad Sci U S A 90:8722-8726.
34. Woolrich MW, Ripley BD, Brady M, Smith SM (2001): Temporal autocorrelation in univariate linear modeling of FMRI data. Neuroimage 14:1370-1386.
35. Woolrich MW, Behrens TE, Beckmann CF, Jenkinson M, Smith SM (2004): Multilevel linear modelling for FMRI group analysis using Bayesian inference. Neuroimage 21:1732-1747.