Cross-modal integration during vowel identification in audiovisual speech: A functional magnetic resonance imaging study

Neuroscience Letters

Volumn 434, Issue 1, 2008, Pages 71-76

  Murase, Mika ^a,b   Saito, Daisuke N ^b,c   Kochiyama, Takanori ^d   Tanabe, Hiroki C ^a,b   Tanaka, Satoshi ^b   Harada, Tokiko ^b   Aramaki, Yu ^b,c   Honda, Manabu ^b,c,e   Sadato, Norihiro ^a,b,c,f  

^a GRADUATE UNIVERSITY FOR ADVANCED STUDIES   (Japan)

^b NATIONAL INSTITUTE FOR PHYSIOLOGICAL SCIENCES   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^d KAGAWA UNIVERSITY   (Japan)

^e NATIONAL INSTITUTE OF NEUROSCIENCE   (Japan)

^f UNIVERSITY OF FUKUI   (Japan)

Author keywords

Cross modal integration; Human voice; Lip reading; Perception; Spoken language; Superior temporal sulcus

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MOTOR CONTROL; PRIORITY JOURNAL; SPEECH ANALYSIS; SPEECH ARTICULATION; STIMULUS RESPONSE; VISUAL STIMULATION; VOWEL; WORKLOAD;

ACOUSTIC STIMULATION; ADULT; ATTENTION; BRAIN; BRAIN MAPPING; DOMINANCE, CEREBRAL; FEMALE; HUMANS; LANGUAGE; LANGUAGE TESTS; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; NEURAL PATHWAYS; PATTERN RECOGNITION, VISUAL; PHONETICS; PHOTIC STIMULATION; REACTION TIME; READING; SPEECH PERCEPTION; TEMPORAL LOBE; VERBAL BEHAVIOR;

EID: 40649109486     PISSN: 03043940     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neulet.2008.01.044     Document Type: Article

References (20)

1. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 15 (2005) 145-153
2. Callan D.E., Jones J.A., Munhall K., Callan A.M., Kroos C., and Vatikiotis-Bateson E. Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport 14 (2003) 2213-2218
3. Callan D.E., Jones J.A., Munhall K., Kroos C., Callan A.M., and Vatikiotis-Bateson E. Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J. Cogn. Neurosci. 16 (2004) 805-816
4. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 11 (2001) 1110-1123
5. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., and David A.S. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10 (1999) 2619-2623
6. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C., McGuire P.K., Woodruff P.W., Iversen S.D., and David A.S. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
7. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10 (2000) 649-657
8. Hurlbert A. Visual perception: learning to see through noise. Curr. Biol. 10 (2000) R231-R233
9. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9 (1971) 97-113
10. Olson I.R., Gatenby J.C., and Gore J.C. A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Brain Res. Cogn. Brain Res. 14 (2002) 129-138
11. Pekkola J., Ojanen V., Autti T., Jaaskelainen I.P., Mottonen R., Tarkiainen A., and Sams M. Primary auditory cortex activation by visual speech: an fMRI study at 3 T. Neuroreport 16 (2005) 125-128
12. Puce A., Allison T., Bentin S., Gore J.C., and McCarthy G. Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 18 (1998) 2188-2199
13. Raij T., Uutela K., and Hari R. Audiovisual integration of letters in the human brain. Neuron 28 (2000) 617-625
14. Saito D.N., Yoshimura K., Kochiyama T., Okada T., Honda M., and Sadato N. Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study. Cereb Cortex 15 (2005) 1750-1760
15. Schorr E.A., Fox N.A., van Wassenhove V., and Knudsen E.I. Auditory-visual fusion in speech perception in children with cochlear implants. Proc. Natl. Acad. Sci. U.S.A. 102 (2005) 18748-18750
16. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. America 26 (1954) 212-215
17. Tanabe H.C., Honda M., and Sadato N. Functionally segregated neural substrates for arbitrary audiovisual paired-association learning. J. Neurosci. 25 (2005) 6409-6418
18. van Atteveldt N.M., Formisano E., Blomert L., and Goebel R. The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cereb Cortex 17 (2007) 962-974
19. van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. U.S.A. 102 (2005) 1181-1186
20. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb Cortex 13 (2003) 1034-1043