Dual neural routing of visual facilitation in speech processing

Journal of Neuroscience

Volumn 29, Issue 43, 2009, Pages 13445-13453

  Arnal, Luc H ^a   Morillon, Benjamin ^a   Kell, Christian A ^a,b   Giraud, Anne Lise ^a,c  

^a ECOLE NORMALE SUPÉRIEURE   (France)

^b GOETHE UNIVERSITY   (Germany)

^c PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY RESPONSE; BRAIN FUNCTION; CLINICAL ARTICLE; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MAGNETOENCEPHALOGRAPHY; MALE; PRIORITY JOURNAL; SPEECH; VISION;

ADULT; BRAIN; BRAIN MAPPING; CEREBROVASCULAR CIRCULATION; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MAGNETOENCEPHALOGRAPHY; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; MOTION PERCEPTION; NEURAL PATHWAYS; PSYCHOACOUSTICS; SPEECH PERCEPTION; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 70350540804     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3194-09.2009     Document Type: Article

References (36)

1. Barraclough NE, Xiao D, Baker CI, Oram MW, Perrett DI (2005) Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci 17:377-391. (Pubitemid 40364527)
2. Beauchamp MS, Lee KE, Argall BD, Martin A (2004a) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823.
3. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A (2004b) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7:1190-1192. (Pubitemid 39426237)
4. Bernstein LE, Lu ZL, Jiang J (2008a) Quantified acoustic-optical speech signal incongruity identifies cortical sites of audiovisual speech processing. Brain Res 1242:172-184.
5. Bernstein LE, Auer ET Jr, Wagner M, Ponton CW (2008b) Spatiotemporal dynamics of audiovisual speech processing. Neuroimage 39:423-435.
6. Besle J, Fort A, Delpuech C, Giard MH (2004) Bimodal speech: early suppressive visual effects in human auditory cortex. Eur J Neurosci 20:2225-2234. (Pubitemid 39331143)
7. Besle J, Fischer C, Bidet-Caulet A, Lecaignard F, Bertrand O, Giard MH (2008) Visual activation and audiovisual interactions in the auditory cortex during speech perception: intracranial recordings in humans. J Neurosci 28:14301-14310.
8. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 15:57-70.
9. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS (1997) Activation of auditory cortex during silent lipreading. Science 276:593-596. (Pubitemid 27193683)
10. Cappe C, Barone P (2005) Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. Eur J Neurosci 22:2886-2902. (Pubitemid 41818860)
11. Chandrasekaran C, Trubanova A, Stillittano S, Caplier A, Ghazanfar AA (2009) The natural statistics of audiovisual speech. PLoS Comput Biol 5:e1000436.
12. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57:11-23.
13. Falchier A, Clavagnier S, Barone P, Kennedy H (2002) Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 22:5749-5759. (Pubitemid 35386498)
14. Friston K (2005) A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci 360:815-836.
15. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
16. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 25:5004-5012.
17. Ghazanfar AA, Chandrasekaran C, Logothetis NK (2008) Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J Neurosci 28:4457-4469.
18. Grill-Spector K, Henson R, Martin A (2006) Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn Sci 10:14-23. (Pubitemid 43049768)
19. Hertrich I, Mathiak K, Lutzenberger W, Menning H, Ackermann H (2007) Sequential audiovisual interactions during speech perception: a whole-head MEG study. Neuropsychologia 45:1342-1354. (Pubitemid 46072902)
20. Hickok G, Poeppel D (2007) The cortical organization of speech processing. Nat Rev Neurosci 8:393-402.
21. Kayser C, Logothetis NK (2009) Directed interactions between auditory and superior temporal cortices and their role in sensory integration. Front Integr Neurosci 3:7.
22. Kayser C, Petkov CI, Augath M, Logothetis NK (2007) Functional imaging reveals visual modulation of specific fields in auditory cortex. J Neurosci 27:1824-1835. (Pubitemid 46310306)
23. Kayser C, Petkov CI, Logothetis NK (2008) Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560-1574. (Pubitemid 351882035)
24. Lakatos P, Chen CM, O'Connell MN, Mills A, Schroeder CE (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279-292. (Pubitemid 46074398)
25. Lakatos P, Karmos G, Mehta AD, Ulbert I, Schroeder CE (2008) Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 320:110-113.
26. Malikovic A, Amunts K, Schleicher A, Mohlberg H, Eickhoff SB, Wilms M, Palomero-Gallagher N, Armstrong E, Zilles K (2007) Cytoarchitectonic analysis of the human extrastriate cortex in the region of V5/MT+: a probabilistic, stereotaxic map of area hOc5. Cereb Cortex 17:562-574. (Pubitemid 46254695)
27. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
28. Melloni L, Schwiedrzik CM, Rodriguez E, Singer W (2009) (Micro)Saccades, corollary activity and cortical oscillations. Trends Cogn Sci 13:239-245.
29. Miller LM, D'Esposito M (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884-5893.
30. Morosan P, Rademacher J, Schleicher A, Amunts K, Schormann T, Zilles K (2001) Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system. Neuroimage 13:684-701. (Pubitemid 34184991)
31. Rockland KS, Ojima H (2003) Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol 50:19-26.
32. Schroeder CE, Lakatos P, Kajikawa Y, Partan S, Puce A (2008) Neuronal oscillations and visual amplification of speech. Trends Cogn Sci 12:106-113.
33. Stekelenburg JJ, Vroomen J (2007) Neural correlates of multisensory integration of ecologically valid audiovisual events. J Cogn Neurosci 19:1964-1973.
34. Sumby WH, Polack I (1954) Perceptual amplification of speech sounds by visual cues. J Acoust Soc Am 26:212-215.
35. van Wassenhove V, Grant KW, Poeppel D (2005) Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci U S A 102:1181-1186. (Pubitemid 40170746)
36. von Kriegstein K, Dogan O, Grüter M, Giraud AL, Kell CA, Grüter T, Kleinschmidt A, Kiebel SJ (2008) Simulation of talking faces in the human brain improves auditory speech recognition. Proc Natl Acad Sci U S A 105:6747-6752. (Pubitemid 351754578)