Visual speech circuits in profound acquired deafness: A possible role for latent multimodal connectivity

Brain

Volumn 130, Issue 11, 2007, Pages 2929-2941

  Lee, Hyo Jeong ^a,b,c,d   Truy, Eric ^e   Mamou, Grégor ^a,b,c   Sappey Marinier, Dominique ^f   Giraud, Anne Lise ^a,b,c  

^a INSERM   (France)

^b SORBONNE UNIVERSITÉ   (France)

^c ECOLE NORMALE SUPÉRIEURE   (France)

^d Hallym University College of Medicine   (South Korea)

^e EDOUARD HERRIOT HOSPITAL   (France)

^f CERMEP IMAGERIE DU VIVANT   (France)

Author keywords

Deafness; fMRI; Multimodal; Reorganization; Speechreading

Indexed keywords

ADULT; AGED; ARTICLE; BRAIN CORTEX; BRAIN NERVE CELL; CLINICAL ARTICLE; CONTROLLED STUDY; CORRELATION ANALYSIS; DISEASE DURATION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING IMPAIRMENT; HUMAN; LIP READING; LONG TERM POTENTIATION; MALE; MENTAL PERFORMANCE; NERVE CELL NETWORK; NERVE CELL PLASTICITY; PRIORITY JOURNAL; SENSORY DEPRIVATION; SPEECH; TEMPORAL CORTEX; VISION;

ACUTE DISEASE; ADULT; AGED; AUDITORY CORTEX; CASE-CONTROL STUDIES; DEAFNESS; FACIAL EXPRESSION; FEMALE; HUMANS; LIPREADING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; REGRESSION ANALYSIS; TIME FACTORS;

EID: 35648948323     PISSN: 00068950     EISSN: 14602156     Source Type: Journal    
DOI: 10.1093/brain/awm230     Document Type: Article

References (61)

1. Andersson U, Lyxell B. Phonological deterioration in adults with an acquired severe hearing impairment. Scand Audiol Suppl 1998; 49: 93-100.
2. Andersson U, Lyxell B, Ronnberg J, Spens KE. Cognitive correlates of visual speech understanding in hearing-impaired individuals. J Deaf Stud Deaf Educ 2001a; 6: 103-16.
3. Andersson U, Lyxell B, Ronnberg J, Spens KE. Effects of tactile training on visual speechreading: performance changes related to individual differences in cognitive skills. J Deaf Stud Deaf Educ 2001b; 6: 116-29.
4. Baker CI, Peli E, Knouf N, Kanwisher NG. Reorganization of visual processing in macular degeneration. J Neurosci 2005; 25: 614-8.
5. Bavelier D, Brozinsky C, Tomann A, Mitchell T, Neville H, Liu G. Impact of early deafness and early exposure to sign language on the cerebral organization for motion processing. J Neurosci 2001; 21: 8931-42.
6. Bavelier D, Dye MW, Hauser PC. Do deaf individuals see better? Trends Cogn Sci 2006; 10: 512-8.
7. Beauchamp MS. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr Opin Neurobiol 2005; 15: 145-53.
8. Bernstein LE, Auer ET Jr, Tucker PE. Enhanced speechreading in deaf adults: can short-term training/practice close the gap for hearing adults? J Speech Lang Hear Res 2001; 44: 5-18.
9. Bernstein LE, Demorest ME, Tucker PE. Speech perception without hearing. Percept Psychophys 2000; 62: 233-52.
10. Blake DT, Heiser MA, Caywood M, Merzenich MM. Experience-dependent adult cortical plasticity requires cognitive association between sensation and reward. Neuron 2006; 52: 371-81.
11. Booth JR, Wood L, Lu D, Houk JC, Bitan T. The role of the basal ganglia and cerebellum in language processing. Brain Res 2007; 1133: 136-44.
12. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, et al. Activation of auditory cortex during silent lipreading. Science 1997; 276: 593-6.
13. Calvert GA, Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 2003; 15: 57-70.
14. Campbell R. Speechreading: advances in understanding its cortical bases and implications for deafness and speech rehabilitation. Scand Audiol Suppl 1998; 49: 80-6.
15. Charlier BL, Leybaert J. The rhyming skills of deaf children educated with phonetically augmented speechreading. Q J Exp Psychol A 2000; 53: 349-75.
16. Doucet ME, Bergeron F, Lassonde M, Ferron P, Lepore F. Cross-modal reorganization and speech perception in cochlear implant users. Brain 2006; 129: 3376-83.
17. Duncan J, Owen AM. Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci 2000; 23: 475-83.
18. Erber NP. Interaction of audition and vision in the recognition of oral speech stimuli. J Speech Hear Res 1969; 12: 423-5.
19. Falchier A, Clavagnier S, Barone P, Kennedy H. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci 2002; 22: 5749-59.
20. Farrer C, Frey SH, Van Horn JD, Tunik E, Turk D, Inati S, et al. The angular gyrus computes action awareness representations. Cereb Cortex 2007; [Epub ahead of print].
21. Fine I, Finney EM, Boynton GM, Dobkins KR. Comparing the effects of auditory deprivation and sign language within the auditory and visual cortex. J Cogn Neurosci 2005; 17: 1621-37.
22. Finney EM, Clementz BA, Hickok G, Dobkins KR. Visual stimuli activate auditory cortex in deaf subjects: evidence from MEG. Neuroreport 2003; 14: 1425-7.
23. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 2005; 25: 5004-12.
24. Ghazanfar AA, Schroeder CE. Is neocortex essentially multisensory? Trends Cogn Sci 2006; 10: 278-85.
25. Giraud AL, Price CJ, Graham JM, Truy E, Frackowiak RS. Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron 2001; 30: 657-63.
26. Gold BT, Buckner RL. Common prefrontal regions coactivate with dissociable posterior regions during controlled semantic and phonological tasks. Neuron 2002; 35: 803-12.
27. Hall DA, Fussell C, Summerfield AQ. Reading fluent speech from talking faces: typical brain networks and individual differences. J Cogn Neurosci 2005; 17: 939-53.
28. Hillis AE, Newhart M, Heidler J, Barker PB, Herskovits EH, Degaonkar M. Anatomy of spatial attention: insights from perfusion imaging and hemispatial neglect in acute stroke. J Neurosci 2005; 25: 3161-7.
29. Jacquemot C, Pallier C, LeBihan D, Dehaene S, Dupoux E. Phonological grammar shapes the auditory cortex: a functional magnetic resonance imaging study. J Neurosci 2003; 23: 9541-6.
30. Koechlin E, Ody C, Kouneiher F. The architecture of cognitive control in the human prefrontal cortex. Science 2003; 302: 1181-5.
31. Lafon JC. In: Eindheren, editor. Le test phonétique et la mesure de l'audition. Centrex; 1964.
32. Lambertz N, Gizewski ER, de Greiff A, Forsting M. Cross-modal plasticity in deaf subjects dependent on the extent of hearing loss. Brain Res Cogn Brain Res 2005; 25: 884-90.
33. Lehmann S, Murray MM. The role of multisensory memories in unisensory object discrimination. Brain Res Cogn Brain Res 2005; 24: 326-34.
34. Levanen S, Hamdorf D. Feeling vibrations: enhanced tactile sensitivity in congenitally deaf humans. Neurosci Lett 2001; 301: 75-7.
35. Ludman CN, Summerfield AQ, Hall D, Elliott M, Foster J, Hykin JL, et al. Lip-reading ability and patterns of cortical activation studied using fMRI. Br J Audiol 2000; 34: 225-30.
36. Lyxell B, Ronnberg J, Samuelsson S. Internal speech functioning and speechreading in deafened and normal hearing adults. Scand Audiol 1994; 23: 179-85.
37. MacLeod A, Summerfield Q. Quantifying the contribution of vision to speech perception in noise. Br J Audiol 1987; 21: 131-41.
38. MacSweeney M, Campbell R, Woll B, Giampietro V, David AS, McGuire PK, et al. Dissociating linguistic and nonlinguistic gestural communication in the brain. Neuroimage 2004; 22: 1605-18.
39. MacSweeney M, Woll B, Campbell R, McGuire PK, David AS, Williams SC, et al. Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain 2002; 125: 1583-93.
40. Meredith MA, Stein BE. Spatial determinants of multisensory integration in cat superior colliculus neurons. J Neurophysiol 1996; 75: 1843-57.
41. Moradi F, Hipp C, Koch C. Activity in the visual cortex is modulated by top-down attention locked to reaction time. J Cogn Neurosci 2007; 19: 331-40.
42. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971; 9: 97-113.
43. Pekkola J, Ojanen V, Autti T, Jaaskelainen IP, Mottonen R, Sams M. Attention to visual speech gestures enhances hemodynamic activity in the left planum temporale. Hum Brain Mapp 2006; 27: 471-7.
44. Petitto LA, Zatorre RJ, Gauna K, Nikelski EJ, Dostie D, Evans AC. Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. Proc Natl Acad Sci USA 2000; 97: 13961-6.
45. Puce A, Allison T, Bentin S, Gore JC, McCarthy G. Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 1998; 18: 2188-99.
46. Reilly KT, Mercier C, Schieber MH, Sirigu A. Persistent hand motor commands in the amputees' brain. Brain 2006; 129: 2211-23.
47. Rouger J, Lagleyre S, Fraysse B, Deneve S, Deguine O, Barone P. From the cover: evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci USA 2007; 104: 7295-300.
48. Schorr EA, Fox NA, van Wassenhove V, Knudsen EI. Auditory-visual fusion in speech perception in children with cochlear implants. Proc Natl Acad Sci USA 2005; 102: 18748-50.
49. Sheffert SM, Olson E. Audiovisual speech facilitates voice learning. Percept Psychophys 2004; 66: 352-62.
50. Scott SK, Johnsrude IS. The neuroanatomical and functional organization of speech perception. Trends Neurosci 2003; 26: 100-7.
51. Smirnakis SM, Brewer AA, Schmid MC, Tolias AS, Schuz A, Augath M, et al. Lack of long-term cortical reorganization after macaque retinal lesions. Nature 2005; 435: 300-7.
52. Summerfield Q. Use of visual information for phonetic perception. Phonetica 1979; 36: 314-31.
53. Summerfield Q. Lipreading and audio-visual speech perception. Philos Trans R Soc Lond B Biol Sci 1992; 335: 71-8.
54. Tyler RS, Lowder MW, Parkinson AJ, Woodworth GG, Gantz BJ. Performance of adult ineraid and nucleus cochlear implant patients after 3.5 years of use. Audiology 1995; 34: 135-44.
55. van Dijk JE, van Olphen AF, Langereis MC, Mens LH, Brokx JP, Smoorenburg GF. Predictors of cochlear implant performance. Audiology 1999; 38: 109-16.
56. van Wassenhove V, Grant KW, Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc Natl Acad Sci USA 2005; 102: 1181-6.
57. Vigneau M, Beaucousin V, Herve PY, Duffau H, Crivello F, Houde O, et al. Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing. Neuroimage 2006; 30: 1414-32.
58. von Kriegstein K, Giraud AL. Implicit multisensory associations influence voice recognition. PLoS Biol 2006; 4: e326.
59. von Kriegstein K, Kleinschmidt A, Giraud AL. Voice recognition and cross-modal responses to familiar speakers' voices in prosopagnosia. Cereb Cortex 2006; 16: 1314-22.
60. von Kriegstein K, Kleinschmidt A, Sterzer P, Giraud AL. Interaction of face and voice areas during speaker recognition. J Cogn Neurosci 2005; 17: 367-76.
61. Womelsdorf T, Anton-Erxleben K, Pieper F, Treue S. Dynamic shifts of visual receptive fields in cortical area MT by spatial attention. Nat Neurosci 2006; 9: 1083-4.