Cross-modal integration and plastic changes revealed by lip movement, random-dot motion and sign languages in the hearing and deaf

Cerebral Cortex

Volumn 15, Issue 8, 2005, Pages 1113-1122

  Sadato, Norihiro ^a,b,c   Okada, Tomohisa ^a,d   Honda, Manabu ^a   Matsuki, Ken Ichi ^b   Yoshida, Masaki ^b   Kashikura, Ken Ichi ^b   Takei, Wataru ^e   Sato, Tetsuhiro ^b   Kochiyama, Takanori ^f   Yonekura, Yoshiharu ^b  

^a NATIONAL INSTITUTE FOR PHYSIOLOGICAL SCIENCES   (Japan)

^b UNIVERSITY OF FUKUI   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^d INSTITUTE OF BIOMEDICAL RESEARCH AND INNOVATION   (Japan)

^e KANAZAWA UNIVERSITY   (Japan)

^f KYOTO UNIVERSITY   (Japan)

Author keywords

Blood flow; Cortex; Deafness; Language; Magnetic resonance; Speech

Indexed keywords

ADULT; ARTICLE; BRAIN BLOOD FLOW; BRAIN CORTEX; BRAIN REGION; CONTROLLED STUDY; FEMALE; HEARING; HEARING ACUITY; HEARING IMPAIRMENT; HUMAN; HUMAN EXPERIMENT; LIP READING; MALE; MENTAL TASK; MOTION; MOUTH; NERVE CELL PLASTICITY; NUCLEAR MAGNETIC RESONANCE; PHONETICS; PRIORITY JOURNAL; RANDOMIZATION; SIGN LANGUAGE; SPEECH; TASK PERFORMANCE; VISUAL STIMULATION;

ADULT; DEAFNESS; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; LIPREADING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MOTION PERCEPTION; NEURONAL PLASTICITY; PHOTIC STIMULATION; SIGN LANGUAGE;

EID: 25444438540     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhh210     Document Type: Article

References (54)

1. Aitkin LM, Dickhaus H, Schult W, Zimmermann M (1978) External nucleus of inferior colliculus: auditory and spinal somatosensory afferents and their interactions. J Neurophysiol 41:837-847.
2. Aitkin LM, Kenyon CE, Philpott P (1981) The representation of the auditory and somatosensory systems in the external nucleus of the cat inferior colliculus. J Comp Neurol 196:25-40.
3. Baumgart F, Gaschler-Markefski B, Woldorff MG, Heinze H-J, Scheich H (1999) A movement-sensitive area in auditory cortex. Nature 400:724-726.
4. Belin P, McAdams S, Smith B, Savel S, Thivard L, Samson S, Samson Y (1998a) The functional anatomy of sound intensity discrimination. J Neurosci 18:6388-6394.
5. Belin P, Zilbovicius M, Crozier S, Thivard L, Fontaine A, Masure M, Samson Y (1998b) Lateralization of speech and auditory temporal processing. J Cogn Neurosci 10:536-540.
6. Bernstein LE, Demorest ME, Tucker PE (1998) What makes a good speechreader? First you have to find one. In: Hearing by eye: II. The psychology of speechreading and auditory-visual speech (Campbell R, Burnham D, Burnham D, eds), pp. 211-228. Hove: Psychology Press.
7. Bernstein LE, Auer ET, Moor JK, Ponton CW, Don M, Singh M (2002) Visual speech perception without primary auditory cortex activation. Neuroreport 13:311-315.
8. Bucchino G, Binkofski F, Fink GR, Fadiga L, Fagossi L, Gallese V, Seitz R, Zilles K, Rizzolatti G, Freund H-J (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Europ J Neurosci 13:400-404.
9. Büchel C, Friston KJ (1997) Modulation of connectivity in visual pathways by attention: cortical interactions evaluated with structural equation modelling and fMRI. Cereb Cortex 7:768-778.
10. Burt DM, Perrett DI (1997) Perceptual asymmetries in judgments of facial attractiveness, age, gender, speech and expression. Neuropsychologia 35:685-693.
11. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SC, McGuire PK, Woodruff PW, Iversen SD, David AS (1997) Activation of auditory cortex during silent lipreading. Science 276:593-596.
12. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 15:57-70.
13. Campbell R, Landis T, Regard M (1986) Face recognition and lipreading. A neurological dissociation. Brain 109:509-521.
14. Campbell R, MacSweeney M, Surguladze S, Calvert GA, McGuire P, Suckling J, Brammer MJ, David AS (2001) Cortical substrates for the perception of face action: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Cogn Brain Res 12:233-243.
15. Driver J (1996) Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381:66-68.
16. Evans AC, Kamber M, Collins DL, MacDonald D (1994) An MRI-based probabilistic atlas of neuroanatomy. In: Magnetic resonance scanning and epilepsy (Shorvon SD, ed.), pp. 263-274. New York: Plenum Press.
17. Finney EM, Fine I, Dobkins KR (2001) Visual stimuli activate auditory cortex in the deaf. Nat Neurosci 4:1171-1173.
18. Friston KJ, Worsley KJ, Frackowiak RSJ, Mazziotta JC, Evans AC (1994) Assessing the significance of focal activations using their spatial extent. Hum Brain Mapp 1:210-220.
19. Friston KJ, Holmes AP, Worsley KJ, Poline JB, Frith CD, Frackowiak RSJ (1995a) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210.
20. Friston KJ, Ashburner J, Frith CD, Heather JD, Frackowiak RSJ (1995b) Spatial registration and normalization of images. Hum Brain Mapp 2:165-189.
21. Friston KJ, Holmes A, Poline J-B, Price CJ, Frith CD (1996) Detecting activations in PET and fMRI: levels of inference and power. Neuroimage 4:223-235.
22. Friston KJ, Holmes AP, Worsley KJ (1999a) How many subjects constitute a study? Neuroimage 10:1-5.
23. Friston KJ, Zarahn E, Josephs O, Henson RNA, Dale AM (1999b) Stochastic designs in event-related fMRI. Neuroimage 10:607-619.
24. Galuske RAW, Schlote W, Bratzke H, Singer W (2000) Interhemispheric asymmetries of the modular structure in human temporal cortex. Science 289:1946-1949.
25. Geers A, Moog J (1989) Factors predictive of the development of literacy in profoundly hearing-impaired adolescents. Volta Rev 91:69-86.
26. Giraud AL, Price CJ, Graham JM, Truy E, Frackowiak RS (2001) Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron 30:657-663.
27. Iacoboni M, Woods RP, Brass M, Becckering H, Mazziotta JC, Rizzolatti G (1999) Cortical mechanisms of human imitation. Science 286:2526-2528.
28. Just MA, Carpenter PA, Keller TA, Eddy WF, Thulborn KR (1996) Brain activation modulated by sentence comprehension. Science 274:114-116.
29. Kral A, Schroder J, Klinke R, Engel A (2003) Absence of cross-modal reorganization in the primary auditory cortex of congenitally deaf cats. Exp Brain Res 153:605-613.
30. Lee DS, Lee JS, Oh SH, Kim S-K, Kim J-W, Chung J-K, Lee MC, Kim CS (2001) Cross-modal plasticity and cochlear implants. Nature 409:149-150.
31. Liberman AM, Whalen DH (2000) On the relation of speech to language. Trends Cogn Sci 4:187-196.
32. McCarthy G, Blamire AM, Rothman DL, Gruetter R, Shulman RG (1993) Echo-planar magnetic resonance imaging studies of frontal cortex activation during word generation in humans. Proc Natl Acad Sci USA 90:4952-4956.
33. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
34. Moores DF, Sweet C (1991) Factors predictive of school achievement. In: Educational and developmental aspects of deafness (Moores DF, K.P. M-O, eds), pp. 154-201. Washington, DC: Gallaudet University Press.
35. Neville HJ, Bavelier D, Corina D, Rauschecker J, Karni A, Lalwani A, Braun A, Clark V, Jezzard P, Turner R (1998) Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. Proc Natl Acad Sci USA 95:922-929.
36. Nishimura H, Hashikawa K, Doi K, Iwaki T, Watanabe Y, Kusuoka H, Nishimura T, Kubo T (1999) Sign language 'heard' in the auditory cortex. Nature 397:116.
37. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97-113.
38. Olson IR, Gatenby JC, Gore JC (2002) A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Cogn Brain Res 14:129-138.
39. Petitto LA, Zatorre RJ, Gauna K, Nikelski EJ, Dostie D, Evans AC (2000) Speech-like cerebral activity in profoundly deaf people processing signed languages: implication for the neural basis of human language. Proc Natl Acad Sci USA 97:13961-13966.
40. Price CJ, Wise RJ, Watson JD, Patterson K, Howard D, Frackowiak RS (1994) Brain activity during reading. The effects of exposure duration and task. Brain 117:1255-1269.
41. Puce A, Allison T, Bentin S, Gore JC, McCarthy G (1998) Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 18:2188-2199.
42. Rauschecker JP (1995) Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci 18:3643.
43. Rizzolatti G, Arbib A (1998) Language within our grasp. Trends Neurosci 21:188-194.
44. Robards MJ (1979) Somatic neurons in the brainstem and neocortex projecting to the external nucleus of the inferior colliculus: an anatomical study in the opossum. J Comp Neurol 184:547-565.
45. Schroeder CE, Lindsley RW, Specht C, Marcovici A, Smiley JF, Javitt DC (2001) Somatosensory input to auditory association cortex in the macaque monkey. J Neurophysiol 85:1322-1327.
46. Schwartz JH, Tallal P (1980) Rate of acoustic change may underlie hemispheric specialization for speech perception. Science 207:1380-1381.
47. Shore SE, Vass Z, Wys NL, Altschuler RA (2000) Trigeminal ganglion innervates the auditory brainstem. J Comp Neurol 419:271-285.
48. Sumby WH, Polack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26:212-215.
49. Watkins KE, Strafella AP, Paus T (2003) Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41:989-994.
50. Westbury CF, Zatorre RJ, Evans AC (1999) Quantifying variability in the planum temporale: a probability map. Cereb Cortex 9:392-405.
51. Zatorre RJ, Evans AC, Meyer E, Gjedde A (1992) Lateralization of phonetic and pitch discrimination in speech processing. Science 256:846-849.
52. Zatorre RC, Evans AC, Meyer E (1994) Neural mechanisms underlying melodic perception and memory for pitch. J Neurosci 14:1908-1919.
53. Zatorre RJ, Meyer E, Gjedde A, Evans AC (1996) PET studies of phonetic processing of speech: review, replication, and reanalysis. Cereb Cortex 6:21-30.
54. Zatorre RJ, Belin P, Penhune VB (2002) Structure and function of auditory cortex: music and speech. Trends Cogn Sci 6:37-46.