How sensory-motor systems impact the neural organization for language: Direct contrasts between spoken and signed language

Frontiers in Psychology

Volumn 5, Issue MAY, 2014, Pages

  Emmorey, Karen ^a   McCullough, Stephen ^a   Mehta, Sonya ^b,c   Grabowski, Thomas J ^c  

^a SAN DIEGO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

Author keywords

American sign language; Audio visual english; Bimodal bilinguals; FMRI; PET

Indexed keywords

EID: 84904503174     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00484     Document Type: Article

References (92)

1. Atkinson, J., Marshall, J., Woll, B., and Thacker, A. (2005). Testing comprehension abilities in users of British Sign Language following CVA. Brain Lang. 94, 233-248. doi: 10.1016/j.bandl.2004.12.008
2. Bates, E., D'Amico, S., Jacobsen, T., Szekely, A., Andonova, E., Devescovi, A., et al. (2003). Timed picture naming in seven languages. Psychon. Bull. Rev. 10, 344-380. doi: 10.3758/BF03196494
3. Bavelier, D., Brozinsky, C., Tomann, A., Mitchell, T., Neville, H., and Lui, G. (2001). Impact of deafness and early exposure to sign language on cerebral organization for motion processing. J. Neurosci. 21, 8931-8942.
4. Bavelier, D., Newman, A. J., Mukherjerr, M., Hauser, P., Kemeny, S., Braun, A., et al. (2008). Encoding, rehearsal, and recall in signers and speakers: shared network but differential engagement. Cereb. Cortex 18, 2263-2274. doi: 10.1093/cercor/bhm248
5. Berent, I., Dupuis, A., and Brentari, D. (2013). Amodal aspects of linguistic design. PloS ONE 8: e60617. doi: 10.1371/journal.pone.0060617
6. Bosworth, R., and Dobkins, K. (2001). Visual field asymmetries for motion processing in deaf and hearing signers. Brain Cogn. 49, 170-181. doi: 10.1006/brcg.2001.1498
7. Braun, A. R., Guillemin, A., Hosey, L., and Varga, M. (2001). The neural organization of discourse: an H215O-PET study of narrative production in English and American Sign Language. Brain 124, 2028-2044. doi: 10.1093/brain/124.10.2028
8. Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 13, 400-404. doi: 10.1111/j.1460-9568.2001.01385.x
9. Buchsbaum, B., Pickell, B., Love, T., Hatrak, M., Bellugi, U., and Hickok, G. (2005). Neural substrates for working memory in deaf signers: fMRI study and lesion case report. Brain Lang. 95, 265-272. doi: 10.1016/j.bandl.2005.01.009
10. Cardin, V., Orfanidou, E., Rönnberg, J., Capek, C. M., Rudner, M., and Woll, B. (2013). Dissociating cognitive and sensory neural plasticity in human superior temporal cortex. Nat. Commun. 4, 1473. doi: 10.1038/ncomms2463
11. Caspers, S., Zilles, K., Laird, A. R., and Eickhoff, S. B. (2010). ALE meta-analysis of action observation and imitation in the human brain. Neuroimage 50, 1148-1167. doi: 10.1016/j.neuroimage.2009.12.112
12. Chen, G., Saad, Z., Nath, A. R., Beauchamp, M. S., and Cox, R. W. (2012). FMRI group analysis combining effect estimates and their variances. Neuroimage 60, 747-765. doi: 10.1016/j.neuroimage.2011.12.060
13. Corina, D. P., and Knapp, H. (2006). Sign language processing and the mirror neuron system. Cortex 42, 529-539. doi: 10.1016/S0010-9452(08)70393-9
14. Corina, D. P., Lawyer, L. A., and Cates, D. (2013). Cross-linguistic differences in the neural representation of human language: evidence from users of signed languages. Front. Psychol. 3: 587. doi: 10.3389/fpsyg.2012.00587
15. Corina, D. P., McBurney, S. L., Dodrill, C., Hinshaw, K., Brinkley, J., and Ojemann, G. (1999). Functional roles of Broca's area and SMG: evidence from cortical stimulation mapping in a deaf signer. Neuroimage 10, 570-581. doi: 10.1006/nimg.1999.0499
16. Corina, D. P., San Jose-Robertson, L., Guillemin, A., High, J., and Braun, A. R. (2003). Language lateralization in a bimanual language. J. Cogn. Neurosci. 15, 718-730. doi: 10.1162/jocn.2003.15.5.718
17. Courtin, C., Jobard, G., Vigneau, M., Beaucousin, V., Razafimandimby, A., Hervé, P. Y., et al. (2011). A common neural system is activated in hearing non-signers to process French Sign language and spoken French. Brain Res. Bull. 84, 75-87. doi: 10.1016/j.brainresbull.2010.09.013
18. Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29, 162-173. doi: 10.1006/cbmr.1996.0014
19. Creem-Regehr, S. (2009). Sensory-motor and cognitive function of the human posterior parietal cortex involved in manual actions. Neurobiol. Learn. Mem. 91, 166-171. doi: 10.1016/j.nlm.2008.10.004
20. Dachovsky, S., and Sandler, W. (2009). Visual intonation in the prosody of a sign language. Lang. Speech 52, 287-314. doi: 10.1177/0023830909103175
21. Damasio, H., Grabowski, T. J., Frank, R., Knosp, B., Hichwa, R. D., Watkins, G. L., et al. (1994). " PET-Brainvox, a technique for neuroanatomical analysis of positron emission tomography images," in Quantification of Brain Function, eds K. Uemura, N. A. Lassen, T. Jones, and I. Kanno (Amsterdam: Elsevier), 465-474.
22. Emmorey, K. (2002). Language, Cognition, and the Brain: INSIGHTS from Sign Language Research. Mahwah, NJ: Lawrence Erlbaum and Associates.
23. Emmorey, K., Bosworth, R., and Kraljic, T. (2009a). Visual feedback and self-monitoring of sign language. J. Mem. Lang. 61, 398-411. doi: 10.1016/j.jml.2009.06.001
24. Emmorey, K., Corina, D., and Bellugi, U. (1995). " Differential processing of topographic and referential functions of space" in Language, Gesture, and Space, eds K. Emmorey and J. Reilly, (Hillsdale, NJ: Lawrence Erlbaum Associates), 43-62.
25. Emmorey, K., Gertsberg, N., Korpics, F., and Wright, C. E. (2009b). The influence of visual feedback and register changes on sign language production: a kinematic study with deaf signers. Appl. Psycholinguist. 30, 187-203. doi: 10.1017/S0142716408090085
26. Emmorey, K., Grabowski, T., McCullough, S., Damasio, H., Ponto, L., Hichwa, R., et al. (2003). Neural systems underlying lexical retrieval for sign language. Neuropsychologia 41, 85-95. doi: 10.1016/S0028-3932(02)00089-1
27. Emmorey, K., Grabowski, T. J., McCullough, S., Ponto, L., Hichwa, R., and Damasio, H. (2005). The neural correlates of spatial language in English and American Sign Language: a PET study with hearing bilinguals. Neuroimage 24, 832-840. doi: 10.1016/j.neuroimage.2004.10.008
28. Emmorey, K., Korpics, F., and Petronio, K. (2009c). The use of visual feedback during signing: evidence from signers with impaired vision. J. Deaf Stud. Deaf Educ. 14, 99-104. doi: 10.1093/deafed/enn020
29. Emmorey, K., and McCullough, S. (2009). The bimodal brain: effects of sign language experience. Brain Lang. 110, 208-221. doi: 10.1016/j.bandl.2008.03.005
30. Emmorey, K., McCullough, S., Mehta, S., Ponto, L. L. B., and Grabowski, T. J. (2013). The biology of linguistic expression impacts neural correlates for spatial language. J. Cogn. Neurosci. 25, 517-533. doi: 10.1162/jocn_a_00339
31. Emmorey, K., Mehta, S., and Grabowski, T. J. (2007). The neural correlates of sign versus word production. Neuroimage 36, 202-208. doi: 10.1016/j.neuroimage.2007.02.040
32. Emmorey, K., Xu, J., and Braun, A. (2011). Neural responses to meaningless pseudosigns: evidence for sign-based phonetic processing in superior temporal cortex. Brain Lang. 117, 34-38. doi: 10.1016/j.bandl.2010.10.003
33. Finney, E. M., Fine, I., and Dobkins, K. R. (2001). Visual stimuli activate auditory cortex in the deaf. Nat. Neurosci. 4, 1171-1173. doi: 10.1038/nn763
34. Frank, R. J., Damasio, H., and Grabowski, T. J. (1997). Brainvox: an interactive, multimodal visualization and analysis system for neuroanatomical imaging. Neuroimage 5, 13-30. doi: 10.1006/nimg.1996.0250
35. Friederici, A. D. (2011). The brain basis of language processing: from structure to function. Physiol. Rev. 91, 1357-1392. doi: 10.1152/physrev.00006.2011
36. Friederici, A. D., Rüschemyer, S. A., Hahne, A., and Fiebach, C. J. (2003). The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. Cereb. Cortex 13, 170-177. doi: 10.1093/cercor/13.2.170
37. Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J.-B., Frith, C. D., and Frackowiak, R. S. J. (1995). Statistical parametric maps in functional imaging: a general linear approach. Hum. Brain Mapp. 2, 189-210. doi: 10.1002/hbm.460020402
38. Grabowski, T. J., Damasio, H., Frank, R., Hichwa, R. D., Ponto, L. L., and Watkins, G. L. (1995). A new technique for PET slice orientation and MRI-PET coregistration. Hum. Brain Mapp. 2, 123-133. doi: 10.1002/hbm.460020302
39. Grabowski, T. J., Frank, R. J., Brown, C. K., Damasio, H., Ponto, L. L. B., Watkins, G. L., et al. (1996). Reliability of PET activation across statistical methods, subject groups, and sample sizes. Hum. Brain Mapp. 4, 227-239. doi: 10.1002/(SICI)1097-0193(1996)4: 1< 23: : AID-HBM2> 3.0.CO; 2-R
40. Grabowski, T. J., Frank, R. J., Szumski, N. R., Brown, C. K., and Damasio, H. (2000). Validation of partial tissue segmentation of single-channel magnetic resonance images. Neuroimage 12, 640-656. doi: 10.1006/nimg.2000.0649
41. Grodzinsky, Y., and Amunts, K. (2005). Broca's Region. Oxford: Oxford University Press.
42. Guenther, F. H., Hampson, M., and Johnson, D. (1998). A theoretical investigation of reference frames for the planning of speech movements. Psychol. Rev. 105, 611-633. doi: 10.1037/0033-295X.105.4.611-633
43. Gullberg, M., and Indefrey, P. (2006). The Cognitive Neuroscience of Second Language Acquisition. Oxford, UK: Blackwell Publishing.
44. Hagoort, P. (2013). MUC (Memory, Unification, Control) and beyond. Front. Psychol. 4: 416. doi: 10.3389/fpsyg.2013.00416
45. Herscovitch, P., Markham, J., and Raichle, M. E. (1983). Brain blood flow measure with intravenous H152 O. I. Theory and error analysis. J. Nucl. Med. 24, 782-789.
46. Hesse, M. D., Nishitani, N., Fink, G. R., Jousmäki, V., and Hari, R. (2010). Attenuation of somatosensory activation for self-produced tactile stimulation. Cereb. Cortex 20, 425-432. doi: 10.1093/cercor/bhp110
47. Hichwa, R. D., Ponto, L. L., and Watkins, G. L. (1995). " Clinical blood flow measurement with [150]water and positron emission tomography (PET)" in Symposium Proceedings of the International Symposium on Chemists' Views of Imaging Centers, ed A. M. Emran (New York, NY: Plenum Publishing).
48. Hickok, G., Bellugi, U., and Klima, E. (1998). What's right about the neural organization of sign language? A perspective on recent neuroimaging studies. Trends Cogn. Sci. 2, 465-468. doi: 10.1016/S1364-6613(98)01263-7
49. Hickok, G., Bellugi, U., and Klima, E. S. (1996). The neurobiology of sign language and its implications for the neural basis of language. Nature 381, 699-702. doi: 10.1038/381699a0
50. Hickok, G., Okada, K., and Serences, J. T. (2009). Area Spt in the human planum temporale supports sensory-motor integration for speech processing. J. Neurophysiol. 101, 2725-2732. doi: 10.1152/jn.91099.2008
51. Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402. doi: 10.1038/nrn2113
52. Horwitz, B., Amunts, K., Bhattacharyya, R., Patkin, D., Jeffries, K., Zilles, K., et al. (2003). Activation of Broca's area during the production of spoken and signed langauge: a combined cytoarchitectonic mapping and PET analysis. Neuropsychologia 41, 1868-1876. doi: 10.1016/S0028-3932(03)00125-8
53. Hosemann, J., Hermann, A., Steinbach, M., Bornkessel-Schlesewsky, I., and Schlesewsky, M. (2013). Lexical prediction via forward models: N400 evidence from German Sign Language. Neuropsychologia 51, 2224-2237. doi: 10.1016/j.neuropsychologia.2013.07.013
54. Houde, J. F., Nagarajan, S. S., Sekihara, K., and Merzenich, M. M. (2002). Modulation of auditory cortex during speech: an MEG study. J. Cogn. Neurosci. 14, 112-1138. doi: 10.1162/089892902760807140
55. Hu, Z., Wang, W., Liu, H., Peng, D., Yang, Y., Li, K., et al. (2011). Brain activations associated with sign production using word and picture inputs in deaf signers. Brain Lang. 116, 64-70. doi: 10.1016/j.bandl.2010.11.006
56. Indefrey, P., and Levelt, W. J. M. (2004). The spatial and temporal signatures of word production components. Cognition 92, 101-144. doi: 10.1016/j.cognition.2002.06.001
57. Jenkinson, M., Bannister, P. R., Brady, J. M., and Smith, S. M. (2002). Improved optimisation for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17, 825-841. doi: 10.1006/nimg.2002.1132
58. Jenkinson, M., and Smith, S. M. (2001). A global optimisation method for robust affine registration of brain images. Med. Image Anal. 5, 143-156. doi: 10.1016/S1361-8415(01)00036-6
59. Kassubek, J., Hickok, G., and Erhard, P. (2004). Involvement of classical anterior and posterior language areas in sign language production, as investigated by 4 T functional magnetic resonance imaging. Neurosci. Lett. 364, 168-172. doi: 10.1016/j.neulet.2004.04.088
60. Kilner, J. M. (2011). More than one pathway to action understanding. Trends Cogn. Sci. 15, 352-357. doi: 10.1016/j.tics.2011.06.005
61. Leonard, M. K., Ramirez, N. F., Torres, C., Travis, K. E., Hatrak, M., Mayberry, R. I., et al. (2012). Signed words in the congenitally deaf evoke typical late lexicosemantic responses with no early visual responses in left superior temporal cortex. J. Neurosci. 32, 9700-9705. doi: 10.1523/JNEUROSCI.1002-12.2012
62. Lorey, B., Pilgramm, S., Walter, B., Stark, R., Munzert, J., and Zentgraf, K. (2010). Your mind's hand: motor imagery of pointing movements with different accuracy. Neuroimage 49, 3239-3247. doi: 10.1016/j.neuroimage.2009.11.038
63. MacSweeney, M., Campbell, R., Woll, B., Brammer, M. J., Giampietro, V., David, A. S., et al. (2006). Lexical and sentential processing in British Sign Language. Hum. Brain Mapp. 27, 63-76. doi: 10.1002/hbm.20167
64. MacSweeney, M., Capek, C. M., Campbell, R., and Woll, B. (2008a). The signing brain: the neurobiology of sign language. Trends Cogn. Sci. 12, 432-440. doi: 10.1016/j.tics.2008.07.010
65. MacSweeney, M., Waters, D., Brammer, M. J., Woll, B., and Goswami, U. (2008b). Phonological processing in deaf signers and the impact of age of first acquisition. Neuroimage 40, 1369-1379. doi: 10.1016/j.neuroimage.2007.12.047
66. MacSweeney, M., Woll, B., Campbell, R., Calvert, G. A., McGuire, P. K., David, A. S., et al. (2002b). Neural correlates of British Sign Language comprehension: spatial processing demands of topographic language. J. Cogn. Neurosci. 14, 1604-1075. doi: 10.1162/089892902320474517
67. MacSweeney, M., Woll, B., Campbell, R., McGuire, P. K., David, A. S., Williams, S. C. et al. (2002a). Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain 125, 1583-1593. doi: 10.1093/brain/awf153
68. McCullough, S., Saygin, A. P., Korpics, F., and Emmorey, K. (2012). Motion-sensitive cortex and motion semantics in American Sign Language. Neuroimage 63, 111-118. doi: 10.1016/j.neuroimage.2012.06.029
69. Miller, A. J. (1991). Least squares routines to supplement those of gentleman. Appl. Statist. Algorithm 274, 458-478.
70. Neville, H. J., Bavelier, D., Corina, D., Rauschecker, J., Karni, A., Lalwani, A., et al. (1998). Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. Proc. Natl. Acad. Sci. U.S.A. 95, 992-929. doi: 10.1073/pnas.95.3.922
71. Newman, A. J., Supalla, T., Hauser, P. C., Newport, E. L., and Bavelier, D. (2010). Prosodic and narrative processing in American Sign Language: an fMRI study. Neuroimage 52, 669-676. doi: 10.1016/j.neuroimage.2010.03.055
72. Nichols, T., Brett, M., Andersson, J., Wager, T., and Poline, J. B. (2005). Valid conjunction inference with the minimum statistic. Neuroimage 25, 653-660. doi: 10.1016/j.neuroimage.2004.12.005
73. Numminen, J., Salmelin, R., and Hari, R. (1999). Subject's own speech reduces reactivity of the human auditory cortex. Neurosci. Lett. 265, 119-122. doi: 10.1016/S0304-3940(99)00218-9
74. Pa, J., Wilson, S. M., Pickell, H., Bellugi, U., and Hickok, G. (2008). Neural organization of linguistic short-term memory is sensory modality-dependent: evidence from signed and spoken language. J. Cogn. Neurosci. 20, 2198-2210. doi: 10.1162/jocn.2008.20154
75. Parker Jones, 'Ô., Green, D. W., Grogan, A., Pliatskias, C., Filippopolitis, K., Ali, N., et al. (2012). Where, when and why brain activation differs for bilinguals and monolinguals during picture naming and reading aloud. Cereb. Cortex 22, 892-902. doi: 10.1093/cercor/bhr161
76. Petitto, L. A., Zatorre, R. J., Gauna, K., Nikelski, E. J., Dostie, D., and Evans, A. C. (2000). Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. Proc. Natl. Acad. Sci. U.S.A. 97, 13961-13966. doi: 10.1073/pnas.97.25.13961
77. Pickering, M. J., and Garrod, S. (2013). An integrated theory of language production and comprehension. J. Behav. Brain Sci. 36, 329-392. doi: 10.1017/S0140525X12001495
78. Postma, A., and Noordanus, C. (1996). Production and detection of speech errors in silent, mouthed, noise-masked, and normal auditory feedback speech. Lang. Speech 39, 375-392.
79. Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816-847. doi: 10.1016/j.neuroimage.2012.04.062
80. Rönnberg, J., Rudner, M., and Ingvar, M. (2004). Neural correlates of working memory for sign language. Cogn. Brain Res. 20, 165-182. doi: 10.1016/j.cogbrainres.2004.03.002
81. Sakai, K. L., Tatsuno, Y., Suzuki, K., Kimura, H., and Ichida, Y. (2005). Sign and speech: amodal commonality in left hemisphere dominance for comprehension of sentences. Brain 128, 1407-1417. doi: 10.1093/brain/awh465
82. Sandler, W. (1999). Prosody in two natural language modalities. Lang. Speech 42, 127-142. doi: 10.1177/00238309990420020101
83. Saygin, A. P., McCullough, S., Alac, M., and Emmorey, K. (2010). Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. J. Cogn. Neurosci. 22, 2480-2490. doi: 10.1162/jocn.2009.21388
84. Schippers, M. B., and Keysers, C. (2011). Mapping the flow of information within the putative mirror neuron sysem during gesture observation. Neuroimage 57, 37-44. doi: 10.1016/j.neuroimage.2011.02.018
85. Simmons, A. J., Wise, R. J. S., and Leech, R. (2011). Two tongues, one brain: imaging bilingual speech production. Front. Psychol. 2: 166. doi: 10.3389/fpsyg.2011.00166
86. Söderfelt, B., Ingvar, M., Rönnberg, J., Eriksson, L., Serrander, M., and Stone-Elander, S. (1997). Signed and spoken language perception studied by positron emission tomography. Neurology 49, 82-87. doi: 10.1212/WNL.49.1.82
87. Tourville, J. A., and Guenther, F. H. (2011). The DIVA model: a neural theory of speech acquisition and production. Lang. Cogn. Process. 26, 952-981. doi: 10.1080/01690960903498424
88. Tourville, J. A., Reilly, K. J., and Guenther, F. H. (2008). Neural mechanisms controlling auditory feedback control of speech. Neuroimage 39, 1429-1443. doi: 10.1016/j.neuroimage.2007.09.054
89. Tungaraza, R. F., Mehta, S., Emmorey, K., and Grabowski, T. J. (2011). " White matter differences between deaf ASL signers and hearing English speakers," in Poster Presented at Human Brain Mapping (Québec city, QC).
90. Woods, R. P., Dapretto, M., Sicotte, N. L., Toga, A. W., and Mazziotta, J. C. (1999). Creation and use of a Talairach-compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data. Hum. Brain Mapp. 8, 73-79. doi: 10.1002/(SICI)1097-0193(1999)8: 2/33.0.CO; 2-7
91. Worsley, K. J. (1994). Local maxima and the expected Euler characteristic of excursion sets of chi-squared, F and t fields. Adv. Appl. Probabil. 26, 13-42. doi: 10.2307/1427576
92. Worsley, K. J., Evans, A. C., Marrett, S., and Neelin, P., (1992). A three dimensional statistical analysis for CBF activation studies in human brain. J. Cereb. Blood Flow Metab. 12, 900-918. doi: 10.1038/jcbfm.1992.127