The signer as an embodied mirror neuron system: Neural mechanisms underlying sign language and action

Action to Language Via the Mirror Neuron System

Volumn , Issue , 2006, Pages 110-135

  Emmorey, Karen ^a  

^a SAN DIEGO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79955745418     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511541599.005     Document Type: Chapter

References (101)

1. Anderson, D., and Reilly, J. S., 1997. The puzzle of negation: how children move from communicative to grammatical negation in ASL. Appl. Psycholing. 18: 411–429.
2. Arbib, M. A., 2005. From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav Brain Sci. 28: 105–167.
3. Bavelier, D., Corina, D., Jezzard, P., et al., 1998. Hemispheric specialization for English and ASL: left invariance-right variability. Neuroreport 9: 1537–1542.
4. Best, C., 1995. A direct realist perspective on cross-language speech perception. In W. Strange and J. J. Jenkins (eds.) Cross-Language Speech Perception. Timonium, MD: York Press, pp. 171–204.
5. Blakemore, S.-J., and Decety, J., 2001. From the perception of action to the understanding of intention. Nature Rev. 2: 561–567.
6. Braun, A. R., Varga, M., Stager, S., et al., 1997. Altered patterns of cerebral activity during speech and language production in developmental stuttering: an H2 (15)O positron emission tomography study. Brain 120: 761–784.
7. Braun, A. R., Guillemin, A., Hosey, L., and Varga, V., 2001. The neural organization of discourse: an H215O PET study of narrative production in English and American Sign Language. Brain 124: 2028–2044.
8. Brentari, D., 1998. A Prosodic Model of Sign Language Phonology. Cambridge, MA: MIT Press
9. Buccino, G., Binkofski, F., Fink, G. R., et al., 2001. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 13: 400–404.
10. Calvert, G. A., and Campbell, R., 2003. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15: 57–70.
11. Calvert, G. A., Bullmore, E. T., Brammer, M. J., et al., 1997. Activation of auditory cortex during silent lipreading. Science 276: 593–596
12. Calvo-Merino, B., Glaser, D. E., Grezes, J., Passingham, R. E., and Haggard, P., 2004. Action observation and acquired motor skills: an fMRI study with expert dancers. Cereb Cortex. 15: 1243–1249.
13. Campbell, R., MacSweeney, M., Sugurladze, S., et al., 2001. The specificity of activation for seen speech and form meaningless lower-face acts (gurning). Brain Res. Cog. Res. 12: 233–243.
14. Chao, L., and Martin, A., 2000. Representation of manipulable man-made objects in the dorsal stream. Neuroimage 12: 478–484.
15. Choi, S. H., Na, D. L., Kang, E., et al., 2001. Functional magnetic resonance imaging during pantomiming tool-use gestures. Exp. Brain Res. 139: 311–317.
16. Clegg, M., and Aiello, L. C., 2000. Paying the price for speech? An analysis of mortality statistics for choking on food. Am. J. Phys. Anthropol. (Suppl. 30), 126: 9482–9483.
17. Corballis, M., 2002. From Hand to Mouth: The Origins of Language. Princeton, NJ: Princeton University Press.
18. Corina, D. P., and Sandler, W., 1993. On the nature of phonological structure in sign language. Phonology 10: 165–207.
19. Corina, D. P., Poizner, H., Bellugi, U., et al., 1992. Dissociation between linguistic and non-linguistic gestural systems: a case for compositionality. Brain Lang. 43: 414–447.
20. Corina, D. P., McBurney, S. L., Dodrill, C., et al., 1999. Functional roles of Broca’s area and supramarginal gyrus: evidence from cortical stimulation mapping in a deaf signer. Neuroimage 10: 570–581.
21. Crasborn, O., 2001. Phonetic Implementation of Phonological Categories in Sign Language of the Netherlands. LOT: Utrecht, Netherlands.
22. Cutler, A., 1987. Speaking for listening. In A. Allport and D. MacKay (eds.), Language Perception and Production: Relationship between Listening, Speaking, Reading, and Writing. San Diego, CA: Academic Press, pp. 23–40.
23. Damasio, H., Grabowski, T. J., Tranel, D., Hichwa, R., and Damasio, A. R., 1996. A neural basis for lexical retrieval. Nature 380: 499–505.
24. Damasio, H., Grabowski, T. J., Tranel, D., et al., 2001. Neural correlates of naming actions and of naming spatial relations. Neuroimage 13: 1053–1064.
25. Emmorey, K., 2002. Language, Cognition, and the Brain: Insights from Sign Language Research. Mahwah, NJ: Lawrence Erlbaum.
26. Emmorey, K., (ed.), 2003. Perspectives on Classifier Constructions in Signed Languages. Mahwah, NJ: Lawrence Erlbaum.
27. Emmorey, K., 2005. Signing for viewing: some relations between the production and comprehension of sign language. In A. Cutler (ed.) Twenty-First Century Psycholinguistics: Four Cornerstones. Mahwah, NJ: Lawrence Erlbaum, pp. 293–309.
28. Emmorey, K., 2006. The role of Broca’s area in sign language. In Y. Grodzinsky and K. Amunts (eds.) Broca’s Region. Oxford, UK: Oxford University Press, pp. 167–182.
29. Emmorey, K., and Corina, D., 1990. Lexical recognition in sign language: effects of phonetic structure and morphology. Percept. Motor Skills 71: 1227–1252.
30. Emmorey, K., and Grabowski, T., 2004. Neural organization for sign versus speech production. J. Cogn. Neurosci. (suppl.): 205.
31. Emmorey, K., Grabowski, T., McCullough, S., et al., 2003a. Neural systems underlying lexical retrieval for sign language. Neuropsychologia 41: 85–95.
32. Emmorey, K., McCullough, S., and Brentari, D., 2003b. Categorical perception in American Sign Language. Lang. Cogn. Processes 18: 21–45.
33. Emmorey, K., Grabowski, T., McCullough, S., et al., 2004. Motor-iconicity of sign language does not alter the neural systems underlying tool and action naming. Brain Lang. 89: 27–37.
34. Finney, E. M., Fine, I., and Dobkins, K. R., 2001. Visual stimuli activate auditory cortex in the deaf. Nature Neurosci. 4: 1171–1173.
35. Fowler, C., 1986. An event approach to the study of speech perception: a direct-realist perspective. J. Phonet. 14: 3–28.
36. Gallese, V., Fadiga, L., Fogassi, L., and Rizzolatti, G., 1996. Action recognition in the premotor cortex. Brain 119: 593–609.
37. Gallese, V., Fadiga, L., Fogassi, L., and Rizzolatti, G., 2002. Action representation and the inferior parietal lobule. In W. Prinz and B. Hommel (eds.) Common Mechanisms in Perception and Action. Oxford, UK: Oxford University Press, pp. 334–355.
38. Goldstein, L., and Fowler, C., 2003. Articulatory phonology: a phonology for public language use. In N. Schiler and A. Meyer (eds.) Phonetics and Phonology in Language Comprehension and Production. New York: Mouton de Gruyter, pp. 159–208.
39. Grabowski, T. J., Damasio, H., and Damasio, A., 1998. Premotor and prefrontal correlates of category-related lexical retrieval. Neuroimage 7: 232–243.
40. Grafton, S., Fadiga, L., Arbib, M., and Rizzolatti, G., 1997. Premotor cortex activation during observation and naming of familiar tools. Neuroimage 6: 231–236.
41. Grossman, E., Donnelly, M., Price, R., et al., 2000. Brain areas involved in perception of biological motion. J. Cogn. Neurosci. 12: 711–720.
42. Heilman, K. M., Rothi, I. J., and Valenstein, E., 1982. Two forms of ideomotor apraxia. Neurology 32: 342–346.
43. Hickok, G., and Poeppel, D., 2000. Towards a functional neuroanatomy of speech perception. Trends Cogn. Sci. 4: 131–138.
44. Hickok, G., Bellugi, U., and Klima, E. S. (1998). What’s right about the neural organization of sign language? A perspective on recent neuroimaging results. Trends Cogn. Sci. 2: 465–468.
45. Hickok, G., Love-Geffen, T., and Klima, E. S., 2002. Role of the left hemisphere in sign language comprehension. Brain Lang. 82: 167–178.
46. Horwitz, B., Amunts, K., Bhattacharyya, R., et al., 2003. Activation of Broca’s area during the production of spoken and signed language: a combined cytoarchitectonic mapping and PET analysis. Neuropsychologia 41: 1868–1876.
47. Iacoboni, M., Woods, R. P., Brass, M., et al., 1999. Cortical mechanisms of human imitation. Science 286: 2526–2528.
48. Iacoboni, M., Molnar-Szakacs, I., Gallese, V., et al., 2005. Grasping the intentions of others with one’s own mirror neuron system. PLoS Biol. 3 (3): e79.
49. Indefrey, P., and Levelt, W. J., 2004. The spatial and temporal signatures of word production components. Cognition 92: 101–144.
50. Indefrey, P., and Levelt, W., 2000. The neural correlates of language production. In M. Gazzaniga (ed.) The New Cognitive Neurosciences. Cambridge, MA: MIT Press, pp. 845–865.
51. Janzen, T., and Shaffer, B., 2002. Gesture as the substrate in the process of ASL grammaticalization. In R. P. Meier, K. Cormier, and D. Quinto-Pozos (eds.) Modality and Structure in Signed and Spoken Languages. Cambridge, UK: Cambridge University Press, pp. 199–223.
52. Ladefoged, P., 2000. A Course in Phonetics, 3rd edn. Zurich, Switzerland: Heinle.
53. Levänen, S., Uutela, K., Salenius, S., and Hari, R., 2001. Cortical representation of sign language: comparison of deaf signers and hearing non-signers. Cereb. Cortex 11: 506–512.
54. Liberman, A., 1996. Speech: A Special Code. Cambridge, MA: Bradford Books.
55. MacSweeney, M., Amaro, E., Calvert, G. A., et al., 2000. Activation of auditory cortex by silent speechreading in the absence of scanner noise: an event-related fMRI study. Neuroreport 11: 1729–1734.
56. MacSweeney, M., Woll, B., Campbell, R., et al., 2002. Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain 125: 1583–1593.
57. MacSweeney, M., Campbell, R., Woll, B., et al., 2004. Dissociating linguistic and nonlinguistic gestural communication in the brain. Neuroimage 22: 1605–1618.
58. Marshall, J., Atkinson, J., Smulovitch, E., Thacker, A., and Woll, B., 2004. Aphasia in a user of British Sign Language: dissociation between sign and gesture. Cogn. Neuropsychol. 21: 537–554.
59. Mayberry, R., 1994. The importance of childhood to language acquisition: insights from American Sign Language. In J. C. Goodman and H. C. Nusbaum (eds.) The Development of Speech Perception: The Transition from Speech Sounds to Words. Cambridge, MA: MIT Press, pp. 57–90.
60. Mayberry, R., 1995. Mental phonology and language comprehension or What does that sign mistake mean? In K. Emmorey and J. Reilly (eds.) Language, Gesture, and Space. Hillsdale, NJ: Lawrence Erlbaum, pp. 355–370.
61. Mayberry, R. I., and Fischer, S. D., 1989. Looking through phonological shape to lexical meaning: the bottleneck of non-native sign language processing. Mem. Cogn. 17: 740–754.
62. McCullough, S., Emmorey, K., and Sereno, M., 2005. Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. Brain Res. Cogn. Brain Res. 22: 193–203.
63. McDonald, P. A., and Paus, T., 2003. The role of parietal cortex in awareness of self-generated movements: a transcranial magnetic stimulation study. Cereb. Cortex 13: 962–967.
64. McGuire, P., Silbersweig, D. A., and Frith, C. D., 1996. Functional neuroanatomy of verbal self-monitoring. Brain 119: 907–917.
65. Moll, J., de Oliveira-Souza, R., Passman, L. J., et al., 2000. Functional MRI correlates of real and imagined tool-use pantomimes. Neurology 54: 1331–1336.
66. Mountcastle, V. B., Lynch, J. C., Georgopoulos, A., Sakata, H., and Acuna, C., 1975. Posterior parietal association cortex of the monkey: command functions for operations within extrapersonal space. J. Neurophysiol. 38: 871–908.
67. Neville, H. J., Bavelier, D., Corina, D., et al., 1998. Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. Proc. Natl Acad. Sci. USA 95: 922–929.
68. Newman, A., Bavelier, D., Corina, D., Jezzard, P., and Neville, H. J., 2002. A critical period for right hemisphere recruitment in American Sign Language processing. Nature Neurosci. 5: 76–80.
69. Newport, E. L., and Meier, R. P., 1985. The acquisition of American Sign Language. In D. Slobin (ed.) The Cross-Linguistic Study of Language Acquisition. Hillsdale, NJ: Lawrence Erlbaum, pp. 881–938.
70. Nishimura, H., Hashikawa, K., Doi, K., et al., 1999. Sign language “heard” in the auditory cortex. Nature 397: 116.
71. Papathanassiou, D., Etard, O., Mellet, E., et al., 2000. A common language netword for comprehension and production: a contribution to the definition of language epicenters with PET. Neuroimage 11: 347–357.
72. Paulesu, E., Perani, D., Blasi, V., et al., 2003. A functional–anatomical model for lipreading. J. Neurophysiol. 90: 2005–2013.
73. Petitto, L. A., 1987. On the autonomy of language and gesture: evidence from the acquisition of personal pronouns in American Sign Language. Cognition 27: 1–52.
74. Petitto, L. A., Zatorre, R. J., Gauna, K., et al., 2000. Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. Proc. Natl Acad. Sci. USA 97: 13961–13966.
75. Quinto-Pozos, D., 2003. Contact between Mexican Sign Language and American Sign Language in two Texas border areas. Ph. D. dissertation, University of Texas, Austin, TX.
76. Rizzolatti, G. and Arbib, M., 1998. Language within our grasp. Trends Neurosci. 21: 188–194.
77. Rizzolatti, G., Fadiga, L., Matelli, M., et al., 1996. Premotor cortex and the recognition of motor actions. Cogn. Brain Res. 71: 491–507.
78. Rizzolatti, G., Fogassi, L., and Gallese, V., 2002. Motor and cognitive functions of the ventral premotor cortex. Curr. Opin. Neurobiol. 12: 149–154.
79. Rothi, L. J., Heilman, K. M., and Watson, R. T., 1985. Pantomime comprehension and ideomotor apraxia. J. Neurol. Neurosurg. Psychiat. 48: 207–210.
80. Sadato, N., Yamada, H., Okada, T., et al., 2004. Age-dependent plasticity in the superior temporal sulcus in deaf humans: a functional MRI study. BMC Neurosci. 5: 56–61.
81. Sakai, K. L., Tatsuno, Y., Suzuki, K., Kimura, H., and Ichida, Y., 2005. Sign and speech: amodal commonality in left hemisphere dominance for comprehension of sentences. Brain 128: 1407–1417.
82. Sandler, W., 1989. Phonological Representation of the Sign: Linearity and Nonlinearity in American Sign Language. Dordrecht, Netherlands: Foris.
83. San José-Robertson, L., Corina, D. P., Ackerman, D., Guillemin, A., and Braun, A. R., 2004. Neural systems for sign language production: mechanisms supporting lexical selection, phonological encoding, and articulation. Hum. Brain Map. 23: 156–167.
84. Sekiyama, K., Kanno, I., Miura, S., and Sugita, Y., 2003. Auditory–visual speech perception examined by fMRI and PET. Neurosci. Res. 47: 277–287.
85. Senghas, A., 2003. Intergenerational influence and ontogenetic development in the emergence of spatial grammar in Nicaraguan Sign Language. Cogn. Devel. 18: 511–531.
86. Skipper, J. I., Nusbaum, H. C., and Small, S. L., 2005. Listening to talking faces: motor cortical activation during speech perception. Neuroimage 25: 76–89.
87. Söderfeldt, B., Rönnberg, J., and Risberg, J., 1994. Regional cerebral blood flow in sign language users. Brain Lang. 46: 59–68.
88. Söderfeldt, B., Ingvar, M., Rönnberg, J., et al., 1997. Signed and spoken language perception studied by positron emission tomography. Neurology 49: 82–87.
89. Stevens, K., and Blumstein, S., 1981. The search for invariant acoustic correlates of phonetic features. In P. D. Eimas and J. L. Miller (eds.) Perspectives on the Study of Speech. Hillsdale, NJ: Lawrence Erlbaum, pp. 1–38.
90. Supalla, T., and Newport, E., 1978. How many seats in a chair? The derivation of nouns and verbs in American Sign Language. In P. Siple (ed). Understanding Language through Sign Language Research. New York: Academic Press.
91. Talairach, J., and Tournoux, P., 1988. Co-Planar Stereotaxic Atlas of the Human Brain. New York: Thieme.
92. Tanaka, S., and Inui, T., 2002. Cortical involvement for action imitation of hand/arm versus finger configurations: an fMRI study. Neuroreport 13: 1599–1602.
93. Tanaka, S., Inui, T., Iwaki, S., Konishi, J., and Nakai, T., 2001. Neural substrates involved in imitating finger configurations: an fMRI study. Neuroreport 12: 1171–1174.
94. Taub, S., 2001. Language from the Body: Iconicity and Metaphor in American Sign Language. New York: Cambridge University Press.
95. Tomasello, M., Savage-Rumbaugh, S., and Kruger, A. C., 1993. Imitative learning of actions on objects by children, chimpanzees, and enculturated chimpanzees. Child Devel. 64: 1688–705.
96. Umiltá, M. A., Kohler, E., Gallese, V., et al., 2001. I know what you are doing: a neurophysiological study. Neuron 31: 155–165.
97. Vaina, L. M., Solomon, J., Chowdhury, S., Sinha, P., and Belliveau, J. W., 2001. Functional neuroanatomy of biological motion perception in humans. Proc. Natl Acad. Sci. USA 98: 11656–11661.
98. Volterra, V., and Iverson, J., 1995. When do modality factors affect the course of language acquisition? In K. Emmorey and J. Reilly (eds.) Language, Gesture, and Space. Hillsdale, NJ: Lawrence Erlbaum, pp. 371–390.
99. Watanabe, J., Sugiura, M., Miura, N., et al., 2004. The human parietal cortex is involved in spatial processing of tongue movement: an fMRI study. Neuroimage 21: 1289–1299.
100. Wise, R. J. S., Scott, S. K., Blank, S. C., et al., 2001. Separate neural subsystems within ‘Wernicke’s’ area. Brain 124: 83–95.
101. Wolpert, D. M., Goodbody, S. J., and Husain, M., 1998. Maintaining internal representations: the role of the human superior parietal lobe. Nature Neurosci. 1: 529–533.