Perception, action, and word meanings in the human brain: The case from action verbs

Annals of the New York Academy of Sciences

Volumn 1224, Issue 1, 2011, Pages 81-95

  Bedny, Marina ^a   Caramazza, Alfonso ^b,c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF TRENTO   (Italy)

Author keywords

Action verbs; Concept; Experience; Neural; Sensory motor; Word meaning

Indexed keywords

BRAIN; BRAIN REGION; COGNITION; COMPREHENSION; FRONTAL CORTEX; HUMAN; MOTOR PERFORMANCE; NERVE CELL NETWORK; PARIETAL CORTEX; PERCEPTION; REVIEW; TEMPORAL CORTEX;

EID: 79954466852     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06013.x     Document Type: Review

References (131)

1. Miller, G.A. & P. Johnson-Laird 1987. Language and Perception. Harvard University Press. Cambridge, MA
2. Barsalou, L.W. 1999. Perceptual symbol systems. Behav. Brain Sci. 22: 577-609; discussion 610-560.
3. Pulvermuller, F. 1999. Words in the brain's language. Behav. Brain Sci. 22: 253-279; discussion 280-336.
4. Gallese, V. & G. Lakoff 2005. The brain concepts: the role of the sensorymotor system in conceptual structure. Cogn. Neuropsychol. 22: 455-479.
5. Caramazza, A., A. Hillis, B. Rapp & C. Romani 1990. The multiple semantics hypothesis: Multiple confusions? Cogn. Neuropsychol. 7: 161-189.
6. Jackendoff, R. 2002. Foundations of Language: Brain, Meaning, Grammar, Evolution. Oxford University Press. Oxford
7. Caramazza, A. & B.Z. Mahon 2003. The organization of conceptual knowledge: the evidence from category-specific semantic deficits. Trends Cogn. Sci. 7: 354-361.
8. Fodor, J. 1983. The Modularity of Mind. MIT Press. Cambridge
9. Descartes, R. 1639. Meditations on First Philosophy in which are demonstrated the existence of God and distinction between the human soul and the body.
10. Berkeley, G. 17091732. An Essay Towards a New Theory of Vision. Dublin: Printed by Aaron Rhames for Jeremy Pepyal
11. Zalta, E.N., ed. 2008. The Stanford Encyclopedia of Philosophy. The Metaphysics Research Lab, Stanford University. Stanford, CA
12. Paivio, A. 1971. Imagery and Verbal Processes. Holt, Rinehart & Winston. New York
13. Potter, M.C. & B.A. Faulconer 1975. Time to understand pictures and words. Nature 253: 437-438.
14. Potter, M.C., V.V. Valian & B.A. Faulconer 1977. Representation of a sentence and its pragmatic implications: verbal, imagistic, or abstract? J. Verb. Learn. Verb. Behav. 16: 1-12.
15. Tyler, L.K. & H.E. Moss 2001. Towards a distributed account of conceptual knowledge. Trends Cogn. Sci. 5: 244-252.
16. Zwaan, R.A. 2003. The immersed experiencer: Toward an embodied theory of language comprehension. Psychol. Learn. Motiv. 44: 35-62.
17. Patterson, K., P.J. Nestor & T.T. Rogers 2007. Where do you know what you know? The representation of semantic knowledge in the human brain. Nat. Rev. Neurosci. 8: 976-987.
18. Kemmerer, D. 2007. How words capture visual experience: The perspective from cognitive neuroscience. In Words and the World: How Words Capture Experience. B. Malt & P. Wolff, Eds. Oxford University Press. Oxford
19. Pulvermuller, F. 2001. Brain reflections of words and their meaning. Trends Cogn. Sci. 5: 517-524.
20. Barsalou, L.W. 2007. Grounded cognition. Annu. Rev. Psychol. 59: 617-645.
21. Rogers, T.T., M.A. Lambon Ralph, P. Garrard, et al 2004. Structure and deterioration of semantic memory: a neuropsychological and computational investigation. Psychol. Rev. 111: 205-235.
22. Revill, K.P., R.N. Aslin, M.K. Tanenhaus & D. Bavelier 2008. Neural correlates of partial lexical activation. Proc. Natl. Acad. Sci. USA 105: 13111-13115.
23. Martin, A., J.V. Haxby, F.M. Lalonde, et al 1995. Discrete cortical regions associated with knowledge of color and knowledge of action. Science 270: 102-105.
24. Hauk, O., I. Johnsrude & F. Pulvermuller 2004. Somatotopic representation of action words in human motor and premotor cortex. Neuron 41: 301-307.
25. Bedny, M., A. Caramazza, E. Grossman, et al 2008. Concepts are more than percepts: the case of action verbs. J. Neurosci. 28: 11347-11353.
26. Snowden, R.J. & T.C. Freeman 2004. The visual perception of motion. Curr. Biol. 14: R828-831.
27. Born, R.T. & D.C. Bradley 2005. Structure and function of visual area MT. Annu. Rev. Neurosci. 28: 157-189.
28. Tootell, R.B., J.B. Reppas, K.K. Kwong, et al 1995. Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J. Neurosci. 15: 3215-3230.
29. Dubner, R. & S.M. Zeki 1971. Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Res. 35: 528-532.
30. de Jong, B.M., S. Shipp, B. Skidmore, et al 1994. The cerebral activity related to the visual perception of forward motion in depth. Brain 117(Pt 5): 1039-1054.
31. Zeki, S. 1991. Cerebral akinetopsia (visual motion blindness). A review. Brain 114(Pt 2): 811-824.
32. Zihl, J., D. von Cramon & N. Mai 1983. Selective disturbance of movement vision after bilateral brain damage. Brain 106(Pt 2): 313-340.
33. Beckers, G. & V. Homberg 1992. Cerebral visual motion blindness: transitory akinetopsia induced by transcranial magnetic stimulation of human area V5. Proc. Biol. Sci. 249: 173-178.
34. Grossman, E.D., M. Donnelly, R. Price, et al 2000. Brain areas involved in perception of biological motion. J. Cogn. Neurosci. 12: 711-720.
35. Grossman, E.D. & R. Blake 2002. Brain areas active during visual perception of biological motion. Neuron 35: 1167-1175.
36. Grossman, E.D., L. Battelli & A. Pascual-Leone 2005. Repetitive, T.M.S over posterior STS disrupts perception of biological motion. Vision Res. 45: 2847-2853.
37. Sunaert, S., P. Van Hecke, G. Marchal & G.A. Orban 1999. Motion-responsive regions of the human brain. Exp. Brain Res. 127: 355-370.
38. Vanduffel, W., D. Fize, H. Peuskens, et al 2002. Extracting 3D from motion: differences in human and monkey intraparietal cortex. Science 298: 413-415.
39. Claeys, K.G., D.T. Lindsey, E. De Schutter & G.A. Orban 2003. A higher order motion region in human inferior parietal lobule: evidence from fMRI. Neuron 40: 631-642.
40. Martinez-Trujillo, J.C., D. Cheyne, W. Gaetz, et al 2007. Activation of area MT/V5 and the right inferior parietal cortex during the discrimination of transient direction changes in translational motion. Cereb. Cortex 17: 1733-1739.
41. Lewis, J.W., M.S. Beauchamp & E.A. DeYoe 2000. A comparison of visual and auditory motion processing in human cerebral cortex. Cereb. Cortex 10: 873-888.
42. Bremmer, F., A. Schlack, N.J. Shah, et al 2001. Polymodal motion processing in posterior parietal and premotor cortex: a human fMRI study strongly implies equivalencies between humans and monkeys. Neuron 29: 287-296.
43. Zwaan, R.A., C.J. Madden, R.H. Yaxley & M.E. Aveyard 2004. Moving words: Dynamic mental representations in language comprehension. Cogn. Sci. 28: 611-619.
44. Kaschak, M.P., C.J. Madden, D.J. Therriault, et al 2005. Perception of motion affects language processing. Cognition 94: B79-89.
45. Meteyard, L., N. Zokaei, B. Bahrami & G. Vigliocco 2008. Visual motion interferes with lexical decision on motion words. Curr. Biol. 18: R732-R733.
46. Meteyard, L., B. Bahrami & G. Vigliocco 2007. Motion detection and motion verbs: language affects low-level visual perception. Psychol. Sci. 18: 1007-1013.
47. Zwaan, R.A. & L.J. Taylor 2006. Seeing, acting, understanding: motor resonance in language comprehension. J. Exp. Psychol. Gen. 135: 1-11.
48. Yaxley, R.H., Zwaan, R.A. 2007. Simulating visibility during language comprehension. Cognition 105: 229-236.
49. Winawer, J., N. Witthoft, M.C. Frank, et al 2007. Russian blues reveal effects of language on color discrimination. Proc. Natl. Acad. Sci. USA 104: 7780-7785.
50. Vaina, L.M., A. Cowey, R.T. Eskew Jr., et al 2001. Regional cerebral correlates of global motion perception: evidence from unilateral cerebral brain damage. Brain 124: 310-321.
51. Kourtzi, Z. & N. Kanwisher 2000. Activation in human MT/MST by static images with implied motion. J. Cogn. Neurosci. 12: 48-55.
52. Mahon, B.Z. & A. Caramazza 2008. A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. J. Physiol. Paris 102: 59-70.
53. Maeda, F., R. Kanai & S. Shimojo 2004. Changing pitch induced visual motion illusion. Curr. Biol. 14: R990-991.
54. Tranel, D., R. Adolphs, H. Damasio & A.R. Damasio 2001. A neural basis for the retrieval of words for actions. Cogn. Neuropsychol. 18: 655-674.
55. Tranel, D., D. Kemmerer, R. Adolphs, et al 2003. Neural correlates of conceptual knowledge for actions. Cogn. Neuropsychol. 20: 409-432.
56. Kable, J.W., J. Lease-Spellmeyer & A. Chatterjee 2002. Neural substrates of action event knowledge. J. Cogn. Neurosci. 14: 795-805.
57. Kable, J.W., I.P. Kan, A. Wilson, et al 2005. Conceptual representations of action in the lateral temporal cortex. J. Cogn. Neurosci. 17: 1855-1870.
58. Sadaghiani, S., J.X. Maier & U. Noppeney 2009. Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing. J. Neurosci. 29: 6490-6499.
59. Noppeney, U., O. Josephs, S. Kiebel, et al 2005a. Action selectivity in parietal and temporal cortex. Brain Res. Cogn. Brain Res. 25: 641-649.
60. van Dam, W.O., S.A. Rueschemeyer & H. Bekkering 2010. How specifically are action verbs represented in the neural motor system: An fMRI study. Neuroimage 53(4): 1318-1325.
61. Mahon, B.Z., S.C. Milleville, G.A. Negri, et al 2007. Action-related properties shape object representations in the ventral stream. Neuron 55: 507-520.
62. Pobric, G., E. Jefferies & M.A. Lambon Ralph 2010. Category-specific versus category-general semantic impairment induced by transcranial magnetic stimulation. Curr. Biol. 20: 964-968.
63. Culham, J.C. & K.F. Valyear 2006. Human parietal cortex in action. Curr. Opin. Neurobiol. 16: 205-212.
64. Price, C.J. 2010. The anatomy of language: a review of 100 fMRI studies published in 2009. Ann. N. Y. Acad. Sci. 1191: 62-88.
65. Saygin, A.P., S. McCullough, M. Alac & K. Emmorey 2009. Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. J. Cogn. Neurosci. 22(11): 2480-2490.
66. Deen, B. & G. McCarthy 2010. Reading about the actions of others: Biological motion imagery and action congruency influence brain activity. Neuropsychologia 48(6): 1607-1615.
67. Wallentin, M., T.E. Lund, S. Ostergaard, et al 2005. Motion verb sentences activate left posterior middle temporal cortex despite static context. Neuroreport 16: 649-652.
68. Pulvermuller, F. & L. Fadiga 2010. Active perception: sensorimotor circuits as a cortical basis for language. Nat. Rev. Neurosci. 11: 351-360.
69. Willems, R.M. & P. Hagoort 2007. Neural evidence for the interplay between language, gesture, and action: a review. Brain Lang. 101: 278-289.
70. Kemmerer, D. & J. Gonzalez-Castillo 2008. The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system. Brain Lang 112(1): 54-76.
71. Dum, R.P. & P.L. Strick 1991. The origin of corticospinal projections from the premotor areas in the frontal lobe. J. Neurosci. 11: 667-689.
72. Sanes, J.N. & M.H. Schieber 2001. Orderly somatotopy in primary motor cortex: does it exist? Neuroimage 13: 968-974.
73. Riehle, A. & J. Requin 1989. Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement. J. Neurophysiol. 61: 534-549.
74. Graziano, M. 2006. The organization of behavioral repertoire in motor cortex. Annu. Rev. Neurosci. 29: 105-134.
75. Pascual-Leone, A., D. Nguyet, L.G. Cohen, et al 1995. Modulation of muscle responses evoked by transcranial magnetic stimulation during the acquisition of new fine motor skills. J. Neurophysiol. 74: 1037-1045.
76. Feydy, A., R. Carlier, A. Roby-Brami, et al 2002. Longitudinal study of motor recovery after stroke: recruitment and focusing of brain activation. Stroke 33: 1610-1617.
77. Rizzolatti, G. & C. Sinigaglia 2010. The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat. Rev. Neurosci. 11: 264-274.
78. Schluter, N.D., M.F. Rushworth, R.E. Passingham & K.R. Mills 1998. Temporary interference in human lateral premotor cortex suggests dominance for the selection of movements. A study using transcranial magnetic stimulation. Brain 121(Pt 5): 785-799.
79. Schubotz, R.I. & D.Y. von Cramon 2003. Functional-anatomical concepts of human premotor cortex: evidence from fMRI and PET studies. Neuroimage 20(Suppl 1): S120-S131.
80. Schubotz, R.I. & D.Y. von Cramon 2004. Sequences of abstract nonbiological stimuli share ventral premotor cortex with action observation and imagery. J. Neurosci. 24: 5467-5474.
81. Schubotz, R.I. 2007. Prediction of external events with our motor system: towards a new framework. Trends Cogn. Sci. 11: 211-218.
82. Wolfensteller, U., R.I. Schubotz & D.Y. von Cramon 2007. Understanding non-biological dynamics with your own premotor system. Neuroimage 36(Suppl 2): T33-43.
83. Chouinard, P.A. & T. Paus 2006. The primary motor and premotor areas of the human cerebral cortex. Neuroscientist 12: 143-152.
84. Forstmann, B.U., G. Dutilh, S. Brown, et al 2008. Striatum and pre-SMA facilitate decision-making under time pressure. Proc. Natl. Acad. Sci. USA 105: 17538-17542.
85. Nachev, P., C. Kennard & M. Husain 2008. Functional role of the supplementary and pre-supplementary motor areas. Nat. Rev. Neurosci. 9: 856-869.
86. Leek, E.C. & S.J. Johnston 2009. Functional specialization in the supplementary motor complex. Nat. Rev. Neurosci. 10: 78; author reply 78.
87. Miller, E.K. & J.D. Cohen 2001. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24: 167-202.
88. Ruschemeyer, S.A., M. Brass & A.D. Friederici 2007. Comprehending prehending: neural correlates of processing verbs with motor stems. J. Cogn. Neurosci. 19: 855-865.
89. Willems, R.M., P. Hagoort & D. Casasanto 2010. Body-specific representations of action verbs: neural evidence from right- and left-handers. Psychol. Sci. 21: 67-74.
90. Willems, R.M., I. Toni, P. Hagoort & D. Casasanto 2009b. Neural dissociations between action verb understanding and motor imagery. J. Cogn. Neurosci 21(1): 67-74.
91. Davis, M.H., F. Meunier & W.D. Marslen-Wilson 2004. Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study. Brain Lang. 89: 439-449.
92. Duffau, H., L. Capelle, D. Denvil, et al 2003. The role of dominant premotor cortex in language: a study using intraoperative functional mapping in awake patients. Neuroimage 20: 1903-1914.
93. Ullman, M.T. 2004. Contributions of memory circuits to language: the declarative/procedural model. Cognition 92: 231-270.
94. van Heuven, W.J., H. Schriefers, T. Dijkstra & P. Hagoort 2008. Language conflict in the bilingual brain. Cereb. Cortex 18: 2706-2716.
95. Pulvermuller, F., Y. Shtyrov & R. Ilmoniemi 2005. Brain signatures of meaning access in action word recognition. J. Cogn. Neurosci. 17: 884-892.
96. Postle, N., K.L. McMahon, R. Ashton, et al 2008. Action word meaning representations in cytoarchitectonically defined primary and premotor cortices. Neuroimage 43: 634-644.
97. de Zubicaray, G., N. Postle, K. McMahon, et al 2008. Mirror neurons, the representation of word meaning, and the foot of the third left frontal convolution. Brain Lang. 112(1): 77-84.
98. Willems, R.M., I. Toni, P. Hagoort & D. Casasanto 2009a. Body-specific motor imagery of hand actions: neural evidence from right- and left-handers. Front Hum. Neurosci. 3: 39.
99. Aziz-Zadeh, L., S.M. Wilson, G. Rizzolatti & M. Iacoboni 2006. Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol. 16: 1818-1823.
100. Buccino, G., L. Riggio, G. Melli, et al 2005. Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Brain Res. Cogn. Brain Res. 24: 355-363.
101. Beilock, S.L., I.M. Lyons, A. Mattarella-Micke, et al 2008. Sports experience changes the neural processing of action language. Proc. Natl. Acad. Sci. USA 105: 13269-13273.
102. Haaland, K.Y., C.L. Elsinger, A.R. Mayer, et al 2004. Motor sequence complexity and performing hand produce differential patterns of hemispheric lateralization. J. Cogn. Neurosci. 16: 621-636.
103. Grafton, S.T. & A.F. Hamilton 2007. Evidence for a distributed hierarchy of action representation in the brain. Hum. Mov. Sci. 26: 590-616.
104. Zwaan, R.A. & G.A. Radvansky 1998. Situation models in language comprehension and memory. Psychol. Bull. 123: 162-185.
105. Perani, D., S.F. Cappa, T. Schnur, et al 1999. The neural correlates of verb and noun processing: A PET study. Brain 122: 2337-2344.
106. Grossman, M., P. Koenig, C. DeVita, et al 2002. Neural representation of verb meaning: An fMRI study. Hum. Brain Mapp. 15: 124-134.
107. Bedny, M. & S.L. Thompson-Schill 2006. Neuroanatomically separable effects of imageability and grammatical class during single-word comprehension. Brain Lang. 98: 127-139.
108. Price, C.J. 1998. The functional anatomy of word comprehension. Trends Cogn. Sci. 2(8): 281-288.
109. Thompson-Schill, S.L., M. D'Esposito, G.K. Aguirre & M.J. Farah 1997. Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. Proc. Natl. Acad. Sci. USA 94: 14792-14797.
110. Swaab, T.Y., C. Brown & P. Hagoort 1998. Understanding ambiguous words in sentence contexts: electrophysiological evidence for delayed contextual selection in Broca's aphasia. Neuropsychologia 36: 737-761.
111. Bedny, M., M. McGill & S.L. Thompson-Schill 2008b. Semantic adaptation and competition during word comprehension. Cereb. Cortex 18: 2574-2585.
112. Holland, R. & M.A. Ralph 2010. The anterior temporal lobe semantic hub is a part of the language neural network: Selective disruption of irregular past tense verbs by rTMS. Cereb. Cortex 20(12): 2771-2775.
113. Martin, A. 2007. The representation of object concepts in the brain. Annu. Rev. Psychol. 58: 25-45.
114. Yokoyama, S., T. Miyamoto, J. Riera, et al 2006. Cortical mechanisms involved in the processing of verbs: an fMRI study. J. Cogn. Neurosci. 18: 1304-1313.
115. Shapiro, K.A., L.R. Moo & A. Caramazza 2006. Cortical signatures of noun and verb production. Proc. Natl. Acad. Sci. U S A 103: 1644-1649.
116. Kemmerer, D., J.G. Castillo, T. Talavage, et al 2008. Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI. Brain Lang. 107: 16-43.
117. Bedny, M., A. Caramazza, A. Pascual-Leone & R. Saxe (in press). Typical neural representations of action verbs develop without vision. Cerebral Cortex.
118. Noppeney, U., K.J. Friston & C.J. Price 2003. Effects of visual deprivation on the organization of the semantic system. Brain 126: 1620-1627.
119. Landau, B. & L. Gleitman 1985. Language and experience: evidence from the blind child. Harvard University Press. Cambridge, MA
120. Sadato, N., A. Pascual-Leone, J. Grafman, et al 1996. Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380: 526-528.
121. Amedi, A., A. Floel, S. Knecht, et al 2004. Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects. Nat. Neurosci. 7: 1266-1270.
122. Saenz, M., L.B. Lewis, A.G. Huth, et al 2008. Visual motion area MT+/V5 responds to auditory motion in human sight-recovery subjects. J. Neurosci. 28: 5141-5148.
123. Wolbers, T., P. Zahorik & N.A. Giudice 2010. Decoding the direction of auditory motion in blind humans. Neuroimage. May 5. [Epub ahead of print].
124. Bedny, M., T. Konkle, K.A. Pelphrey, et al 2010. Sensitive period for a multi-modal response in human visual motion area MT/MST. Curr. Biol. 20(21): 1900-1906.
125. Shetreet, E., D. Palti, N. Friedmann & U. Hadar 2007. Cortical representation of verb processing in sentence comprehension: number of complements, subcategorization, and thematic frames. Cereb. Cortex 17: 1958-1969.
126. Kalenine, S., L.J. Buxbaum & H.B. Coslett 2010. Critical brain regions for action recognition: lesion symptom mapping in left hemisphere stroke. Brain 133: 3269-3280.
127. Kemmerer, D., D. Rudrauf, K. Manzel & D. Tranel 2010. Behavioral patterns and lesion sites associated with impaired processing of lexical and conceptual knowledge of actions. Cortex. Nov 18. [Epub ahead of print].
128. Barsalou, L.W., W. Kyle Simmons, A.K. Barbey & C.D. Wilson 2003. Grounding conceptual knowledge in modality-specific systems. Trends Cogn. Sci. 7: 84-91.
129. Zwaan, R.A. & M.P. Kaschak 2008. Language in the brain, body, and world. In The Cambridge Handbook of Situated Cognition. P. Robbins & M. Aydede, Eds. Cambridge University Press. New York, NY
130. Chatterjee, A. 2010. Disembodying cognition. Lang. Cogn. 2: 79-116.
131. Tanenhaus, M.K. & S. Brown-Schmidt 2008. Language processing in the natural world. Philos. Trans. R Soc. Lond. B Biol. Sci. 363: 1105-1122.