Flexibility in embodied language understanding

Frontiers in Psychology

Volumn 2, Issue JUN, 2011, Pages

  Willems, Roel M ^a,b   Casasanto, Daniel ^a,c,d  

^a RADBOUD UNIVERSITY   (Netherlands)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

^d NEW SCHOOL FOR SOCIAL RESEARCH   (United States)

Author keywords

EEG; Embodied; fMRI; Language; Neuroimaging; Semantics

Indexed keywords

EID: 84855212471     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00116     Document Type: Review

References (118)

1. Aglioti, S. M., Cesari, P., Romani, M., and Urgesi, C. (2008). Action anticipation and motor resonance in elite basketball players. Nat. Neurosci. 11, 1109-1116.
2. Aguirre, G. K., Zarahn, E., and D'Esposito, M. (1998). An area within human ventral cortex sensitive to "building" stimuli: evidence and implications. Neuron 21, 373-383.
3. Allport, D. A. (1985). "Distributed memory, modular systems and dysphasia," in Current Perspectives in Dysphasia, eds S. K. Newman and R. Epstein (Edinburgh: Livingstone), 30-60.
4. Anderson, M. L. (2003). Embodied cognition: a field guide. Artif. Intell. 149, 91-130
5. Anderson, M. L. (2008). "On the grounds of (X)-grounded cognition," in The Handbook of Cognitive Science: An Embodied Approach, eds P. Calvo and T. Gomila (Amsterdam: Elsevier), 423-435
6. Arbib, M. A. (2005). From monkey-like action recognition to human language: an evolutionary framework for neurolinguistics. Behav. Brain Sci. 28, 105-124.
7. Arevalo, A. L., Baldo, J. V., and Dronkers, N. F. (2010). What do brain lesions tell us about theories of embodied semantics and the human mirror neuron system? Cortex doi:10.1016/j. cortex.2010.06.001. [E pub ahead of print].
8. Aziz-Zadeh, L., Fiebach, C. J., Naranayan, S., Feldman, J., Dodge, E., and Ivry, R. B. (2008). Modulation of the FFA and PPA by language related to faces and places. Soc. Neurosci. 3, 229-238.
9. Aziz-Zadeh, L., Wilson, S. M., Rizzolatti, G., and Iacoboni, M. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol. 16, 1818-1823.
10. Barclay, J. R., Bransford, J. D., Franks, J. J., McCarrell, N. S., and Nitsch, K. (1974). Comprehension and semantic flexibility. J. Verbal Learn. Verbal Behav. 13, 471-481.
11. Barsalou, L. W. (1999). Perceptual symbol systems. Behav. Brain Sci. 22, 577-609
12. Barsalou, L. W. (2008). Grounded cognition. Annu. Rev. Psychol. 59, 617-645.
13. Beauchamp, M. S., and Martin, A. (2007). Grounding object concepts in perception and action: evidence from fMRI studies of tools. Cortex 43, 461-468.
14. Bedny, M., Caramazza, A., Grossman, E., Pascual-Leone, A., and Saxe, R. (2008). Concepts are more than percepts: the case of action verbs. J. Neurosci. 28, 11347-11353.
15. Beilock, S. L., Lyons, I. M., Mattarella-Micke, A., Nusbaum, H. C., and Small, S. L. (2008). Sports experience changes the neural processing of action language. Proc. Natl. Acad. Sci. U.S.A. 105, 13269-13273.
16. Boroditsky, L. (2000). Metaphoric structuring: understanding time through spatial metaphors. Cognition 75, 1-28.
17. Boulenger, V., Hauk, O., and Pulvermuller, F. (2008a). Grasping ideas with the motor system: semantic somatotopy in idiom comprehension. Cereb. Cortex. 19, 1905-1914.
18. Boulenger, V., Mechtouff, L., Thobois, S., Broussolle, E., Jeannerod, M., and Nazir, T. A. (2008b). Word processing in Parkinson's disease is impaired for action verbs but not for concrete nouns. Neuropsychologia 46, 743-756.
19. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., and Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Brain Res. Cogn. Brain Res. 24, 355-363.
20. Caetano, G., Jousmaki, V., and Hari, R. (2007). Actor's and observer's primary motor cortices stabilize similarly after seen or heard motor actions. Proc. Natl. Acad. Sci. U.S.A. 104, 9058-9062.
21. Casasanto, D. (2008). Similarity and proximity: when does close in space mean close in mind? Mem. Cognit. 36, 1047-1056.
22. Casasanto, D. (2009). Embodiment of abstract concepts: good and bad in rightand left-handers. J. Exp. Psychol. Gen. 138, 351-367.
23. Casasanto, D., and Dijkstra, K. (2010). Motor action and emotional memory. Cognition 115, 179-185.
24. Clark, A., and Chalmers, D. (1998). The extended mind. Analysis 58, 7-19.
25. Cohen, L., Lehericy, S., Chochon, F., Lemer, C., Rivaud, S., and Dehaene, S. (2002). Language-specific tuning of visual cortex? Functional properties of the visual word form area. Brain 125, 1054-1069.
26. Copleston, F. C. (1946/1993). A History of Philosophy, Vol. 1: Greece and Rome. London: Image.
27. Corballis, M. C. (2003). From mouth to hand: gesture, speech, and the evolution of right-handedness. Behav. Brain Sci. 26, 199-208.
28. Craik, F. I. M., and Lockhart, R. S. (1972). Levels of processing: a framework for memory research. J. Verbal Learn. Verbal Behav. 11, 671-684.
29. Cutler, A., and Clifton, C. E. (1999). "Comprehending spoken language: a blueprint of the listener," in The Neurocognition of Language, eds C. M. Brown and P. Hagoort (Oxford: Oxford University Press), 123-166.
30. Desai, R. H., Binder, J. R., and Conant, L. L., and Seidenberg, M. S. (2010). Activation of sensory-motor areas in sentence comprehension. Cereb Cortex. 20, 468-478
31. di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., and Rizzolatti, G. (1992). Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176-180.
32. Elman, J. L. (2004). An alternative view of the mental lexicon. Trends Cogn. Sci. (Regul. Ed.) 8, 301-306.
33. Elman, J. L. (2009). On the meaning of words and dinosaur bones: lexical knowledge without a lexicon. Cogn. Sci. 33, 1-36.
34. Enfield, N. J. (2005). The body as a cognitive artifact in kinship representations. Curr. Anthropol. 46, 51-81.
35. Epstein, R., Harris, A., Stanley, D., and Kanwisher, N. (1999). The parahippocampal place area: recognition, navigation, or encoding? Neuron 23, 115-125.
36. Epstein, R., and Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature 392, 598-601
37. Farah, M. J. (1989). The neural basis of mental imagery. Trends Neurosci. 12, 395-399.
38. Feldman, J. (2006). From Molecule to Metaphor: A Neural Theory of Language. Cambridge, MA: MIT press.
39. Fernandino, L., and Iacoboni, M. (2010). Are cortical motor maps based on body parts or coordinated actions? Implications for embodied semantics. Brain Lang. 112, 44-53.
40. Fischer, M. H., and Zwaan, R. A. (2008). Embodied language: a review of the role of the motor system in language comprehension. Q. J. Exp. Psychol. 61, 825-850.
41. Gainotti, G. (2000). What the locus of brain lesion tells us about the nature of the cognitive defect underlying category-specific disorders: a review. Cortex 36, 539-559.
42. Gallese, V., and Lakoff, G. (2005). The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cogn. Neuropsychol. 22, 455-479.
43. Ghio, M., and Tettamanti, M. (2010). Semantic domain-specific functional integration for action-related vs. abstract concepts. Brain Lang. 112, 223-232.
44. Gibbs, R. W. (2006). Embodiment and Cognitive Science. New York: Cambridge University Press.
45. Glenberg, A. M. (2007). "Language and action: creating sensible combinations of ideas," in The Oxford Handbook of Psycholinguistics, ed. M. G. Gaskell (Oxford: Oxford University Press) 361-370.
46. Glenberg, A. M., Sato, M., and Cattaneo, L. (2008a). Use-induced motor plasticity affects the processing of abstract and concrete language. Curr. Biol. 18, R290-R291
47. Glenberg, A. M., Sato, M., Cattaneo, L., Riggio, L., Palumbo, D., and Buccino, G. (2008b). Processing abstract language modulates motor system activity. Q. J. Exp. Psychol. 61, 905-919.
48. Graziano, M. S., and Aflalo, T. N. (2007). Mapping behavioral repertoire onto the cortex. Neuron 56, 239-251.
49. Grossman, E. D., Jardine, N. L., and Pyles, J. A. (2010). fMR-adaptation reveals invariant coding of biological motion on human STS. Front. Hum. Neurosci. 4:15. doi: 10.3389/neuro.09.015.2010
50. Hauk, O., Davis, M. H., Kherif, F., and Pulvermuller, F. (2008). Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging. Eur. J. Neurosci. 27, 1856-1866.
51. Hauk, O., Johnsrude, I., and Pulvermuller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron 41, 301-307.
52. Hauk, O., and Pulvermuller, F. (2004). Neurophysiological distinction of action words in the fronto-central cortex. Hum. Brain Mapp. 21, 191-201.
53. Herbert, C., Ethofer, T., Anders, S., Junghofer, M., Wildgruber, D., Grodd, W., and Kissler, J. (2009). Amygdala activation during reading of emotional adjectives - an advantage for pleasant content. Soc. Cogn. Affect. Neurosci. 4, 35-49.
54. Hickok, G. (2009). Eight problems for the mirror neuron theory of action understanding in monkeys and humans. J. Cogn. Neurosci. 21, 1229-1243.
55. Hodges, A. (1983). Alan Turing: The enigma. New York, NY: Simon and Schuster.
56. Huang, Y. Z., Edwards, M. J., Rounis, E., Bhatia, K. P., and Rothwell, J. C. (2005). Theta burst stimulation of the human motor cortex. Neuron 45, 201-206.
57. Indefrey, P., and Cutler, A. (2005). "Prelexical and lexical processing in listening," in The Cognitive Neurosciences III, ed. M. S. Gazzaniga (Cambridge, MA: MIT Press), 759-774.
58. Indefrey, P., and Levelt, W. J. (2004). The spatial and temporal signatures of word production components. Cognition 92, 101-144
59. Isenberg, N., Silbersweig, D., Engelien, A., Emmerich, S., Malavade, K., Beattie, B., Leon, A. C., and Stern, E. (1999). Linguistic threat activates the human amygdala. Proc. Natl. Acad. Sci. U.S.A. 96, 10456-10459.
60. Jirak, D., Menz, M. M., Buccino, G., Borghi, A. M., and Binkofski, F. (2010). Grasping language - A short story on embodiment. Conscious. Cogn. 19, 711-720.
61. Kable, J. W., Kan, I. P., Wilson, A., Thompson-Schill, S. L., and Chatterjee, A. (2005). Conceptual representations of action in the lateral temporal cortex. J. Cogn. Neurosci. 17, 1855-1870.
62. Kable, J. W., Lease-Spellmeyer, J., and Chatterjee, A. (2002). Neural substrates of action event knowledge. J. Cogn. Neurosci. 14, 795-805.
63. Kanwisher, N., McDermott, J., and Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311.
64. Kemmerer, D., Castillo, J. G., Talavage, T., Patterson, S., and Wiley, C. (2008). Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI. Brain Lang. 107, 16-43.
65. Kemmerer, D., and Gonzalez-Castillo, J. (2008). The two-level theory of verb meaning: an approach to integrating the semantics of action with the mirror neuron system. Brain Lang. 112, 54-76.
66. Lakoff, G., and Johnson, M. (1980). Metaphors we Live by. Chicago, IL: Chicago University Press.
67. Landau, A. N., Aziz-Zadeh, L., and Ivry, R. B. (2010). The influence of language on perception: listening to sentences about faces affects the perception of faces. J. Neurosci. 30, 15254-15261.
68. Levelt, W. J. (1999). "Producing spoken language: a blueprint of the speaker," in The Neurocognition of Language, eds C. Brown and P. Hagoort (Oxford: Oxford university Press), 83-120.
69. Locke, J. (1690/1979). An Essay Concerning Human Understanding. New York: Oxford University Press
70. Lyons, I. M., Mattarella-Micke, A., Cieslak, M., Nusbaum, H. C., Small, S. L., and Beilock, S. L. (2010). The role of personal experience in the neural processing of action-related language. Brain Lang. 112, 214-222.
71. Mahon, B. Z., and Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. J. Physiol. Paris 102, 59-70.
72. Mahon, B. Z., and Caramazza, A. (2009). Concepts and categories: a cognitive neuropsychological perspective. Annu. Rev. Psychol. 60, 27-51.
73. Martin, A. (2007). The representation of object concepts in the brain. Annu. Rev. Psychol. 58, 25-45.
74. Meier, B. P., and Robinson, M. D. (2004). Why the sunny side is up: association between affect and vertical position. Psychol. Sci. 15, 243-247.
75. Moody, C. L., and Gennari, S. P. (2010). Effects of implied physical effort in sensory-motor and pre-frontal cortex during language comprehension. Neuroimage 49, 782-793.
76. Moscoso del Prado Martin, F., Hauk, O., and Pulvermuller, F. (2006). Category specificity in the processing of colorrelated and form-related words: an ERP study. Neuroimage 29, 29-37.
77. Papeo, L., Vallesi, A., Isaja, A., and Rumiati, R. I. (2009). Effects of TMS on different stages of motor and non-motor verb processing in the primary motor cortex. PLoS ONE 4, e4508. doi: 10.1371/journal.pone.0004508
78. Perfetti, C. A. (1999). "Comprehending written language: a blueprint of the reader," in The Neurocognition of Language, eds C. M. Brown and P. Hagoort (Oxford: Oxford University Press), 167-208.
79. Postle, N., McMahon, K. L., Ashton, R., Meredith, M., and de Zubicaray, G. I. (2008). Action word meaning representations in cytoarchitectonically defined primary and premotor cortices. Neuroimage 43, 634-644
80. Prinz, J. (2002). Furnishing the Mind. Cambridge, MA: MIT press.
81. Pulvermuller, F. (2005). Brain mechanisms linking language and action. Nat. Rev. Neurosci. 6, 576-582.
82. Pulvermuller, F., Hauk, O., Nikulin, V. V., and Ilmoniemi, R. J. (2005a). Functional links between motor and language systems. Eur. J. Neurosci. 21, 793-797.
83. Pulvermuller, F., Shtyrov, Y., and Ilmoniemi, R. (2005b). Brain signatures of meaning access in action word recognition. J. Cogn. Neurosci. 17, 884-892.
84. Raposo, A., Moss, H. E., Stamatakis, E. A., and Tyler, L. K. (2009). Modulation of motor and premotor cortices by actions, action words and action sentences. Neuropsychologia 47, 388-396.
85. Rizzolatti, G., and Craighero, L. (2004). The mirror-neuron system. Annu. Rev. Neurosci. 27, 169 -192.
86. Rueschemeyer, S. A., Brass, M., and Friederici, A. D. (2007). Comprehending prehending: neural correlates of processing verbs with motor stems. J. Cogn. Neurosci. 19, 855-865.
87. Rueschemeyer, S. A., van Rooij, D., Lindemann, O., Willems, R. M., and Bekkering, H. (2010). The function of words: distinct neural correlates for words denoting differently manipulable objects. J. Cogn. Neurosci. 22, 1844-1851.
88. Rusconi, E., Kwan, B., Giordano, B. L., Umilta, C., and Butterworth, B. (2006). Spatial representation of pitch height: the SMARC effect. Cognition 99, 113-129.
89. Saffran, E., and Scholl, A. (1999). "Clues to the functional and neural architecture of word meaning," in The Neurocognition of Language, eds C. M. Brown and P. Hagoort (Oxford: Oxford University Press), 241-272.
90. Sato, M., Mengarelli, M., Riggio, L., Gallese, V., and Buccino, G. (2008). Task related modulation of the motor system during language processing. Brain Lang. 105, 83-90
91. Saygin, A. P., McCullough, S., Alac, M., and Emmorey, K. (2010). Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. J. Cogn. Neurosci. 22, 2480-2490.
92. Schubert, T. (2005). Your highness: Vertical position as perceptual symbols of power. J. Pers. Soc. Psychol. 89, 1-21.
93. Simmons, W. K., Ramjee, V., Beauchamp, M. S., McRae, K., Martin, A., and Barsalou, L. W. (2007). A common neural substrate for perceiving and knowing about color. Neuropsychologia 45, 2802-2810.
94. Speer, N. K., Reynolds, J. R., Swallow, K. M., and Zacks, J. M. (2009). Reading stories activates neural representations of visual and motor experiences. Psychol. Sci. 20, 989-999.
95. Strange, B. A., Henson, R. N. A., Friston, K. J., and Dolan, R. J. (2000). Brain mechanisms for detecting perceptual, semantic, and emotional deviance. Neuroimage 12, 425-433.
96. Taylor, L. J., and Zwaan, R. A. (2008). Motor resonance and linguistic focus. Q. J. Exp. Psychol. 61, 896-904.
97. Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P., Fazio, F., Rizzolatti, G., Cappa, S. F., and Perani, D. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. J. Cogn. Neurosci. 17, 273-281.
98. Tettamanti, M., Manenti, R., Della Rosa, P. A., Falini, A., Perani, D., Cappa, S. F., and Moro, A. (2008). Negation in the brain: modulating action representations. Neuroimage 43, 358-367.
99. Turella, L., Pierno, A. C., Tubaldi, F., and Castiello, U. (2009). Mirror neurons in humans: consisting or confounding evidence? Brain Lang. 108, 10-21.
100. van Dam, W. O., Rueschemeyer, S. A., and Bekkering, H. (2010). How specifically are action verbs represented in the neural motor system: an fMRI study. Neuroimage 53, 1318-1325.
101. van Elk, M., van Schie, H. T., Hunnius, S., Vesper, C., and Bekkering, H. (2008). You'll never crawl alone: neurophysiological evidence for experience-dependent motor resonance in infancy. Neuroimage 43, 808-814.
102. van Elk, M., van Schie, H. T., and Bekkering, H. (2009). Short-term action intentions overrule long-term semantic knowledge. Cognition 111, 72-83.
103. van Elk, M., van Schie, H. T., Zwaan, R. A., and Bekkering, H. (2010). The functional role of motor activation in language processing: motor cortical oscillations support lexical-semantic retrieval. Neuroimage 50, 665-677.
104. Weiskopf, D. A. (2009). The plurality of concepts. Synthese 169, 145-173.
105. Weiskopf, D. A. (2010). Embodied cognition and linguistic comprehension. Stud. Hist. Philos. Sci. 41, 294-304.
106. Willems, R. M., Clevis, K., and Hagoort, P. (2010a). Add a picture for suspense: neural correlates of the interaction between language and visual information in the perception of fear. Soc. Cogn. Affect. Neurosci. doi:10.1093/ scan/nsq050. [Epub a head of print].
107. Willems, R. M., Hagoort, P., and Casasanto, D. (2010b). Body-specific representations of action verbs: Neural evidence from rightand left-handers. Psychol. Sci. 21, 67-74.
108. Willems, R. M., Toni, I., Hagoort, P., and Casasanto, D. (2010c). Neural dissociations between action verb understanding and motor imagery. J. Cogn. Neurosci. 22, 2387-2400.
109. Willems, R. M., and Hagoort, P. (2007). Neural evidence for the interplay between language, gesture, and action: a review. Brain Lang. 101, 278-289.
110. Willems, R. M., Labruna, L., D'Esposito, M., and Ivry, R. (B)., Casasanto, D. (in press). A functional role for the motor system in language understanding: evidence from theta burst TMS. Psychol. Sci.
111. Williams, L. E., and Bargh, J. A. (2008). Experiencing physical warmth promotes interpersonal warmth. Science 322, 606-607.
112. Wilson, M. (2002). Six views of embodied cognition. Psychon. Bull. Rev. 9, 625-636.
113. Woolsey, C. N. (1963). Comparative studies on localization in precentral and supplementary motor areas. Int. J. Neurol. 4, 13-20.
114. Woolsey, C. N., Erickson, T. C., and Gilson, W. E. (1979). Localization in somatic sensory and motor areas of human cerebral cortex as determined by direct recording of evoked potentials and electrical stimulation. J. Neurosurg. 51, 476-506.
115. Xu, J., Kemeny, S., Park, G., Frattali, C., and Braun, A. (2005). Language in context: emergent features of word, sentence, and narrative comprehension. Neuroimage 25, 1002-1015.
116. Zwaan, R. A. (2004). "The immersed experiencer: toward an embodied theory of language comprehension," in The Psychology of Learning and Motivation, Vol. 44, ed. B. H. Ross (New York: Academic Press), 35-62.
117. Zwaan, R. A., and Kaschak, M. P. (2008). "Language in the brain, body, and world," in Cambridge Handbook of Situated Cognition, eds M. Robbins and M. Aydede (Cambridge: Cambridge University press)
118. Zwaan, R. A., Taylor, L. J., and de Boer, M. (2010). Motor resonance as a function of narrative time: Further tests of the linguistic focus hypothesis. Brain Lang. 112, 143-149.