Action-based language: A theory of language acquisition, comprehension, and production

Cortex

Volumn 48, Issue 7, 2012, Pages 905-922

  Glenberg, Arthur M ^a,b   Gallese, Vittorio ^c,d  

^a ARIZONA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c UNIVERSITY OF PARMA   (Italy)

^d ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

Embodiment; HMOSAIC model of action control; Language; Mirror neurons

Indexed keywords

ARTICLE; BEHAVIORAL SCIENCE; BRAIN FUNCTION; COGNITION; COMPREHENSION; GESTURE; KINETICS; LANGUAGE ABILITY; LANGUAGE DEVELOPMENT; LANGUAGE PROCESSING; MOTOR CONTROL; NEUROPHYSIOLOGY; NEUROSCIENCE; PREDICTOR VARIABLE; SENSORIMOTOR FUNCTION; SIMULATION; THEORY;

BRAIN; COMPREHENSION; EMOTIONS; HUMANS; LANGUAGE; LANGUAGE DEVELOPMENT; LEARNING; MIRROR NEURONS; SPEECH; SPEECH PERCEPTION;

EID: 84861910350     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2011.04.010     Document Type: Article

References (119)

1. Altmann G.T.M., Kamide Y. Now you see it, now you don't: Mediating the mapping between language and the visual world. The Interface of Language, Vision, and Action: Eye Movements and the Visual World 2004, 347-386. Psychology Press, New York. J.M. Henderson, F. Ferreira (Eds.).
2. Anderson M.L. Neural re-use as a fundamental organizational principle of the brain. Behavioral and Brain Sciences 2010, 33:245-266.
3. Angrave L.C., Glenberg A.M. Infant Gestures Predict Verb Production One Year Later 2007, Paper presented at the annual meeting of the American Psychological Association.
4. Awh E., Armstrong K.M., Moore T. Visual and oculomotor selection: Links, causes and implications for spatial attention. Trends in Cognitive Sciences 2006, 10(3):124-130.
5. Aziz-Zadeh L., Wilson S.M., Rizzolatti G., Iacoboni M. Embodied semantics and the premotor cortex: Congruent representations for visually presented actions and linguistic phrases describing actions. Current Biology 2006, 16:1818-1823.
6. Bak T.H., Hodges J.R. The effects of motor neurone disease on language: Further evidence. Brain and Language 2003, 89:354-361.
7. Bannard C., Mathews D. Stored word sequences in language learning. Psychological Science 2008, 19:240-248.
8. Barsalou L.W. Perceptual symbol systems. The Behavioral and Brain Sciences 1999, 22:577-660.
9. Bernardis P., Gentilucci M. Speech and gesture share the same communication system. Neuropsychologia 2006, 44:178-190.
10. Blakemore S.J., Goodbody S.J., Wolpert D.M. Predicting the consequences of our own actions: The role of sensorimotor context estimation. The Journal of Neuroscience 1998, 18:7511-7518.
11. Bonini L., Rozzi S., Serventi F.U., Simone L., Ferrari P.F., Fogassi L. Ventral premotor and inferior parietal cortices make distinct contribution to action organization and intention understanding. Cerebral Cortex 2010, 20:1372-1385.
12. Borghi A.M., Glenberg A.M., Kaschak M.P. Putting words in perspective. Memory and Cognition 2004, 32:863-873.
13. Buccino G., Binkofski F., Fink G.R., Fadiga L., Fogassi L., Freund H.J., et al. Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience 2001, 13(2):400-404.
14. Buccino G., Binkofski F., Riggio L. The mirror neuron system and action recognition. Brain and Language 2004, 89(2):370-376.
15. Buccino G., Riggio L., Melli G., Binkofski F., Gallese V., Rizzolatti G. Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research 2005, 24(3):355-363.
16. Buccino G., Solodkin A., Small S. Functions of the mirror neuron system: Implications for neurorehabilitation. Cognitive Behavioral Neurology 2006, 19:55-63.
17. Buresh J.S., Woodward A., Brune C.W. The roots of verbs in prelinguistic action knowledge. Action Meets Word: How Children Learn Verbs 2006, 208-227. Oxford University Press, New York. K. Hirsh-Paskek, R.M. Golinkoff (Eds.).
18. Castiello U., Becchio C., Zoia S., Nelini C., Sartori L., et al. Wired to be social: The ontogeny of human interaction. PLoS ONE 2010, 5(10):e13199. 10.1371/journal.pone.0013199.
19. Chambers C.G., Tanenhaus M.K., Magnuson J.S. Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition 2004, 30(3):687-696.
20. Chang F., Dell G.S., Bock K. Becoming syntactic. Psychological Review 2006, 113(2):234-272.
21. Childers J.B., Tomasello M. Two-year-olds learn novel nouns, verbs, and conventional actions from massed or distributed exposures. Developmental Psychology 2002, 38(6):967-978.
22. Classen J., Liepert J., Wise S.P., Hallett M., Cohen L.G. Rapid plasticity of human cortical movement representation induced by practice. Journal of Neurophysiology 1998, 79(2):1117-1123.
23. Craighero L., Fadiga L., Rizzolatti G., Umiltà C. Visuomotor priming. Visual Cognition 1998, 5(1):109-125.
24. D'Ausilio A., Pulvermüller F., Salmas P., Bufalari I., Begliomini C., Fadiga L. The motor somatotopy of speech perception. Current Biology 2009, 19(5):381-385.
25. De Vega M. Levels of embodied meaning. From pointing to counterfactuals. Symbols, Embodiment, and Meaning 2008, 285-308. Oxford University Press, Oxford. M. de Vega, A.M. Glenberg, A.C. Graesser (Eds.).
26. Dinstein I., Thomas C., Behrmann M., Heeger D.J. A mirror up to nature. Current Biology 2008, 18(1):R13-R18.
27. Fadiga L., Gallese V. Action representation and language in the brain. Theoretical Linguistics 1997, 23(3):267-280.
28. Fadiga L., Craighero L., Buccino G., Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience 2002, 15(2):399-402.
29. Fadiga L., Craighero L., Roy A. Broca's region: A speech Area?. Broca's Region 2006, 137-152. Oxford University Press, Oxford. Y. Grodzinsky (Ed.).
30. Fiebach C.J., Schubotz R.I. Dynamic anticipatory processing of hierarchical sequential events: A common role for Broca's area and ventral premotor cortex across domains?. Cortex 2006, 42(4):499-502.
31. Fogassi L., Ferrari P.F., Gesierich B., Rozzi S., Chersi F., Rizzolatti G. Parietal lobe: From action organization to intention understanding. Science 2005, 308(5722):662-667.
32. Friederici A.D., Bahlmann J., Heim S., Schubotz R.I., Anwander A. The brain differentiates human and non-human grammars: Functional localization and structural connectivity. Proceedings of the National Academy of Sciences of the United States of America 2006, 103(7):2458-2463.
33. Galantucci B., Fowler C.A., Turvey M.T. The motor theory of speech perception reviewed. Psychonomic Bulletin and Review 2006, 13(3):361-377.
34. Gallese V. The manifold nature of interpersonal relations: The quest for a common mechanism. Philosophical Transactions of the Royal Society of London B, Biological Sciences 2003, 358(1431):517-528.
35. Gallese V. A neuroscientific grasp of concepts: From control to representation. Philosophical Transactions of the Royal Society of London B, Biological Sciences 2003, 358(1435):1231-1240.
36. Gallese V. Before and below theory of mind: Embodied simulation and the neural correlates of social cognition. Philosophical Transactions of the Royal Society of London B, Biological Sciences 2007, 362(1480):659-669.
37. Gallese V., Goldman A. Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 1998, 2(12):493-501.
38. Gallese V., Lakoff G. The brain's concepts: The role of the sensory-motor system in reason and language. Cognitive Neuropsychology 2005, 22(3):455-479.
39. Gallese V., Fadiga L., Fogassi L., Rizzolatti G. Action recognition in the premotor cortex. Brain 1996, 119(2):593-609.
40. Gallese V. Mirror neurons and the social nature of language: The neural exploitation hypothesis. Social Neuroscience 2008, 3:317-333.
41. Gentilucci M., Corballis M.C. From manual gesture to speech: A gradual transition. Neuroscience and Biobehavioral Reviews 2006, 30(7):949-960.
42. Gentilucci M., Bernardis P., Crisi G., Volta R.D. Repetitive transcranial magnetic stimulation of Broca's area affects verbal responses to gesture observation. Journal of Cognitive Neuroscience 2006, 18(7):1059-1074.
43. Gentner D. Why verbs are hard to learn. Action Meets Word: How Children Learn Verbs 2006, 544-564. Oxford University Press, New York. K. Hirsh-Paske, R.M. Golinkoff (Eds.).
44. Glenberg A.M. Language and action: creating sensible combinations of ideas. The Oxford Handbook of Psycholinguistics 2007, 361-370. Oxford University Press, Oxford. G. Gaskell (Ed.).
45. Glenberg A.M., Kaschak M.P. Grounding language in action. Psychonomic Bulletin and Review 2002, 9(3):558-565.
46. Glenberg A.M., Robertson D.A. Indexical understanding of instructions. Discourse Processes 1999, 28:1-26.
47. Glenberg A.M., Robertson D.A. Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language 2000, 43(3):379-401.
48. Glenberg A.M., Meyer M., Lindem K. Mental models contribute to foregrounding during text comprehension. Journal of Memory and Language 1987, 26(1):69-83.
49. Glenberg A.M., Sato M., Cattaneo L. Use-induced motor plasticity affects the processing of abstract and concrete language. Current Biology 2008, 18(7):R290-R291.
50. Glenberg A.M., Sato M., Cattaneo L., Riggio L., Palumbo D., Buccino G. Processing abstract language modulates motor system activity. Quarterly Journal of Experimental Psychology 2008, 61(6):905-919.
51. Glenberg A.M., Webster B.J., Mouilso E., Havas D.A., Lindeman L.M. Gender, emotion, and the embodiment of language comprehension. Emotion Review 2009, 1(2):151-161.
52. Goldberg A.E. Constructions: A Construction Grammar Approach to Argument Structure 1995, University of Chicago Press, Chicago.
53. Goldin-Meadow S., Seligman M.E.P., Gelman R. Language in the two-year-old: Receptive and productive stages. Cognition 1976, 4(2):189-202.
54. Goldin-Meadow S., Nusbaum H., Kelly S., Wagner S. Explaining math: Gesturing lightens the load. Psychological Science 2001, 12(6):516-522.
55. Grush R. The emulation theory of representation: Motor control, imagery, and perception. Behavioral and Brain Sciences 2004, 27:377-442.
56. Guenther F.H., Ghosh S.S., Tourville J.A. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain and Language 2006, 96(3):280-301.
57. Haruno M., Wolpert D.M., Kawato M. Hierarchical MOSAIC for movement generation. International Congress Series 2003, 1250:575-590.
58. Hauk O., Johnsrude I., Pulvermüller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 2004, 41:301-307.
59. Havas D.A., Glenberg A.M., Rinck M. Emotion simulation during language comprehension. Psychonomic Bulletin and Review 2007, 14:436-441.
60. Havas D.H., Glenberg A.M., Gutowski K., Lucarelli M., Davdison R. Cosmetic use of botulinum toxin-A affects processing of emotional language. Psychological Science 2010, 21:895-900.
61. Herrmann E., Call J., Hernandez-Lloreda M.V., Hare B., Tomasello M. Humans have evolved specialized skills of social cognition: The cultural intelligence hypothesis. Science 2007, 317:1360-1366.
62. Hintzman D.C " Schema abstraction" in a multiple-trace memory model. Psychological Review 1986, 93(4):411-428.
63. Hirsh-Pasek K., Golinkoff R.M. Action Meets Word: How Children Learn Verbs 2006, Oxford University Press, New York.
64. Hostetter A.B., Alibali M.W. Visible embodiment: Gesture as simulated action. Psychonomic Bulletin and Review 2008, 15(3):495-514.
65. Hurley S. The shared circuits hypothesis: A unified functional architecture for control, imitation, and simulation. Perspectives on Imitation: From Neuroscience to Social Science 2004, MIT Press, Cambridge. S. Hurley, N. Chater (Eds.).
66. Huttenlocher J., Smiley P., Charney R. Emergence of action categories in the child: Evidence from verb meanings. Psychological Review 1983, 90(1):72-93.
67. Iacoboni M., Wilson S.M. Beyond a single area: Motor control and language within a neural architecture encompassing Broca's area. Cortex 2006, 42(4):503-506.
68. Iverson J.M., Goldin-Meadow S. The resilience of gesture in talk: Gesture in blind speakers and listeners. Developmental Science 2001, 4(4):416-422.
69. Johnson-Laird P.N. Mental models. Foundations of Cognitive Science 1989, MIT Press, Cambridge. M.I. Posner (Ed.).
70. Kaschak M.P., Glenberg A.M. Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language 2000, 43(3):508-529.
71. Kaschak M.P., Madden C.J., Therriault D.J., Yaxley R.H., Aveyard M., Blanchard A., et al. Perception of motion affects language processing. Cognition 2005, 94(3):B79-B89.
72. Kelly S.D., Barr D.J., Church R.B., Lynch K. Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language 1999, 40(4):577-592.
73. Kraskov A., Dancause N., Quallo M.M., Shepherd S., Lemon R.N. Corticospinal neurons in macaque ventral premotor cortex with mirror properties: A potential mechanism for action suppression?. Neuron 2009, 64(6):922-930.
74. Krauss R.M. Why do we gesture when we speak?. Current Directions in Psychological Science 1998, 7(2):54-60.
75. Llinas R. The I of the Vortex:From Neurons to Self 2001, MIT Press, Cambridge, MA.
76. MacDonald M.C. Distributional information in language comprehension, production, and acquisition: Three puzzles and a moral. The Emergence of Language 1999, 177-196. Erlbaum, Mahwah. B. MacWhinney (Ed.).
77. Mandler J.M. On the birth and growth of concepts. Philosophical Psychology 2008, 21(2):207-230.
78. Masur E.F. Maternal labeling of novel and familiar objects: Implications for children's development of lexical constraints. Journal of Child Language 1997, 24(2):427-439.
79. McNeill D. Hand and Mind: What Gestures Reveal About Thought 1992, University of Chicago Press, Chicago.
80. Meister I.G., Wilson S.M., Deblieck C., Wu A.D., Iacoboni M. The essential role of premotor cortex in speech perception. Current Biology 2007, 17(19):1692-1696.
81. Mukamel R., Ekstrom A.D., Kaplan J., Iacoboni M., Fried I. Single-neuron responses in humans during execution and observation of actions. Current Biology 2010, 20(8):750-756.
82. Pecher D., Zeelenberg R., Barsalou L.W. Verifying different-modality properties for concepts produces switching costs. Psychological Science 2003, 14(2):119-125.
83. Petrides M., Pandya D.N. Comparative architectonic analysis of the human and the macaque frontal cortex. Handbook of Neuropsychology, Vol. 9 1994, 17-58. Elsevier, Amsterdam. F. Boller, J. Grafman (Eds.).
84. Pickering M.J., Garrod S. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences 2004, 27(2):169-226.
85. Pickering M.J., Garrod S. Do people use language production to make predictions during comprehension?. Trends in Cognitive Sciences 2007, 11(3):105-110.
86. Proffitt D.R., Stefanucci J., Banton T., Epstein W. The role of effort in distance perception. Psychological Science 2003, 14(2):106-112.
87. Pulvermüller F. The Neuroscience of Language 2002, Cambridge University Press, Cambridge, UK.
88. Pulvermüller F. Brain mechanisms linking language and action. Nature Reviews Neuroscience 2005, 6(7):576-582.
89. Pulvermüller F. Grounding language in the brain. Symbols, Embodiment, and Meaning 2008, 85-116. Oxford University Press, Oxford. M. de Vega, A.M. Glenberg, A.C. Graesser (Eds.).
90. Richardson D.C., Spivey M.J. Representation, space, and Hollywood squares: Looking at things that aren't there anymore. Cognition 2000, 76(3):269-295.
91. Rizzolatti G., Arbib M. Language within our grasp. Trends in Neurosciences 1998, 21(5):188-194.
92. Rizzolatti G., Craighero L. The mirror-neuron system. Annual Review of Neuroscience 2004, 27:169-192.
93. Rizzolatti G., Craighero L. Language and mirror neurons. Oxford Handbook of Psycholinguistics 2007, Oxford University Press, Oxford. G. Gaskell (Ed.).
94. Rizzolatti G., Luppino G. The cortical motor system. Neuron 2001, 31(6):889-901.
95. Rizzolatti G., Sinigaglia C. Mirrors in the Brain. How Our Minds Share Actions, Emotions, and Experience 2007, Oxford University Press, Oxford.
96. Rizzolatti G., Riggio L., Dascola I., Umiltà C. Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory. Neuropsychologia 1987, 25(1):31-40.
97. Rizzolatti G., Camarda R., Fogassi M., Gentilucci M., Luppino G., Matelli M. Functional organization of inferior area 6 in the macaque monkey: II. Area F5 and the control of distal movements. Experimental Brain Research 1988, 71(3):491-507.
98. Rizzolatti G., Fadiga L., Gallese V., Fogassi L. Premotor cortex and the recognition of motor actions. Cognitive Brain Research 1996, 3(2):131-141.
99. Rizzolatti G., Fogassi L., Gallese V. Cortical mechanisms subserving object grasping and action recognition: a new view on the cortical motor functions. The Cognitive Neurosciences 2000, 539-552. MIT Press, Cambridge. 2nd ed. M.S. Gazzaniga (Ed.).
100. Rochat M.J., Caruana F., Jezzini A., Escola L., Intskirveli I., Grammont F., et al. Responses of mirror neurons in area F5 to hand and tool grasping observation. Experimental Brain Research 2010, 204(4):605-616.
101. Rovee-Collier C.K., Capatides J.B. Positive behavioral contrast in 3-month-old infants on multiple conjugate reinforcement schedules. Journal of the Experimental Analysis of Behavior 1979, 32(1):15-27.
102. Saygin A.P., McCullough S., Alac M., Emmorey K. Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. Journal of Cognitive Neuroscience 2010, 22(11):2480-2490.
103. Scorolli C., Borghi A.M., Glenberg A.M. Language-induced motor activity in bi-manual lifting. Experimental Brain Research 2009, 193(1):43-53.
104. Sommerville, Decety Weaving the fabric of social interaction: Articulating developmental psychology and cognitive neuroscience in the domain of motor cognition. Psychonomic Bulletin and Review 2006, 13(2):179-200.
105. Taylor LJ and Zwaan RA. Language modulates response force. in preparation.
106. Tettamanti M., Buccino G., Saccuman M.C., Gallese V., Danna M., Scifo P., et al. Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience 2005, 17(2):273-281.
107. Thothathiri M., Snedeker J. Syntactic priming during language comprehension in three- and four-year-old children. Journal of Memory and Language 2008, 58(2):188-213.
108. Tomasello M. Constructing a Language: A Usage-based Theory of Language Acquisition 2003, Harvard University Press, Cambridge, MA.
109. Umiltà M.A., Escola L., Intskirveli I., Grammont F., Rochat M., Caruana F., et al. How pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences 2008, 105(6):2209-2213.
110. Vigliocco G., Warren J., Siri S., Aruili J., Scott S., Wise R. The role of semantics and grammatical class in the neural representation of words. Cerebral Cortex 2006, 16(12):1790-1796.
111. von Bonin G., Bailey P. The Neocortex of Macaca Mulatta 1947, University of Illinois Press, Urbana, IL.
112. Watkins K., Paus T. Modulation of motor excitability during speech perception: The role of Broca's area. Journal of Cognitive Neuroscience 2004, 16(6):978-987.
113. Watkins K.E., Strafella A.P., Paus T. Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 2003, 48(8):989-994.
114. Wilson M., Knoblich G. The case for motor involvement in perceiving conspecifics. Psychological Bulletin 2005, 131(3):460-473.
115. Wilson S.M., Saygin A.P., Sereno M.I., Iacoboni M. Listening to speech activates motor areas involved in speech production. Nature Neuroscience 2004, 7(7):701-702.
116. Witt J.K., Proffitt D.R., Epstein W. How and when does action scale perception?. Journal of Experimental Psychology: Human Perception and Performance 2010, 36(5):1153-1160.
117. Wolpert D.M., Kawato M. Multiple paired forward and inverse models for motor control. Neural Networks 1998, 11(7):1317-1329.
118. Wolpert D.M., Doya K., Kawato M. A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London, B, Biological Sciences 2003, 358(1413):593-602.
119. Zwaan R.A., Taylor L.J. Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General 2006, 135(1):1-11.