Sentence processing and embodiment

Brain and Language

Volumn 112, Issue 3, 2010, Pages 137-142

  Knoeferle, Pia ^a   Crocker, Matthew W ^b   Pulvermüller, Friedemann ^c  

^a BIELEFELD UNIVERSITY   (Germany)

^b SAARLAND UNIVERSITY   (Germany)

^c MEDICAL RESEARCH COUNCIL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN CORTEX; BRAIN FUNCTION; COGNITION; COMPREHENSION; EDITORIAL; FUNCTIONAL ASSESSMENT; HUMAN; LANGUAGE ABILITY; LANGUAGE PROCESSING; LINGUISTICS; MENTAL TASK; MOTOR CORTEX; MOTOR NERVE; NEUROIMAGING; NEUROMODULATION; NEUROPSYCHOLOGY; NONHUMAN; PERCEPTIVE DISCRIMINATION; PREMOTOR CORTEX; SEMANTICS; SENSORIMOTOR FUNCTION; SENSORY NERVE; TEMPORAL CORTEX; THINKING;

BRAIN; COGNITION; COMPREHENSION; HUMANS; LINGUISTICS; MODELS, PSYCHOLOGICAL; MOTOR ACTIVITY; PSYCHOLINGUISTICS; SPACE PERCEPTION; VISUAL PERCEPTION;

EID: 77949265956     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2009.11.004     Document Type: Editorial

References (82)

1. Altmann G.T.M., and Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73 (1999) 247-264
2. Altmann G.T.M., and Kamide Y. Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition 111 (2009) 55-71
3. Aziz-Zadeh L., Wilson S., Rizzolatti G., and Iacoboni M. Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Current Biology 16 (2006) 1818-1823
4. Ballard D., Hayhoe M., Pook P., and Rao R. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20 (1997) 723-767
5. Barsalou L.W. Language comprehension: Archival memory or preparation for situated action?. Discourse Processes 28 (1999) 61-80
6. Barsalou L.W. Perceptual and symbol systems. Behavioural and Brain Sciences 22 (1999) 577-609
7. Barsalou L.W. Cognitive and neural contributions to understanding the conceptual system. Current Directions in Psychological Science 17 (2008) 91-95
8. Bergen B., Narayan S., and Feldman J. Embodied verbal semantics: Evidence from an image-verb matching task. In: Alterman R., and Kirsh D. (Eds). Proceedings of the 25th annual conference of the Cognitive Science Society (2003), Cognitive Science Society, Boston, Massachusetts, USA 139-144
9. Bergen B., and Wheeler K.B. Grammatical aspect and mental simulation. Brain & Language 112 (2010) 150-158
10. Boulenger V., Hauk O., and Pulvermüller F. Grasping ideas with the motor system: Semantic somatotopy in idiom comprehension. Cerebral Cortex 19 (2009) 1905-1914
11. Boulenger V., Silber B.Y., Roy A.C., Paulignan Y., Jeannerod M., and Nazir T.A. Subliminal display of action words interferes with motor planning: A combined EEG and kinematic study. Journal of Physiology-Paris 102 (2008) 130-136
12. Brooks R., and Stein L. Building brains for bodies. Autonomous Robots 1 (1994) 7-25
13. Buccino G., Riggio L., Melli G., Binkofski F., Gallese V., and Rizzolattii G. Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research 24 (2005) 355-363
14. Chambers C.G., Tanenhaus M.K., and Magnuson J.S. Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 687-696
15. Chao L., Haxby J., and Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature Neuroscience 2 (1999) 913-919
16. Chiel H., and Beer R. The brain has a body: Adaptive behavior emerges from interactions of nervous system, body and environment. Trends in Neurosciences 20 (1997) 553-557
17. Clark A. Being there: Putting brain, body, and world together again (1997), The MIT Press
18. Clark A. Embodiment and the philosophy of mind. In: O'Hear A. (Ed). Current issues in the philosophy of mind: Royal institute of philosophy supplement 43 (1998), Cambridge University Press 35-52
19. Coventry K., Lynott D., Cangelosi A., Knight L., Joyce D., and Richardson D.C. Spatial language, visual attention, and perceptual simulation. Brain & Language 112 (2010) 202-213
20. Crocker M.W., Knoeferle P., and Mayberry M. Embedded sentence processing: The coordinated interplay account and a neurobehavioural model. Brain & Language 112 (2010) 189-201
21. Del Prado Martin F., Hauk O., and Pulvermüller F. Category specificity in the processing of color-related and form-related words: An ERP study. Neuroimage 29 (2006) 29-37
22. Dominey P.F., and Hoen M. Structure mapping and semantic integration in a construction-based neurolinguistic model of sentence processing. Cortex 42 (2006) 476-479
23. Fadiga L., Craighero L., Buccino G., and Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience 15 (2002) 399-402
24. Fodor J. Modularity of mind (1983), MIT Press, Cambridge, MA
25. Forster K. Levels of processing and the structure of the language processor. In: Cooper W.E., and Waler E.C.T. (Eds). Sentence processing: Psycholinguistic studies presented to Merrill Garrett (1979), Lawrence Erlbaum, Hillsdale, NJ 27-85
26. Frazier L., and Fodor J.D. The sausage machine: A new two-stage parsing model. Cognition 6 (1979) 291-325
27. Gallese V., Fadiga L., Fogassi L., and Rizzolatti G. Action recognition in the premotor cortex. Brain 119 (1996) 593-609
28. Gentilucci M. Object motor representation and language. Experimental Brain Research 153 (2003) 260-265
29. Ghio M., and Tettamanti M. Semantic domain-specific functional integration for action-related vs. abstract concepts. Brain & Language 112 (2010) 223-232
30. Glaser W., and Glaser M. Context effects in stroop-like word and picture processing. Journal of Experimental Psychology: General 118 (1989) 13-42
31. Glenberg, A., de Vega, M., Graesser, A. C. (2008). Framing the debate. In M. de Vega, A. Glenberg, & A. C. Graesser (Eds.), Symbol, embodiment, and meaning (pp. 1-10). Oxford University Press.
32. Glenberg A., and Kaschak M.P. Grounding language in action. Psychonomic Bulletin and Review 9 (2002) 558-565
33. Hauk, O., Johnsrude, I., Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301-307.
34. Hauk O., Shtyrov Y., and Pulvermüller F. The time course of action and action-word comprehension in the human brain as revealed by neurophysiology. Journal of Physiology - Paris 102 (2008) 50-58
35. Humphreys G.W., and Forde E. Hierarchies, similarity, and interactivity in object recognition: Category-specific neuropsychological deficits. Behavioural and Brain Sciences 24 (2001) 453-476
36. Kaup B., Lüdtke J., and Maienborn C. The drawer is still closed: Simulating past and future movements when processing sentences that describe a state. Brain & Language 112 (2010) 159-166
37. Kemmerer D. Action verbs, argument structure constructions, and the mirror neuron system. In: Arbib M. (Ed). Action to language via the mirror neuron system (2006), Cambridge University Press 347-373
38. Kemmerer D., Castillo J.G., Talavage T., Patterson S., and Wiley C. Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI. Brain and Language 107 (2008) 16-43
39. Knoeferle P. Comparing the time-course of processing initially ambiguous and unambiguous German SVO/OVS sentences in depicted events. In: van Gompel R., Fischer M., Murray W., and Hill R. (Eds). Eye movement research: Insights into mind and brain (2007), Elsevier, Oxford 517-533
40. Knoeferle P., and Crocker M.W. The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science 30 (2006) 481-529
41. Knoeferle P., and Crocker M.W. The influence of recent scene events on spoken comprehension: Evidence from eye-movements. Journal of Memory and Language 75 (2007) 519-543
42. Knoeferle P., Crocker M.W., Scheepers C., and Pickering M.J. The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition 95 (2005) 95-127
43. Knoeferle P., Habets B., Crocker M.W., and Münte T.F. Visual scenes trigger immediate syntactic reanalysis: Evidence from ERPs during situated spoken comprehension. Cerebral Cortex 18 (2008) 789-795
44. Lakoff G. Women, fire, and dangerous things: What categories reveal about the mind (1987), University of Chicago Press, Chicago
45. Landau B., and Jackendoff R. 'What' and 'where' in spatial language and cognition. Behavioural and Brain Sciences 16 (1993) 217-265
46. Lyons I.M., Mattarella-Micke A., Cieslak M., Nusbaum H.C., Small S.L., and Beilock S. The role of personal experience in the neural processing of action-related language. Brain & Language 112 (2010) 214-222
47. Madden C., Hoen D., and Dominey P. A cognitive neuroscience perspective on embodied language for human-robot cooperation. Brain & Language 112 (2010) 180-188
48. Mahon B.Z., and Caramazza A. A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology - Paris 102 (2008) 59-70
49. Martin A. The representation of object concepts in the brain. Annual Review of Psychology 8 (2007) 25-45
50. Mayberry M., Crocker M.W., and Knoeferle P. Learning to attend: A connectionist model of situated language comprehension. Cognitive Science 33 (2009) 449-496
51. Pecher D., Zeelenberg R., and Barsalou L. Verifying different-modality properties for concepts produces switching costs. Psychological Science 13 (2003) 119-124
52. Pulvermüller F. Neurobiologie der Sprache (1996), Pabst Science Publishers
53. Pulvermüller F. Words in the brain's language. Behavioural and Brain Sciences 22 (1999) 253-331
54. Pulvermüller F. The neuroscience of language (2002), CUP, Cambridge
55. Pulvermüller F. Sequence detectors in the brain. Theory in Biosciences 122 (2003) 87-103
56. Pulvermüller F. Brain mechanisms linking language and action. Nature Reviews Neuroscience 6 (2005) 576-582
57. Pulvermüller F. Brain embodiment of syntax: Mechanistic grammar theory spelt out in neuronal circuits. Brain & Language 112 (2010) 167-179
58. Pulvermüller F., Haerle M., and Hummel F. Neurophysiological distinction of verb categories. NeuroReport 11 (2000) 2789-2793
59. Pulvermüller F., Härle M., and Hummel F. Walking or talking? Behavioural and neurophysiological correlates of action verb processing. Brain and Language 78 (2001) 143-168
60. Pulvermüller F., and Hauk O. Category-specific conceptual processing of color and form in left fronto-temporal cortex. Cerebral Cortex 16 (2006) 1193-1201
61. Pulvermüller F., and Knoblauch A. Discrete combinatorial circuits emerging in neural networks: A mechanism for rules of grammar in the human brain?. Neural Networks 22 (2009) 161-172
62. Pulvermüller F., Lutzenberger W., and Preissl H. Nouns and verbs in the intact brain: Evidence from event-related potentials and high-frequency cortical responses. Cerebral Cortex 9 (1999) 498-508
63. Pulvermüller F., Shtyrov Y., and Ilmoniemi R. Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience 17 (2005) 884-892
64. Regier T., and Carlson L. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology: General 130 (2001) 273-298
65. Richardson D.C., Spivey M.J., Barsalou L.W., and McRae K. Spatial representations activated during real-time comprehension of verbs. Cognitive Science 27 (2003) 767-780
66. Rizzolatti G., and Arbib M. Language within our grasp. Trends in Neurosciences 21 (1998) 188-194
67. Rizzolatti G., and Craighero L. The mirror-neuron system. Annual Review of Neuroscience 21 (2004) 188-194
68. Roy D., and Pentland A. Learning words from sights and sounds: A computational model. Cognitive Science 26 (2002) 113-146
69. Sedivy J.C., Tanenhaus M.K., Chambers C.G., and Carlson G.N. Achieving incremental semantic interpretation through contextual representation. Cognition 71 (1999) 109-148
70. Shtyrov Y., Hauk O., and Pulvermüller F. Distributed neuronal networks for encoding category-specific semantic information: The mismatch negativity to action words. European Journal of Neuroscience 19 (2004) 1083-1092
71. Simmons W.K., Ramjee V., Beauchamp M.S., McRae K., Martin A., and Barsalou L.W. A common neural substrate for perceiving and knowing about color. Neuropsychologia 12 (2007) 2802-2810
72. Spivey M.J., Richardson D., and Fitneva S. Thinking outside the brain: Spatial indices to linguistic and visual information. In: Henderson J., and Ferreira F. (Eds). The integration of language, vision and action (2004), Psychology Press, New York 161-189
73. Spivey M.J., Tanenhaus M.K., Eberhard K.M., and Sedivy J.C. Eye-movements and spoken language comprehension: Effects of visual context on syntactic ambiguity resolution. Cognitive Psychology 45 (2002) 447-481
74. Spivey M.J., Tyler M.J., Eberhard K.M., and Tanenhaus M.K. Linguistically mediated visual search. Psychological Science 12 (2001) 282-286
75. In: Steels L., and Brooks R. (Eds). The artificial life route to artificial intelligence: Building embodied situated agents (1995), Lawrence Erlbaum Associates, Inc.
76. Stroop J.R. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 18 (1935) 643-662
77. Talmy L. In: Pick H., and Acredolo L. (Eds). How language structures space (1983), Plenum Press, New York 225-282
78. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K., and Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 268 (1995) 632-634
79. Tettamanti M., Buccino G., Saccuman M.C., Gallese V., Danna M., Scifo P., et al. Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience 17 (2005) 273-281
80. Warrington E., and McCarthy R. Categories of knowledge: Further fractionations and an attempted integration. Brain 110 (1987) 1273-1296
81. Zwaan R.A., and Taylor L.J. Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General 135 (2006) 1-11
82. Zwaan R.A., Taylor L.J., and de Boer M. Motor resonance as a function of narrative time: further tests of the linguistic-focus hypothesis. Brain & Language 112 (2010) 143-149