Motion and actions in language: Semantic representations in occipito-temporal cortex

Brain and Language

Volumn 125, Issue 1, 2013, Pages 94-105

  Humphreys, Gina F ^a   Newling, Katherine ^a   Jennings, Caroline ^a   Gennari, Silvia P ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Animacy; Area V5; Event structure; Language comprehension; Motion; Posterior temporal cortex; Semantic representations

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; FEMALE; GESTURE; HUMAN; HUMAN EXPERIMENT; IMAGERY; LANGUAGE; MALE; MOTION; MOVEMENT PERCEPTION; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; OCCIPITAL CORTEX; SEMANTICS; TEMPORAL CORTEX; TEMPORAL LOBE; VISUAL STIMULATION;

ADULT; BRAIN MAPPING; COMPREHENSION; FEMALE; HUMANS; IMAGINATION; LANGUAGE; MAGNETIC RESONANCE IMAGING; MALE; MOTION; OCCIPITAL LOBE; SEMANTICS; TEMPORAL LOBE;

EID: 84875594175     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2013.01.008     Document Type: Article

References (69)

1. Altmann G.T.M. Language-mediated eye movements in the absence of a visual world: The 'blank screen paradigm'. Cognition 2004, 93(2):B79-B87.
2. Altmann G.T.M., Kamide Y. Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition 2009, 111(1):55-71.
3. Barsalou L.W. Situated simulation in the human conceptual system. Language and Cognitive Processes 2003, 18(5-6):513-562.
4. Barsalou L.W., Simmons W.K., Barbey A.K., Wilson C.D. Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Sciences 2003, 84-91.
5. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Current Opinion in Neurobiology 2005, 15(2):145-153.
6. Beauchamp M.S., Lee K.E., Haxby J.V., Martin A. Parallel visual motion processing stream for manipulable objects and human movements. Neuron 2002, 34:1-20.
7. Beauchamp M.S., Lee K.E., Haxby J.V., Martin A. FMRI responses to video and point-light displays of moving humans and manipulable objects. Journal of Cognitive Neuroscience 2003, 15(7):991-1001.
8. Bedny M., Caramazza A. Perception, action, and word meanings in the human brain: The case from action verbs. Annals of the New York Academy of Sciences 2011, 1224:81-95.
9. Bedny M., Caramazza A., Grossman E., Pascual-Leone A., Saxe R. Concepts are more than percepts: The case of action verbs. Journal of Neuroscience 2008, 28(44):11347-11353.
10. Bedny M., Caramazza A., Pascual-Leone A., Saxe R. Typical neural representations of action verbs develop without vision. Cerebral Cortex 2012, 22(2):286-293.
11. Binder J.R., Desai R.H. The neurobiology of semantic memory. Trends in Cognitive Sciences 2011, 15(11):527-536.
12. Blakemore S.J., Boyer P., Pachot-Clouard M., Meltzoff A., Segebarth C., Decety J. The detection of contingency and animacy from simple animations in the human brain. Cerebral Cortex 2003, 13:837-844.
13. Bornkessel I., Zysset S., Friederici A.D., von Cramon D.Y., Schlesewsky M. Who did what to whom? The neural basis of argument hierarchies during language comprehension. NeuroImage 2005, 26(1):221-233.
14. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., David A.S. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 1999, 10:2619-2623.
15. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 2000, 10:649-657.
16. Chen E., Widick P., Chatterjee A. Functional-anatomical organization of predicate metaphor processing. Brain and Language 2008, 107:194-201.
17. Damasio A.R. The brain binds entities and events by multiregional activation from convergence. Neural Computation 1989, 1(1):123-132.
18. Dumoulin S.O., Bittar R.G., Kabani N.J., Baker C.L., Le Goualher G., Bruce Pike G., et al. A new anatomical landmark for reliable identification of human area V5/MT: A quantitative analysis of sulcal patterning. Cerebral cortex 2000, 10(5):454-463.
19. Friston K.J. Ten ironic rules for non-statistical reviewers. Neuroimage 2012, 61(4):1300-1310.
20. Gennari S.P. Representing motion in language comprehension: Lessons from neuroimaging. Language and Linguistics Compass 2012, 6(2):67-84.
21. Gennari S.P., MacDonald M.C., Postle B.R., Seidenberg M.S. Context-dependent interpretation of words: Evidence for interactive neural processes. Neuroimage 2007, 35(3):1278-1286.
22. Grewe T., Bornkessel-Schlesewsky I., Zysset S., Wiese R., von Cramon D.Y., Schlesewsky M. The role of the posterior superior temporal sulcus in the processing of unmarked transitivity. NeuroImage 2007, 35(1):343-352.
23. Hauk O., Johnsrude I., Pulvermuller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 2004, 41(2):301-307.
24. Hsu N.S., Kraemer D.J.M., Oliver R.T., Schlichting M.L., Thompson-Schill S.L. Color, context, and cognitive style: Variations in color knowledge retrieval as a function of task and subject variables. Journal of Cognitive Neuroscience 2011, 23(9):2544-2557.
25. Jenkinson M., Bannister P., Brady M., Smith S. Improved optimisation for the robust and accurate linear registration and motion correction of brain images. Neuroimage 2002, 17(2):825-841.
26. Juch H., Zimine I., Seghier M., Lazeyras F., Fasel J.H.D. Anatomical variability of the lateral frontal lobe surface: Implication for intersubject variability in language neuroimage. Neuroimage 2005, 24:504-514.
27. Kable J.W., Lease-Spellmeyer J., Chatterjee A. Neural substrates of action event knowledge. Journal of Cognitive Neuroscience 2002, 14(5):795-805.
28. Kable J.W., Kan I.P., Wilson A., Thompson-Schill S.L., Chatterjee A. Conceptual representations of action in the lateral temporal cortex. Journal of Cognitive Neuroscience 2005, 17(12):1855-1870.
29. Kaschak M.P., Madden C.J., Therriault D.J., Yaxley R.H., Aveyard M., Blanchard A.A., et al. Perception of motion affects language processing. Cognition 2005, 94:B79-B89.
30. Kellenbach M.L., Brett M., Patterson K. Actions speak louder than functions: The importance of manipulability and action in tool representation. Journal of Cognitive Neuroscience 2003, 15(1):30-45.
31. Kiefer M., Sim E.-J., Herrnberger B., Grothe J., Hoenig K. The sound of concepts: Four markers for a link between auditory and conceptual brain systems. Journal of Neuroscience 2008, 28(47):12224-12230.
32. Kiefer M., Trumpp N., Herrnberger B., Sim E.-J., Hoenig K., Pulvermuller F. Dissociating the representation of action- and sound-related concepts in middle temporal cortex. Brain and Language 2012, 122:120-125.
33. Knoeferle P., Crocker M.W. The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language 2007, 57(4):519-543.
34. Kourtzi Z., Kanwisher N. Activation in human MT/MST by static images with implied motion. Journal of Cognitive Neuroscience 2000, 12(1):48-55.
35. Loftus G.R., Masson M.E.J. Using confidence-intervals in within-subject designs. Psychonomic Bulletin and Review 1994, 1:476-490.
36. Martin A., Chao L.L. Semantic memory and the brain: Structure and processes. Current Opinion in Neurobiology 2001, 11(2):194-201.
37. Meteyard L., Cuadrado S.R., Bahrami B., Vigliocco G. Coming of age: A review of embodiment and the neuroscience of semantics. Cortex 2012, 48(7):788-804.
38. Morito Y., Tanabe H.C., Kochiyama T., Sadato N. Neural representation of animacy in the early visual areas: A functional MRI study. Brain Research Bulletin 2009, 79(5):271-280.
39. Noppeney U., Josephs O., Kiebel S., Friston K.J., Price C.J. Action selectivity in parietal and temporal cortex. Cognitive Brain Research 2005, 25(3):641-649.
40. O'Craven K.M., Rosen B.R., Kwong K.K., Treisman A., Savoy R.L. Voluntary attention modulates fMRI activity in human MT-MST. Neuron 1997, 18(4):591-598.
41. Peelen M.V., Romagno D., Caramazza A. Independent representations of verbs and actions in left lateral temporal cortex. Journal of Cognitive Neuroscience 2012, 24(10):2096-2107.
42. Puce A., Perrett D. Electrophysiology and brain imaging of biological motion. Philosophical Transactions of the Royal Society of London Series B: Biological Sciences 2003, 358(1431):435-445.
43. Pulvermuller F. Brain mechanisms linking language and action. Nature Reviews Neuroscience 2005, 6(7):576-582.
44. Pulvermuller F., Shtyrov Y., Ilmoniemi R. Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience 2005, 17(6):884-892.
45. Revill K.P., Aslin R.N., Tanenhaus M.K., Bavelier D. Neural correlates of partial lexical activation. Proceedings of the National Academy of Sciences of the United States of America 2008, 105(35):13111-13115.
46. Richardson D.C., Spivey M.J. Representation, space and Hollywood Squares: Looking at things that aren't there anymore. Cognition 2000, 76(3):269-295.
47. Rodríguez-Ferreiro J., Gennari S.P., Davies R., Cuetos F. Neural correlates of abstract verb processing. Journal of Cognitive Neuroscience 2011, 23(1):106-118.
48. Rueschemeyer S., Glenberg A.M., Kaschak M.P., Mueller K., Friederici A.D. Top-down and bottom-up contributions to understading sentences describing objects in motions. Frontiers in Psychology 2010, 1:1-11.
49. Saygin A.P., McCullough S., Morana A., Emmory K. Modulation of BOLD response in motion-sensitive lateral temporal cortex by real and fictive motion sentences. Journal of Cognitive Neuroscience 2010, 22(11):2480-2490.
50. Schultz J., Friston K.J., O'Doherty J., Wolpert D.M., Frith C.D. Activation in posterior superior temporal sulcus parallels parameter inducing the percept of animacy. Neuron 2005, 45(4):625-635.
51. Senior C., Barnes J., Giampietro V., Simmons A., Bullmore E.T., Brammer M., et al. The functional neuroanatomy of implicit-motion perception or representational momentum. Current Biology 2000, 10(1):16-22.
52. Servos P., Osu R., Santi A., Kawato M. The neural substrates of biological motion perception: an fMRI study. Cerebral Cortex 2002, 12(7):772-782.
53. Schultz J., Firston K.J., O'Doherty J., Wolpert D.M., Frith C.D. Activation of posterior superior temporal sulcis parallels parameter inducing the percept of animacy. Neuron 2005, 45:625-635.
54. Swallow M.K., Braver T.S., Snyder A.Z., Speer N.K., Zacks J.M. Reliability of functional localization using fMRI. Neuroimage 2003, 20:1561-1577.
55. Thompson J.C., Clarke M., Stewart T., Puce A. Configural processing of biological motion in human superior temporal sulcus. Journal of Neuroscience 2005, 25(39):9059-9066.
56. Tootell R.B., Reppas J.B., Kwong K.K., Malach R., Born R.T., Brady T.J., et al. Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. Journal of Neuroscience 1995, 15(4):3215-3230.
57. Tranel D., Martin C., Damasio H., Grabowski T.J., Hichwa R. Effects of noun-verb homonymy on the neural correlates of naming concrete entities and actions. Brain & Language 2005, 92(3):288-299.
58. Tyler L.K., Bright P., Fletcher P., Stamatakis E.A. Neural processing of nouns and verbs: the role of inflexional morphology. Neuropsychologia 2004, 42:512-523.
59. Tyler L.K., Marslen-Wilson W. Fronto-temporal brain systems supporting spoken language comprehension. Philosophical Transactions of the Royal Society of London - Series B: Biological Sciences 2008, 363(1493):1037-1054.
60. Tyler L.K., Randall B., Stamatakis E.A. Cortical differentiation for nouns and verbs depends on grammatical markers. Journal of Cognitive Neuroscience 2008, 20(8):1381-1389.
61. Tyler L.K., Stamatakis E.A., Dick E., Bright P., Fletcher P., Moss H. Objects and their actions: Evidence for a neurally distributed semantic system. NeuroImage 2003, 18(2):542-557.
62. Wallentin M., Lund T.E., Ostergaard S., Ostergaard L., Roepstorff A. Motion verb sentences activate left posterior middle temporal cortex despite static context. Neuroreport 2005, 16(6):649-652.
63. Wallentin M., Nielsen A.H., Vuust P., Dohn A., Roepstorff A., Lund T.E. BOLD response to motion verbs in left posterior middle temporal gyrus during story comprehension. Brain and Language 2011, 119:221-225.
64. Whitney C., Jefferies E., Kircher T. Heterogeneity of the left temporal lobe in semantic representation and control: Priming multiple versus single meanings of ambiguous words. Cerebral Cortex 2011, 21(4):831-844.
65. Whitney C., Kirk M., O'Sullivan J., Lambon Ralph M.A., Jefferies E. The neural organization of semantic control: TMS evidence for a distributed network in left inferior frontal and posterior middle temporal gyrus. Cerebral Cortex 2011, 21(5):1066-1075.
66. Whitney C., Kirk M., O'Sullivan J., Lambon Ralph M.A., Jefferies E. Executive semantic processing is underpinned by a large-scale neural network: Revealing the contribution of left prefrontal, posterior temporal, and parietal cortex to controlled retrieval and selection using TMS. Journal of Cognitive Neuroscience 2012, 24(1):133-147.
67. Woolrich M.W., Ripley B.D., Brady J.M., Smith S.M.T. Temporal autocorrelation in univariate linear modelling of FMRI data. Neuroimage 2001, 14(6):1370-1386.
68. Worsley K.J. Statistical analysis of activation images. Functional MRI: An introduction to methods 2001, Oxford University Press, Oxford. P. Jezzard, P.M. Matthews, S.M. Smith (Eds.).
69. Zihl J., von Cramon D., Mai N., Schmid C. Disturbance of movement vision after bilateral posterior brain damage. Further evidence and follow up observations. Brain 1991, 114(Pt 5):2235-2252.