Predicting brain activation patterns associated with individual lexical concepts based on five sensory-motor attributes

Neuropsychologia

Volumn 76, Issue , 2015, Pages 17-26

  Fernandino, Leonardo ^a   Humphries, Colin J ^a   Seidenberg, Mark S ^b   Gross, William L ^a   Conant, Lisa L ^a   Binder, Jeffrey R ^a  

^a MEDICAL COLLEGE OF WISCONSIN   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Concepts; Embodiment; FMRI; Lexical semantics; Multimodal processing; Semantic memory

Indexed keywords

ADULT; ARTICLE; AUDITORY SYSTEM FUNCTION; BRAIN DEPTH STIMULATION; BRAIN FUNCTION; CONCEPT ANALYSIS; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; FEMALE; FUNCTIONAL ASSESSMENT; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MOTOR PERFORMANCE; NORMAL HUMAN; PREDICTION; SEMANTICS; SENSORIMOTOR FUNCTION; SENSORIMOTOR INTEGRATION; VISUAL SYSTEM FUNCTION; WORD RECOGNITION; BRAIN; BRAIN MAPPING; CONCEPT FORMATION; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; YOUNG ADULT;

ADULT; BRAIN; BRAIN MAPPING; CONCEPT FORMATION; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; PATTERN RECOGNITION, PHYSIOLOGICAL; PHOTIC STIMULATION; SEMANTICS; YOUNG ADULT;

EID: 84944150675     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2015.04.009     Document Type: Article

References (47)

1. Andrews M., Frank S., Vigliocco G. Reconciling embodied and distributional accounts of meaning in language. Top. Cognit. Sci. 2014, 6(3):359-370. 10.1111/tops.12096.
2. Aziz-Zadeh L., Wilson S.M., Rizzolatti G., Iacoboni M. Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol. 2006, 16(18):1818-1823. 10.1016/j.cub.2006.07.060.
3. Balota D.A., Yap M.J., Cortese M.J., Hutchison K.A., Kessler B., Loftis B., Neely J.H., Nelson D.L., Simpson G.B., Treiman R. The English Lexicon Project. Behav. Res. Methods 2007, 39:445-459.
4. Barsalou L.W. Grounded cognition. Annu. Rev. Psychol. 2008, 59:617-645. 10.1146/annurev.psych.59.103006.093639.
5. Binder J.R., Desai R.H. The neurobiology of semantic memory. Trends Cognit. Sci. 2011, 15(11):527-536. 10.1016/j.tics.2011.10.001.
6. Bird H., Franklin S., Howard D. Age of acquisition and imageability ratings for a large set of words, including verbs and function words. Behav. Res. Methods Instrum. Comput. 2001, 33(1):73-79.
7. Brysbaert M., Warriner A.B., Kuperman V. Concreteness ratings for 40 thousand generally known English word lemmas. Behav. Res. Methods 2014, 46(3):904-911. 10.3758/s13428-013-0403-5.
8. Chao L.L., Haxby J.V., Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat. Neurosci. 1999, 2(10):913-919. 10.1038/13217.
9. Clark J.M., Paivio A. Extensions of the Paivio, Yuille, and Madigan (1968) norms. Behav. Res. Methods, Instrum. Comput. 2004, 36(3):371-383.
10. Cox D.D., Savoy R.L. Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. NeuroImage 2003, 19(2 Pt 1):261-270.
11. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. Int. J. 1996, 29(3):162-173.
12. Damasio A.R. Time-locked multiregional retroactivation: a systems-level proposal for the neural substrates of recall and recognition. Cognition 1989, 33(1-2):25-62.
13. Evans G.A.L., Lambon Ralph M.A., Woollams A.M. What's in a word? a parametric study of semantic influences on visual word recognition. Psychon. Bull. Rev. 2012, 19(2):325-331. 10.3758/s13423-011-0213-7.
14. Farah M.J., McClelland J.L. A computational model of semantic memory impairment: modality specificity and emergent category specificity. J. Exp. Psychol.: Gen. 1991, 120(4):339-357. 10.1037/0096-3445.120.4.339.
15. Fernandino L., Binder J.R., Desai R.H., Pendl S.L., Humphries C.J., Gross W.L., Connant L.L., Seidenberg M.S. Concept representation reflects multimodal abstraction: a framework for embodied semantics. Cereb. Cortex 2015, 10.1093/cercor/bhv020.
16. Fischer M.H., Zwaan R.A. Embodied language: a review of the role of the motor system in language comprehension. Q. J. Exp. Psychol. 2008, 61(6):825-850. 10.1080/17470210701623605.
17. Glenberg A.M., Gallese V. Action-based language: a theory of language acquisition, comprehension, and production. Cortex 2012, 48(7):905-922. 10.1016/j.cortex.2011.04.010.
18. Hauk O., Johnsrude I., Pulvermüller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 2004, 41(2):301-307.
19. Haxby J.V., Connolly A.C., Guntupalli J.S. Decoding neural representational spaces using multivariate pattern analysis. Annu. Rev. Neurosci. 2014, 37(1):435-456. 10.1146/annurev-neuro-062012-170325.
20. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293(5539):2425-2430. 10.1126/science.1063736.
21. Haxby J.V., Guntupalli J.S., Connolly A.C., Halchenko Y.O., Conroy B.R., Gobbini M.I., et al. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 2011, 72(2):404-416. 10.1016/j.neuron.2011.08.026.
22. Hoenig K., Müller C., Herrnberger B., Sim E.-J., Spitzer M., Ehret G., Kiefer M. Neuroplasticity of semantic representations for musical instruments in professional musicians. NeuroImage 2011, 56(3):1714-1725. 10.1016/j.neuroimage.2011.02.065.
23. Hoffman P., Lambon Ralph M.A. Shapes, scents and sounds: quantifying the full multi-sensory basis of conceptual knowledge. Neuropsychologia 2013, 51(1):14-25. 10.1016/j.neuropsychologia.2012.11.009.
24. Hsu N.S., Frankland S.M., Thompson-Schill S.L. Chromaticity of color perception and object color knowledge. Neuropsychologia 2012, 50(2):327-333. 10.1016/j.neuropsychologia.2011.12.003.
25. Huth A.G., Nishimoto S., Vu A.T., Gallant J.L. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 2012, 76(6):1210-1224. 10.1016/j.neuron.2012.10.014.
26. Kiefer M., Pulvermüller F. Conceptual representations in mind and brain: theoretical developments, current evidence and future directions. Cortex 2012, 48(7):805-825. 10.1016/j.cortex.2011.04.006.
27. Kiefer M., Sim E.-J., Herrnberger B., Grothe J., Hoenig K. The sound of concepts: four markers for a link between auditory and conceptual brain systems. J. Neurosci. 2008, 28(47):12224-12230. 10.1523/JNEUROSCI.3579-08.2008.
28. Kiefer M., Sim E.-J., Liebich S., Hauk O., Tanaka J. Experience-dependent plasticity of conceptual representations in human sensory-motor areas. J. Cognit. Neurosci. 2007, 19(3):525-542. 10.1162/jocn.2007.19.3.525.
29. Kiefer M., Trumpp N., Herrnberger B., Sim E.-J., Hoenig K., Pulvermüller F. Dissociating the representation of action- and sound-related concepts in middle temporal cortex. Brain Lang. 2012, 122(2):120-125. 10.1016/j.bandl.2012.05.007.
30. Kriegeskorte N., Mur M., Ruff D.A., Kiani R., Bodurka J., Esteky H., et al. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 2008, 60(6):1126-1141. 10.1016/j.neuron.2008.10.043.
31. Machery E. Concept empiricism: a methodological critique. Cognition 2007, 104(1):19-46. 10.1016/j.cognition.2006.05.002.
32. Martin A., Wiggs C.L., Ungerleider L.G., Haxby J.V. Neural correlates of category-specific knowledge. Nature 1996, 379(6566):649-652. 10.1038/379649a0.
33. McCarthy R.A., Warrington E.K. Evidence for modality-specific meaning systems in the brain. Nature 1988, 334(6181):428-430. 10.1038/334428a0.
34. Medler, D.A., Binder, J.R., 2005. MCWord: An On-Line Orthographic Database of the English Language. http://www.neuro.mcw.edu/mcword/.
35. Meteyard L., Vigliocco G. The role of sensory and motor information in semantic representation. Handbook of Cognitive Science: An Embodied Approach 2008, Elsevier, San Diego, Oxford, Amsterdam. P. Calvo, T. Gomila (Eds.).
36. Meteyard L., Cuadrado S.R., Bahrami B., Vigliocco G. Coming of age: a review of embodiment and the neuroscience of semantics. Cortex 2012, 48(7):788-804. 10.1016/j.cortex.2010.11.002.
37. Mitchell T.M., Hutchinson R., Niculescu R.S., Pereira F., Wang X. Learning to decode cognitive states from brain images. Machine Learning 2004, 57:145-175.
38. Mitchell T.M., Shinkareva S.V., Carlson A., Chang K.-M., Malave V.L., Mason R.A., Just M.A. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320(5880):1191-1195. 10.1126/science.1152876.
39. Naselaris T., Kay K.N., Nishimoto S., Gallant J.L. Encoding and decoding in fMRI. NeuroImage 2011, 56(2):400-410. 10.1016/j.neuroimage.2010.07.073.
40. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9(1):97-113.
41. Spiridon M., Kanwisher N. How distributed is visual category information in human occipito-temporal cortex? an fMRI study. Neuron 2002, 35(6):1157-1165.
42. Talairach J., Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain. 3-Dimensional Proportional System: An Approach to Cerebral Imaging 1988, Thieme, New York.
43. Trumpp N.M., Traub F., Kiefer M. Masked priming of conceptual features reveals differential brain activation during unconscious access to conceptual action and sound information. PLoS One 2013, 8(5):1-10. 10.1371/journal.pone.0065910.
44. Weisberg J., van Turennout M., Martin A. A neural system for learning about object function. Cereb. Cortex 2007, 17(3):513-521. 10.1093/cercor/bhj176.
45. Warrington E.K., Shallice T. Category specific semantic impairments. Brain 1984, 107(Pt 3):829-854.
46. Willems R.M., Toni I., Hagoort P., Casasanto D. Neural dissociations between action verb understanding and motor imagery. J. Cognit. Neurosci. 2010, 22(10):2387-2400. 10.1162/jocn.2009.21386.
47. Wilson M. MRC Psycholinguistic Database: Machine-usable dictionary, version 2.00. Behav. Res. Methods Instrum. Comput. 1988, 20(1):6-10. 10.3758/BF03202594.