Representational similarity analysis reveals commonalities and differences in the semantic processing of words and objects

Journal of Neuroscience

Volumn 33, Issue 48, 2013, Pages 18906-18916

  Devereux, Barry J ^a   Clarke, Alex ^a   Marouchos, Andreas ^a   Tyler, Lorraine K ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANGULAR GYRUS; ARTICLE; COMPUTER MODEL; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MALE; MIDDLE TEMPORAL GYRUS; NERVE CELL NETWORK; NORMAL HUMAN; PRIORITY JOURNAL; REPRESENTATIONAL SIMILARITY ANALYSIS; SEMANTICS; VISUAL STIMULATION; BRAIN MAPPING; CLUSTER ANALYSIS; IMAGE PROCESSING; LINGUISTICS; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; READING; VISION; YOUNG ADULT;

ADULT; BRAIN MAPPING; CLUSTER ANALYSIS; FEMALE; FORM PERCEPTION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; PSYCHOLINGUISTICS; READING; SEMANTICS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84888222866     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3809-13.2013     Document Type: Article

References (58)

1. Akama H, Murphy B, Na L, Shimizu Y, Poesio M (2012) Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study. Front Neuroinform 6:24. CrossRef Medline
2. Baayen R, Piepenbrock R, van Rijn H (1993) The CELEX lexical database on CD-ROM. Philadelphia: Linguistic Data Consortium.
3. Badre D, Poldrack RA, Paré-Blagoev EJ, Insler RZ, Wagner AD (2005) Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron 47:907-918. CrossRef Medline
4. Bates E, D'Amico S, Jacobsen T, Székely A, Andonova E, Devescovi A, Herron D, Lu CC, Pechmann T, Pléh C, Wicha N, Federmeier K, Gerdjikova I, Gutierrez G, Hung D, Hsu J, Iyer G, Kohnert K, Mehotcheva T, Orozco-Figueroa A, Tzeng A, Tzeng O (2003) Timed picture naming in seven languages. Psychon Bull Rev 10:344-380. CrossRef Medline
5. Beauchamp MS, Lee KE, Haxby JV, Martin A (2003) fMRI responses to video and point-light displays of moving humans and manipulable objects. J Cogn Neurosci 15:991-1001. CrossRef Medline
6. Binder JR, Desai RH, Graves WW, Conant LL (2009) Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb Cortex 19:2767-2796. CrossRef Medline
7. Binney RJ, Embleton KV, Jefferies E, Parker GJM, Ralph MAL (2010) The ventral and inferolateral aspects of the anterior temporal lobe are crucial in semantic memory: evidence from a novel direct comparison of distortion-corrected fMRI, rTMS, and semantic dementia. Cereb Cortex 20:2728-2738. CrossRef Medline
8. Bouchard KE, Mesgarani N, Johnson K, Chang EF (2013) Functional organization of human sensorimotor cortex for speech articulation. Nature 495:327-332. CrossRef Medline
9. Bright P, Moss H, Tyler LK (2004) Unitary vs multiple semantics: PET studies of word and picture processing. Brain Lang 89:417-432. CrossRef Medline
10. Bright P, Moss HE, Longe O, Stamatakis EA, Tyler LK (2007) Conceptual structure modulates anteromedial temporal involvement in processing verbally presented object properties. Cereb Cortex 17:1066-1073. CrossRef Medline
11. Cattell RB (1966) The scree test for the number of factors. Multivariate Behav Res 1:245-276. CrossRef
12. Chao LL, Haxby JV, Martin A (1999) Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat Neurosci 2:913-919. CrossRef Medline
13. Chee MWL, Weekes B, Lee KM, Soon CS, Schreiber A, Hoon JJ, Chee M (2000) Overlap and dissociation of semantic processing of Chinese characters, English words, and pictures: evidence from fMRI. Neuroimage 12:392-403. CrossRef Medline
14. Clarke A, Taylor KI, Tyler LK (2011) The evolution of meaning: spatiotemporal dynamics of visual object recognition. J Cogn Neurosci 23: 1887-1899. CrossRef Medline
15. Connolly AC, Guntupalli JS, Gors J, Hanke M, Halchenko YO, Wu YC, Abdi H, Haxby JV (2012) The representation of biological classes in the human brain. J Neurosci 32:2608-2618. CrossRef Medline
16. Creem-Regehr SH, Lee JN (2005) Neural representations of graspable objects: are tools special? Brain Res Cogn Brain Res 22:457-469. CrossRef Medline
17. Creem-Regehr SH, Dilda V, Vicchrilli AE, Federer F, Lee JN (2007) The influence of complex action knowledge on representations of novel graspable objects: evidence from functional magnetic resonance imaging. J Int Neuropsychol Soc 13:1009-1020. CrossRef Medline
18. Cristescu TC, Devlin JT, Nobre AC (2006) Orienting attention to semantic categories. Neuroimage 33:1178-1187. CrossRef Medline
19. Drane DL, Ojemann GA, Ojemann JG, Aylward E, Silbergeld DL, Miller JW, Tranel D (2009) Category-specific recognition and naming deficits following resection of a right anterior temporal lobe tumor in a patient with atypical language lateralization. Cortex 45:630-640. CrossRef Medline
20. Dronkers NF, Wilkins DP, Van Valin RD Jr, Redfern BB, Jaeger JJ (2004) Lesion analysis of the brain areas involved in language comprehension. Cognition 92:145-177. CrossRef Medline
21. Fairhall SL, Caramazza A (2013) Brain regions that represent amodal conceptual knowledge. J Neurosci 33:10552-10558. CrossRef Medline
22. Felleman DJ, Van Essen DC (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1:1-47. CrossRef Medline
23. Guenther FH, Ghosh SS, Tourville JA (2006) Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang 96:280-301. CrossRef Medline
24. Hoeren M, Kaller CP, Glauche V, Vry MS, Rijntjes M, Hamzei F, Weiller C (2013) Action semantics and movement characteristics engage distinct processing streams during the observation of tool use. Exp Brain Res 229:243-260. CrossRef Medline
25. Holland R, Lambon Ralph MA (2010) The anterior temporal lobe semantic hub is a part of the language neural network: selective disruption of irregular past tense verbs by rTMS. Cereb Cortex 20:2771-2775. CrossRef Medline
26. Humphries C, Binder JR, Medler DA, Liebenthal E (2007) Time course of semantic processes during sentence comprehension: an fMRI study. Neuroimage 36:924-932. CrossRef Medline
27. Kriegeskorte N, Kievit RA (2013) Representational geometry: integrating cognition, computation, and the brain. Trends Cogn Sci (Regul Ed) 17: 401-412. CrossRef Medline
28. Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci U S A 103:3863-3868. CrossRef Medline
29. Kriegeskorte N, Mur M, Bandettini P (2008) Representational similarity analysis-connecting the branches of systems neuroscience. Front Syst Neurosci 2:4. CrossRef Medline
30. Lau EF, Phillips C, Poeppel D (2008) A cortical network for semantics: (de)constructing the N400. Nat Rev Neurosci 9:920-933. CrossRef Medline
31. Mahon BZ, Milleville SC, Negri GAL, Rumiati RI, Caramazza A, Martin A (2007) Action-related properties shape object representations in the ventral stream. Neuron 55:507-520. CrossRef Medline
32. Mahon BZ, Schwarzbach J, Caramazza A (2010) The representation of tools in left parietal cortex is independent of visual experience. Psychol Sci 21:764-771. CrossRef Medline
33. Martin A (2007) The representation of object concepts in the brain. Annu Rev Psychol 58:25-45. CrossRef Medline
34. Meyer K, Kaplan JT, Essex R, Webber C, Damasio H, Damasio A (2010) Predicting visual stimuli on the basis of activity in auditory cortices. Nat Neurosci 13:667-668. CrossRef Medline
35. Moss HE, Rodd JM, Stamatakis EA, Bright P, Tyler LK (2005) Anteromedial temporal cortex supports fine-grained differentiation among objects. Cereb Cortex 15:616-627. CrossRef Medline
36. Mur M, Bandettini PA, Kriegeskorte N (2009) Revealing representational content with pattern-information fMRI-an introductory guide. Soc Cogn Affect Neurosci 4:101-109. CrossRef Medline
37. Nichols TE, Holmes AP (2002) Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum Brain Mapp 15:1-25. CrossRef Medline
38. Noonan KA, Jefferies E, Visser M, Lambon RalphMA (2013) Going beyond inferior prefrontal involvement in semantic control: evidence for the additional contribution of dorsal angular gyrus and posterior middle temporal cortex. J Cogn Neurosci 25:1824-1850. CrossRef Medline
39. Patterson K, Nestor PJ, Rogers TT (2007) Where do you know what you know? The representation of semantic knowledge in the human brain. Nat Rev Neurosci 8:976-987. CrossRef Medline
40. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay É (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825-2830.
41. Rissman J, Gazzaley A, D'EspositoM (2004) Measuring functional connectivity during distinct stages of a cognitive task. Neuroimage 23:752-763. CrossRef Medline
42. Rizzolatti G, MatelliM (2003) Two different streams form the dorsal visual system: anatomy and functions. Exp Brain Res 153:146-157. CrossRef Medline
43. Shinkareva SV, Malave VL, Mason RA, Mitchell TM, Just MA (2011) Commonality of neural representations of words and pictures. Neuroimage 54:2418-2425. CrossRef Medline
44. Simanova I, Hagoort P, Oostenveld R, Gerven MAJ van (2012) Modalityindependent decoding of semantic information from the human brain. Cereb Cortex. Advance online publication. Retrieved December 7, 2013. doi:10.1093/cercor/bhs324. CrossRef Medline
45. Snodgrass JG, Corwin J (1988) Perceptual identification thresholds for 150 fragmented pictures from the Snodgrass and Vanderwart picture set. Percept Motor Skills 67:3-36. CrossRef Medline
46. Székely A, Bates E (2000) Objective visual complexity as a variable in studies of picture naming, Vol 12, number 2. La Jolla, CA: Center for Research in Language, University of California, San Diego.
47. Taylor KI, Moss HE, Stamatakis EA, Tyler LK (2006) Binding crossmodal object features in perirhinal cortex. Proc Natl Acad Sci U S A 103:8239-8244. CrossRef Medline
48. Taylor KI, Devereux BJ, Acres K, Randall B, Tyler LK (2012) Contrasting effects of feature-based statistics on the categorisation and basic-level identification of visual objects. Cognition 122:363-374. CrossRef Medline
49. Tranel D (2006) Impaired naming of unique landmarks is associated with left temporal polar damage. Neuropsychology 20:1-10. CrossRef Medline
50. Tyler LK, Marslen-Wilson W (2008) Fronto-temporal brain systems supporting spoken language comprehension. Philos Trans R Soc Lond B Biol Sci 363:1037-1054. CrossRef Medline
51. Tyler LK, Stamatakis EA, Bright P, Acres K, Abdallah S, Rodd JM, Moss HE (2004) Processing objects at different levels of specificity. J Cogn Neurosci 16:351-362. CrossRef Medline
52. Tyler LK, Cheung TPL, Devereux BJ, Clarke A (2013) Syntactic computations in the language network: characterizing dynamic network properties using representational similarity analysis. Front Psychol 4:271. CrossRef Medline
53. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15:273-289. CrossRef Medline
54. Valyear KF, Cavina-Pratesi C, Stiglick AJ, Culham JC (2007) Does toolrelated fMRI activity within the intraparietal sulcus reflect the plan to grasp? Neuroimage 36 [Suppl 2]:T94-T108. CrossRef
55. Vandenberghe R, Price C, Wise R, Josephs O, Frackowiak RSJ (1996) Functional anatomy of a common semantic system for words and pictures. Nature 383:254-256. CrossRef Medline
56. Vigneau M, Beaucousin V, Hervé PY, Duffau H, Crivello F, Houdé O, Mazoyer B, Tzourio-Mazoyer N (2006) Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing. Neuroimage 30:1414-1432. CrossRef Medline
57. Visser M, Jefferies E, Embleton KV, Lambon Ralph MA (2012) Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobes. J Cogn Neurosci 24:1766-1778. CrossRef Medline
58. Warrington EK, Shallice T (1984) Category specific semantic impairments. Brain 107:829-854. CrossRef Medline