Unique semantic space in the brain of each beholder predicts perceived similarity

Proceedings of the National Academy of Sciences of the United States of America

Volumn 111, Issue 40, 2014, Pages 14565-14570

  Charest, Ian ^a   Kievit, Rogier A ^a   Schmitz, Taylor W ^a   Deca, Diana ^b   Kriegeskorte, Nikolaus ^a   Ungerleider, Leslie G ^c  

^a MEDICAL RESEARCH COUNCIL   (United Kingdom)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Memory; Neuroimaging; Object representations; Representational similarity analysis; Visual perception

Indexed keywords

ADULT; BIOLOGICAL ACTIVITY; BRAIN REGION; CLINICAL DECISION MAKING; CONFERENCE PAPER; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GENE EXPRESSION; GEOMETRY; HUMAN; IMAGE ANALYSIS; INFERIOR TEMPORAL CORTEX; MALE; MEDIAL TEMPORAL LOBE; NORMAL HUMAN; PRIORITY JOURNAL; VISION; VISUAL CORTEX; VISUAL MEMORY; YOUNG ADULT; ADOLESCENT; ANATOMY AND HISTOLOGY; BRAIN; BRAIN MAPPING; CLINICAL TRIAL; DECISION MAKING; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY; SEMANTICS; VISUAL SYSTEM;

ADOLESCENT; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; JUDGMENT; MAGNETIC RESONANCE IMAGING; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REPRODUCIBILITY OF RESULTS; SEMANTICS; VISUAL PATHWAYS; YOUNG ADULT;

EID: 84928583444     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1402594111     Document Type: Article

References (55)

1. Hasson U, Nir Y, Levy I., Fuhrmann G, Malach R. (2004) Intersubject synchronization of cortical activity during natural vision. Science 303 (5664):1634-1640.
2. Ochsner KN, Bunge SA, Gross J.J., Gabrieli JDE (2002) Rethinking feelings: An FMRI study of the cognitive regulation of emotion. J Cogn Neurosci 14(8):1215-1229.
3. Schwarzkopf DS, Song C, Rees G. (2011) The surface area of human V1 predicts the subjective experience of object size. Nat Neurosci 14(1):28-30.
4. Puce A, Allison T, Gore J.C., McCarthy G. (1995) Face-sensitive regions in human extrastriate cortex studied by functional MRI. J Neurophysiol 74(3):1192-1199.
5. Martin A, Wiggs CL, Ungerleider L.G., Haxby J.V. (1996) Neural correlates of categoryspecific knowledge. Nature 379 (6566):649-652.
6. Malach R, et al (1995) Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci USA 92(18):8135-8139.
7. Kanwisher N, McDermott J, Chun M.M. (1997) The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci 17(11):4302-4311.
8. Epstein R, Kanwisher N. (1998) A cortical representation of the local visual environment. Nature 392 (6676):598-601.
9. Grill-Spector K., Kushnir T, Edelman S., Itzchak Y, Malach R. (1998) Cue-invariant activation in object-related areas of the human occipital lobe. Neuron 21(1):191-202.
10. Haxby JV, et al (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293 (5539):2425-2430.
11. Kriegeskorte N, Formisano E, Sorger B., Goebel R. (2007) Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc Natl Acad Sci USA 104(51): 20600-20605.
12. Kay KN, Naselaris T, Prenger R.J., Gallant J.L. (2008) Identifying natural images from human brain activity. Nature 452 (7185):352-355.
13. Mur M, et al (2012) Categorical, yet graded - single-image activation profiles of human category-selective cortical regions. J Neurosci 32(25):8649-8662.
14. Huth AG, Nishimoto S, Vu A.T., Gallant J.L. (2012) A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76(6):1210-1224.
15. Kiani R, Esteky H, Mirpour K., Tanaka K. (2007) Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. J Neurophysiol 97(6):4296-4309.
16. Kriegeskorte N, Mur M, Bandettini P. (2008) Representational similarity analysis - connecting the branches of systems neuroscience. Front Syst Neurosci 2:4.
17. Naselaris T, Stansbury DE, Gallant J.L. (2012) Cortical representation of animate and inanimate objects in complex natural scenes. J Physiol Paris 106(5-6):239-249.
18. Polyn SM, Natu VS, Cohen J.D., Norman K.A. (2005) Category-specific cortical activity precedes retrieval during memory search. Science 310 (5756):1963-1966.
19. Xue G, et al (2010) Greater neural pattern similarity across repetitions is associated with better memory. Science 330 (6000):97-101.
20. Shinkareva SV, Malave VL, Just M.A., Mitchell T.M. (2012) Exploring commonalities across participants in the neural representation of objects. Hum Brain Mapp 33(6): 1375-1383.
21. Raizada RDS, Connolly A.C. (2012) What makes different people's representations alike: Neural similarity space solves the problem of across-subject fMRI decoding. J Cogn Neurosci 24(4):868-877.
22. Haxby JV, et al (2011) A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 72(2):404-416.
23. Kriegeskorte N, et al (2008) Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60(6):1126-1141.
24. Norman KA, Polyn SM, Detre G.J., Haxby J.V. (2006) Beyond mind-reading: Multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10(9):424-430.
25. Haynes JD, Rees G. (2006) Decoding mental states from brain activity in humans. Nat Rev Neurosci 7(7):523-534.
26. Weiner KS, Grill-Spector K (2010) Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. Neuroimage 52(4):1559-1573.
27. Spiridon M, Kanwisher N. (2002) How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35(6):1157-1165.
28. O'Toole A.J., Jiang F, Abdi H., Haxby J.V. (2005) Partially distributed representations of objects and faces in ventral temporal cortex. J Cogn Neurosci 17(4):580-590.
29. Harel A, Kravitz DJ, Baker C.I. (2013) Deconstructing visual scenes in cortex: Gradients of object and spatial layout information. Cereb Cortex 23(4):947-957.
30. Mur M, et al (2013) Human Object-Similarity Judgments Reflect and Transcend the Primate-IT Object Representation. Front Psychol 4:128.
31. Suzuki WA, Amaral D.G. (1994) Perirhinal and parahippocampal cortices of the macaque monkey: Cortical afferents. J Comp Neurol 350(4):497-533.
32. Goldstone R (1994) An efficient method for obtaining similarity data. Behav Res Methods Instrum Comput 26(4):381-386.
33. Kriegeskorte N, Mur M. (2012) Inverse MDS: Inferring dissimilarity structure from multiple item arrangements. Front Psychol 3:245.
34. Aguirre GK (2007) Continuous carry-over designs for fMRI. Neuroimage 35(4):1480-1494.
35. Kriegeskorte N, Kievit R.A. (2013) Representational geometry: Integrating cognition, computation, and the brain. Trends Cogn Sci 17(8):401-412.
36. Murray SO, Boyaci H, Kersten D. (2006) The representation of perceived angular size in human primary visual cortex. Nat Neurosci 9(3):429-434.
37. Dougherty RF, et al (2003) Visual field representations and locations of visual areas V1/2/3 in human visual cortex. J Vis 3(10):586-598.
38. Stensaas SS, Eddington DK, Dobelle W.H. (1974) The topography and variability of the primary visual cortex in man. J Neurosurg 40(6):747-755.
39. Schwarzkopf DS, Rees G. (2013) Subjective size perception depends on central visual cortical magnification in human v1. PLoS ONE 8(3):e60550.
40. Kanai R, Rees G. (2011) The structural basis of inter-individual differences in human behaviour and cognition. Nat Rev Neurosci 12(4):231-242.
41. Mumford D (1992) On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol Cybern 66(3):241-251.
42. Rao RPN, Ballard D. (1999) Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2(1): 79-87.
43. Murray SO, Kersten D, Olshausen B.A., Schrater P., Woods D.L. (2002) Shape perception reduces activity in human primary visual cortex. Proc Natl Acad Sci USA 99(23): 15164-15169.
44. Staresina BP, Henson RNA, Kriegeskorte N, Alink A. (2012) Episodic reinstatement in the medial temporal lobe. J Neurosci 32(50):18150-18156.
45. Lee S-H, Kravitz D.J., Baker C.I. (2012) Disentangling visual imagery and perception of real-world objects. Neuroimage 59(4):4064-4073.
46. Stokes M, Thompson R, Cusack R., Duncan J. (2009) Top-down activation of shapespecific population codes in visual cortex during mental imagery. J Neurosci 29(5): 1565-1572.
47. Cichy RM, Heinzle J, Haynes J-D (2012) Imagery and perception share cortical representations of content and location. Cereb Cortex 22(2):372-380.
48. Reddy L, Kanwisher NG, VanRullen R. (2009) Attention and biased competition in multi-voxel object representations. Proc Natl Acad Sci USA 106(50):21447-21452.
49. Macevoy SP, Epstein R.A. (2009) Decoding the representation of multiple simultaneous objects in human occipitotemporal cortex. Curr Biol 19(11):943-947.
50. Op de Beeck HP, Baker CI, DiCarlo J.J., Kanwisher N.G. (2006) Discrimination training alters object representations in human extrastriate cortex. J Neurosci 26(50):13025-13036.
51. James TW, Culham J, Humphrey G.K., Milner AD, Goodale M.A. (2003) Ventral occipital lesions impair object recognition but not object-directed grasping: An fMRI study. Brain 126(Pt 11):2463-2475.
52. Dakin S, Frith U. (2005) Vagaries of visual perception in autism. Neuron 48(3):497-507.
53. Hoffman P, Jones RW, Ralph MAL (2012) The degraded concept representation system in semantic dementia: Damage to pan-modal hub, then visual spoke. Brain 135(Pt 12):3770-3780.
54. Kay KN, Winawer J, Mezer A., Wandell B.A. (2013) Compressive spatial summation in human visual cortex. J Neurophysiol 110(2):481-494.
55. Kay K, Rokem A, Winaver J., Dougherty R, Wandell B. (2013) GLMdenoise: A fast, automated technique for denoising task-based fMRI data. Front Neurosci 7:247.