Representational geometry: Integrating cognition, computation, and the brain

Trends in Cognitive Sciences

Volumn 17, Issue 8, 2013, Pages 401-412

  Kriegeskorte, Nikolaus ^a   Kievit, Rogier A ^a,b  

^a MEDICAL RESEARCH COUNCIL   (United Kingdom)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN COMPUTATION; BRAIN INFORMATION PROCESSING; COMPUTATIONAL THEORIES; DISTANCE MATRICES; INTERMEDIATE LEVEL; NEURAL POPULATIONS; NEURONAL ACTIVITIES; NEURONAL POPULATIONS;

BRAIN MODELS; COMPUTATIONAL GEOMETRY; DATA PROCESSING;

COMPUTATION THEORY;

ANALYTICAL PARAMETERS; BRAIN; BRAIN COMPUTER INTERFACE; BRAIN REGION; COGNITION; ELECTROENCEPHALOGRAM; EMOTION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GEOMETRY; HEARING; HUMAN; LANGUAGE; MATHEMATICS; MEMORY; MOTOR CONTROL; NERVE CELL; NERVE CELL PLASTICITY; NERVE CONDUCTION; OCCIPITAL LOBE; OPTOMETRY; PERCEPTION; RECALL; REPRESENTATIONAL DISSIMILARITY MATRIX; REPRESENTATIONAL GEOMETRY; REVIEW; SENSORIMOTOR INTEGRATION; VISION; VISUAL SYSTEM;

BRAIN; COGNITION; COMPUTER SIMULATION; HUMANS; MATHEMATICS; MODELS, NEUROLOGICAL;

EID: 84880938482     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2013.06.007     Document Type: Review

References (114)

1. Dennett D. The Intentional Stance 1987, MIT Press.
2. Forstmann B.U., et al. Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract?. Trends Cogn. Sci. 2011, 15:272-279.
3. Averbeck B.B., et al. Neural correlations, population coding and computation. Nat. Rev. Neurosci. 2006, 7:358-366.
4. Visual Population Codes - Toward a Common Multivariate Framework for Cell Recording and Functional Imaging 2012, MIT Press. N. Kriegeskorte, G. Kreiman (Eds.).
5. Torgerson W.S. Theory and Methods of Scaling 1958, Wiley.
6. Shepard R.N. Stimulus and response generalization: tests of a model relating generalization to distance in psychological space. J. Exp. Psychol. 1958, 55:509-523.
7. Shepard R.N. Toward a universal law of generalization for psychological science. Science 1987, 237:1317-1323.
8. Tversky A. Features of similarity. Psychol. Rev. 1977, 84:327-352.
9. Edelman S. Representation is representation of similarities. Behav. Brain Sci. 1998, 21:449-467.
10. Gärdenfors P. Conceptual Spaces: The Geometry of Thought 2004, MIT Press.
11. Edelman S.H., et al. Toward direct visualization of the internal shape representation space by fMRI. Psychobiology 1998, 26:309-321.
12. Laakso A., Cottrell G. Content and cluster analysis: assessing representational similarity in neural systems. Philos. Psychol. 2000, 13:47-76.
13. Op de Beeck H.P., et al. Inferotemporal neurons represent low-dimensional configurations of parameterized shapes. Nat. Neurosci. 2001, 4:1244-1252.
14. Aguirre G.K. Continuous carry-over designs for fMRI. Neuroimage 2007, 35:1480-1494.
15. Kriegeskorte N., et al. Representational similarity analysis - connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2008, 2:4.
16. Mitchell T.M., et al. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320:1191-1195.
17. Naselaris T., et al. Encoding and decoding in fMRI. Neuroimage 2011, 56:400-410.
18. Kay K.N., et al. Identifying natural images from human brain activity. Nature 2008, 452:352-355.
19. Haxby J.V., et al. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 2011, 72:404-416.
20. Haxby J.V., et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
21. Cox D.D., Savoy R.L. Functional magnetic resonance imaging (fMRI) 'brain reading': detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 2003, 19:261-270.
22. Carlson T.A., et al. Patterns of activity in the categorical representation of objects. J. Cogn. Neurosci. 2003, 15:704-717.
23. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005, 8:679-685.
24. Mur M., et al. Revealing representational content with pattern-information fMRI - an introductory guide. Soc. Cogn. Affect. Neurosci. 2009, 4:101-109.
25. Norman K.A., et al. Beyond mindreading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10:424-430.
26. Haynes J.D., Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 2006, 7:523-534.
27. Tong F., Pratte M.S. Decoding patterns of human brain activity. Annu. Rev. Psychol. 2012, 63:483-509.
28. Tenenbaum J.B., Griffiths T.L. Generalization, similarity, and Bayesian inference. Behav. Brain Sci. 2001, 24:629-640.
29. DiCarlo J.J., Cox D. Untangling invariant object recognition. Trends Cogn. Sci. 2007, 11:334-341.
30. Kriegeskorte N. Pattern-information analysis: from stimulus decoding to computational-model testing. Neuroimage 2011, 56:411-421.
31. Carandini M., et al. Do we know what the early visual system does?. J. Neurosci. 2005, 25:10577-10597.
32. Hegdé J., Van Essen D.C. A comparative study of shape representation in macaque visual areas V2 and V4. Cereb. Cortex 2007, 17:1100-1116.
33. Freeman J., et al. A functional and perceptual signature of the second visual area in primates. Nat. Neurosci. 2013, 16:1362-1377.
34. Ziemba C., et al. Selectivity and invariance are greater in macaque V2 than V1. Program of the 9th Annual Computational and Systems Neuroscience Meeting 2012, 150. COSYNE.
35. Hiramatsu C., et al. Transformation from image-based to perceptual representation of materials along the human ventral visual pathway. Neuroimage 2011, 57:482-494.
36. Groen I.I.A., et al. Low-level contrast statistics are diagnostic of invariance of natural textures. Front. Comp. Neurosci. 2012, 6:2.
37. Groen I.I.A., et al. Spatially pooled contrast responses predict neural and perceptual similarity of naturalistic image categories. PLoS Comput. Biol. 2012, 8:e1002726.
38. Brouwer G.J., Heeger D.J. Decoding and reconstructing color from responses in human visual cortex. J. Neurosci. 2009, 29:13992-14003.
39. Adelson E.H. On seeing stuff: the perception of materials by humans and machines. Proc. SPIE 2001, 4299:1-12.
40. Op de Beeck H.P., et al. Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway. J. Neurosci. 2008, 28:10111-10128.
41. Haushofer J., et al. Multivariate patterns in object-selective cortex dissociate perceptual and physical shape similarity. PLoS Biol. 2008, 6:e187.
42. Drucker D.M., Aguirre G.K. Different spatial scales of shape similarity representation in lateral and ventral LOC. Cereb. Cortex 2009, 19:2269-2280.
43. Yamane Y., et al. A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nat. Neurosci. 2008, 11:1352-1360.
44. Huth A.G., et al. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 2012, 76:1210-1224.
45. Kriegeskorte N., et al. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 2008, 26:1126-1141.
46. Kiani R., et al. Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. J. Neurophys. 2007, 97:4296-4309.
47. Naselaris T., et al. Cortical representation of animate and inanimate objects in complex natural scenes. J. Physiol. Paris 2012, 106:239-249.
48. Caramazza A., Shelton J.R. Domain-specific knowledge systems in the brain: the animate-inanimate distinction. J. Cogn. Neurosci. 1998, 10:1-34.
49. Davis T., Poldrack R.A. Quantifying the internal structure of categories using a neural typicality measure. Cereb. Cortex 2013, 10.1093/cercor/bht014.
50. Mormann F., et al. A category-specific response to animals in the right human amygdala. Nat. Neurosci. 2011, 14:1247-1249.
51. Looser C.E., et al. Multivoxel patterns in face-sensitive temporal regions reveal an encoding schema based on detecting life in a face. Soc. Cogn. Affect. Neurosci. 2013, 10.1093/scan/nss078.
52. Mahon S.A., et al. Category-specific organization in the human brain does not require visual experience. Neuron 2009, 63:397-405.
53. Connolly A.C., et al. The representation of biological classes in the human brain. J. Neurosci. 2012, 32:2608-2618.
54. Mur M., et al. Human object-similarity judgments reflect and transcend the primate-IT object representation. Front. Percept. Sci. 2013, 4:128.
55. Epstein R., Kanwisher N. A cortical representation of the local visual environment. Nature 1998, 392:598-601.
56. Kanwisher N., et al. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
57. Walther D.B., et al. Natural scene categories revealed in distributed patterns of activity in the human brain. J. Neurosci. 2009, 29:10573-10581.
58. Walther D.B., et al. To err is human: correlating fMRI decoding and behavioral errors to probe the neural representation of natural scene categories. Visual Population Codes - Toward a Common Multivariate Framework for Cell Recording and Functional Imaging 2012, 391-416. MIT Press. N. Kriegeskorte, G. Kreiman (Eds.).
59. Walther D.B., et al. Simple line drawings suffice for functional MRI decoding of natural scene categories. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:9661-9666.
60. Kravitz D.J., et al. Real-world scene representations in high-level visual cortex: it's the spaces more than the places. J. Neurosci. 2011, 31:7322-7333.
61. Harel A., et al. Deconstructing visual scenes in cortex: gradients of object and spatial layout information. Cereb. Cortex 2013, 23:947-957.
62. Morgan L.K., et al. Distances between real-world locations are represented in the human hippocampus. J. Neurosci. 2011, 31:1238-1245.
63. Kriegeskorte N., et al. Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc. Natl Acad. Sci. U.S.A. 2007, 104:20600-20605.
64. Nestor A., et al. Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:9998-10003.
65. Anzellotti S., et al. Decoding representations of face identity that are tolerant to rotation. Cereb. Cortex 2013, 10.1093/cercor/bht046.
66. Goesaert E., Op de Beeck H.P.O. Representations of facial identity information in the ventral visual stream investigated with multivoxel pattern analyses. J. Neurosci. 2013, 33:8549-8558.
67. Freiwald W.A., Tsao D.Y. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 2010, 330:845-851.
68. Kietzmann T.C., et al. Prevalence of selectivity for mirror-symmetric views of faces in the ventral and dorsal visual pathways. J. Neurosci. 2012, 32:11763-11772.
69. DiCarlo J.J., et al. How does the brain solve visual object recognition?. Neuron 2012, 73:415-434.
70. Kravitz D.J., et al. High-level visual object representations are constrained by position. Cereb. Cortex 2010, 20:2916-2925.
71. Hung C.P., et al. Fast readout of object identity from macaque inferior temporal cortex. Science 2005, 310:863-866.
72. Rust N.C., DiCarlo J.J. Selectivity and tolerance ('invariance') both increase as visual information propagates from cortical area V4 to IT. J. Neurosci. 2010, 30:12978-12995.
73. Zoccolan D., et al. Multiple object response normalization in monkey inferotemporal cortex. J. Neurosci. 2005, 25:8150-8164.
74. Reddy L., Kanwisher N. Category selectivity in the ventral visual pathway confers robustness to clutter and diverted attention. Curr. Biol. 2007, 2067-2072.
75. Reddy L., et al. Attention and biased competition in multi-voxel object representations. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:21447-21452.
76. MacEvoy S.P., Epstein R.A. Decoding the representation of multiple simultaneous objects in human occipitotemporal cortex. Curr. Biol. 2009, 19:943-947.
77. Carandini M., Heeger D.J. Normalization as a canonical neural computation. Nat. Rev. Neurosci. 2012, 13:51-62.
78. Said C.P., et al. Distributed representations of dynamic facial expressions in the superior temporal sulcus. J. Vis. 2010, 10:1-12.
79. Peelen M.V., et al. Supramodal representations of perceived emotions in the human brain. J. Neurosci. 2010, 30:10127-10134.
80. Carlin J.D., et al. A head view-invariant representation of gaze direction in anterior superior temporal sulcus. Curr. Biol. 2011, 21:1817-1821.
81. Lee S.H., et al. Disentangling visual imagery and perception of real-world objects. Neuroimage 2012, 4:4064-4073.
82. Stokes M., et al. Top-down activation of shape-specific population codes in visual cortex during mental imagery. J. Neurosci. 2009, 29:1565-1572.
83. Cichy R.M., et al. Imagery and perception share cortical representations of content and location. Cereb. Cortex 2012, 22:372-380.
84. Giordano B.L., et al. Abstract encoding of auditory objects in cortical activity patterns. Cereb. Cortex 2013, 10.1093/cercor/bhs162.
85. Staeren N., et al. Sound categories are represented as distributed patterns in the human auditory cortex. Curr. Biol. 2009, 19:498-502.
86. Chang E.F., et al. Categorical speech representation in human superior temporal gyrus. Nat. Neurosci. 2010, 13:1428-1432.
87. Raizada R.D.S., et al. Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: prediction of individual differences. Cereb. Cortex 2010, 20:1-12.
88. Howard J.D., et al. Odor quality coding and categorization in human posterior piriform cortex. Nat. Neurosci. 2009, 12:932-938.
89. Polyn S.M., et al. Category-specific cortical activity precedes retrieval during memory search. Science 2005, 310:1963-1966.
90. Xue G., et al. Greater neural pattern similarity across repetitions is associated with better memory. Science 2010, 330:97-101.
91. Schurger A., et al. Reproducibility distinguishes conscious from nonconscious neural representations. Science 2010, 327:97-99.
92. LaRocque K.F., et al. Global similarity and pattern separation in the human medial temporal lobe predict subsequent memory. J. Neurosci. 2013, 33:5466-5474.
93. Staresina B.P., et al. Episodic reinstatement in the medial temporal lobe. J. Neurosci. 2012, 32:18150-18156.
94. Ritchey M., et al. Neural similarity between encoding and retrieval is related to memory via hippocampal interactions. Cereb. Cortex 2013, 10.1093/cercor/bhs258.
95. Visser R.M., et al. Associative learning increases trial-by-trial similarity of BOLD-MRI patterns. J. Neurosci. 2011, 31:12021-12028.
96. Visser R.M., et al. Neural pattern similarity predicts long-term fear memory. Nat. Neurosci. 2013, 16:388-390.
97. Georgopoulos A.P., et al. Neuronal population coding of movement direction. Science 1986, 233:1416-1419.
98. Wiestler T., et al. Integration of sensory and motor representations of single fingers in the human cerebellum. J. Neurophysiol. 2011, 105:3042-3053.
99. Diedrichsen J., et al. Two distinct ipsilateral cortical representations for individuated finger movements. Cereb. Cortex 2013, 23:1362-1377.
100. Kriegeskorte N., et al. Information-based functional brain mapping. Proc. Natl. Acad. Sci. U.S.A. 2006, 103:3863-3868.
101. Kievit R.A., et al. Mind the gap: a psychometric approach to the reduction problem. Psychol. Inq. 2011, 22:67-87.
102. Carlson T.A., et al. High temporal resolution decoding of object position and category. J. Vis. 2011, 11:1-17.
103. Su L., et al. Spatiotemporal searchlight representational similarity analysis in EMEG source space. Proceedings of the 2012 IEEE Workshop on Pattern Recognition in Neuroimaging 2012, 97-100. IEEE.
104. Carlson T.A., et al. Representational dynamics of object vision: the first 1000ms. J. Vis 2013, (in press).
105. Diedrichsen J., et al. Comparing the similarity and spatial structure of neural representations: a pattern-component model. Neuroimage 2011, 55:1665-1678.
106. Poggio T., Girosi F. Regularization algorithms for learning that are equivalent to multilayer networks. Science 1990, 247:978-982.
107. Rullen R.V., Thorpe S.J. Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 2001, 13:1255-1283.
108. Fries P., et al. The gamma cycle. Trends Neurosci. 2007, 30:309-316.
109. Houghton C., Victor J. Measuring representational distances - the spike-train metrics approach. Visual Population Codes - Toward a Common Multivariate Framework for Cell Recording and Functional Imaging 2010, 391-416. MIT Press. N. Kriegeskorte, G. Kreiman (Eds.).
110. Raizada R.D.S., Connolly A.C. What makes different people's representations alike: neural similarity-space solves the problem of across-subject fMRI decoding. J. Cogn. Neurosci. 2012, 24:868-877.
111. Shinkareva S.V., et al. Exploring commonalities across participants in the neural representation of objects. Hum. Brain. Mapp. 2012, 33:1375-1383.
112. Dumoulin S.O., Wandell B.A. Population receptive field estimates in human visual cortex. Neuroimage 2008, 39:647-660.
113. Cauda F., et al. Shared 'core' areas between the pain and other task-related networks. PLoS ONE 2012, 7:e41929.
114. Yarkoni T., et al. Large-scale automated synthesis of human functional neuroimaging data. Nat. Methods 2011, 8:665-670.