A Model of Representational Spaces in Human Cortex

Cerebral Cortex

Volumn 26, Issue 6, 2016, Pages 2919-2934

  Guntupalli, J Swaroop ^a   Hanke, Michael ^b   Halchenko, Yaroslav O ^a   Connolly, Andrew C ^a   Ramadge, Peter J ^c   Haxby, James V ^a,d  

^a Dartmouth College   (United States)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

^c Princeton University   (United States)

^d UNIVERSITY OF TRENTO   (Italy)

Author keywords

Functional magnetic resonance imaging (fMRI); Hyperalignment; Multivariate pattern analysis (MVPA); Neural decoding; Representational similarity analysis (RSA)

Indexed keywords

ADULT; ANATOMICAL CONCEPTS; ARTICLE; BRAIN CORTEX; BRAIN SIZE; COGNITION; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GRAY MATTER; HEAD MOVEMENT; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NONHUMAN; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; VISUAL CORTEX; YOUNG ADULT; ALGORITHM; BIOLOGICAL MODEL; BRAIN MAPPING; DIAGNOSTIC IMAGING; HEARING; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; STATISTICAL MODEL; VISION;

ALGORITHMS; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; HUMANS; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEUROPSYCHOLOGICAL TESTS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84974627389     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhw068     Document Type: Article

References (53)

1. Amunts K, Lepage C, Borgeat L, Mohlberg H, Dickscheid T, Rousseau M-É, Bludau S, Bazin P-L, Lewis LB, Oros-Peusquens A-M, et al. 2013. BigBrain: An ultra-high resolution 3D human brain model. Science. 340:1472-1475.
2. Carlin JD, Calder AJ, Kriegeskorte N, Nili NH, Rowe JB. 2011. A head view-invariant representation of gaze direction in anterior superior temporal sulcus. Curr Biol. 21:1817-1821.
3. CaseyM, Thompson J, Kang O, Raizada R, Wheatley T. 2011. Population codes representing musical timbre for high-level fMRI categorization of music genres. In: Langs G, Rish I, Grosse-Wentrup M, Murphy B, editors. Machine Learning and Interpretation in Neuroimaging. Berlin (Germany): Springer. p. 34-41.
4. Chen Y, Namburi P, Elliott LT, Heinzle J, Soon CS, Chee MWL. 2011. Cortical surface-based searchlight decoding. Neuroimage. 56:582-592.
5. Cichy RM, Pantazis D, Oliva A. 2014. Resolving human object recognition in space and time. Nat Neurosci. 17:455-462.
6. Connolly AC, Guntupalli JS, Gors J, Hanke M, Halchenko YO, WuYC, Abdi H, Haxby JV. 2012. The representation of biological classes in the human brain. J Neurosci. 32:2608-2618.
7. Conroy BR, Singer BD, Haxby JV, Ramadge PR. 2009. MRI-Based inter-subject cortical alignment using functional connectivity. In: Bengio Y, Schuurmans D, Lafferty J, Williams CKI, Culotta A, editors. Advances in Neural Information Processing Systems. Vol. 22, p. 378-386.
8. Conroy BR, Singer BD, Guntupalli JS, Ramadge PR, Haxby JV. 2013. Inter-subject alignment of human cortical anatomy using functional connectivity. Neuroimage. 81:400-411.
9. Cortes C, Vapnik V. 1995. Support-vector networks. Mach Learn. 20:273-297.
10. Cox DD, Savoy RL. 2003. Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage. 19:261-270.
11. Cox RW. 1996. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res. 29:162-173.
12. Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, Dale AM, Maquire RP, Hyman BT, et al. 2006. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage. 31:968-980.
13. Downing PE, Jiang Y, Shuman M, Kanwisher N. 2001. A cortical area selective for visual processing of the human body. Science. 293:2470-2473.
14. Epstein R, Kanwisher N. 1998. A cortical representation of the local visual environment. Nature. 392:598-601.
15. Fischl B, Sereno MI, Tootell RBH, Dale AM. 1999. High-resolution intersubject averaging and a coordinate system for the cortical surface. Hum Brain Mapp. 8:272-284.
16. Formisano E, De Martino F, Bonte M, Goebel R. 2008. "Who" is saying "What"? Brain-based decoding of human voice and speech. Science. 322:970-973.
17. Gordon EM, Laumann TO, Adeyemo B, Huckins JF, Kelley WM, Petersen SE. 2016. Generation and evaluation of a cortical area parcellation from resting-state correlations. Cereb Cortex. 26:288-303.
18. Grill-Spector K, Weiner KS. 2014. The functional architecture of the ventral temporal cortex and its role in categorization. Nat Rev Neurosci. 15:536-548.
19. Halchenko YO, Hanke M. 2012. Open is not enough. Let's take the next step: An integrated, community-driven computing platform for neuroscience. Front Neuroinformatics. 6:22.
20. Hanke M, Halchenko YO, Sederberg PB, Hanson SJ, Haxby JV, Pollman S. 2009. PyMVPA: A Python toolbox for multivariate pattern analysis of fMRI data. Neuroinformatics. 7:37-53.
21. Hasson U, Malach R, Heeger DJ. 2010. Reliability of cortical activity during natural stimulation. Trends Cogn Sci. 14:40-48.
22. Haxby JV, Connolly AC, Guntupalli JS. 2014. Decoding neural representational spaces using multivariate pattern analysis. Annu Rev Neurosci. 37:435-456.
23. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P. 2001. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science. 293:2425-2430.
24. Haxby JV, Guntupalli JS, Connolly AC, Halchenko YO, Conroy BR, Gobbini MI, Hanke M, Ramadge PJ. 2011. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron. 72:404-416.
25. Huth AG, Nishimoto S, Vu AT, Gallant JL. 2012. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron. 76:1210-1224.
26. Kanwisher N. 2010. Functional specificity in the human brain: A window into the functional architecture of the mind. Proc Natl Acad Sci U S A. 107:11163-11170.
27. Kanwisher N, McDermott J, Chun MM. 1997. The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci. 17:4302-4311.
28. Kay KN, Naselaris T, Prenger RJ, Gallant JL. 2008. Identifying natural images from human brain activity. Nature. 452:352-355.
29. Khaligh-Razavi S-M, Kriegeskorte N. 2014. Deep supervised, but not unsupervised, models explain IT representation. PLoS Comput Biol. 10:1-29.
30. Kirby KN, Gerlanc D. 2013. BootES: An R package for bootstrap confidence intervals on effect sizes. Behav Res. 45:905-927.
31. KriegeskorteN, Goebel R, Bandettini P. 2006. Information-based functional brain mapping. Proc Natl Acad Sci U S A. 103:3863-3868.
32. Kriegeskorte N, Kievit RA. 2013. Representational geometry: integrating cognition, computation, and the brain. Trends Cogn Sci. 17:401-412.
33. Kriegeskorte N, Mur M, Bandettini P. 2008. Representational similarity analysis-connecting the branches of systems neuroscience. Front Syst Neurosci. 2:4.
34. Kriegeskorte N, Mur M, Ruff DA, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA. 2008. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron. 60:1126-1141.
35. LaumannTO, GordonEM, AdeyemoB, Snyder AZ, Joo SJ, ChenM-Y, Gilmoe AW, McDermott KB, Nelson SM, Dosenbach NUF, et al. 2015. Functional system and areal organization of a highly sampled individual human brain. Neuron. 87:1-14.
36. Malach R, Reppas JB, Benson RR, Kwong KK, Jiang H, KennedyWA, Ledden PJ, Brady TJ, Rosen BR, Tootell RBH. 1995. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci U S A. 92:8135-8139.
37. Mitchell TM, Shinkareva SV, Carlson A, Chang KM, Malave VL, Mason RA, Just MA. 2008. Predicting human brain activity associated with the meanings of nouns. Science. 320:1191-1195.
38. Naselaris T, Kay KN, Nishimoto S, Gallant JL. 2010. Encoding and decoding in fMRI. Neuroimage. 56:400-410.
39. Naselaris T, Prenger RJ, Kay KN, Oliver M, Gallant JL. 2009. Bayesian reconstruction of natural images fromhuman brain Activity. Neuron. 63:902-915.
40. Nishimoto S, Vu AT, Naselaris T, Benjamini Y, Yu B, Gallant JL. 2011. Reconstructing visual experiences from brain activity evoked by natural movies. Curr Biol. 21:1641-1646.
41. Oosterhof NN, Tipper SP, Downing PE. 2013. Cross-modal and action specific: neuroimaging the human mirror neuron system. Trends Cogn Sci. 17:311-318.
42. Oosterhof NN, Wiestler T, Downing PE, Diedrichsen J. 2011. A comparison of volume-based and surface-based multi-voxel pattern analysis. Neuroimage. 56:593-600.
43. Oosterhof NN, Wiggett AJ, Diedrichsen J, Tipper SP, Downing PE. 2010. Surface-based information mapping reveals crossmodal vision-action representations in human parietal and occipitotemporal cortex. J Neurophysiol. 104:1077-1089.
44. Peelen MV, Downing PE. 2005. Selectivity for the human body in the fusiform gyrus. J Neurophysiol. 93:603-608.
45. Power JD, Cohen AL, Nelson SM, Wig GS, Barnes KA, Church JA, Vogel AC, Laumann TO, Miezin FM, Schlaggar BL, et al. 2011. Functional network organization of the human brain. Neuron. 72:665-678.
46. Saad ZS, Reynolds RC, Argall B, Japee S, Cox RW. 2004. in IEEE International Symposium on Biomedical Imaging: Nano to Macro. 2:1510-1513.
47. Sabuncu M, Singer BD, Conroy B, Bryan RE, Ramadge PJ, Haxby JV 2010. Function-based intersubject alignment of human cortical anatomy. Cereb Cortex. 20:130-140.
48. Said CS, Moore CD, Engell AD, Todorov AD, Haxby JV. 2010. Distributed representations of dynamic facial expressions in the superior temporal sulcus. J Vis. 10:1-12.
49. Schönemann PH. 1966. A generalized solution of the orthogonal Procrustes problem. Psychometrika. 31:1-10.
50. Sereno MI, Dale AM, Reppas JB, Kwong KK, Belliveau JW, Brady TJ, Rosen BR, Tootell RB. 1995. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science. 268:889-893.
51. Sporns O. 2015. Cerebral cartography and connectomics. Philos Trans R Soc Lond B. 370:20140173.
52. Yarkoni T, Poldrack RA, Nichols TE, Van Essen DC, Wager TD. 2011. Large-scale automated synthesis of human functional neuroimaging data. Nat Methods. 8:665-670.
53. Yeo BT, Krienen FM, Sepulcre J, Sabuncu MR, Lashkari D, HollinsheadM, Roffman JL, Smoller JW, Zöllei L, Polimeni JR, et al. 2011. The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J Neurophysiol. 106:1125-1165.