A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain

Neuron

Volumn 76, Issue 6, 2012, Pages 1210-1224

  Huth, Alexander G ^a   Nishimoto, Shinji ^a   Vu, An T ^a   Gallant, Jack L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; BRAIN MAPPING; BRAIN REGION; EVOKED RESPONSE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NERVE STIMULATION; NEUROANATOMY; NORMAL HUMAN; PRIORITY JOURNAL; VISUAL CORTEX; VOXEL BASED MORPHOMETRY;

ADULT; BRAIN MAPPING; CEREBRAL CORTEX; CONCEPT FORMATION; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; REFERENCE VALUES; SEMANTICS; VERBAL BEHAVIOR;

EID: 84871373265     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2012.10.014     Document Type: Article

References (57)

1. Adelson E.H., Bergen J.R. Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am. A 1985, 2:284-299.
2. Aguirre G.K., Zarahn E., D'Esposito M. An area within human ventral cortex sensitive to " building" stimuli: evidence and implications. Neuron 1998, 21:373-383.
3. Avidan G., Hasson U., Malach R., Behrmann M. Detailed exploration of face-related processing in congenital prosopagnosia: 2. Functional neuroimaging findings. J. Cogn. Neurosci. 2005, 17:1150-1167.
4. Bartels A., Zeki S. Functional brain mapping during free viewing of natural scenes. Hum. Brain Mapp. 2004, 21:75-85.
5. Buccino G., Binkofski F., Fink G.R., Fadiga L., Fogassi L., Gallese V., Seitz R.J., Zilles K., Rizzolatti G., Freund H.J. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 2001, 13:400-404.
6. Büchel C., Josephs O., Rees G., Turner R., Frith C.D., Friston K.J. The functional anatomy of attention to visual motion. A functional MRI study. Brain 1998, 121:1281-1294.
7. Calvert G.A., Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 2003, 15:57-70.
8. Chao L.L., Haxby J.V., Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat. Neurosci. 1999, 2:913-919.
9. Clark V.P., Keil K., Maisog J.M., Courtney S., Ungerleider L.G., Haxby J.V. Functional magnetic resonance imaging of human visual cortex during face matching: a comparison with positron emission tomography. Neuroimage 1996, 4:1-15.
10. Cohen L., Dehaene S., Naccache L., Lehéricy S., Dehaene-Lambertz G., Hénaff M.A., Michel F. The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. Brain 2000, 123:291-307.
11. Connolly A.C., Guntupalli J.S., Gors J., Hanke M., Halchenko Y.O., Wu Y.-C., Abdi H., Haxby J.V. The representation of biological classes in the human brain. J. Neurosci. 2012, 32:2608-2618.
12. Downar J., Crawley A.P., Mikulis D.J., Davis K.D. A cortical network sensitive to stimulus salience in a neutral behavioral context across multiple sensory modalities. J. Neurophysiol. 2002, 87:615-620.
13. Downing P.E., Jiang Y., Shuman M., Kanwisher N. A cortical area selective for visual processing of the human body. Science 2001, 293:2470-2473.
14. Downing P.E., Chan A.W.Y., Peelen M.V., Dodds C.M., Kanwisher N. Domain specificity in visual cortex. Cereb. Cortex 2006, 16:1453-1461.
15. Edelman S., Grill-Spector K., Kushnir T., Malach R. Toward direct visualization of the internal shape representation space by fMRI. Psychobiology 1998, 26:309-321.
16. Engel S.A., Glover G.H., Wandell B.A. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb. Cortex 1997, 7:181-192.
17. Epstein R., Kanwisher N. A cortical representation of the local visual environment. Nature 1998, 392:598-601.
18. Fox C.J., Iaria G., Barton J.J.S. Defining the face processing network: optimization of the functional localizer in fMRI. Hum. Brain Mapp. 2009, 30:1637-1651.
19. Halgren E., Dale A.M., Sereno M.I., Tootell R.B.H., Marinkovic K., Rosen B.R. Location of human face-selective cortex with respect to retinotopic areas. Hum. Brain Mapp. 1999, 7:29-37.
20. Hansen K.A., Kay K.N., Gallant J.L. Topographic organization in and near human visual area V4. J. Neurosci. 2007, 27:11896-11911.
21. Hasson U., Nir Y., Levy I., Fuhrmann G., Malach R. Intersubject synchronization of cortical activity during natural vision. Science 2004, 303:1634-1640.
22. Hasson U., Yang E., Vallines I., Heeger D.J., Rubin N. A hierarchy of temporal receptive windows in human cortex. J. Neurosci. 2008, 28:2539-2550.
23. Hauk O., Johnsrude I., Pulvermüller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 2004, 41:301-307.
24. Haxby J.V., Guntupalli J.S., Connolly A.C., Halchenko Y.O., Conroy B.R., Gobbini M.I., Hanke M., Ramadge P.J. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 2011, 72:404-416.
25. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
26. Hsu A., Borst A., Theunissen F.E. Quantifying variability in neural responses and its application for the validation of model predictions. Network 2004, 15:91-109.
27. Iacoboni M., Lieberman M.D., Knowlton B.J., Molnar-Szakacs I., Moritz M., Throop C.J., Fiske A.P. Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline. Neuroimage 2004, 21:1167-1173.
28. Jenkinson M., Smith S. A global optimisation method for robust affine registration of brain images. Med. Image Anal. 2001, 5:143-156.
29. Jones, E., Oliphant, T. E., and Peterson, P. (2001). SciPy: Open Source Scientific Tools for Python. http://www.scipy.org.
30. Just M.A., Cherkassky V.L., Aryal S., Mitchell T.M. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PLoS ONE 2010, 5:e8622.
31. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
32. Kay K.N., Naselaris T., Prenger R.J., Gallant J.L. Identifying natural images from human brain activity. Nature 2008, 452:352-355.
33. Konkle T., Oliva A. A real-world size organization of object responses in occipitotemporal cortex. Neuron 2012, 74:1114-1124.
34. Kriegeskorte N., Mur M., Ruff D.A., Kiani R., Bodurka J., Esteky H., Tanaka K., Bandettini P.A. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 2008, 60:1126-1141.
35. McCarthy G., Puce A., Gore J.C., Allison T. Face-specific processing in the human fusiform gyrus. J. Cogn. Neurosci. 1997, 9:605-610.
36. Miller G.A. WordNet: a lexical database for English. Commun. ACM 1995, 38:39-41.
37. Mitchell T.M., Shinkareva S.V., Carlson A., Chang K.-M., Malave V.L., Mason R.A., Just M.A. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320:1191-1195.
38. Nakamura K., Kawashima R., Sato N., Nakamura A., Sugiura M., Kato T., Hatano K., Ito K., Fukuda H., Schormann T., Zilles K. Functional delineation of the human occipito-temporal areas related to face and scene processing. A PET study. Brain 2000, 123:1903-1912.
39. Naselaris T., Prenger R.J., Kay K.N., Oliver M., Gallant J.L. Bayesian reconstruction of natural images from human brain activity. Neuron 2009, 63:902-915.
40. Nishimoto S., Vu A.T., Naselaris T., Benjamini Y., Yu B., Gallant J.L. Reconstructing visual experiences from brain activity evoked by natural movies. Curr. Biol. 2011, 21:1641-1646.
41. O'Toole A.J., Jiang F., Abdi H., Haxby J.V. Partially distributed representations of objects and faces in ventral temporal cortex. J. Cogn. Neurosci. 2005, 17:580-590.
42. Oliphant T.E. Guide to NumPy 2006, Brigham Young University, Provo, UT.
43. Op de Beeck H.P., Haushofer J., Kanwisher N.G. Interpreting fMRI data: maps, modules and dimensions. Nat. Rev. Neurosci. 2008, 9:123-135.
44. Op de Beeck H.P., Brants M., Baeck A., Wagemans J. Distributed subordinate specificity for bodies, faces, and buildings in human ventral visual cortex. Neuroimage 2010, 49:3414-3425.
45. Peelen M.V., Downing P.E. Selectivity for the human body in the fusiform gyrus. J. Neurophysiol. 2005, 93:603-608.
46. Peelen M.V., Wiggett A.J., Downing P.E. Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion. Neuron 2006, 49:815-822.
47. Pelphrey K.A., Morris J.P., Michelich C.R., Allison T., McCarthy G. Functional anatomy of biological motion perception in posterior temporal cortex: an FMRI study of eye, mouth and hand movements. Cereb. Cortex 2005, 15:1866-1876.
48. Poldrack R.A., Wagner A.D., Prull M.W., Desmond J.E., Glover G.H., Gabrieli J.D.E. Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. Neuroimage 1999, 10:15-35.
49. Raichle M.E., MacLeod A.M., Snyder A.Z., Powers W.J., Gusnard D.A., Shulman G.L. A default mode of brain function. Proc. Natl. Acad. Sci. USA 2001, 98:676-682.
50. Rajimehr R., Young J.C., Tootell R.B.H. An anterior temporal face patch in human cortex, predicted by macaque maps. Proc. Natl. Acad. Sci. USA 2009, 106:1995-2000.
51. Schwarzlose R.F., Baker C.I., Kanwisher N.G. Separate face and body selectivity on the fusiform gyrus. J. Neurosci. 2005, 25:11055-11059.
52. Smith A.T., Greenlee M.W., Singh K.D., Kraemer F.M., Hennig J. The processing of first- and second-order motion in human visual cortex assessed by functional magnetic resonance imaging (fMRI). J. Neurosci. 1998, 18:3816-3830.
53. Spiridon M., Fischl B., Kanwisher N. Location and spatial profile of category-specific regions in human extrastriate cortex. Hum. Brain Mapp. 2006, 27:77-89.
54. Tsao D.Y., Moeller S., Freiwald W.A. Comparing face patch systems in macaques and humans. Proc. Natl. Acad. Sci. USA 2008, 105:19514-19519.
55. Ungerleider L.G., Mishkin M. Two cortical visual systems. Analysis of Visual Behavior 1982, 549-596. MIT Press, Cambridge, MA. D.J. Ingle, M.A. Goodale, R.J.W. Masfield (Eds.).
56. Van Essen D.C., Drury H.A., Dickson J., Harwell J., Hanlon D., Anderson C.H. An integrated software suite for surface-based analyses of cerebral cortex. J. Am. Med. Inform. Assoc. 2001, 8:443-459.
57. Watson A.B., Ahumada A.J. Model of human visual-motion sensing. J. Opt. Soc. Am. A 1985, 2:322-341.