Natural speech reveals the semantic maps that tile human cerebral cortex

Nature

Volumn 532, Issue 7600, 2016, Pages 453-458

  Huth, Alexander G ^a   De Heer, Wendy A ^a   Griffiths, Thomas L ^a   Theunissen, Frédéric E ^a   Gallant, Jack L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATLAS; BRAIN; CELLS AND CELL COMPONENTS; CONNECTIVITY; LANGUAGE; MAPPING METHOD; NUMERICAL METHOD;

ADULT; ARTICLE; AUDITORY CORTEX; BOLD SIGNAL; BRAIN CORTEX; BRAIN MAPPING; BROCA AREA; COMPREHENSION; CONNECTOME; DEFAULT MODE NETWORK; EXTRASTRIATE BODY AREA; FEMALE; FRONTAL EYE FIELD; FUNCTIONAL ANATOMY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; FUSIFORM FACE AREA; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MALE; NEUROANATOMY; NORMAL HUMAN; OCCIPITAL FACE AREA; PARAHIPPOCAMPAL PLACE AREA; PRIORITY JOURNAL; RETROSPLENIAL CORTEX; SECONDARY SOMATOSENSORY CORTEX; SEMANTICS; SOCIAL INTERACTION; SOMATOSENSORY CORTEX; SPEECH; ANATOMY AND HISTOLOGY; HEARING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PRINCIPAL COMPONENT ANALYSIS; REPRODUCIBILITY; VERBAL COMMUNICATION;

ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NARRATION; PRINCIPAL COMPONENT ANALYSIS; REPRODUCIBILITY OF RESULTS; SEMANTICS; SPEECH;

EID: 84964849126     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature17637     Document Type: Article

References (38)

1. Binder, J. R., Desai, R. H., Graves, W. W. & Conant, L. L. Where is the semantic system? A critical review and meta-Analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767-2796 (2009).
2. Lerner, Y., Honey, C. J., Silbert, L. J. & Hasson, U. Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. J. Neurosci. 31, 2906-2915 (2011).
3. Friederici, A. D., Opitz, B. & von Cramon, D. Y. Segregating semantic and syntactic aspects of processing in the human brain: an fMRI investigation of different word types. Cereb. Cortex 10, 698-705 (2000).
4. Noppeney, U. & Price, C. J. Retrieval of abstract semantics. Neuroimage 22, 164-170 (2004).
5. Binder, J. R., Westbury, C. F., McKiernan, K. A., Possing, E. T. & Medler, D. A. Distinct brain systems for processing concrete and abstract concepts. J. Cogn. Neurosci. 17, 905-917 (2005).
6. Bedny, M., Caramazza, A., Grossman, E., Pascual-Leone, A. & Saxe, R. Concepts are more than percepts: the case of action verbs. J. Neurosci. 28, 11347-11353 (2008).
7. Saxe, R. & Kanwisher, N. People thinking about thinking people. The role of the temporo-parietal junction in "theory of mind". Neuroimage 19, 1835-1842 (2003).
8. Caramazza, A. & Shelton, J. R. Domain-specific knowledge systems in the brain the animate-inanimate distinction. J. Cogn. Neurosci. 10, 1-34 (1998).
9. Mummery, C. J., Patterson, K., Hodges, J. R. & Price, C. J. Functional neuroanatomy of the semantic system: divisible by what? J. Cogn. Neurosci. 10, 766-777 (1998).
10. Just, M. A., Cherkassky, V. L., Aryal, S. & Mitchell, T. M. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PLoS ONE 5, e8622 (2010).
11. Warrington, E. K. The selective impairment of semantic memory. Q. J. Exp. Psychol. 27, 635-657 (1975).
12. Mitchell, T. M. et al. Predicting human brain activity associated with the meanings of nouns. Science 320, 1191-1195 (2008).
13. Damasio, H., Grabowski, T. J., Tranel, D., Hichwa, R. D. & Damasio, A. R. A neural basis for lexical retrieval. Nature 380, 499-505 (1996).
14. Huth, A. G., Nishimoto, S., Vu, A. T. & Gallant, J. L. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76, 1210-1224 (2012).
15. Wehbe, L. et al. Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses. PLoS ONE 9, e112575 (2014).
16. Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M. & Gallant, J. L. Bayesian reconstruction of natural images from human brain activity. Neuron 63, 902-915 (2009).
17. Nishimoto, S. et al. Reconstructing visual experiences from brain activity evoked by natural movies. Curr. Biol. 21, 1641-1646 (2011).
18. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K. & Harshman, R. Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41, 391-407 (1990).
19. Lund, K. & Burgess, C. Producing high-dimensional semantic spaces from lexical co-occurrence. Behav. Res. Methods Instrum. Comput. 28, 203-208 (1996).
20. Turney, P. D. & Pantel, P. From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 37, 141-188 (2010).
21. Caramazza, A. & Mahon, B. Z. The organisation of conceptual knowledge in the brain: the future's past and some future directions. Cogn. Neuropsychol. 23, 13-38 (2006).
22. Huth, A. G., Griffiths, T. L., Theunissen, F. E. & Gallant, J. L. PrAGMATiC: a probabilistic and generative model of areas tiling the cortex. Preprint at http://arxiv.org/abs/1504.03622 (2015).
23. Amunts, K., Malikovic, A., Mohlberg, H., Schormann, T. & Zilles, K. Brodmann's areas 17 and 18 brought into stereotaxic space-where and how variable? Neuroimage 11, 66-84 (2000).
24. Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S. & Kanwisher, N. New method for fMRI investigations of language: defining ROIs functionally in individual subjects. J. Neurophysiol. 104, 1177-1194 (2010).
25. Hinton, G. E. Training products of experts by minimizing contrastive divergence. Neural Comput. 14, 1771-1800 (2002).
26. Buckner, R. L., Andrews-Hanna, J. R. & Schacter, D. L. The brain's default network: anatomy, function, and relevance to disease. Ann. NY Acad. Sci. 1124, 1-38 (2008).
27. DeWitt, I. & Rauschecker, J. P. Phoneme and word recognition in the auditory ventral stream. Proc. Natl Acad. Sci. USA 109, E505-E514 (2012).
28. Riesenhuber, M. Appearance isn't everything: news on object representation in cortex. Neuron 55, 341-344 (2007).
29. Dehaene, S., Cohen, L., Sigman, M. & Vinckier, F. The neural code for written words: a proposal. Trends Cogn. Sci. 9, 335-341 (2005).
30. Op de Beeck, H. P., Haushofer, J. & Kanwisher, N. G. Interpreting fMRI data: maps, modules and dimensions. Nature Rev. Neurosci. 9, 123-135 (2008).
31. Caspers, S. et al. Organization of the human inferior parietal lobule based on receptor architectonics. Cereb. Cortex 23, 615-628 (2013).
32. Cohen, A. L. et al. Defining functional areas in individual human brains using resting functional connectivity MRI. Neuroimage 41, 45-57 (2008).
33. Yuan, J. & Liberman, M. Speaker identification on the SCOTUS corpus. Proc. Acoust. Preprint at http://www.ling.upenn.edu/~jiahong/publications/c09.pdf (2008).
34. Boersma, P. & Weenink, D. Praat: doing phonetics by computer (University of Amsterdam, 2014).
35. Benjamini, Y. & Hochberg, Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B 57, 289-300 (1995).
36. Oliphant, T. E. Guide to NumPy (Brigham Young University, 2006).
37. Jones, E., Oliphant, T. E. & Peterson, P. SciPy: Open source scientific tools for Python (SciPy, 2001).
38. Gao, J. S., Huth, A. G., Lescroart, M. D. & Gallant, J. L. Pycortex: an interactive surface visualizer for fMRI. Front. Neuroinform. 9, 23 (2015).