Who is That? Brain Networks and Mechanisms for Identifying Individuals

Trends in Cognitive Sciences

Volumn 19, Issue 12, 2015, Pages 783-796

  Perrodin, Catherine ^a,b   Kayser, Christoph ^c   Abel, Taylor J ^d   Logothetis, Nikos K ^a,e   Petkov, Christopher I ^f  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF GLASGOW   (United Kingdom)

^d UNIVERSITY OF IOWA   (United States)

^e UNIVERSITY OF MANCHESTER   (United Kingdom)

^f NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Face; Human; Identity; Multisensory; Primate; Temporal lobe; Voice

Indexed keywords

MAMMALS; NEURONS; SPEECH; SYNTHESIS (CHEMICAL);

FACE; HUMAN; IDENTITY; MULTISENSORY; PRIMATE; TEMPORAL LOBES;

ANIMALS;

ANIMAL EXPERIMENT; ANIMAL MODEL; BRAIN; DISEASE MODEL; HAPLORHINI; HUMAN VERSUS ANIMAL COMPARISON; IDENTITY; MODEL; NONHUMAN; SYNTHESIS; TEMPORAL LOBE; VOICE; WRITING; ANIMAL; AUDITORY STIMULATION; BIOLOGICAL MODEL; BRAIN MAPPING; HEARING; HEMISPHERIC DOMINANCE; HUMAN; NERVE TRACT; PHOTOSTIMULATION; PHYSIOLOGY;

ACOUSTIC STIMULATION; ANIMALS; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; FUNCTIONAL LATERALITY; HUMANS; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; PHOTIC STIMULATION;

EID: 84951072042     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2015.09.002     Document Type: Review

References (123)

1. Bergman T.J., et al. Hierarchical classification by rank and kinship in baboons. Science 2003, 302:1234-1236.
2. Ghazanfar A.A., et al. Vocal-tract resonances as indexical cues in rhesus monkeys. Curr. Biol. 2007, 17:425-430.
3. Ghazanfar A.A., Schroeder C.E. Is neocortex essentially multisensory?. Trends Cogn. Sci. 2006, 10:278-285.
4. Blank H., et al. Person recognition and the brain: merging evidence from patients and healthy individuals. Neurosci. Biobehav. Rev. 2014, 47:717-734.
5. Belin P., et al. Understanding voice perception. Br. J. Psychol. 2011, 102:711-725.
6. Campanella S., Belin P. Integrating face and voice in person perception. Trends Cogn. Sci. 2007, 11:535-543.
7. Bruce V., Young A. Understanding face recognition. Br. J. Psychol. 1986, 77:305-327.
8. Haxby J.V., et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
9. Busigny T., et al. Face-specific impairment in holistic perception following focal lesion of the right anterior temporal lobe. Neuropsychologia 2014, 56:312-333.
10. Yang H., et al. The anterior temporal face area contains invariant representations of face identity that can persist despite the loss of right FFA and OFA. Cereb. Cortex 2014, Published online December 19, 2014. 10.1093/cercor/bhu289.
11. Collins J.A., Olson I.R. Beyond the FFA: the role of the ventral anterior temporal lobes in face processing. Neuropsychologia 2014, 61:65-79.
12. Gainotti G. Is the right anterior temporal variant of prosopagnosia a form of 'associative prosopagnosia' or a form of 'multimodal person recognition disorder'?. Neuropsychol. Rev. 2013, 23:99-110.
13. Van Lancker D.R., Canter G.J. Impairment of voice and face recognition in patients with hemispheric damage. Brain Cogn. 1982, 1:185-195.
14. Mathias S.R., von Kriegstein K. How do we recognise who is speaking?. Front. Biosci. (Schol. Ed.) 2014, 6:92.
15. Damasio H., et al. A neural basis for lexical retrieval. Nature 1996, 380:499-505.
16. Waldron E.J., et al. The left temporal pole is a heteromodal hub for retrieving proper names. Front. Biosci. (Schol. Ed.) 2014, 6:50.
17. Binder J.R., et al. Where Is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 2009, 19:2767-2796.
18. Patterson K., et al. Where do you know what you know? The representation of semantic knowledge in the human brain. Nat. Rev. Neurosci. 2007, 8:976-987.
19. Ralph M.A.L. Neurocognitive insights on conceptual knowledge and its breakdown. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2014, 369:20120392.
20. Hurley R.S., et al. Asymmetric connectivity between the anterior temporal lobe and the language network. J. Cogn. Neurosci. 2015, 27:464-473.
21. Bulthoff I., Newell F.N. Distinctive voices enhance the visual recognition of unfamiliar faces. Cognition 2015, 137:9-21.
22. O'Mahony C., Newell F.N. Integration of faces and voices, but not faces and names, in person recognition. Br. J. Psychol. 2012, 103:73-82.
23. Schweinberger S.R., Burton A.M. Covert recognition and the neural system for face processing. Cortex 2003, 39:9-30.
24. Pobric G., et al. Amodal semantic representations depend on both anterior temporal lobes: evidence from repetitive transcranial magnetic stimulation. Neuropsychologia 2010, 48:1336-1342.
25. Rogers T.T., et al. Structure and deterioration of semantic memory: a neuropsychological and computational investigation. Psychol. Rev. 2004, 111:205.
26. Abel T.J., et al. Direct physiologic evidence of a heteromodal convergence region for proper naming in human left anterior temporal lobe. J. Neurosci. 2015, 35:1513-1520.
27. Drane D.L., et al. Famous face identification in temporal lobe epilepsy: support for a multimodal integration model of semantic memory. Cortex 2013, 49:1648-1667.
28. Perrett D.I., et al. Visual neurones responsive to faces in the monkey temporal cortex. Exp. Brain Res. 1982, 47:329-342.
29. Bruce C., et al. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 1981, 46:369-384.
30. Kanwisher N., et al. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
31. Sergent J., et al. Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain 1992, 115:15-36.
32. Freiwald W.A., Tsao D.Y. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 2010, 330:845-851.
33. Ku S.P., et al. fMRI of the face-processing network in the ventral temporal lobe of awake and anesthetized macaques. Neuron 2011, 70:352-362.
34. Logothetis N.K., et al. Functional imaging of the monkey brain. Nat. Neurosci. 1999, 2:555-562.
35. Tsao D.Y., et al. A cortical region consisting entirely of face-selective cells. Science 2006, 311:670-674.
36. Tsao D.Y., Livingstone M.S. Mechanisms of face perception. Annu. Rev. Neurosci. 2008, 31:411-437.
37. Chechik G., Nelken I. Auditory abstraction from spectro-temporal features to coding auditory entities. Proc. Natl. Acad. Sci. U.S.A. 2012, 109:18968-18973.
38. Kikuchi Y., et al. Hierarchical auditory processing directed rostrally along the monkey's supratemporal plane. J. Neurosci. 2010, 30:13021-13030.
39. Bizley J.K., et al. Auditory cortex represents both pitch judgments and the corresponding acoustic cues. Curr. Biol. 2013, 23:620-625.
40. Romanski L.M., et al. Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. J. Neurophysiol. 2005, 93:734-747.
41. Rauschecker J.P., et al. Processing of complex sounds in the macaque nonprimary auditory cortex. Science 1995, 268:111-114.
42. Kajikawa Y., et al. Auditory properties in the parabelt regions of the superior temporal gyrus in the awake macaque monkey: an initial survey. J. Neurosci. 2015, 35:4140-4150.
43. Wang X., Kadia S.C. Differential representation of species-specific primate vocalizations in the auditory cortices of marmoset and cat. J. Neurophysiol. 2001, 86:2616-2620.
44. Recanzone G.H. Representation of con-specific vocalizations in the core and belt areas of the auditory cortex in the alert macaque monkey. J. Neurosci. 2008, 28:13184-13193.
45. Russ B.E., et al. Coding of auditory-stimulus identity in the auditory non-spatial processing stream. J. Neurophysiol. 2008, 99:87-95.
46. Poremba A., et al. Species-specific calls evoke asymmetric activity in the monkey's temporal poles. Nature 2004, 427:448-451.
47. Remedios R., et al. An auditory region in the primate insular cortex responding preferentially to vocal communication sounds. J. Neurosci. 2009, 29:1034-1045.
48. Gifford G.W., et al. The neurophysiology of functionally meaningful categories: macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. J. Cogn. Neurosci. 2005, 17:1471-1482.
49. Plakke B., Romanski L.M. Auditory connections and functions of prefrontal cortex. Front. Neurosci. 2014, 8:199.
50. Belin P., et al. Voice-selective areas in human auditory cortex. Nature 2000, 403:309-312.
51. Formisano E., et al. 'Who' is saying 'what'? Brain-based decoding of human voice and speech. Science 2008, 322:970-973.
52. Petkov C.I., et al. A voice region in the monkey brain. Nat. Neurosci. 2008, 11:367-374.
53. Andics A., et al. Voice-sensitive regions in the dog and human brain are revealed by comparative fMRI. Curr. Biol. 2014, 24:574-578.
54. Tsao D.Y., et al. Comparing face patch systems in macaques and humans. Proc. Natl. Acad. Sci. U.S.A. 2008, 105:19514-19519.
55. Kriegeskorte N., et al. Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:20600-20605.
56. Morin E.L., et al. Hierarchical encoding of social cues in primate inferior temporal cortex. Cereb. Cortex 2015, 25:3036-3045.
57. Andics A., et al. Neural mechanisms for voice recognition. Neuroimage 2010, 52:1528-1540.
58. von Kriegstein K., et al. Modulation of neural responses to speech by directing attention to voices or verbal content. Brain Res. Cogn. Brain Res. 2003, 17:48-55.
59. Chandrasekaran B., et al. Neural processing of what and who information in speech. J. Cogn. Neurosci. 2011, 23:2690-2700.
60. Belin P., Zatorre R.J. Adaptation to speaker's voice in right anterior temporal lobe. Neuroreport 2003, 14:2105-2109.
61. Blasi A., et al. Early specialization for voice and emotion processing in the infant brain. Curr. Biol. 2011, 21:1220-1224.
62. Grossmann T., et al. The developmental origins of voice processing in the human brain. Neuron 2010, 65:852-858.
63. Perrodin C., et al. Voice cells in the primate temporal lobe. Curr. Biol. 2011, 21:1408-1415.
64. Perrodin C., et al. Auditory and visual modulation of temporal lobe neurons in voice-sensitive and association cortices. J. Neurosci. 2014, 34:2524-2537.
65. Hasselmo M.E., et al. The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 1989, 32:203-218.
66. Stein B.E., Stanford T.R. Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 2008, 9:255-266.
67. Bizley J.K., et al. Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cereb. Cortex 2007, 17:2172-2189.
68. Werner S., Noppeney U. Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. J. Neurosci. 2010, 30:2662-2675.
69. Sugihara T., et al. Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J. Neurosci. 2006, 26:11138-11147.
70. Ghazanfar A.A., et al. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 2005, 25:5004-5012.
71. Perrodin C., et al. Natural asynchronies in audiovisual communication signals regulate neuronal multisensory interactions in voice-sensitive cortex. Proc. Natl. Acad. Sci. U.S.A. 2015, 112:273-278.
72. Chandrasekaran C., Ghazanfar A.A. Different neural frequency bands integrate faces and voices differently in the superior temporal sulcus. J. Neurophysiol. 2009, 101:773-788.
73. Ghazanfar A.A., et al. Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. J. Neurosci. 2008, 28:4457-4469.
74. Dahl C.D., et al. Spatial organization of multisensory responses in temporal association cortex. J. Neurosci. 2009, 29:11924-11932.
75. Ghazanfar A.A., Takahashi D.Y. The evolution of speech: vision, rhythm, cooperation. Trends Cogn. Sci. 2014, 18:543-553.
76. Watson R., et al. People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus. Cortex 2014, 50:125-136.
77. Beauchamp M.S., et al. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat. Neurosci. 2004, 7:1190-1192.
78. Bastos A.M., et al. Visual areas exert feedforward and feedback influences through distinct frequency channels. Neuron 2015, 85:390-401.
79. Chandrasekaran C., et al. Dynamic faces speed up the onset of auditory cortical spiking responses during vocal detection. Proc. Natl. Acad. Sci. U.S.A. 2013, 110:E4668-E4677.
80. Turesson H.K., et al. Category-selective phase coding in the superior temporal sulcus. Proc. Natl. Acad. Sci. U.S.A. 2012, 109:19438-19443.
81. Petkov C.I., et al. Different forms of effective connectivity in primate frontotemporal pathways. Nat. Commun. 2015, 6:6000.
82. Matsui T., et al. Direct comparison of spontaneous functional connectivity and effective connectivity measured by intracortical microstimulation: an fMRI study in macaque monkeys. Cereb. Cortex 2011, 21:2348-2356.
83. Saleem K.S., et al. Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J. Comp. Neurol. 2008, 506:659-693.
84. Frey S., et al. Orbitofrontal contribution to auditory encoding. Neuroimage 2004, 22:1384-1389.
85. Pascual B., et al. Large-scale brain networks of the human left temporal pole: a functional connectivity MRI study. Cereb. Cortex 2015, 25:680-702.
86. Binney R.J., et al. Convergent connectivity and graded specialization in the rostral human temporal lobe as revealed by diffusion-weighted imaging probabilistic tractography. J. Cogn. Neurosci. 2012, 24:1998-2014.
87. Pernet C.R., et al. The human voice areas: spatial organization and inter-individual variability in temporal and extra-temporal cortices. Neuroimage 2015, 119:164-174.
88. von Kriegstein K., et al. Interaction of face and voice areas during speaker recognition. J. Cogn. Neurosci. 2005, 17:367-376.
89. von Kriegstein K., Giraud A.L. Implicit multisensory associations influence voice recognition. PLoS Biol. 2006, 4:e326.
90. Schall S., et al. Early auditory sensory processing of voices is facilitated by visual mechanisms. Neuroimage 2013, 77:237-245.
91. Blank H., et al. Direct structural connections between voice- and face-recognition areas. J. Neurosci. 2011, 31:12906-12915.
92. Chan A.M., et al. First-pass selectivity for semantic categories in human anteroventral temporal lobe. J. Neurosci. 2011, 31:18119-18129.
93. Deen B., et al. Functional organization of social perception and cognition in the superior temporal sulcus. Cereb. Cortex 2015, Published online June 5, 2015. 10.1093/cercor/bhv111.
94. Quiroga R.Q., et al. Invariant visual representation by single neurons in the human brain. Nature 2005, 435:1102-1107.
95. Cervenka M.C., et al. Electrocorticographic functional mapping identifies human cortex critical for auditory and visual naming. Neuroimage 2013, 69:267-276.
96. Abel T.J., et al. Mapping the temporal pole with a specialized electrode array: technique and preliminary results. Physiol. Meas. 2014, 35:323-337.
97. Afraz S-R., et al. Microstimulation of inferotemporal cortex influences face categorization. Nature 2006, 442:692-695.
98. Bestelmeyer P.E., et al. Right temporal TMS impairs voice detection. Curr. Biol. 2011, 21:R838-R839.
99. Parvizi J., et al. Electrical stimulation of human fusiform face-selective regions distorts face perception. J. Neurosci. 2012, 32:14915-14920.
100. Fan L., et al. Connectivity-based parcellation of the human temporal pole using diffusion tensor imaging. Cereb. Cortex 2014, 24:3365-3378.
101. Munoz-Lopez M.M., et al. Anatomical pathways for auditory memory in primates. Front. Neuroanat. 2010, 4:129.
102. Fritz J., et al. In search of an auditory engram. Proc. Natl. Acad. Sci. U.S.A. 2005, 102:9359-9364.
103. Duncan J. The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn. Sci. 2010, 14:172-179.
104. Stoewer S., et al. Frontoparietal activity with minimal decision and control in the awake macaque at 7 T. Magn. Reson. Imaging 2010, 28:1120-1128.
105. Brennan P.A. The nose knows who's who: chemosensory individuality and mate recognition in mice. Horm. Behav. 2004, 46:231-240.
106. Kadohisa M., Wilson D.A. Separate encoding of identity and similarity of complex familiar odors in piriform cortex. Proc. Natl. Acad. Sci. U.S.A. 2006, 103:15206-15211.
107. Gire D.H., et al. Information for decision-making and stimulus identification is multiplexed in sensory cortex. Nat. Neurosci. 2013, 16:991-993.
108. Petrulis A., et al. Neural correlates of social odor recognition and the representation of individual distinctive social odors within entorhinal cortex and ventral subiculum. Neuroscience 2005, 130:259-274.
109. Okabe S., et al. Pup odor and ultrasonic vocalizations synergistically stimulate maternal attention in mice. Behav. Neurosci. 2013, 127:432-438.
110. Budinger E., et al. Multisensory processing via early cortical stages: connections of the primary auditory cortical field with other sensory systems. Neuroscience 2006, 143:1065-1083.
111. Cohen L., et al. Multisensory integration of natural odors and sounds in the auditory cortex. Neuron 2011, 72:357-369.
112. Varga A.G., Wesson D.W. Distributed auditory sensory input within the mouse olfactory cortex. Eur. J. Neurosci. 2013, 37:564-571.
113. Bizley J.K., Cohen Y.E. The what, where and how of auditory-object perception. Nat. Rev. Neurosci. 2013, 14:693-707.
114. Poirier C., et al. Own-song recognition in the songbird auditory pathway: selectivity and lateralization. J. Neurosci. 2009, 29:2252-2258.
115. Ding S.L., et al. Parcellation of human temporal polar cortex: a combined analysis of multiple cytoarchitectonic, chemoarchitectonic, and pathological markers. J. Comp. Neurol. 2009, 514:595-623.
116. von Kriegstein K., et al. Neural representation of auditory size in the human voice and in sounds from other resonant sources. Curr. Biol. 2007, 17:1123-1128.
117. Latinus M., et al. Norm-based coding of voice identity in human auditory cortex. Curr. Biol. 2013, 23:1075-1080.
118. Joly O., et al. Interhemispheric differences in auditory processing revealed by fMRI in awake Rhesus monkeys. Cereb. Cortex 2012, 22:838-885.
119. Gil-da-Costa R., et al. Species-specific calls activate homologs of Broca's and Wernicke's areas in the macaque. Nat. Neurosci. 2006, 9:1064-1070.
120. Chandrasekaran C., et al. Monkeys and humans share a common computation for face/voice integration. PLoS Comput. Biol. 2011, 7:e1002165.
121. Lakatos P., et al. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007, 53:279-292.
122. Fetsch C.R., et al. Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons. Nat. Rev. Neurosci. 2013, 14:429-442.
123. Baylis G.C., et al. Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res. 1985, 342:91-102.