A unified coding strategy for processing faces and voices

Trends in Cognitive Sciences

Volumn 17, Issue 6, 2013, Pages 263-271

  Yovel, Galit ^a   Belin, Pascal ^b,c,d  

^a TEL AVIV UNIVERSITY   (Israel)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c UNIVERSITÉ DE MONTRÉAL   (Canada)

^d AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Auditory cortex; Face recognition; Neural selectivity; Sensory coding; Visual cortex; Voice recognition

Indexed keywords

AUDITORY CORTEX; COMPUTATIONAL PROBLEM; NEURAL-PROCESSING; NEUROPSYCHOLOGICAL; SENSORY CODING; SIMILAR SOLUTION; SOCIAL INTERACTIONS; VISUAL CORTEXES;

ELECTROPHYSIOLOGY; FACE RECOGNITION; SPEECH RECOGNITION;

NEUROIMAGING;

AGE; AUDITORY MEMORY; CODING; COGNITION; ELECTROPHYSIOLOGY; FACE; GENDER; HUMAN; IDENTITY; NEUROIMAGING; NEUROPSYCHOLOGY; RECOGNITION; REVIEW; SENSORY STIMULATION; SOCIAL INTERACTION; VISUAL MEMORY; VOICE; AUDITORY STIMULATION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; HEARING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FACE; HUMANS; NEUROIMAGING; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); VOICE;

EID: 84891707740     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2013.04.004     Document Type: Review

References (106)

1. Belin P., et al. Understanding voice perception. Br. J. Psychol. 2011, 102:711-725.
2. Kanwisher N., Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2006, 361:2109-2128.
3. Atkinson A.P., Adolphs R. The neuropsychology of face perception: beyond simple dissociations and functional selectivity. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2011, 366:1726-1738.
4. Tsao D.Y., et al. Comparing face patch systems in macaques and humans. Proc. Natl. Acad. Sci. U.S.A. 2008, 105:19514-19519.
5. Charest I., et al. Cerebral processing of voice gender studied using a continuous carryover fMRI design. Cereb. Cortex 2013, 23:958-966.
6. Ethofer T., et al. Emotional voice areas: anatomic location, functional properties, and structural connections revealed by combined fMRI/DTI. Cereb. Cortex 2012, 22:191-200.
7. Leaver A.M., Rauschecker J.P. Cortical representation of natural complex sounds: effects of acoustic features and auditory object category. J. Neurosci. 2010, 30:7604-7612.
8. Moerel M., et al. Processing of natural sounds in human auditory cortex: tonotopy, spectral tuning, and relation to voice sensitivity. J. Neurosci. 2012, 32:14205-14216.
9. Remedios R., et al. An auditory region in the primate insular cortex responding preferentially to vocal communication sounds. J. Neurosci. 2009, 29:1034-1045.
10. Romanski L.M. Integration of faces and vocalizations in ventral prefrontal cortex: implications for the evolution of audiovisual speech. Proc. Natl. Acad. Sci. U.S.A. 2012, 109(Suppl. 1):10717-10724.
11. Romanski L.M., et al. Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. J. Neurophysiol. 2005, 93:734-747.
12. Gao Z., et al. A magnetoencephalographic study of face processing: M170, gamma-band oscillations and source localization. Hum. Brain Mapp. 2012, 10.1002/hbm.22028.
13. Rossion B., Jacques C. Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. Neuroimage 2008, 39:1959-1979.
14. Charest I., et al. Electrophysiological evidence for an early processing of human voices. BMC Neurosci. 2009, 10:127.
15. De Lucia M., et al. A temporal hierarchy for conspecific vocalization discrimination in humans. J. Neurosci. 2010, 30:11210-11221.
16. Rogier O., et al. An electrophysiological correlate of voice processing in 4- to 5-year-old children. Int. J. Psychophysiol. 2010, 75:44-47.
17. Capilla A., et al. The early spatio-temporal correlates and task independence of cerebral voice processing studied with MEG. Cereb. Cortex 2013, 23:1388-1395.
18. Pitcher D., et al. Triple dissociation of faces, bodies, and objects in extrastriate cortex. Curr. Biol. 2009, 19:319-324.
19. Sadeh B., et al. Stimulation of category-selective brain areas modulates ERP to their preferred categories. Curr. Biol. 2011, 21:1894-1899.
20. Bestelmeyer P., et al. Right temporal TMS impairs voice detection. Curr. Biol. 2011, 21:R838-R839.
21. Gainotti G. Laterality effects in normal subjects' recognition of familiar faces, voices and names. Perceptual and representational components. Neuropsychologia 2013, 51:1151-1160.
22. Yovel G., et al. The asymmetry of the fusiform face area is a stable individual characteristic that underlies the left-visual-field superiority for faces. Neuropsychologia 2008, 46:3061-3068.
23. Freiwald W.A., Tsao D.Y. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 2010, 330:845-851.
24. Yovel, G. and Freiwald, W.A. (2013) Face recognition systems in monkey and human: are they the same thing? F1000Prime Report 5 http://dx.doi.org/10.12703/P5-10.
25. Petkov C.I., et al. A voice region in the monkey brain. Nat. Neurosci. 2008, 11:367-374.
26. Perrodin C., et al. Voice cells in the primate temporal lobe. Curr. Biol. 2011, 21:1408-1415.
27. Kravitz D.J., et al. A new neural framework for visuospatial processing. Nat. Rev. Neurosci. 2011, 12:217-230.
28. Rauschecker J.P., Scott S.K. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 2009, 12:718-724.
29. Barton J.J. Structure and function in acquired prosopagnosia: lessons from a series of 10 patients with brain damage. J. Neuropsychol. 2008, 2:197-225.
30. Susilo T., Duchaine B. Advances in developmental prosopagnosia research. Curr. Opin. Neurobiol. 2012, 10.1016/j.conb.2012.12.011.
31. Hailstone J.C., et al. Progressive associative phonagnosia: a neuropsychological analysis. Neuropsychologia 2010, 48:1104-1114.
32. Neuner F., Schweinberger S.R. Neuropsychological impairments in the recognition of faces, voices, and personal names. Brain Cogn. 2000, 44:342-366.
33. Sidtis D., Kreiman J. In the beginning was the familiar voice: personally familiar voices in the evolutionary and contemporary biology of communication. Integr. Psychol. Behav. Sci. 2012, 46:146-159.
34. Garrido L., et al. Developmental phonagnosia: a selective deficit of vocal identity recognition. Neuropsychologia 2009, 47:123-131.
35. von Kriegstein K., et al. Interaction of face and voice areas during speaker recognition. J. Cogn. Neurosci. 2005, 17:367-376.
36. Young A.W., Bruce V. Understanding person perception. Br. J. Psychol. 2011, 102:959-974.
37. Valentine T. A unified account of the effects of distinctiveness, inversion, and race in face recognition. Q. J. Exp. Psychol. A 1991, 43:161-204.
38. Leopold D.A., et al. Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 2006, 442:572-575.
39. Latinus M., Belin P. Anti-voice adaptation suggests prototype-based coding of voice identity. Front. Psychol. 2011, 2:175.
40. Leopold D.A., et al. Prototype-referenced shape encoding revealed by high-level aftereffects. Nat. Neurosci. 2001, 4:89-94.
41. Latinus, M. et al. Norm-based coding of voice identity in human auditory cortex. Current Biology, in press.
42. Loffler G. fMRi evidence for the neural representation of faces. Nat. Neurosci. 2005, 8:1386-1390.
43. Simion F., et al. The processing of social stimuli in early infancy: from faces to biological motion perception. Prog. Brain Res. 2011, 189:173-193.
44. Johnson M.H. Subcortical face processing. Nat. Rev. Neurosci. 2005, 6:766-774.
45. Kisilevsky B.S., et al. Effects of experience on fetal voice recognition. Psychol. Sci. 2003, 14:220-224.
46. Beauchemin M., et al. Mother and stranger: an electrophysiological study of voice processing in newborns. Cereb. Cortex 2011, 21:1705-1711.
47. Vouloumanos A., et al. The tuning of human neonates' preference for speech. Child Dev. 2010, 81:517-527.
48. Tzourio-Mazoyer N., et al. Neural correlates of woman face processing by 2-month-old infants. Neuroimage 2002, 15:454-461.
49. de Haan M., et al. Development of face-sensitive event-related potentials during infancy: a review. Int. J. Psychophysiol. 2003, 51:45-58.
50. Halit H., et al. Cortical specialisation for face processing: face-sensitive event-related potential components in 3- and 12-month-old infants. Neuroimage 2003, 19:1180-1193.
51. Dehaene-Lambertz G., et al. Functional neuroimaging of speech perception in infants. Science 2002, 298:2013-2015.
52. Grossman T., et al. The developmental origins of voice processing in the human brain. Neuron 2010, 65:852-858.
53. Blasi A., et al. Early specialization for voice and emotion processing in the infant brain. Curr. Biol. 2011, 21:1220-1224.
54. Pascalis O., et al. Is face processing species-specific during the first year of life?. Science 2002, 296:1321-1323.
55. Di Giorgio E., et al. Is the face-perception system human-specific at birth?. Dev. Psychol. 2012, 48:1083-1090.
56. Kuhl P.K., et al. Linguistic experience alters phonetic perception in infants by 6 months of age. Science 1992, 255:606-608.
57. Perrachione T.K., Wong P.C. Learning to recognize speakers of a non-native language: implications for the functional organization of human auditory cortex. Neuropsychologia 2007, 45:1899-1910.
58. Winters S.J., et al. Identification and discrimination of bilingual talkers across languages. J. Acoust. Soc. Am. 2008, 123:4524-4538.
59. Perrachione T.K., et al. Asymmetric cultural effects on perceptual expertise underlie an own-race bias for voices. Cognition 2010, 114:42-55.
60. Young S.G., et al. Perception and motivation in face recognition: a critical review of theories of the Cross-Race Effect. Pers. Soc. Psychol. Rev. 2012, 16:116-142.
61. Yin R.K. Looking at upside-down faces. J. Exp. Psychol. 1969, 81:141-145.
62. Nederhouser M., et al. The deleterious effect of contrast reversal on recognition is unique to faces, not objects. Vision Res. 2007, 47:2134-2142.
63. DeGutis J., et al. Using regression to measure holistic face processing reveals a strong link with face recognition ability. Cognition 2013, 126:87-100.
64. Blesser B. Speech perception under conditions of spectral transformation. I. Phonetic characteristics. J. Speech Hear. Res. 1972, 15:5-41.
65. Bedard C., Belin P. A 'voice inversion effect'?. Brain Cogn. 2004, 55:247-249.
66. Agus T.R., et al. Fast recognition of musical sounds based on timbre. J. Acoust. Soc. Am. 2012, 131:4124-4133.
67. Bruce V., et al. Effects of distinctiveness, repetition and semantic priming on the recognition of face familiarity. Can. J. Exp. Psychol. 1993, 47:38-60.
68. Natu V., O'Toole A.J. The neural processing of familiar and unfamiliar faces: a review and synopsis. Br. J. Psychol. 2011, 102:726-747.
69. Hershler O., et al. The wide window of face detection. J. Vis. 2010, 10:21.
70. Langton S.R., et al. Attention capture by faces. Cognition 2008, 107:330-342.
71. Oosterhof N.N., Todorov A. The functional basis of face evaluation. Proc. Natl. Acad. Sci. U.S.A. 2008, 105:11087-11092.
72. Willis J., Todorov A. First impressions: making up your mind after a 100ms exposure to a face. Psychol. Sci. 2006, 17:592-598.
73. Scherer K.R. Judging personality from voice: a cross-cultural approach to an old issue in interpersonal perception. J. Pers. 1972, 40:191-210.
74. Engell A.D., et al. Common neural mechanisms for the evaluation of facial trustworthiness and emotional expressions as revealed by behavioral adaptation. Perception 2010, 39:931-941.
75. Rauschecker J.P., Tian B. Mechanisms and streams for processing of 'what' and 'where' in auditory cortex. Proc. Natl. Acad. Sci. U.S.A. 2000, 97:11800-11806.
76. Stevenage S.V., et al. The effect of distraction on face and voice recognition. Psychol. Res. 2013, 77:167-175.
77. Integrating face and voice in person perception 2012, Springer. P. Belin (Ed.).
78. Schweinberger S.R., et al. Hearing facial identities: brain correlates of face-voice integration in person identification. Cortex 2011, 47:1026-1037.
79. Smith E.L., et al. Auditory-visual crossmodal integration in perception of face gender. Curr. Biol. 2007, 17:1680-1685.
80. de Gelder B., Vroomen J. The perception of emotions by ear and by eye. Cogn. Emot. 2000, 14:289-311.
81. Pourtois G., et al. Perception of facial expressions and voices and of their combination in the human brain. Cortex 2005, 41:49-59.
82. Hagan C.C., et al. MEG demonstrates a supra-additive response to facial and vocal emotion in the right superior temporal sulcus. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:20010-20015.
83. Patterson M.L., Werker J.F. Two-month-old infants match phonetic information in lips and voice. Dev. Sci. 2003, 6:191-196.
84. Lewkowicz D.J., Ghazanfar A.A. The emergence of multisensory systems through perceptual narrowing. Trends Cogn. Sci. 2009, 13:470-478.
85. Grossmann T., et al. Neural correlates of perceptual narrowing in cross-species face-voice matching. Dev. Sci. 2012, 15:830-839.
86. Haxby J.V., et al. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
87. Belin P., et al. Voice-selective areas in human auditory cortex. Nature 2000, 403:309-312.
88. Jeffery L., et al. Distinguishing norm-based from exemplar-based coding of identity in children: evidence from face identity aftereffects. J. Exp. Psychol. Hum. Percept. Perform. 2011, 37:1824-1840.
89. Lavner Y., et al. The prototype model in speaker identification by human listeners. Int. J. Speech Technol. 2001, 4:63-74.
90. Langlois J.H., Roggman L.A. Attractive faces are only average. Psychol. Sci. 1990, 1:115-121.
91. Bruckert L., et al. Vocal attractiveness increases by averaging. Curr. Biol. 2010, 20:116-120.
92. O'Neil S.F., Webster M.A. Adaptation and the perception of facial age. Vis. Cogn. 2011, 19:534-550.
93. Tillman M.A., Webster M.A. Selectivity of face distortion aftereffects for differences in expression or gender. Front. Psychol. 2012, 3:14.
94. Webster M.A., MacLeod D.I. Visual adaptation and face perception. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2011, 366:1702-1725.
95. Schweinberger S.R., et al. Auditory adaptation in voice perception. Curr. Biol. 2008, 18:684-688.
96. Zäske R., et al. Voice aftereffects of adaptation to speaker identity. Hear. Res. 2010, 268:38-45.
97. Latinus M., Belin P. Perceptual auditory aftereffects on voice identity using brief vowel stimuli. PLoS ONE 2012, 7:e41384.
98. Bestelmeyer P., et al. Auditory adaptation in vocal affect perception. Cognition 2010, 117:217-223.
99. Galton F. Composite portraits. J. Anthropol. Inst. 1878, 8:132-144.
100. Grammer K., et al. Darwinian aesthetics: sexual selection and the biology of beauty. Biol. Rev. Camb. Philos. Soc. 2003, 78:385-407.
101. Little A.C., et al. Facial attractiveness: evolutionary based research. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2011, 366:1638-1659.
102. Winkielman P., et al. Prototypes are attractive because they are easy on the mind. Psychol. Sci. 2006, 17:799-806.
103. Feinberg D.R., et al. The role of femininity and averageness of voice pitch in aesthetic judgments of women's voices. Perception 2008, 37:615-623.
104. Said C.P., Todorov A. A statistical model of facial attractiveness. Psychol. Sci. 2011, 22:1183-1190.
105. DeBruine L.M., et al. Dissociating averageness and attractiveness: attractive faces are not always average. J. Exp. Psychol. Hum. Percept. Perform. 2007, 33:1420-1430.
106. Braun, C. et al. (2001) Beautycheck - Ursachen und Folgen von Attraktivität. Projektabschlussbericht. http://www.beautycheck.de/cmsms/index.php/der-ganze-bericht.