Mechanisms of face perception

Annual Review of Neuroscience

Volumn 31, Issue , 2008, Pages 411-437

  Tsao, Doris Y ^a   Livingstone, Margaret S ^b  

^a UNIVERSITY OF BREMEN   (Germany)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Face cells; Face detection; Face processing; Face recognition; Holistic processing; Temporal lobe

Indexed keywords

ALGORITHM; CODING; FACE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HYPOTHESIS; MONKEY; NEUROLOGIC EXAMINATION; NONHUMAN; PERCEPTION; PRIORITY JOURNAL; REVIEW; SIGNAL DETECTION; SIGNAL PROCESSING; SINGLE UNIT ACTIVITY; TEMPORAL LOBE; VISUAL MEMORY;

EID: 48249094613     PISSN: 0147006X     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.neuro.30.051606.094238     Document Type: Review

References (112)

1. Afraz SR, Cavanagh P. 2008. Retinotopy of the face aftereffect. Vision Res. 48:42-54
2. Afraz SR, Kiani R, Esteky H. 2006. Microstimulation of inferotemporal cortex influences face categorization. Nature 442:692-95
3. Andrews TJ, Ewbank MP. 2004. Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe. Neuroimage 23:905-13
4. Andrews TJ, Schluppeck D, Homfray D, Matthews P, Blakemore C. 2002. Activity in the fusiform gyrus predicts conscious perception of Rubin's vase-face illusion. Neuroimage 17:890-901
5. Anstis S. 2005. Last but not least. Perception 34:237-40
6. Argyle M, Cook M. 1976. Gaze and Mutual Gaze. Cambridge, UK/New York: Cambridge Univ. Press, xi, 210 pp.
7. Baker CI, Behrmann M, Olson CR. 2002. Impact of learning on representation of parts and wholes in monkey inferotemporal cortex. Nat. Neurosci. 5:1210-16
8. Barlow HB. 1986. Why have multiple cortical areas? Vision Res. 26:81-90
9. Belhumeur PN, Hespanha JP, Kriegnam DJ. 1997. Eigenfaces vs Fisherfaces: recognition using class specific linear projection. IEEE Trans. Patt. Anal. Mach. Intell. 19:711-20
10. Bertrand M. 1969. The Behavioural Repertoire of the Stumptail Macaque: A Descriptive and Comparative Study. Basel, Switz.: Karger
11. Brincat SL, Connor CE. 2004. Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nat. Neurosci. 7:880-86
12. Bruce C, Desimone R, Gross CG. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46:369-84
13. Bruce V, Young A. 1986. Understanding face recognition. Br. J. Psychol. 77(Pt. 3):305-27
14. Calder AJ, Burton AM, Miller P, Young AW, Akamatsu S. 2001. A principal component analysis of facial expressions. Vision Res. 41:1179-208
15. Calder AJ, Young AW. 2005. Understanding the recognition of facial identity and facial expression. Nat. Rev. Neurosci. 6:641-51
16. Cohen L, Dehaene S. 2004. Specialization within the ventral stream: the case for the visual word form area. Neuroimage 22:466-76
17. Coltheart M, Curtis B, Atkins P, Heller M. 1993. Models of reading aloud: dual-route and parallel-distributed-processing approaches. Psychol. Rev. 100:589-608
18. Cottrell GW, Branson KM, Calder AJ. 2002. Do expression and identity need separate representations? Presented at Annu. Meet. Cogn. Sci. Soc., 24th, Fairfax, Va.
19. Desimone R, Albright TD, Gross CG, Bruce C. 1984. Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4:2051-62
20. De Souza WC, Eifuku S, Tamura R, Nishijo H, Ono T. 2005. Differential characteristics of face neuron responses within the anterior superior temporal sulcus of macaques. J. Neurophysiol. 94:1252-66
21. Diamond R, Carey S. 1986. Why faces are and are not special: an effect of expertise. J. Exp. Psychol. Gen. 115:107-17
22. Eger E, Schyns PG, Kleinschmidt A. 2004. Scale invariant adaptation in fusiform face-responsive regions. Neuroimage 22:232-42
23. Eifuku S, De Souza WC, Tamura R, Nishijo H, Ono T. 2004. Neuronal correlates of face identification in the monkey anterior temporal cortical areas. J. Neurophysiol. 91:358-71
24. Farah MJ, Wilson KD, Drain HM, Tanaka JR. 1995. The inverted face inversion effect in prosopagnosia: evidence for mandatory, face-specific perceptual mechanisms. Vision Res. 35:2089-93
25. Farah MJ, Wilson KD, Drain M, Tanaka JN 1998. What is "special" about face perception? Psychol. Rev. 105:482-98
26. Foldiak P, Xiao D, Keysers C, Edwards R, Perrett DI. 2004. Rapid serial visual presentation for the determination of neural selectivity in area STSa. Prog. Brain Res. 144:107-16
27. Freiwald WA, Tsao D, Tootell RB, Livingstone MS. 2005. Single-unit recording in an fMRI-identified macaque face patch. II. Coding along multiple feature axes. Soc. Neurosci. Abstr. 362.6
28. Fujita I, Tanaka K, Ito M, Cheng K. 1992. Columns for visual features of objects in monkey inferotemporal cortex. Nature 360:343-46
29. Gauthier I, Tarr MJ. 2002. Unraveling mechanisms for expert object recognition: bridging brain activity and behavior. J. Exp. Psychol. Hum. Percept. Perform. 28:431-46
30. Grill Spector K, Knouf N, Kanwisher N. 2004. The fusiform face area subserves face perception, not generic within-category identification. Nat. Neurosci. 7:555-62
31. Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, Malach R. 1999. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24:187-203
32. Grill-Spector K, Malach R. 2004. The human visual cortex. Annu. Rev. Neurosci. 27:649-77
33. Gross CG, Bender DB, Rocha-Miranda CE. 1969. Visual receptive fields of neurons in inferotem-poral cortex of the monkey. Science 166:1303-6
34. Gross CG, Rocha-Miranda CE, Bender DB. 1972. Visual properties of neurons in inferotemporal cortex of the macaque. J. Neurophysiol. 35:96-111
35. Hasson U, Hendler T, Ben Bashat D, Malach R. 2001. Vase or face? Aneural correlate of shape-selective grouping processes in the human brain. J. Cogn. Neurosci. 13:744-53
36. Hasson U, Levy I, Behrmann M, Hendler T, Malach R. 2002. Eccentricity bias as an organizing principle for human high-order object areas. Neuron 34:479-90
37. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P. 2001. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425-30
38. Haxby JV, Grady CL, Horwitz B, Ungerleider LG, Mishkin M, et al. 1991. Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proc. Natl. Acad. Sci. USA 88:1621-25
39. Haxby JV, Hoffman EA, Gobbini MI. 2000. The distributed human neural system for face perception. Trends Cogn. Sci. 4:223-33
40. Jebara T. 2003. Images as bags of pixels. Presented at IEEE Int. Conf. Comp. Vis. (ICCV'03), 9th, Nice, France
41. Jeffery L, Rhodes G, Busey T. 2006. View-specific coding of face shape. Psychol. Sci. 17:501-5
42. Johnson MH, Dziurawiec S, Ellis H, Morton J. 1991. Newborns' preferential tracking of face-like stimuli and its subsequent decline. Cognition 40:1-19
43. Kanwisher N, Tong F, Nakayama K. 1998. The effect of face inversion on the human fusiform face area. Cognition 68:B1-11
44. Kanwisher NG, McDermott J, Chun MM. 1997. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17:4302-11
45. Kayaert G, Biederman I, Op de Beeck H, Vogels R. 2005a. Tuning for shape dimensions in macaque inferior temporal cortex. Eur. J. Neurosci. 22:212-24
46. Kayaert G, Biederman I, Vogels R. 2005b. Representation of regular and irregular shapes in macaque inferotemporal cortex. Cereb. Cortex 15:1308-21
47. Kemp R, McManus C, Pigott T. 1990. Sensitivity to the displacement of facial features in negative and inverted images. Perception 19:531-43
48. Kobatake E, Tanaka K. 1994. Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J. Neurophysiol. 71:856-67
49. Konorski J. 1967. Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago: Univ. Chicago Press. xii, 531 pp.
50. Lee K, Byatt G, Rhodes G. 2000. Caricature effects, distinctiveness, and identification: testing the face-space framework. Psychol. Sci. 11:379-85
51. Leonard CM, Rolls ET, Wilson FA, Baylis GC. 1985. Neurons in the amygdala of the monkey with responses selective for faces. Behav. Brain Res. 15:159-76
52. Leopold DA, Bondar IV, Giese MA. 2006. Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442:572-75
53. Leopold DA, O'Toole AJ, Vetter T, Blanz V. 2001. Prototype-referenced shape encoding revealed by high-level aftereffects. Nat. Neurosci. 4:89-94
54. Liu J, Harris A, Kanwisher N. 2002. Stages of processing in face perception: an MEG study. Nat. Neurosci. 5:910-16
55. McCarthy G, Luby M, Gore J, Goldman-Rakic P. 1997. Infrequent events transiently activate human prefrontal and parietal cortex as measured by functional MRI. J. Neurophysiol. 77:1630-34
56. Moghaddam B, Jebara T, Pentland A. 2000. Bayesian face recognition. Pattern Recognit. 33:1771-82
57. Mooney CM. 1957. Age in the development of closure ability in children. Can. J. Psychol. 11:219-26
58. Moscovitch M, Winocur G, Behrmann M. 1997. What is special about face recognition? Nineteen experiments on a person with visual object agnosia and dyslexia but normal face recognition. J. Cogn. Neurosci. 9:555-604
59. Mountcastle VB. 1997. The columnar organization of the neocortex. Brain 120(Pt. 4):701-22
60. Oram MW, Perrett DI. 1992. Time course of neural responses discriminating different views of the face and head. J. Neurophysiol. 68:70-84
61. O'Toole A, Abdi H, Deffenbacher K, Valentin D. 1993. Low dimensional representation of faces in high dimensions of the space. J. Opt. Soc. Am. A 10:405-10
62. Pasupathy A, Connor CE. 2001. Shape representation in area V4: position-specific tuning for boundary conformation. J. Neurophysiol. 86:2505-19
63. Perrett DI, Harries MH, Bevan R, Thomas S, Benson PJ, et al. 1989. Frameworks of analysis for the neural representation of animate objects and actions. J. Exp. Biol. 146:87-113
64. Perrett DI, Oram MW, Harries MH, Bevan R, Hietanen JK, et al. 1991. Viewer-centred and object-centred coding of heads in the macaque temporal cortex. Exp. Brain Res. 86:159-73
65. Perrett DI, Rolls ET, Caan W. 1982. Visual neurones responsive to faces in the monkey temporal cortex. Exp. Brain Res. 47:329-42
66. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. 1984. Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Hum. Neurobiol. 3:197-208
67. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. 1985. Visual cells in the temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. London B Biol. Sci. 223:293-317
68. Pinsk MA, Desimone K, Moore T, Gross CG, Kastner S. 2005. Representations of faces and body parts in macaque temporal cortex: a functional MRI study. Proc. Natl. Acad. Sci. USA 102:6996-7001
69. Pourtois G, Schwartz S, Seghier ML, Lazeyras F, Vuilleumier P. 2005. View-independent coding of face identity in frontal and temporal cortices is modulated by familarity: an event-related fMRI study. Neuroimage 24:1214-24
70. Puce A, Allison T, Asgari M, Gore JC, McCarthy G. 1996. Differential sensitivity of human visual cortex to faces, letterstrings, and textures: a functional magnetic resonance imaging study. J. Neurosci. 16:5205-15
71. Quiroga RQ, Reddy L, Kreiman G, Koch C, Fried I. 2005. Invariant visual representation by single neurons in the human brain. Nature 435:1102-7
72. Rhodes G, Brennan S, Carey S. 1987. Identification and ratings of caricatures: implications for mental representations of faces. Cogn. Psychol. 19:473-97
73. Rhodes G, Jeffery L. 2006. Adaptive norm-based coding of facial identity. Vision Res. 46: 2977-87
74. Rhodes G, Jeffery L, Watson TL, Jaquet E, Winkler C, Clifford CW. 2004. Orientation-contingent face aftereffects and implications for face-coding mechanisms. Curr. Biol. 14:2119-23
75. Rhodes G, McLean IG. 1990. Distinctiveness and expertise effects with homogeneous stimuli: towards a model of configural coding. Perception 19:773-94
76. Riesenhuber M, Poggio T. 2000. Models of object recognition. Nat. Neurosci. 3(Suppl.):1199-204
77. Rolls ET, Baylis GC. 1986. Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Exp. Brain Res. 65:38-48
78. Rotshtein P, Henson RN, Treves A, Driver J, Dolan RJ. 2005. Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain. Nat. Neurosci. 8:107-13
79. Scalaidhe SP, Wilson FA, Goldman-Rakic PS. 1999. Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. Cereb. Cortex 9:459-75
80. Sergent J, Ohta S, MacDonald B. 1992. Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain 115:15-36
81. Shakhnarovich G, Moghaddam B. 2004. Face recognition in subspaces. In Handbook of Face Recognition, ed. SZ Li, AK Jain. Berlin: Springer-Verlag
82. Simion F, Valenza E, Umilta C, Dalla Barba B. 1998. Preferential orienting to faces in newborns: a temporal-nasal asymmetry. J. Exp. Psychol. Hum. Percept. Perform. 24:1399-405
83. Sinha P. 2002a. Qualitative representations for recognition. In Lecture Notes in Computer Science, pp. 249-62. Berlin: Springer-Verlag
84. Sinha P. 2002b. Recognizing complex patterns. Nat. Neurosci. 5(Suppl.):1093-97
85. Sinha P, Balas BJ, Ostrovsky Y, Russell R. 2006. Face recognition by humans: nineteen results all computer vision researchers should know about. Proc. IEEE 94(11):1948-62
86. Sinha P, Poggio T. 1996. I think I know that face. Nature 384:404
87. Somogyi P, Tamas G, Lujan R, Buhl EH. 1998. Salient features of synaptic organisation in the cerebral cortex. Brain Res. Brain Res. Rev. 26:113-35
88. Spiridon M, Kanwisher N. 2002. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35:1157-65
89. Sugase Y, Yamane S, Ueno S, Kawano K. 1999. Global and fine information coded by single neurons in the temporal visual cortex. Nature 400:869-73
90. Suzuki S, Cavanagh P. 1998. A shape-contrast effect for briefly presented stimuli. J. Exp. Psychol. Hum. Percept. Perform. 24:1315-41
91. Tamura H, Tanaka K. 2001. Visual response properties of cells in the ventral and dorsal parts of the macaque inferotemporal cortex. Cereb. Cortex 11:384-99
92. Tanaka JW, Farah MJ. 1993. Parts and wholes in face recognition. Q. J. Exp. Psychol. A Hum. Exp. Psychol. 46A:225-45
93. Tanaka K, Saito H, Fukada Y, Moriya M. 1991. Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J. Neurophysiol. 66:170-89
94. Tarr MJ, Gauthier I. 2000. FFA: a flexible fusiform area for subordinate-level visual processing automatized by expertise. Nat. Neurosci. 3:764-69
95. Thompson P. 1980. Margaret Thatcher: a new illusion. Perception 9:483-84
96. Tong F, Nakayama K, Moscovitch M, Weinrib O, Kanwisher N. 2000. Response properties of the human fusiform face area. Cogn. Neuropsychol. 17:257-79
97. Tovee MJ, Rolls ET, Azzopardi P. 1994. Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. J. Neurophysiol. 72:1049-60
98. Tovee MJ, Rolls ET, Treves A, Bellis RP. 1993. Information encoding and the responses of single neurons in the primate temporal visual cortex. J. Neurophysiol. 70:640-54
99. Tsao DY, Freiwald WA, Knutsen TA, Mandeville JB, Tootell RB. 2003. Faces and objects in macaque cerebral cortex. Nat. Neurosci. 6:989-95
100. Tsao DY, Freiwald WA, Tootell RB, Livingstone MS. 2006. A cortical region consisting entirely of face-selective cells. Science 311:670-74
101. Turk M, Pentland A. 1991. Eigenfaces for recognition. J. Cogn. Neurosci. 3:71-86
102. Ullman S. 2007. Object recognition and segmentation by a fragment-based hierarchy. Trends Cogn. Sci. 11:58-64
103. Ullman S, Vidal-Naquet M, Sali E. 2002. Visual features of intermediate complexity and their use in classification. Nat. Neurosci. 5:682-87
104. Viola P, Jones M. 2004. Robust real-time face detection. Int. J. Comp. Vision 57:137-54
105. Wang G, Tanaka K, Tanifuji M. 1996. Optical imaging of functional organization in the monkey inferotemporal cortex. Science 272:1665-68
106. Wang Y, Fujita I, Murayama Y. 2000. Neuronal mechanisms of selectivity for object features revealed by blocking inhibition in inferotemporal cortex. Nat. Neurosci. 3:807-13
107. Webster MA, MacLin OH. 1999. Figural aftereffects in the perception of faces. Psychon. Bull. Rev. 6:647-53
108. Wolberg G. 1998. Image morphing: a survey. Vis. Comput. 14:360-72
109. Yin R. 1969. Looking at upside-down faces. J. Exp. Psychol. 81:141-45
110. Young AW, Hellawell D, Hay DC. 1987. Configurational information in face perception. Perception 16:747-59
111. Yue X, Tjan BS, Biederman I. 2006. What makes faces special? Vision Res. 46:3802-11
112. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A. 2003. Face recognition: a literature survey. ACM Comput. Surv. 35:399-458