Toward a Social Psychophysics of Face Communication

Annual Review of Psychology

Volumn 68, Issue , 2017, Pages 269-297

  Jack, Rachael E ^a   Schyns, Philippe G ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Culture; Facial expressions; Reverse correlation; Social communication; Social psychophysics

Indexed keywords

FACIAL EXPRESSION; HUMAN; NONVERBAL COMMUNICATION; PERCEPTION; PSYCHOLOGY; PSYCHOPHYSICS;

FACIAL EXPRESSION; HUMANS; NONVERBAL COMMUNICATION; PSYCHOPHYSICS; SOCIAL PERCEPTION;

EID: 85009453083     PISSN: 00664308     EISSN: 15452085     Source Type: Book Series    
DOI: 10.1146/annurev-psych-010416-044242     Document Type: Review

References (138)

1. Adams RB, Pauker K, Weisbuch M. 2010. Looking the other way: the role of gaze direction in the cross-race memory effect. J. Exp. Soc. Psychol. 46:478-81
2. Ahumada A, Lovell J. 1971. Stimulus features in signal detection. J. Acoust. Soc. Am. 49:1751-56
3. Arak A, Enquist M. 1993. Hidden preferences and the evolution of signals. Philos. Trans. R. Soc. Lond. Biol. Sci. 340:207-13
4. Arridge S, Moss JP, Linney AD, James DR. 1985. Three dimensional digitization of the face and skull. J. Maxillofac. Surg. 13:136-43
5. Atkinson AP, Dittrich WH, Gemmell AJ, Young AW. 2004. Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33:717-46
6. Bar M, Neta M, Linz H. 2006. Very first impressions. Emotion 6:269-78
7. BeaupréM, Cheung N, Hess U. 2000. TheMontreal set of facial displays of emotion. Slides, Dep. Psychol., Univ. Quebec Montr
8. Belin P, Fillion-Bilodeau S, Gosselin F. 2008. The Montreal Affective Voices: a validated set of nonverbal affect bursts for research on auditory affective processing. Behav. Res. Methods 40:531-39
9. Bellman R. 1956. Dynamic programming and Lagrange multipliers. PNAS 42:767-69
10. Biehl M, Matsumoto D, Ekman P, Hearn V, Heider K, et al. 1997. Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion ( JACFEE): reliability data and cross-national differences. J. Nonverbal Behav. 21:3-21
11. Bijlstra G, Holland RW, Wigboldus DH. 2010. The social face of emotion recognition: evaluations versus stereotypes. J. Exp. Soc. Psychol. 46:657-63
12. Blais C, Jack RE, Scheepers C, Fiset D, Caldara R. 2008. Culture shapes how we look at faces. PLOS ONE 3:e3022
13. Blanz V, Vetter T. 1999. A morphable model for the synthesis of 3D faces. Proc. Annu. Conf. Comput. Graph. Interact. Techn., 26th, Los Angeles, Aug. 8-13, pp. 187-94. New York: ACM Press
14. BrajeWL, KerstenD, TarrMJ, TrojeNF. 1998. Illumination effects in face recognition. Psychobiology 26:371-80
15. Burriss RP, Little AC, Nelson EC. 2007. 2D:4D and sexually dimorphic facial characteristics. Arch. Sex. Behav. 36:377-84
16. Chen C, Garrod O, Schyns P, Jack R. 2015. The face is the mirror of the cultural mind. J. Vis. 15:928
17. Cordaro DT, Keltner D, Tshering S, Wangchuk D, Flynn LM. 2015. The voice conveys emotion in ten globalized cultures and one remote village in Bhutan. Emotion 16:117-28
18. Cunningham DW, Kleiner M, Bülthoff HH, Wallraven C. 2004. The components of conversational facial expressions. Proc. Symp. Appl. Percept. Graph. Vis., 1st, Los Angeles, Aug. 7-8, pp. 143-50. New York: ACM Press
19. Dael N, Mortillaro M, Scherer KR. 2012. The body action and posture coding system (BAP): development and reliability. J. Nonverbal Behav. 36:97-121
20. Darwin C. 1999 (1872). The Expression of the Emotions in Man and Animals. London: Fontana Press
21. Davis JA. 1963. Intellectual climates in 135 American colleges and universities: a study in "social psychophysics." Sociol. Educ. 37:110-28
22. Gelder B. 2009. Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philos. Trans. R. Soc. Biol. Sci. 364:3475-84
23. Dezecache G, Mercier H, Scott-Phillips TC. 2013. An evolutionary approach to emotional communication. J. Pragmat. 59:221-33
24. Dotsch R, Wigboldus DH, Langner O, van Knippenberg A. 2008. Ethnic out-group faces are biased in the prejudiced mind. Psychol. Sci. 19:978-80
25. Doty TJ, Japee S, Ingvar M, Ungerleider LG. 2014. Intersubject variability in fearful face processing: the link between behavior and neural activation. Cogn. Aff. Behav. Neurosci. 14:1438-53
26. DukasR. 1998. Cognitive Ecology:The Evolutionary Ecology of Information Processing andDecision Making.Chicago: Univ. Chicago Press
27. Eberhardt JL, Davies PG, Purdie-Vaughns VJ, Johnson SL. 2006. Looking deathworthy: perceived stereotypicality of Black defendants predicts capital-sentencing outcomes. Psychol. Sci. 17:383-86
28. Ekman P, Friesen W. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Sunnyvale, CA: Consult. Psychol. Press
29. Ekman P, Sorenson ER, FriesenWV. 1969. Pan-cultural elements in facial displays of emotion. Science 164:86-88
30. ElfenbeinHA. 2015. In-group advantage and other-group bias in facial emotion recognition. In Understanding Facial Expressions in Communication, ed. MK Mandal, A Awasthi, pp. 57-71. Berlin: Springer
31. Eriksen CW, James JDS. 1986. Visual attention within and around the field of focal attention: a zoom lens model. Percept. Psychophys. 40:225-40
32. Fink B, Grammer K, Matts PJ. 2006. Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evol. Hum. Behav. 27:433-42
33. Freeman JB, Johnson KL, Ambady N, Rule NO. 2010. Sexual orientation perception involves gendered facial cues. Personal. Soc. Psychol. Bull. 36:1318-31
34. Gauthier I, Tarr MJ, Anderson AW, Skudlarski P, Gore JC. 1999. Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects. Nat. Neurosci. 2:568-73
35. Gill D, Garrod OG, Jack RE, Schyns PG. 2014. Facial movements strategically camouflage involuntary social signals of face morphology. Psychol. Sci. 25:1079-86
36. Gosselin F, Schyns PG. 2001. Bubbles: a technique to reveal the use of information in recognition tasks. Vis. Res. 41:2261-71
37. Gosselin F, Schyns PG. 2002. RAP: a new framework for visual categorization. Trends Cogn. Sci. 6:70-77
38. Gosselin F, Schyns PG. 2003. Superstitious perceptions reveal properties of internal representations. Psychol. Sci. 14:505-9 www.annualreviews.org Social Psychophysics of Face Communication 293
39. Grammer K, Thornhill R. 1994. Human (Homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. J. Comp. Psychol. 108:233-42
40. Grezes J, Pichon S, De Gelder B. 2007. Perceiving fear in dynamic body expressions. NeuroImage 35:959-67
41. Gross JJ, Levenson RW. 1995. Emotion elicitation using films. Cogn. Emot. 9:87-108
42. Hammond P, Suttie M. 2012. Large-scale objective phenotyping of 3D facial morphology. Hum. Mutat. 33:817-25
43. Haub C. 2002. How many people have ever lived on Earth? Popul. Today 30:3-4
44. Hawkley LC, Cacioppo JT. 2007. Aging and loneliness: downhill quickly? Curr. Dir. Psychol. Sci. 16:187-91
45. Haxby JV, Hoffman EA, Gobbini MI. 2000. The distributed human neural system for face perception. Trends Cogn. Sci. 4:223-33
46. Henrich J, Heine S, Norenzayan A. 2010. The weirdest people in the world? Behav. Brain Sci. 33:61-83
47. Hill H, Bruce V, Akamatsu S. 1995. Perceiving the sex and race of faces: the role of shape and colour. Proc. R. Soc. Lond. Biol. Sci. 261:367-73
48. Hill H, Schyns PG, Akamatsu S. 1997. Information and viewpoint dependence in face recognition. Cognition 62:201-22
49. Howells WW. 1960. The distribution of man. Sci. Am. 203:113-30
50. Hsiao J-W, Cottrell G. 2008. Two fixations suffice in face recognition. Psychol. Sci. 19:998-1006
51. Hummert ML. 2014. Age changes in facial morphology, emotional communication, and age stereotyping. In The Oxford Handbook of Emotion, Social Cognition, and Problem Solving in Adulthood, ed. P Verhaeghen, C Hertzog, pp. 47-60. Oxford, UK: Oxford Univ. Press
52. Ince RA, Van Rijsbergen NJ, Thut G, Rousselet GA, Gross J, et al. 2015. Tracing the flow of perceptual features in an algorithmic brain network. Sci. Rep. 5:17681
53. Jack RE. 2013. Culture and facial expressions of emotion. Vis. Cogn. 21:1248-86
54. Jack RE, Blais C, Scheepers C, Schyns PG, Caldara R. 2009. Cultural confusions show that facial expressions are not universal. Curr. Biol. 19:1543-48
55. Jack RE, Caldara R, Schyns PG. 2011. Internal representations reveal cultural diversity in expectations of facial expressions of emotion. J. Exp. Psychol. Gen. 141:19-25. doi: 10.1037/a0023463
56. Jack RE, Garrod OG, Yu H, Caldara R, Schyns PG. 2012. Facial expressions of emotion are not culturally universal. PNAS 109:7241-44
57. Jack RE,GarrodOGB,SchynsPG. 2014. Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Curr. Biol. 24:187-92
58. Jack RE, Sun W, Delis I, Garrod O, Schyns P. 2016. Four not six: revealing culturally common facial expressions of emotion. J. Exp. Psychol. Gen. 145:708-30
59. Johnson SK, Podratz KE, Dipboye RL, Gibbons E. 2010. Physical attractiveness biases in ratings of employment suitability: tracking down the "beauty is beastly" effect. J. Soc. Psychol. 150:301-18
60. Johnston A,Hill H, CarmanN. 2013. Recognising faces: effects of lighting direction, inversion, and brightness reversal. Perception 42:1227-37
61. Jones AL, Kramer RS,Ward R. 2012. Signals of personality and health: the contributions of facial shape, skin texture, and viewing angle. J. Exp. Psychol. Hum. Percept. Perform. 38:1353-61
62. Karremans JC,Dotsch R, Corneille O. 2011. Romantic relationship status biases memory of faces of attractive opposite-sex others: evidence from a reverse-correlation paradigm. Cognition 121:422-26
63. Krumhuber EG, Kappas A, Manstead AS. 2013. Effects of dynamic aspects of facial expressions: a review. Emot. Rev. 5:41-46
64. Krumhuber EG, Manstead AS,CoskerD,Marshall D, Rosin PL, KappasA. 2007. Facial dynamics as indicators of trustworthiness and cooperative behavior. Emotion 7:730-35
65. Labarre W. 1947. The cultural basis of emotions and gestures. J. Personal. 16:49-68
66. LaiM, I Oruç, Barton JJ. 2013. The role of skin texture and facial shape in representations of age and identity. Cortex 49:252-65
67. Lang PJ, BradleyMM,Cuthbert BN. 2005. International affective picture system (IAPS): affective ratings of pictures and instruction manual. Rep. No. A-8, Cent. Study Emot. Atten., Univ. Fla., Gainesville
68. Langner O, Dotsch R, Bijlstra G, Wigboldus DHJ, Hawk ST, van Knippenberg A. 2010. Presentation and validation of the Radboud Faces Database. Cogn. Emot. 24:1377-88
69. Leopold DA, O'Toole AJ, Vetter T, Blanz V. 2001. Prototype-referenced shape encoding revealed by highlevel aftereffects. Nat. Neurosci. 4:89-94
70. Little AC, Jones BC, Waitt C, Tiddeman BP, Feinberg DR, et al. 2008. Symmetry is related to sexual dimorphism in faces: data across culture and species. PLOS ONE 3:e2106
71. Little AC, Perrett DI. 2007. Using composite images to assess accuracy in personality attribution to faces. Br. J. Psychol. 98:111-26
72. Littlewood W. 2001. Cultural awareness and the negotiation of meaning in intercultural communication. Lang. Aware. 10:189-99
73. Liu F, van der Lijn F, Schurmann C, Zhu G, Chakravarty MM, et al. 2012. A genome-wide association study identifies five loci influencing facial morphology in Europeans. PLOS Genet. 8:e1002932
74. LundqvistD, Flykt A,Öhman A. 1998. The Karolinska directed emotional faces. CD-ROM,Dep.Clin.Neurosci., Psychol. Sect., Karolinska Inst., Stockholm
75. Macrae CN, Bodenhausen GV. 2000. Thinking categorically about others. Annu. Rev. Psych. 51:93-120
76. Mangini M, Biederman I. 2004. Making the ineffable explicit: estimating the information employed for face classifications. Cogn. Sci. 28:209-26
77. Matsumoto D, Ekman P. 1988. Japanese and Caucasian Facial Expressions of Emotion ( JACFEE) and Neutral Faces ( JACNeuF). Slides, Dep. Psychiatry, Univ. Calif., San Francisco
78. Mautz BS, Wong BB, Peters RA, Jennions MD. 2013. Penis size interacts with body shape and height to influence male attractiveness. PNAS 110:6925-30
79. Miellet S, Caldara R, Schyns PG. 2011. Local Jekyll and global Hyde: the dual identity of face identification. Psychol. Sci. 22:1518-26
80. MorencyL-P, Stratou G, DeVault D, Hartholt A, LhommetM, et al. 2015. SimSensei demonstration: a perceptive virtual human interviewer for healthcare applications. Presented at AAAI Conf. Artif. Intell., 29th, Jan. 25-30, Austin, TX
81. Morris D. 1979. Gestures, Their Origins and Distribution. New York: Stein and Day
82. Nelson NL, Russell JA. 2013. Universality revisited. Emot. Rev. 5:8-15
83. Nusseck M, Cunningham DW, Wallraven C, Bulthoff HH. 2008. The contribution of different facial regions to the recognition of conversational expressions. J. Vis. 8:1.1-23
84. Oosterhof NN, Todorov A. 2008. The functional basis of face evaluation. PNAS 105:11087-92
85. O'Toole AJ, Deffenbacher KA, Valentin D, Abdi H. 1994. Structural aspects of face recognition and the other-race effect. Mem. Cogn. 22:208-24
86. Palmer SE. 1999. Vision Science: Photons to Phenomenology. Cambridge, MA: MIT Press
87. Perrett DI, Lee KJ, Penton-Voak I, Rowland D, Yoshikawa S, et al. 1998. Effects of sexual dimorphism on facial attractiveness. Nature 394:884-87
88. Peterson MF, EcksteinMP. 2012. Looking just below the eyes is optimal across face recognition tasks. PNAS 109:E3314-23
89. Pollick FE, Paterson HM, Bruderlin A, Sanford AJ. 2001. Perceiving affect from arm movement. Cognition 82:B51-B61
90. Rhodes G. 2006. The evolutionary psychology of facial beauty. Annu. Rev. Psychol. 57:199-226
91. Rhodes MG, Anastasi JS. 2012. The own-age bias in face recognition: a meta-analytic and theoretical review. Psychol. Bull. 138:146-74
92. Roberts A. 2010. The Incredible Human Journey. London: A and C Black
93. Roether CL, Omlor L, Christensen A, Giese MA. 2009. Critical features for the perception of emotion from gait. J. Vis. 9:15.1-32
94. Rule NO, Garrett JV, Ambady N. 2010. On the perception of religious group membership from faces. PLOS ONE 5:e14241
95. Scheiner E, Fischer J. 2011. Emotion expression: the evolutionary heritage in the human voice. In Interdisciplinary Anthropology: Continuing Evolution of Man, ed. W Welsch, WJ Singer, A Wunder, pp. 105-29. Berlin: Springer
96. Schyns PG. 1998. Diagnostic recognition: task constraints, object information, and their interactions. Cognition 67:147-79
97. Schyns PG, Goldstone RL, Thibaut JP. 1998. The development of features in object concepts. Behav. Brain Sci. 21:1-17, discussion 17-54 www.annualreviews.org Social Psychophysics of Face Communication 295
98. Schyns PG, Gosselin F, Smith ML. 2009. Information processing algorithms in the brain. Trends Cogn. Sci. 13:20-26
99. Schyns PG,Petro LS, SmithML.2007. Dynamics of visual information integration in the brain for categorizing facial expressions. Curr. Biol. 17:1580-85
100. Schyns PG, Thut G, Gross J. 2011. Cracking the code of oscillatory activity. PLOS Biol. 9:e1001064
101. Scott-Phillips TC. 2008. Defining biological communication. J. Evol. Biol. 21:387-95
102. Shannon CE. 1948. A mathematical theory of communication. Mob. Comput. Commun. Rev. 5:3-55
103. Simons DJ, Rensink RA. 2005. Change blindness: past, present, and future. Trends Cogn. Sci. 9:16-20
104. Smith FW, Schyns PG. 2009. Smile through your fear and sadness. Psychol. Sci. 20:1202-8
105. SmithML, CottrellGW, Gosselin F, Schyns PG. 2005. Transmitting and decoding facial expressions. Psychol. Sci. 16:184-89
106. SmithML, Gosselin F, Schyns PG. 2012. Measuring internal representations from behavioral and brain data. Curr. Biol. 22:191-96
107. Snodgrass JG. 1975. Psychophysics. In Experimental Sensory Psychology, ed. B Scharf, pp. 17-67. Glenview, IL: Scott Foresman
108. Swets JA, Green DM, Shipley EF, Sewall SE,Wasserman AG. 1963. Signal detection by human observers. DTIC Doc., Camb. Res. Lab. Electron., Mass. Inst. Technol. https://dspace.mit.edu/bitstream/handle/ 1721.1/52270/RLE-QPR-053-XX.pdf?sequence=1
109. Swiatoniowski AK, Quillen EE, Shriver MD, Jablonski NG. 2013. Technical note: comparing von Luschan skin color tiles and modern spectrophotometry for measuring human skin pigmentation. Am. J. Phys. Anthropol. 151:325-30
110. Tanaka J. 2013. Introduction. Vis. Cogn. 21:1077-80
111. Tanaka JW, Kiefer M, Bukach CM. 2004. A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study. Cognition 93:B1-9
112. Telles E. 2014. Pigmentocracies: Ethnicity, Race, and Color in Latin America. Chapel Hill: Univ. N.C. Press
113. Thornhill R, Gangestad SW. 2006. Facial sexual dimorphism, developmental stability, and susceptibility to disease in men and women. Evol. Hum. Behav. 27:131-44
114. TinbergenN. 1948. Social releasers and the experimentalmethod required for their study. Wilson Bull. 60:6-51
115. Todorov A, Mandisodza AN, Goren A, Hall CC. 2005. Inferences of competence from faces predict election outcomes. Science 308:1623-26
116. Troje NF, Bülthoff HH. 1996. Face recognition under varying poses: the role of texture and shape. Vis. Res. 36:1761-71
117. Tskhay KO, Feriozzo MM, Rule NO. 2013. Facial features influence the categorization of female sexual orientation. Perception 42:1090-94
118. Van Bavel JJ, Mende-Siedlecki P, Brady WJ, Reinero DA. 2016. Contextual sensitivity in scientific reproducibility. PNAS 113:6454-59
119. van Rijsbergen N, Jaworska K, Rousselet GA, Schyns PG. 2014. With age comes representational wisdom in social signals. Curr. Biol. 24:2792-96
120. van Rijsbergen NJ, Schyns PG. 2009. Dynamics of trimming the content of face representations for categorization in the brain. PLOS Comput. Biol. 5:e1000561
121. Vetter T, Troje NF. 1997. Separation of texture and shape in images of faces for image coding and synthesis. JoSAA 14:2152-61
122. Vick S-J, Waller BM, Parr LA, Pasqualini MCS, Bard KA. 2007. A cross-species comparison of facial morphology and movement in humans and chimpanzees using the facial action coding system (FACS). J. Nonverbal Behav. 31:1-20
123. Vinciarelli A, Pantic M, Bourlard H. 2009. Social signal processing: survey of an emerging domain. Image Vis. Comput. 27:1743-59
124. Volterra V. 1930. Theory of Functionals and of Integral and Integro-Differential Equations. London: Blackie
125. Wiener N. 1958. Nonlinear Problems in Random Theory. Cambridge, MA: MIT Press
126. Wilson EO. 2012. The Social Conquest of Earth. New York: WWNorton &Co
127. Winter RM. 1996. What's in a face? Nat. Genet. 12:124-29
128. Wu M-K, David SV, Gallant JL. 2006. Complete functional characterization of sensory neurons by system identification. Annu. Rev. Neurosci. 29:477-505
129. Young SG, Hugenberg K. 2012. Individuation motivation and face experience can operate jointly to produce the own-race bias. Soc. Psychol. Personal. Sci. 3:80-87
130. Yu H, Garrod OGB, Schyns PG. 2012. Perception-driven facial expression synthesis. Comput. Graph. 36:152-62
131. Zacharopoulos GV, Manios A, Kau CH, Velagrakis G, Tzanakakis GN, Bree E. 2016. Anthropometric analysis of the face. J. Craniofac. Surg. 27:e71-e75
132. Cohen MM. 2006. Perspectives on the Face. Oxford, UK: Oxford Univ. Press
133. Eckstein MP, Ahumada AJ. 2002. Classification images: a tool to analyze visual strategies. J. Vis. 2:1. doi: 10.1167/2.1.i
134. Guilford T, Dawkins MS. 1991. Receiver psychology and the evolution of animal signals. Anim. Behav. 42:1-14
135. Jack RE, Schyns PG. 2015. The human face as a dynamic tool for social communication. Curr. Biol. 25:R621-34
136. MacLin OH, MacLin MK, Peterson D, Chowdhry O, Joshi P. 2001. Social psychophysics: using psychophysics to answer "social" questions with PsychoPro. Behav. Res. Methods 41:623-32
137. Murray RF. 2011. Classification images: a review. J. Vis. 11:2
138. Yost WA, Fay RR. 2012. Human Psychophysics, Vol. 3. Berlin: Springer