Recognition of Facial Expressions: Past, Present, and Future Challenges

Understanding Facial Expressions in Communication: Cross-Cultural and Multidisciplinary Perspectives

Volumn , Issue , 2015, Pages 19-40

  Fernández Dols, José Miguel ^a   Crivelli, Carlos ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Expressions; Field studies; Isolated cultures; Posed expressions; Recognition; Universality

Indexed keywords

EID: 84956759149     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-81-322-1934-7_2     Document Type: Chapter

References (116)

1. Agar, M. H. (1996). The professional stranger: an informal introduction to ethnography (2nd ed.). New York, NY: Academic Press.
2. Allport, F. H. (1924). Social psychology. Boston, MA: Houghton Mifflin.
3. Aviezer, H., Trope, Y., & Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338, 1225–1229. doi:10.1126/science.1224313.
4. Barrett, L. F. (in press). The conceptual act theory: A précis. Emotion Review.
5. Bateson, G. (1971). Introduction. In G. Bateson, R. L. Birdwhistell, H. Brosin, C. Hockett, N. A. McQuown, & F. Fromm-Reichmann (Eds.), The natural history of an interview. Collection of manuscripts on cultural anthropology series (Vol. 15, Nos. 95–98). Chicago, IL: University of Chicago Library Microfilm.
6. Bateson, G., Birdwhistell, R. L., Brosin, H., Hockett, C., McQuown, N. A., & Fromm-Reichmann, F. (1971). The natural history of an interview. Collection of manuscripts on cultural anthropology series (Vol. 15, Nos. 95–98). Chicago, IL: University of Chicago Library Microfilm.
7. Bell, S. C. (1924). Essays on the anatomy and philosophy of expression. London, UK: John Murray.
8. Birdwhistell, R. L. (1970). Kinesics and context: essays on body motion communication. Philadelphia, PA: University of Pennsylvania Press.
9. Buck, R. (1982). Spontaneous and symbolic nonverbal behavior and the ontogeny of communication. In R. Feldman (Ed.), The development of nonverbal behavior in children (pp. 29–62). New York, NY: Springer.
10. Calder, A. J., Young, A. W., Perrett, D. I., Etcoff, N. L., & Rowland, D. (1996). Categorical perception of morphed facial expressions. Visual Cognition, 3, 81–117.
11. Caldwell-Harris, C. L., & Ayçiçegi-Dinn, A. (2009). Emotion and lying in a non-native language. International Journal of Psychophysiology, 71, 193–204. doi:10.1016/j.ijpsycho.2008.09.006.
12. Chong, S. C. F., Werker, J. F., Russell, J. A., & Carroll, J. M. (2003). Three facial expressions mothers direct to their infants. Infant and Child Development, 12, 211–232. doi:10.1002/icd.286.
13. Darwin, C. (1965). The expression of the emotions in man and animals. Chicago, IL: University of Chicago Press (Original work published 1872).
14. Davis, M. (2001). Film projectors as microscopes: Ray L. Birdwhistell and microanalysis of
15. interaction (1955–1975). Visual Anthropology Review, 17, 39–49.
16. Dawkins, R., & Krebs, J. R. (1978). Animal signals: Information or manipulation? In J. R. Krebs & N. B. Davies (Eds.), Behavioral ecology: an evolutionary approach (1st ed., pp. 282– 309). London, UK: Blackwell Scientific.
17. DeVita, P. R. (1990). The humbled anthropologist: tales from the pacific. Belmont, CA: Wadsworth Publishing.
18. Ekman, P. (1972). Universals and cultural differences in facial expressions of emotions. In J. Cole (Ed.), Nebraska symposium on motivation, 1971 (Vol. 19, pp. 207–283). Lincoln, NE: University of Nebraska Press.
19. Ekman, P. (1973). Cross-cultural studies of facial expression. In P. Ekman (Ed.), Darwin and facial expression: a century of research in review (pp. 169–222). San Diego, CA: Academic Press.
20. Ekman, P. (1980). The face of man: expressions of universal emotions in a new guinea village. New York, NY: Garland STPN Press.
21. Ekman, P. (1982). Emotion in the human face (2nd ed.). New York, NY: Cambridge University Press.
22. Ekman, P. (1994). Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique. Psychological Bulletin, 115, 268–287.
23. Ekman, P. (1997). Should we call it expression or communication? Innovation, 10, 333–344.
24. Ekman, P. (1999). Facial expressions of emotion. In T. Dalgleish & M. Power (Eds.), Facial expressions (pp. 301–320). Sussex, UK: John Wiley.
25. Ekman, P. (2001). Facial expression. In C. Blakemore & S. Jennett (Eds.), The oxford companion to the body. Oxford, UK: Oxford University Press.
26. Ekman, P. (2003). Emotions revealed: recognizing faces and feelings to improve communication and emotional life. New York, NY: Times books.
27. Ekman, P., & Friesen, W. V. (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17, 124–129.
28. Ekman, P., & Friesen, W. V. (1978). The facial action coding system: a technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
29. Ekman, P., & Friesen, W. V. (1988). Who knows what about contempt: A reply to Izard and Haynes. Motivation and Emotion, 12(1), 17–22.
30. Ekman, P., Friesen, W. V., & Ancoli, S. (1980). Facial signs of emotional experience. Journal of Personality and Social Psychology, 39, 1125–1134.
31. Ekman, P., Friesen, W. V., & Ellsworth, P. (1972). What are the similarities and differences in facial behavior across cultures? In P. Ekman, W. V. Friesen, & P. Ellsworth (Eds.), Emotion in the human face (pp. 128–143). New York, NY: Cambridge University Press.
32. Ekman, P., Friesen, W. V., & Tomkins, S. S. (1971). Facial Affect Scoring Technique (FAST): A first validity study. Semiotica, 3(1), 37–58.
33. Ekman, P., & Oster, H. (1979). Facial expressions of emotion. Annual Review of Psychology, 30, 527–554.
34. Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotions. Science, 164, 86–88.
35. Elfenbein, H. A. (2013). Nonverbal dialects and accents in facial expressions of emotion. Emotion Review, 5, 90–96. doi:10.1177/1754073912451332.
36. Elfenbein, H. A., & Ambady, N. (2002a). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203–235. doi:10.1037//0033-2909.128.2.203.
37. Elfenbein, H. A., & Ambady, N. (2002b). Is there an in-group advantage in emotion recognition? Psychological Bulletin, 128, 243–249. doi:10.1037//0033-2909.128.2.243.
38. Etcoff, N. L., & Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44, 227–240.
39. Fellows, S. B. (1901).Grammar of the Kiriwina dialect (together with a vocabulary). Annual Report on British New Guinea, 1900–1901, 171–196. Retrieved from http://trobriandsindept h.com/PDFs/fellows%20wordlist.pdf
40. Fernández-Dols, J. M. (2013). Nonverbal communication: origins, adaptation, and functionality. In J. A. Hall & M. L. Knapp (Eds.), Handbook of nonverbal communication (pp. 69–92). New York, NY: Mouton de Gruyter.
41. Fernández-Dols, J. M., & Carrera, P. (2010). Le bon dieuestdans le detail: Is smiling the recognition of happiness? Behavioral and Brain Sciences, 33, 446–447. doi:10.1077/S0140525X10001512.
42. Fernández-Dols, J. M., Carrera, P., Barchard, K. A., & Gacitua, M. (2008). False recognition of facial expressions of emotion: Causes and implications. Emotion, 8, 530–539. doi:10.1037/a0012724.
43. Fernández-Dols, J. M., Carrera, P., Oceja, L., & de Mendoza, A. H. (2007). Emotional climate as emotion accessibility: How countries prime emotions. Journal of Social Issues, 63, 339– 352. doi:10.1111/j.1540-4560.2007.00512.x.
44. Fernández-Dols, J. M., & Crivelli, C. (2013). Emotion and expression. Emotion Review, 5, 24–29. doi:10.1177/1754073912457229.
45. Fernández-Dols, J. M., & Ruiz-Belda, M. A. (1997). Spontaneous facial behavior during intense emotional episodes: Artistic truth and optical truth. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 255–274). Cambridge, UK: Cambridge University Press.
46. Fields, H. (2012, June). Speaking your mind: Bilingual language, culture, and emotion. Observer, 25(5). Retrieved from http://www.psychologicalscience.org/index.php/publications/observer/2012/may-june-12/speaking-your-mind.html
47. Frank, M. G., & Stennett, J. (2001). The forced-choice paradigm and the perception of facial expressions of emotion. Journal of Personality and Social Psychology, 80, 75–85. doi:10.1037//0022-3514.80.1.75.
48. Fridlund, A. J. (1994). Human facial expression: an evolutionary view. San Diego, CA: Academic Press.
49. Fridlund, A. J. (1997). The new ethology of human facial expressions. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 103–129). Cambridge, UK: Cambridge University Press.
50. Frijda, N. H., & Tcherkassof, A. (1997). Facial expressions as modes of action readiness. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 78–102). Cambridge, UK: Cambridge University Press.
51. Fugate, J. M. B. (2013). Categorical perception for emotional faces. Emotion Review, 5, 84–89. doi:10.1177/1754073912451350.
52. Gendron, M., Lindquist, K. A., Barsalou, L., & Barrett, L. F. (2012). Emotion words shape emotion percepts. Emotion, 12, 314–325. doi:10.1037/a0026007.
53. Gendron, M., Roberson, D., van der Vyver, J.M., & Barrett, L.F. (2014). Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture. Emotion, 14, 251–262.
54. Gordon, P. (2004). Numerical cognition without words: Evidence from Amazonia. Science, 306, 496–499. doi:10.1126/science.1094492.
55. Haidt, J., & Keltner, D. (1999). Culture and facial expression: Open-ended methods fine more expressions and a gradient of recognition. Cognition and Emotion, 13, 225–266.
56. Hassin, R. R., Aviezer, H., & Bentin, S. (2013). Inherently ambiguous: Facial expressions of emotions, in context. Emotion Review, 5, 60–65. doi:10.1177/1754073912451331.
57. Hinde, R. A. (1982). Ethology: its nature and relations with other sciences. New York, NY: Oxford University Press.
58. Hinde, R. A. (1985). Expression and negotiation. In G. Zivin (Ed.), The development of expressive behavior (pp. 103–116). Orlando, FL: AcademicPress.
59. Hurtado de Mendoza, A., Fernández-Dols, J. M., Parrott, W. G., & Carrera, P. (2010). Emotion terms, category structure, and the problem of translation: The case of shame and vergüenza. Cognition and Emotion, 24, 661–680. doi:10.1080/02699930902958255.
60. Izard, C. E. (1971). The face of emotion. New York, NY: Appletown-Century-Crofts.
61. Izard, C. E. (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115, 288–299.
62. Izard, C. E., & Hayes, M. (1988). On the form and universality of the contempt expression: A challenge to Ekman and Friesen’s claim of discovery. Motivation and Emotion, 12(1), 1–16.
63. Jack, R., Garrod, O., Yu, H., Caldara, R., & Schyns, P. G. (2012). Facial expressions of emotion are not culturally universal. Proceedings of the National Academy of Sciences, 109(19), 7241–7244.
64. Leys, R. (2010). How did fear become a scientific object and what kind of object it is? Representations, 110, 66–104.
65. Lindquist, K. A., & Gendron, M. (2013). What’s in a word? Language constructs emotion perception. Emotion Review, 5, 66–71. doi:10.1177/1754073912451351.
66. Lindquist, K. A., Gendron, M., Barrett, L. F., & Dickerson, B. C. (2014). Emotion perception, but not affect perception, is impaired with semantic memory loss.Emotion, 14, 375–387.
67. Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012). The brain basis of emotion: A meta-analytic review. Behavioral and Brain Sciences, 35, 175–184. doi:10.1017/S0140525X11000446.
68. Malinoswki, B. (1965). Coral gardens and their magic. Bloomington, IN: Indiana University Press (Original work published 1935).
69. Malinowski, B. (1984). The argonauts of the Western Pacific: An account on native enterprise and adventure in the archipielagoes of Melanesian New Guinea. Prospect Heights, IL: Waveland Press (Original work published 1922).
70. Mantegazza, P. (1883). Fisonomia e mimica. Milan, Italy: Fratelli Dumollard. [Physiognomy and mimics].
71. Matsumoto, D. (2001). Culture and emotion. In D. Matsumoto (Ed.), The handbook of culture and psychology (pp. 171–194). New York, NY: Oxford University Press.
72. Matsumoto, D. (2002). Methodological requirements to test a possible in-group advantage in
73. judging emotions across cultures: Comment on Elfenbein and Ambady (2002) and evidence. Psychological Bulletin, 128, 236–242. doi:10.1037//0033-2909.128.2.236.
74. Matsumoto, D. (2004). Paul Ekman and the legacy of universals. Journal of Research in Personality, 38, 45–51.
75. Matsumoto, D. (2006). Culture and nonverbal behavior. In V. Manusov & M. L. Patterson (Eds.), The sage handbook of nonverbal communication (pp. 219–235). Thousand Oaks, CA: SAGE.
76. Matsumoto, D., Frank, M. G., & Hwang, H. S. (2013). Nonverbal communication: science and applications. London, UK: SAGE.
77. Matsumoto, D., & Juang, L. (2008). Culture and psychology (4th ed.). Belmont, CA: Thomson.
78. Matsumoto, D., Keltner, D., Shiota, M. N., O’Sullivan, M., & Frank, M. G. (2008). Facial expressions of emotion. In M. Lewis, J. M. Haviland-Jones, & L. F. Barrett (Eds.), Handbook of emotions (3rd ed., pp. 211–234). New York, NY: Guilford Press.
79. Mead, M. (1975). Review of Darwin and facial expression, P. Ekman (ed.). Journal of Communication, 25(1), 209-213.
80. Montagu, J. (1994). The expression of the passions. Yale, CT: Yale University Press.
81. Myers, D. G. (2011). Exploring psychology (8th ed.). New York, NY: Worth Publishers.
82. Nelson, N. L., & Russell, J. A. (2013). Universality revisited. Emotion Review, 5, 8–15. doi:10.1177/1754073912457227.
83. Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010). The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression. Behavioral and Brain Sciences, 33, 417–480. doi:10.1077/S0140525X10000865.
84. Norenzayan, A., & Heine, S. J. (2005). Psychological universals: What are they and how can we know? Psychological Bulletin, 131, 763–784. doi:10.1037/0033-2909.131.5.763.
85. Ortony, A., & Turner, T. J. (1990). What’s basic about basic emotions? Psychological Review, 97, 315–331.
86. Pica, P., Lerner, C., Izard, V., & Dehaene, S. (2004). Exact and approximate arithmetic in an Amazonian indigenous group. Science, 306, 499–503. doi:10.1126/science.306.5695.369m.
87. Reisenzein, R., Studtmann, M., & Horstmann, G. (2013). Coherence between emotion and facial expression: Evidence from laboratory experiments. Emotion Review, 5, 16–23. doi:10.1177/1754073912457228.
88. Rosenberg, E. L., & Ekman, P. (1994). Coherence between expressive and experiential systems in emotion. Cognition and Emotion, 8, 201–229.
89. Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: SAGE.
90. Rosenwein, B. H. (2010). Problems and methods in the history of emotion. Passions in context: International Journal for the History and Theory of Emotions, 1(1), 1–32. Retrieved from http://www.passionsincontext.de/uploads/media/01_Rosenwein.pdf.
91. Rozin, P., Haidt, J., & McCauley, C. R. (2000). Disgust. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 637–653). New York, NY: Guilford Press.
92. Rozin, P., Lowery, L., & Ebert, R. (1994). Varieties of disgust faces and the structure of disgust. Journal of Personality and Social Psychology, 66, 870–881.
93. Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102–141.
94. Russell, J. A. (1995). Facial expressions of emotion: What lies beyond minimal universality? Psychological Bulletin, 118, 379–391.
95. Russell, J. A. (1997). Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 295–320). Cambridge, UK: Cambridge University Press.
96. Russell, J. A. (2003). Core affect and the psychological construction of emotion. Psychological Review, 100, 145–172. doi:10.1037/0033-295X.110.1.145.
97. Russell, J. A. (2009). Emotion, core affect, and psychological construction. Cognition and Emotion, 23, 1259–1283.
98. Senft, G. (1986). Kilivila: The language of trobriand islanders. Berlin, Germany: Mouton de Gruyter.
99. Seyfarth, R. M., & Cheney, D. L. (2003). Signalers and receivers in animal communication. Annual Review of Psychology, 54, 145–173. doi: http://dx.doi.org/10.1146/annurev. psych.54.101601.145121
100. Smith, W. J. (1965). Message, meaning, and context in ethology. The American Naturalist, 99, 405–409.
101. Smith, W. J. (1977). The behavior of communicating. Cambridge, MA: Harvard University Press.
102. Sorenson, E. R. (1975). Culture and the expression of emotion. In T. R. Williams (Ed.), Psychological anthropology (pp. 361–372). Chicago, IL: Aldine.
103. Sorenson, E. R. (1976). The edge of the forest: land, childhood, and change in a new guinea protoagricultural society. Washington, DC: Smithsonian Institution Press.
104. Spaepen, E., Coppola, M., Spelke, E. S., Carey, S. E., & Goldin-Meadow, S. (2011). Number without a language model. Proceedings of the National Academy of Sciences, 108, 3163-3168. doi:10.1073/pnas.1015975108.
105. Tomkins, S. S. (1982). Affect theory. In P. Ekman (Ed.), Emotion in the human face (2nd ed., pp. 353–395). New York, NY: Cambridge University Press.
106. Tomkins, S. S., & McCarter, R. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and Motor Skills, 18, 119–158.
107. Tracy, J. L. (in press). An evolutionary approach to understanding distinct emotions. Emotion Review.
108. Tracy, J. L., & Matsumoto, D. (2008). The spontaneous expressions of pride and shame: Evidence for biologically innate nonverbal displays. Proceedings of the National Academy of Sciences, 105, 11655–11660. doi:10.1073/pnas.0802686105.
109. Vazire, S., Naumann, L. P., Rentfrow, P. J., & Gosling, S. D. (2009). Smiling reflects different affective states in men and women. Behavioral and Brain Sciences, 32, 403–405. doi:10.1077/S0140525X09991026.
110. Widen, S. C., Pochedly, J.T., Pieloch, K., & Russell, J. A. (2013). Introducing the sick face. Motivation & Emotion. Advance online publication.doi: 10.1007/s11031-013-9353-6.
111. Widen, S. C., & Russell, J. A. (2008). Children’s and adult’s understanding of the “disgust face”. Cognition and Emotion, 22, 1513–1541. doi:10.1080/02699930801906744.
112. Widen, S. C., & Russell, J. A. (2010). To children the “disgust face” conveys anger. Emotion, 10, 455–466. doi:10.1037/a0019151.
113. Widen, S. C., & Russell, J. A. (2013). Children’s recognition of disgust in others. Psychological Bulletin, 139, 271–299. doi:10.1037/a0031640.
114. Wierzbicka, A. (2000). Semantics of human facial expressions. Pragmatics & Cognition, 8, 147–183.
115. Yik, M., Widen, S. C., & Russell, J. A. (2013). The within-subjects design in the study of facial expressions. Cognition and Emotion, 27, 1062–1072. doi:10.1080/02699931.2013.763769.
116. Young, M. W. (1998). Malinowski’s kiriwina: fieldwork photography 1915–1918. Chicago, IL: Chicago University Press.