Effects of dynamic aspects of facial expressions: A review

Emotion Review

Volumn 5, Issue 1, 2013, Pages 41-46

  Krumhuber, Eva G ^a   Kappas, Arvid ^a   Manstead, Antony S R ^b  

^a JACOBS UNIVERSITY BREMEN   (Germany)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

dynamics; facial expression; motion; temporal

Indexed keywords

EID: 84872171923     PISSN: 17540739     EISSN: None     Source Type: Journal    
DOI: 10.1177/1754073912451349     Document Type: Review

References (65)

1. Adolphs R., Tranel D., Damasio A. R.. Dissociable neural systems for recognizing emotions. Brain and Cognition. 2003 ; 52: 61-69
2. Ambadar Z., Cohn J. F., Reed L. I.. All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior. 2009 ; 33: 17-34
3. Ambadar Z., Schooler J., Cohn J.. Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science. 2005 ; 16: 403-410
4. Arsalidou M., Morris D., Taylor M. J.. Converging evidence for the advantage of dynamic facial expressions. Brain Topography. 2011 ; 24: 149-163
5. Back E., Ropar D., Mitchell P.. Do the eyes have it? Inferring mental states from animated faces in autism. Child Development. 2007 ; 78: 397-411
6. Bassili J. N.. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance. 1978 ; 4: 373-379
7. Bassili J. N.. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology. 1979 ; 37: 2049-2058
8. Biele C., Grabowska A.. Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research. 2006 ; 26: 1-6
9. Bould E., Morris N.. Role of motion signals in recognizing subtle facial expressions of emotion. British Journal of Psychology. 2008 ; 99: 167-189
10. Bould E., Morris N., Wink B.. Recognising subtle emotional expressions: The role of facial movements. Cognition & Emotion. 2008 ; 22: 1569-1587
11. Bruce V., Valentine T. Practical aspects of memory: Current research and issues. Gruneberg M. M. Morris P. E. Sykes R. N., ed. New York, NY: John Wiley & Sons ; 1988: 169-174.
12. Bugental D. B.. Unmasking the "polite smile": Situational and personal determinants of managed affect in adult-child interaction. Personality and Social Psychology Bulletin. 1986 ; 12: 7-16
13. Butler E. A.. Temporal interpersonal emotion systems: The "TIES" that form relationships. Personality and Social Psychology Review. 2011 ; 15: 367-393
14. Calvo R. A., D'Mello S. K.. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing. 2010 ; 1: 18-37
15. Cosker D., Krumhuber E., Hilton A. Proceedings of the Symposium on Applied Perception in Graphics and Visualization (APGV). Gutierrez D. Kearney J. Banks J. Mania K., ed. New York, NY: ACM ; 2010: 101-108.
16. CoskerD.KrumhuberE.HiltonA. (2011). A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In MetaxasD.QuanL.SanfeliuA.van GoolL. (Eds.), Proceedings of the 13th International Conference on Computer Vision (ICCV) (pp. 2296-2303). Retrieved from http://www.computer.org/portal/web/csdl/doi/10.1109/ICCV.2011.6126510
17. Cunningham D. W., Wallraven C. Proceedings of the 6th Symposium on Applied Perception in Graphics and Visualization (APGV2009). Bodenheimer B. O'Sullivan B., ed. New York, NY: ACM ; 2009a: 41-44.
18. Cunningham D. W., Wallraven C.. Dynamic information for the recognition of conversational expressions. Journal of Vision. 2009b ; 9: 1-17
19. Darwin C. The expression of the emotions in man and animals. London, UK: John Murray ; 1872:
20. Edwards K.. The face of time: Temporal cues in facial expressions of emotion. Psychological Science. 1998 ; 9: 270-276
21. Ehrlich S. M., Schiano D. J., Sheridan K. Proceedings of the ACM CHI 2000 Conference on Human Factors in Computing Systems. Szwillus G. Turner T., ed. New York, NY: ACM ; 2000: 252-253.
22. Ekman P., Friesen W. V., Ellsworth P. Emotion in the human face: Guidelines for research and an integration of findings. New York, NY: Pergamon Press ; 1972:
23. Fiorentini C., Viviani P.. Is there a dynamic advantage for facial expressions?. Journal of Vision. 2011 ; 11: 1-15
24. Gibson J. J. The senses considered as perceptual systems. Boston, MA: Houghton Mifflin ; 1966:
25. Harwood N. K., Hall L. J., Shinkfield A. J.. Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal of Mental Retardation. 1999 ; 104: 270-278
26. Hess U., Kleck R. E.. The cues decoders use in attempting to differentiate emotion-elicited and posed facial expressions. European Journal of Social Psychology. 1994 ; 24: 367-381
27. Hill H. C. H., Troje N. F., Johnston A.. Range- and domain-specific exaggeration of facial speech. Journal of Vision. 2005 ; 5: 793-807
28. Humphreys G. W., Donnelly N., Riddoch M. J.. Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia. 1993 ; 31: 173-181
29. Kamachi M., Bruce V., Mukaida S., Gyoba J., Yoshikawa S., Akamatsu S.. Dynamic properties influence the perception of facial expressions. Perception. 2001 ; 30: 875-887
30. Kappas A. The human face: Measurement and meaning. Katsikitis M., ed. Dordrecht, The Netherlands: Kluwer Academic Publishers ; 2003: 215-234.
31. Kappas A.. Smile when you read this, whether you like it or not: Conceptual challenges to affect detection. IEEE Transactions on Affective Computing. 2010 ; 1: 38-41
32. Kappas A.. Emotion and regulation are one!. Emotion Review. 2011 ; 3: 17-25
33. Kappas A., Descôteaux J. Nonverbal behavior in clinical settings. Philippot P. Coats E. J. Feldman R. S., ed. New York, NY: Oxford University Press ; 2003: 45-74.
34. Kätsyri J., Sams M.. The effect of dynamics on identifying basic emotions from synthetic and natural faces. International Journal of Human-Computer Studies. 2008 ; 66: 233-242
35. Kessler H., Doyen-Waldecker C., Hofer C., Hoffmann H., Traue H. C., Abler B.. Neural correlates of the perception of dynamic versus static facial expressions of emotion. Psychosocial Medicine. 2011 ; 8: 1-8
36. Kilts C. D., Egan G., Gideon D. A., Ely T. D., Hoffman J. M.. Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions. Neuroimage. 2003 ; 18: 158-168
37. Krumhuber E., Kappas A.. Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior. 2005 ; 29: 3-24
38. Krumhuber E., Manstead A. S. R.. Can Duchenne smiles be feigned? New evidence on felt and false smiles. Emotion. 2009 ; 9: 807-820
39. Krumhuber E., Manstead A. S. R., Cosker D., Marshall D., Rosin P. L.. Effects of dynamic attributes of smiles in human and synthetic faces: A simulated job interview setting. Journal of Nonverbal Behavior. 2009 ; 33: 1-15
40. Krumhuber E., Manstead A. S. R., Cosker D., Marshall D., Rosin P. L., Kappas A.. Facial dynamics as indicators of trustworthiness and cooperative behavior. Emotion. 2007 ; 7: 730-735
41. Krumhuber E., Manstead A. S. R., Kappas A.. Temporal aspects of facial displays in person and expression perception: The effects of smile dynamics, head-tilt and gender. Journal of Nonverbal Behavior. 2007 ; 31: 39-56
42. Krumhuber E., Scherer K. R.. Affect bursts: Dynamic patterns of facial expression. Emotion. 2011 ; 11: 825-841
43. LaBar K. S., Crupain M. J., Voyvodic J. T., McCarthy G.. Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex. 2003 ; 13: 1023-1033
44. Lederman S. J., Klatzky R. L., Abramowicz A., Salsman K., Kitada R., Hamilton C.. Haptic recognition of static and dynamic expressions of emotion in the life face. Psychological Science. 2007 ; 18: 158-164
45. Leonard C. M., Voeller K. K., Kuldau J. M.. When's a smile a smile? Or how to detect a message by digitizing the signal. Psychological Science. 1991 ; 2: 166-172
46. Maringer M., Krumhuber E., Fischer A. H., Niedenthal P. M.. Beyond smile dynamics: Mimicry and beliefs in judgments of smiles. Emotion. 2011 ; 11: 181-187
47. Mauss I. B., Robinson M. D.. Measures of emotion: A review. Cognition & Emotion. 2009 ; 23: 209-237
48. Niedenthal P. M., Brauer M., Halberstadt J. B., Innes-Ker Å. H.. When did her smile drop? Facial mimicry and the influence of emotional state on the detection of change in emotional expression. Cognition & Emotion. 2001 ; 15: 853-864
49. Pantic M., Patras I.. Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics. 2006 ; 36: 433-449
50. Ruef A. M., Levenson R. W. Handbook of emotion elicitation and assessment. Coan J. A. Allen J. B., ed. New York, NY: Oxford University Press ; 2007: 286-297.
51. Russell J. A.. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin. 1994 ; 115: 102-141
52. Russell J. A., Bachorowski J. A., Fernández-Dols J. M.. Facial and vocal expression of emotion. Annual Review of Psychology. 2003 ; 54: 329-349
53. Sato W., Fujimura T., Suzuki N.. Enhanced facial EMG activity in response to dynamic facial expressions. International Journal of Psychophysiology. 2008 ; 70: 70-74
54. Sato W., Kochiyama T., Yoshikawa S., Naito E., Matsumura M.. Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study. Cognitive Brain Research. 2004 ; 20: 81-91
55. Sato W., Yoshikawa S.. The dynamic aspects of emotional facial expressions. Cognition & Emotion. 2004 ; 18: 701-710
56. Sato W., Yoshikawa S.. Enhanced experience of emotional arousal in response to dynamic facial expressions. Journal of Nonverbal Behavior. 2007a ; 31: 119-135
57. Sato W., Yoshikawa S.. Spontaneous facial mimicry in response to dynamic facial expressions. Cognition. 2007b ; 104: 1-18
58. Schultz J., Pilz K. S.. Natural facial motion enhances cortical responses to faces. Experimental Brain Research. 2009 ; 194: 465-475
59. Tcherkassof A., Bollon T., Dubois M., Pansu P., Adam J. M.. Facial expressions of emotions: A methodological contribution to the study of spontaneous and dynamic emotional faces. European Journal of Social Psychology. 2007 ; 37: 1325-1345
60. Vinter A.. The role of movement in eliciting early imitations. Child Development. 1986 ; 57: 66-71
61. Wallraven C., Breidt M., Cunningham D. W., Bülthoff H. H.. Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perception. 2008 ; 4: 1-20
62. Wehrle T., Kaiser S., Schmidt S., Scherer K. R.. Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology. 2000 ; 78: 105-119
63. Weyers P., Mühlberger A., Hefele C., Pauli P.. Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology. 2006 ; 43: 1-4
64. With S., Kaiser S.. Sequential patterning of facial actions in the production and perception of emotional expressions. Swiss Journal of Psychology. 2011 ; 70: 241-252
65. Yoshikawa S., Sato W.. Dynamic facial expressions of emotion induce representational momentum. Cognitive, Affective, & Behavioral Neuroscience. 2008 ; 8: 25-31