Decoupling facial expressions and head motions in complex emotions

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Volumn , Issue , 2015, Pages 274-280

  Adams, Andra ^a   Mahmoud, Marwa ^a   Baltrusaitis, Tadas ^a   Robinson, Peter ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

affective computing; emotion recognition

Indexed keywords

INTELLIGENT COMPUTING;

AFFECTIVE COMPUTING; AUTOMATED RECOGNITION; COMPLEX EMOTIONS; EMOTION RECOGNITION; EMOTIONAL INFORMATION; FACIAL EXPRESSIONS; HEAD MOTION;

BEHAVIORAL RESEARCH;

EID: 84964054504     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2015.7344583     Document Type: Conference Paper

References (36)

1. N. Ambady and R. Rosenthal, "Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis," Psychological Bulletin, vol. 111, no. 2, pp. 256-274, 1992.
2. S. Duncan, "Some signals and rules for taking speaking turns in conversations." Journal of personality and social psychology, vol. 23, no. 2, p. 283, 1972.
3. B. Parkinson, "Do facial movements express emotions or communicate motives?" Personality and Social Psychology Review, vol. 9, no. 4, pp. 278-311, 2005.
4. P. Ekman, W. V. Friesen, and P. Ellsworth, Emotion in the Human Face, 2nd ed., P. Ekman, Ed. Cambridge University Press, 1982.
5. F. De la Torre and J. F. Cohn, Guide to Visual Analysis of Humans: Looking at People. Springer, 2011, ch. Facial Expression Analysis.
6. J. F. Cohn and F. De la Torre, "Automated face analysis for affective computing," The Oxford Handbook of Affective Computing, p. 131, 2014.
7. J. N. Bassili, "Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face." Journal of personality and social psychology, vol. 37, no. 11, p. 2049, 1979.
8. Z. Hammal and J. F. Cohn, "Intra-and interpersonal functions of head motion in emotion communication," in Workshop on Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges. ACM, 2014, pp. 19-22.
9. R. el Kaliouby, P. Robinson, and S. Keates, "Temporal context and the recognition of emotion from facial expression," in HCI International Conference, 2003.
10. M. F. Valstar, "Timing is everything: A spatio-temporal approach to the analysis of facial actions," Ph.D. dissertation, 2008.
11. E. Sariyanidi, H. Gunes, and A. Cavallaro, "Automatic analysis of facial affect: A survey of registration, representation and recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014.
12. G. A. Ramirez, T. Baltrušaitis, and L.-P. Morency, "Modeling latent discriminative dynamic of multi-dimensional affective signals," in 1st International Audio/Visual Emotion Challenge and Workshop in conjunction with Affective Computing and Intelligent Interaction, 2011.
13. H. Gunes and M. Pantic, "Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners," in Intelligent virtual agents. Springer, 2010, pp. 371-377.
14. P. Ekman and W. V. Friesen, "Head and body cues in the judgment of emotion: A reformulation," Perceptual and motor skills, vol. 24, no. 3, pp. 711-724, 1967.
15. J. L. Tracy and D. Matsumoto, "The spontaneous expression of pride and shame: Evidence for biologically innate nonverbal displays," Proceedings of the National Academy of Sciences, vol. 105, no. 33, pp. 11 655-11 660, 2008.
16. D. Keltner, "Evidence for the distinctness of embarrassment, shame, and guilt: A study of recalled antecedents and facial expressions of emotion," Cognition &Emotion, vol. 10, no. 2, pp. 155-172, 1996.
17. J. A. Harrigan and D. M. O'Connell, "How do you look when feeling anxious? Facial displays of anxiety," Personality and Individual Differences, vol. 21, no. 2, pp. 205-212, 1996.
18. A. N. Meltzoff and M. K. Moore, "Imitation in newborn infants: Exploring the range of gestures imitated and the underlying mechanisms." Developmental psychology, vol. 25, no. 6, p. 954, 1989.
19. G. Castellano, M. Mortillaro, A. Camurri, G. Volpe, and K. Scherer, "Automated analysis of body movement in emotionally expressive piano performances," 2008.
20. I. Poggi, F. D'Errico, and L. Vincze, "Types of nods. The polysemy of a social signal." in LREC, 2010.
21. A. Mignault and A. Chaudhuri, "The many faces of a neutral face: Head tilt and perception of dominance and emotion," Journal of Nonverbal Behavior, vol. 27, no. 2, pp. 111-132, 2003.
22. J. L. Tracy and R. W. Robins, "The prototypical pride expression: Development of a nonverbal behavior coding system." Emotion, vol. 7, no. 4, p. 789, 2007.
23. U. Hess, R. B. Adams Jr, and R. E. Kleck, "Looking at you or looking elsewhere: The influence of head orientation on the signal value of emotional facial expressions," Motivation and Emotion, vol. 31, no. 2, pp. 137-144, 2007.
24. D. Neth and A. M. Martinez, "Emotion perception in emotionless face images suggests a norm-based representation." Journal of vision, 2009.
25. H. O'Reilly, D. Pigat, S. Fridenson, S. Berggren, S. Tal, O. Golan, S. Bolte, S. Baron-Cohen, and D. Lundqvist, "The EU-Emotion Stimulus Set: A Validation Study," Under review, 2015.
26. M. G. Frank and J. Stennett, "The forced-choice paradigm and the perception of facial expressions of emotion." Journal of personality and social psychology, vol. 80, no. 1, p. 75, 2001.
27. T. Baltrušaitis, P. Robinson, and L.-P. Morency, "Continuous conditional neural fields for structured regression," in European Conference on Computer Vision. Springer, 2014, pp. 593-608.
28. K. Krippendorff, "Agreement and information in the reliability of coding," Communication Methods and Measures, vol. 5, no. 2, pp. 93-112, 2011.
29. S. Afzal and P. Robinson, "Natural affect data: Collection and annotation," in New Perspectives on Affect and Learning Technologies. Springer, 2011, pp. 55-70.
30. P. Ekman and H. Oster, "Facial expressions of emotion," Annual review of psychology, vol. 30, no. 1, pp. 527-554, 1979.
31. J. M. Reeve, "The face of interest," Motivation and Emotion, vol. 17, no. 4, pp. 353-375, 1993.
32. Darwin, Charles (1872), The expression of the emotions in man and animals. Oxford University Press, 2002.
33. R. El Kaliouby and P. Robinson, "Real-time inference of complex mental states from facial expressions and head gestures," in Real-time vision for human-computer interaction. Springer, 2005, pp. 181-200.
34. A. Kapoor and R. W. Picard, "A real-time head nod and shake detector," in Proceedings of the Workshop on Perceptive User Interfaces. ACM, 2001, pp. 1-5.
35. P. Ekman, W. V. Friesen, M. O'Sullivan, A. Chan, I. Diacoyanni-Tarlatzis, K. Heider, R. Krause, W. A. LeCompte, T. Pitcairn, P. E. Ricci-Bitti et al., "Universals and cultural differences in the judgments of facial expressions of emotion." Journal of personality and social psychology, vol. 53, no. 4, p. 712, 1987.
36. J. F. Cohn, L. I. Reed, T. Moriyama, J. Xiao, K. Schmidt, and Z. Ambadar, "Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles," in 6th IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, 2004, pp. 129-135.