Asymmetric facial expressions: Revealing richer emotions for embodied conversational agents

Computer Animation and Virtual Worlds

Volumn 24, Issue 6, 2013, Pages 539-551

  Ahn, Junghyun ^a   Gobron, Stephane ^a,b   Thalmann, Daniel ^c   Boulic, Ronan ^a  

^a EPFL   (Switzerland)

^b Information and Communication Systems (ISIC)   (Switzerland)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

asymmetric facial expression; embodied agent; evaluation study; linear model; real time application; VAD emotional model

Indexed keywords

EMBODIED AGENT; EMOTIONAL MODELS; EVALUATION STUDY; FACIAL EXPRESSIONS; LINEAR MODELING; REAL-TIME APPLICATION;

GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; VIRTUAL REALITY;

FACE RECOGNITION;

EID: 84891040307     PISSN: 15464261     EISSN: 1546427X     Source Type: Journal    
DOI: 10.1002/cav.1539     Document Type: Article

References (46)

1. Ekman P, Friesen WV,. Facial Action Coding System. 1978.
2. Ekman P,. Universals and cultural differences in facial expressions of emotions. In Nebraska Symposium on Motivation. Univ. of Nebraska Press, Lincoln, NE, USA, 1971; 207-283.
3. Averill JR,. A semantic atlas of emotional concepts. JSAS Catalog of Selected Documents in Psychology 1975; 5 (330): 1-64.
4. Russell JA., A circumplex model of affect. Journal of Personality and Social Psychology 1980; 39 (6): 1161-1178.
5. Schatz H,. In Character: Actors Acting. Bulfinch Press, 2006.
6. Sackeim HA, Gur RC, Saucy MC,. Emotions are expressed more intensely on the left side of the face. Science 1978; 202 (4366): 434-436.
7. Ekman P, Friesen WV,. Felt, false, and miserable smiles. Journal of Nonverbal Behavior 1982; 6 (4): 238-252.
8. Bassili JN,. Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 1979; 37 (11): 2049-2058.
9. Martin J-C, Niewiadomski R, Devillers L, Buisine S, Pelachaud C,. Multimodal complex emotions: gesture expressivity and blended facial expressions. International Journal of Humanoid Robotics 2006; 3 (3): 269-291.
10. Krumhuber E, Kappas A,. Moving smiles: the role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 2005; 29 (1): 3-24.
11. Cowie R,. Perceiving emotion: towards a realistic understanding of the task. Philosophical Transactions of The Royal Society B 2009; 364: 3515-3525.
12. Grammer K, Thornhill R,. Human (Homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. Journal of Comparative Psychology 1994; 108 (3): 233-242.
13. Borod JC, Koff E, Yecker S, Santschi C, Schmidt JM,. Facial asymmetry during emotional expression: gender, valence, and measurement technique. Neuropsychologia 1998; 36 (11): 1209-1215.
14. Campbell R,. The lateralisation of emotion: a critical review. International Journal of Psychology 1982; 17 (1-4): 211-229.
15. Borod J, Haywood C, Koff E,. Neuropsychological aspects of facial asymmetry during emotional expression: a review of the normal adult literature. Neuropsychology Review 1997; 7 (1): 41-60.
16. Borod JC, Caron HS,. Facedness and emotion related to lateral dominance, sex and expression type. Neuropsychologia 1980; 18 (2): 237-241.
17. Schiff BB, MacDonald B,. Facial asymmetries in the spontaneous response to positive and negative emotional arousal. Neuropsychologia 1990; 28 (8): 777-785.
18. Schwartz GE, Ahern GL, Brown S-L,. Lateralized facial muscle response to positive and negative emotional stimuli. Psychophysiology 1979; 16 (6): 561-571.
19. Dimberg U, Petterson M,. Facial reactions to happy and angry facial expressions: evidence for right hemisphere dominance. Psychophysiology 2000; 37 (5): 693-696.
20. Wyler F, Graves RE, Landis T,. Cognitive task influence on relative hemispheric motor control: mouth asymmetry and lateral eye movements. Journal of Clinical and Experimental Neuropsychology 1987; 9 (2): 105-116.
21. Fasel B, Luettin J,. Recognition of asymmetric facial action unit activities and intensities. In Proceedings of the International Conference on Pattern Recognition. IEEE Computer Society, Washington, DC, USA, 2000; 1100-1103.
22. Parke FI, Waters K,. Computer Facial Animation. AK Peters, Natick, Massachusetts, USA, 2008.
23. Deng Z, Neumann U,. Data-driven 3D Facial Animation. Springer: London, 2007.
24. Pighin F, Hecker J, Lischinski D, Szeliski R, Salesin DH,. Synthesizing realistic facial expressions from photographs. In SIGGRAPH '98. ACM, New York, NY, USA, 1998; 75-84.
25. Tena JR, De la Torre F, Matthews I,. Interactive region-based linear 3D face models. ACM Transactions on Graphics 2011; 30 (4): 76:1-76:10.
26. Vinayagamoorthy V, Gillies M, Steed A, Tanguy E, Pan X, Loscos C, Slater M,. Building expression into virtual characters. In Eurographics Conference State of the Art Report. Eurographics Association, 2006.
27. Pelachaud C, Poggi I,. Subtleties of facial expressions in embodied agents. Journal of Visualization and Computer Animation 2002; 13 (5): 301-312.
28. Egges A, Kshirsagar S, Magnenat-Thalmann N,. Generic personality and emotion simulation for conversational agents. CAVW 2004; 15: 1-13.
29. Albrecht I, Schröder M, Haber J, Seidel H-P,. Mixed feelings: expression of non-basic emotions in a muscle-based talking head. VR 2005; 8 (4): 201-212.
30. Pelachaud C,. Modelling multimodal expression of emotion in a virtual agent. Philosophical Transactions of The Royal Society B 2009; 364 (1535): 3539-3548.
31. Lance B, Marsella S,. Glances, glares, and glowering: how should a virtual human express emotion through gaze? AAMAS 2010; 20 (1): 50-69.
32. Paterson HM, Pollick FE, Sanford AJ,. The role of velocity in affect discrimination. In Proceedings of the 23rd Annual Conference of the Cognitive Science Society. Psychology Press, 2001; 756-761.
33. Ahn J, Gobron S, Silvestre Q, Thalmann D,. Asymmetrical facial expressions based on an advanced interpretation of two-dimensional Russells emotional model. In Engage Summer School Workshop, 2010.
34. Ahn J, Gobron S, Thalmann D, Boulic R,. Conveying real-time ambivalent feelings through asymmetric facial expressions. In Motion in Games, Vol. 7660, Kallmann M, Bekris K, (eds), Lecture Notes in Computer Science. Springer, Berlin, 2012; 122-133.
35. Bush LE,. Individual differences multidimensional scaling of adjectives denoting feelings. Journal of Personality and Social Psychology 1973; 25 (1): 50-57.
36. Mehrabian A, Russell JA,. An Approach to Environmental Psychology. The MIT Press, Cambridge, Massachusetts, USA, 1974.
37. Bradley MM, Lang PJ,. Affective norms for English words (ANEW): stimuli, instruction manual and affective ratings, Technical Report C-1, University of Florida, Center for Research in Psychophysiology, Gainesville, 1999.
38. Ekman P,. About brows: emotional and conversational signals. In Human Ethology, von Cranach M, Foppa K, Lepenies W, Ploog D, (eds). Cambridge University Press, Cambridge, 1979; 169-248.
39. Ekman P, Roper G, Hager JC,. Deliberate facial movement. Child Development 1980; 51 (3): 886-891.
40. Ekman P, Friesen WV, Ancoli S,. Facial signs of emotional experience. Journal of Personality and Social Psychology 1980; 39 (6): 1125-1134.
41. Boucher JD, Ekman P,. Facial areas and emotional information. Journal of Communication 1975; 25 (2): 21-29.
42. Magnenat-Thalmann N, Thalmann D,. Handbook of Virtual Humans. Wiley, Chichester UK, 2004.
43. Mac Manus IC,. Symmetry and asymmetry in aesthetics and the arts. European Review 2005; 13: 157-180.
44. Norman GJ, Norris CJ, Gollan J, Ito TA, Hawkley LC, Larsen JT, Cacioppo JT, Berntson GG,. Current emotion research in psychophysiology: the neurobiology of evaluative bivalence. Emotion Review 2011; 3: 349-359.
45. Chmiel A, Sobkowicz P, Sienkiewicz J, Paltoglou G, Buckley K, Thelwall M, Holyst JA,. Negative emotions boost user activity at BBC forum. Physica A: Statistical Mechanics and its Applications 15 August 2011; 390 (16): 2936-2944. http://dx.doi.org/10.1016/j.physa.2011.03.040.
46. Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A,. Sentiment in short strength detection informal text. JASIST 2010; 61 (12): 2544-2558.