The effect of dynamics on identifying basic emotions from synthetic and natural faces

International Journal of Human Computer Studies

Volumn 66, Issue 4, 2008, Pages 233-242

  Kätsyri, Jari ^a   Sams, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Basic emotions; Facial animation; Movement perception

Indexed keywords

ANIMATION; FACE RECOGNITION; HUMAN COMPUTER INTERACTION; INFORMATION RETRIEVAL;

DYNAMIC INFORMATION; MOVEMENT PERCEPTION; SYNTHETIC ANIMATED FACES;

ELECTRONIC DOCUMENT IDENTIFICATION SYSTEMS;

EID: 44249101104     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2007.10.001     Document Type: Article

References (54)

1. Adolps R., Tranel D., and Damasio A.R. Dissociable neural systems for recognizing emotions. Brain and Cognition 52 (2003) 61-69
2. Ambadar Z., Schooler J.W., and Cohn J.F. Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychological Science 16 5 (2005) 403-410
3. Bagby R.M., Parker J.D.A., and Taylor G.J. The twenty-item Toronto Alexithymia Scale. Journal of Psychosomatic Research 38 (1994) 23-40
4. Baron-Cohen S., Jolliffe T., Mortimore C., and Robertson M. Another advanced test of theory of mind: evidence from very high functioning adults with autism or Asperger Syndrome. Journal of Child Psychology and Psychiatry 38 (1997) 813-822
5. Baron-Cohen S., Wheelwright S., Hill J., Raste Y., and Plumb I. The "Reading the mind in the eyes" test revised version: a study with normal adults, and adults with Asperger Syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry 42 (2001) 241-252
6. Bartneck C. How convincing is Mr. Data's smile: affective expressions of machines. User Modeling and User-Adapted Interaction 11 4 (2001) 279-295
7. Bartneck C., and Reichenbach J. Subtle emotional expressions of synthetic characters. Journal of Human-Computer Studies 62 (2005) 179-192
8. Bassili J.N. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance 4 3 (1978) 373-379
9. Behrens J.T. Principles and procedures of exploratory data analysis. Psychological Methods 2 2 (1997) 131-160
10. Bruce V., and Valentine T. When a nod's as good as a wink: the role of dynamic information in face recognition. In: Gruneberg M.M., Morris P.E., and Sykes R.N. (Eds). Practical Aspects of Memory: Current Research and Issues vol. 1 (1988), Wiley, Chichester
11. Ehrlich, S.M., Schiano, D.J., Sheridan, K., 2000. Communicating facial affect: it's not the realism, it's the motion. Paper Presented at the ACM CHI 2000 Conference on Human Factors in Computing Systems.
12. Ekman P. Cross-cultural studies of facial expression. In: Ekman P. (Ed). Darwin and Facial Expression (1973), Academic Press Inc., UK 169-222
13. Ekman P. Expression and the nature of emotion. In: Scherer K., and Ekman P. (Eds). Approaches to Emotion (1984), Lawrence Erlbaum, Hillsdale, NJ
14. Ekman P. Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. Psychological Bulletin 115 2 (1994) 268-287
15. Ekman P., and Friesen W. Unmasking the Face. A Guide to Recognizing Emotions from Facial Expressions (1975), Consulting Psychologists Press, Palo Alto, CA
16. Ekman P., and Friesen W. Pictures of Facial Affect (1978), Consulting Psychologists Press, Palo Alto, CA
17. Ekman P., Friesen W.V., and Ellsworth P. What emotion categories or dimensions can observes judge from facial behavior?. In: Ekman P. (Ed). Emotions in the Human Face (1982), Cambridge University Press, UK 39-55
18. Ekman P., Friesen W.V., O'Sullivan M., Chan A., Diacoyanni-Tarlatzis I., Heider K., et al. Universals and cultural differences in the judgments of facial expressions of emotion. Journal of Personality and Social Psychology 53 4 (1987) 712-717
19. Ekman P., Friesen W., and Hager J. Facial Action Coding System. second ed. (2002), Research Nexus eBook, Salt Lake City
20. Ekman P., Friesen W., and Hager J. Facial Action Coding System: Investigator's Guide. second ed. (2002), Research Nexus eBook, Salt Lake City
21. Frydrych, M., Kätsyri, J., Dobsík, M., Sams, M., 2003. Toolkit for animation of Finnish talking head. Paper Presented at the AVSP, St. Jorioz, France.
22. Haidt J., and Keltner D. Culture and facial expression: open-ended methods find more expressions and a gradient of recognition. Cognition and Emotion 13 3 (1999) 225-266
23. Harwood N.K., Hall L.J., and Shinkfield A.J. Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal on Mental Retardation 104 3 (1999) 270-278
24. Hess U., Blairy S., and Kleck R.E. The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior 21 4 (1997) 241-257
25. Hill H., and Johnston A. Categorizing sex and identity from the biological motion of faces. Current Biology 11 11 (2001) 880-885
26. Humphreys G.W., Donnelly N., and Riddoch M.J. Expression is computed separately from facial identity, and it is computed separately for moving and static faces: neuropsychological evidence. Neuropsychologia 31 2 (1993) 173-181
27. Izard C.E. Innate and universal facial expressions: evidence from developmental and cross-cultural research. Psychological Bulletin 115 1 (1994) 102-141
28. Kalliomäki, I., Lampinen, J., 2002. Feature-based inference of human head shapes. Paper Presented at the Finnish Conference on Artificial Intelligence (STeP), Oulu, Finland.
29. Kamachi M., Bruce V., Mukaida S., Gyoba J., Yoshikawa S., and Akamatsu S. Dynamic properties influence the perception of facial expressions. Perception 30 (2001) 875-887
30. Kanade, T., Cohn, J.F., Tian, Y., 2000. Comprehensive database for facial expression analysis. Paper Presented at the 4th IEEE International Conference on Automatic Face and Gesture Recognition.
31. Katsikitis M. The classification of facial expressions of emotion: a multidimensional-scaling approach. Perception 26 5 (1997) 613-626
32. Kätsyri, J., Klucharev, V., Frydrych, M., Sams, M., 2003. Identification of synthetic and natural emotional facial expressions. Paper Presented at the ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP), St. Jorioz, France.
33. Knight B., and Johnston A. The role of movement in face recognition. Visual Cognition 4 3 (1997) 265-273
34. Lander K., Christie F., and Bruce V. The role of movement in the recognition of famous faces. Memory and Cognition 27 6 (1999) 974-985
35. Lander K., Bruce V., and Hill H. Evaluating the effectiveness of pixelation and blurring on masking the identity of familiar faces. Applied Cognitive Psychology 15 (2001) 101-116
36. Lane R.D., Sechrest L., Reidel R., Weldon V., Kaszniak A., and Schwartz G.E. Impaired verbal and nonverbal emotion recognition in Alexithymia. Psychosomatic Medicine 58 (1996) 203-210
37. Mann L., Wise T., Trinidad A., and Kohanski R. Alexithymia, affect recognition, and the five-factor model of personality in normal subjects. Psychological Reports 74 2 (1994) 563-567
38. Massaro D.W. Perceiving Talking Faces (1998), The MIT Press, Cambridge, MA
39. Maurer D., Le Grand R., and Mondloch C.J. The many faces of configural processing. Trends in Cognitive Science 6 6 (2002) 255-260
40. Mazurski E.J., and Bond N.W. A new series of slides depicting facial expressions of affect: a comparison with the pictures of facial affect series. Australian Journal of Psychology 45 (1993) 41-47
41. Ortony A., and Turner T.J. What's basic about basic emotions?. Psychological Review 97 3 (1990) 315-331
42. O'Toole A.J., Harms J., Snow S.L., Hurst D.R., Pappas M.R., Ayyad J.H., et al. A video database of moving faces and people. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 (2005) 812-816
43. Parker J.D.A., Taylor G.J., and Bagby R.M. Alexithymia and the recognition of facial expression of emotion. Psychotherapy and Psychosomatics 59 (1993) 197-202
44. Parker P.D., Prkachin K.M., and Prkachin G.C. Processing of facial expressions of negative emotion in alexithymia: the influence of temporal constraint. Journal of Personality 73 4 (2005) 1087-1107
45. Pelachaud C., Badler N.I., and Steedman M. Linguistic issues in facial animation. In: Magnenat-Thalmann N., and Thalmann D. (Eds). Computer Animation '91 (1991), Springer 15-30
46. Roark D.A., Barrett S.E., Spence M.J., Hervé A., and O'Toole A.J. Psychological and neural perspectives on the role of motion in face recognition. Behavioral and Cognitive Neuroscience Reviews 2 1 (2003) 15-46
47. Rosenberg E.L., and Ekman P. Conceptual and methodological issues in the judgment of facial expressions of emotion. Motivation and Emotion 19 (1995) 111-138
48. Russell J.A. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin 115 1 (1994) 102-141
49. Russell J.A. Facial expressions of emotion: what lies beyond minimal universality?. Psychological Bulletin 118 3 (1995) 379-391
50. Salminen J.K., Saarijärvi S., Äärelä E., Toikka T., and Kauhanen J. Prevalence of alexithymia and its association with sociodemographic variables in the general population of Finland. Journal of Psychosomatic Research 46 1 (1999) 75-82
51. Taylor G.J., Bagby R.M., and Parker J.D.A. The Alexithymia construct. A potential paradigm for psychosomatic medicine. Psychosomatics 32 (1991) 153-164
52. Terzopoulos D., and Waters K. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 6 (1993) 569-579
53. Waters K. A muscle model for animating three-dimensional facial expressions. Computer Graphics 21 4 (1987) 17-24
54. Wehrle T., Kaiser S., Schmidt S., and Scherer K.R. Studying dynamic models of facial expression of emotion using synthetic animated faces. Journal of Personality and Social Psychology 78 1 (2000) 105-119