Foundations of human computing: Facial expression and emotion

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4451 LNAI, Issue , 2007, Pages 1-16

  Cohn, Jeffrey F ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

Automatic facial image analysis; Emotion; Facial expression; Human computer interaction; Measurement; Temporal dynamics

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHLORINE COMPOUNDS; FACE RECOGNITION; FLOW INTERACTIONS;

AUTOMATIC FACIAL IMAGE ANALYSIS; DYADIC INTERACTION; EMOTION; EMOTION RECOGNITION; FACIAL EXPRESSION; FACIAL EXPRESSIONS; HUMAN COMPUTING; HUMAN-CENTERED COMPUTING; HUMAN-COMPUTER INTERACTION; HYDERABAD , INDIA; INDIVIDUAL DIFFERENCES; INTERNATIONAL WORKSHOPS; JOINT CONFERENCE; MEASUREMENT; MULTIPLE COMPONENTS; PERCEPTUAL USER INTERFACES; PHYSIOLOGICAL INDICATORS; SELF-REPORT; TEMPORAL DYNAMICS; TYPICAL PATTERNS;

USER INTERFACES;

EID: 49949106276     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-72348-6_1     Document Type: Conference Paper

References (66)

1. Lazaras, R.S.: Emotion and adaptation. Oxford, NY (1991)
2. Ekman, P.: Emotions revealed. Times, New York, NY (2003)
3. Keltner, D., Haidt, J.: Social functions of emotions at multiple levels of analysis. Cognition and Emotion 13 (1999) 505-522
4. Darwin, C: The expression of the emotions in man and animals (3rd Edition). Oxford University, New York, New York ( 1872/1998)
5. Ekman, P., Rosenberg, E. (eds.): What the face reveals. Oxford, New York (2005)
6. Pantic, M., Patras, L: Dynamics of facial expressions: Recognition of facial actions and their temporal segments from profile image sequences. IEEE Transactions on Systems, Man, and Cybernetics, Part B 36 (2006) 443-449
7. Tian, Y., Cohn, J.F., Kanade, T.: Facial expression analysis. In: Li, S.Z., Jain, A.K. (eds.): Handbook of face recognition. Springer, New York, New York (2005) 247-276
8. Pantic, M., Rothkrantz, M.: Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (2000) 1424-1445
9. Davidson, R.J., Ekman, P., Saron, C.D., Senulis, J.A., Friesen, W.V.: Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology I. Journal of Personality and Social Psychology 58 (1990) 330-341
10. Levenson, R.W., Ekman, P., Friesen, W.V.: Voluntary facial action generates emotionspecific autonomic nervous system activity. Psychophysiology 27 (1990) 363-384
11. Watson, D., Tellegen, A.: Toward a consensual structure of mood. Psychological Bulletin 98 (1985) 219-235
12. Cohn, J.F., Elmore, M.: Effects of contingent changes in mothers' affective expression on the organization of behavior in 3-month old infants. Infants Behavior and Development 11 (1988) 493-505
13. Schmidt, K.L., Cohn, J.F.: Human facial expressions as adaptations: Evolutionary perspectives in facial expression research. Yearbook of Physical Anthropology 116 (2001) 8-24
14. Gottman, J., Levenson, R., Woodin, E.: Facial expressions during marital conflict Journal of Family Communication 1 (2001) 37-57
15. Cohn, J.F., Campbell, S.B.: Influence of maternal depression on infant affect regulation. In: Cicchetti, D., Toth, S.L. (eds.): Developmental perspectives on depression. University of Rochester Press, Rochester, New York (1992) 103-130
16. Cohn, J.F., Schmidt, K.L., Gross, R., Ekman, P.: Individual differences in facial expression: Stability over time, relation to self-reported emotion, and ability to inform person identification. International Conference on Multimodal User Interfaces, Pittsburgh, PA (2002) 491-496
17. Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Fully automatic facial action recognition in spontaneous behavior. IEEE International Conference on Automatic Face and Gesture Recognition, Vol. FG 2006, Southampton, England (2006) 223-228
18. Valstar, M.F., Pantic, M., Ambadar, Z., Cohn, J.F.: Spontaneous vs. posed facial behavior: Automatic analysis of brow actions. ACM International Conference on Multimodal Interfaces, Banff, Canada (2006) 162-170
19. Lucey, S., Matthews, I., Hu, C., Ambadar, Z., De la Torre, F., Cohn, J.F.: AAM derived face representations for robust facial action recognition. Seventh IEEE International Conference on Automatic Face and Gesture Recognition, Southampton, UK (2006) 155-160
20. Baker, S.M., Cohn, J.F., Matthews, I., Ashenfelter, K., Spies, J., Brick, T., Deboeck, P., Covey, E., Tiberio, S.: Coordinated motion and facial expression in dyadic conversation. NSF Human and Social Dynamics Principal Investigators Meeting, Washington, DC. (2006)
21. Cohn, J.F., Ambadar, Z., Ekman, P.: Observer-based measurement of facial expression with the Facial Action Coding System. In: Coan, J.A., Allen, J.B. (eds.): The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science. Oxford University, New York, NY (In press)
22. Ekman, P.: An argument for basic emotions. Cognition and Emotion 6 (1992) 169-200
23. Ekman, P., Friesen, W.V.: Unmasking the face: A guide to emotions from facial cues. Prentice-Hall Inc., Englewood Cliffs, NJ (1975)
24. Ekman, P., Friesen, W.V.: Facial action coding system. Consulting Psychologists Press, Palo Alto, CA (1978)
25. Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Vol. 4, Grenoble (2000) 46-53
26. Pantic, M., Sebe, N., Cohn, J.F., Huang, T.S.: Affective multimodal human-computer interaction. ACM International Conference on Multimedia (2005) 669-676
27. Pantic, M., Rothkrantz, M.: Toward an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE 91 (2003) 1371-1390
28. Keltner, D., Ekman, P.: Facial expression of emotion. In: Lewis, M., Haviland, J.M. (eds.): Handbooks of emotions. Guilford, New York (2000) 236-249
29. Scherer, K.R.: What does facial expression express? In: Strongman, K.T. (ed.): International Review of Studies on Emotion, Vol. 2. John Wiley & Sons Ltd. (1992) 138-165
30. Izard, C.E., Dougherty, L.M., Hembree, E.A.: A system for identifying affect expressions by holistic judgments. Instructional Resources Center, University of Delaware, Newark, Delaware (1983)
31. Ekman, P., Friesen, W.V., O'Sullivan, M.: Smiles when lying. Journal of Personality and Social Psychology 54 (1988) 414-420
32. Cohn, J.F., Ekman, P.: Measuring facial action by manual coding, facial EMG, and automatic facial image analysis. In: Harrigan, J.A., Rosenthal, R., Scherer, K. (eds.): Handbook of nonverbal behavior research methods in the affective sciences. Oxford, New York (2005) 9-64
33. Ekman, P., Friesen, W.V., Hager, J.C. (eds.): Facial action coding system. Research Nexus, Network Research Information, Salt Lake City, UT (2002)
34. Rosenthal, R.: Conducting judgment studies. In: Harrigan, J.A., Rosenthal, R., Scherer, K.R. (eds.): Handbook of nonverbal behavior research methods in the affective sciences. Oxford, NY (2005) 199-236
35. Oster, H., Hegley, D., Nagel, L.: Adult judgments and fine-grained analysis of infant facial expressions: Testing the validity of a priori coding formulas. Developmental Psychology 28 (1992) 1115-1131
36. Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.B. (eds.): The handbook of emotion elicitation and assessment. Oxford, New York, NY (in press)
37. Eibl-Eibesfeldt, I.: Human ethology. Aldine de Gruvier, NY, NY (1989)
38. Sayette, M.A., Cohn, J.F., Wertz, J.M., Perrott, M.A., Parrott, D.J.: A psychometric evaluation of the Facial Action Coding System for assessing spontaneous expression. Journal of Nonverbal Behavior 25 (2001) 167-186
39. Fridlund, A.J., Sabini, J.P., Hedlund, L.E., Schaut, J.A., Shenker, J.J., Knauer, M.J.: Audience effects on solitary faces during imagery: Displaying to the people in your head. Journal of Nonverbal Behavior 14 (1990) 113-137
40. Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. International Journal of Wavelets, Multiresolution and Information Processing 2 (2004) 1-12
41. Fleiss, J.L.: Statistical methods for rates and proportions. Wiley, New York, New York (1981)
42. Messinger, D.S., Chow, S.M., Koterba, S., Hu, C., Haltigan, J.D., Wang, T., Cohn, J.F.: Continuously measured smile dynamics in infant-mother interaction. Miami (2006)
43. Ibanez, L., Messinger, D., Ambadar, Z., Cohn, J.F.: Automated measurement of infant and mother interactive smiling. American Psychological Society (2006)
44. Russell, J.A., Fernandez-Dols, J.M. (eds.): The psychology of facial expression. Cambridge University, Cambridge, United Kingdom (1997)
45. Ekman, P.: Facial expression and emotion. American Psychologist 48 (1993) 384-392
46. Cohn, J.F.: Automated analysis of the configuration and timing of facial expression. In: Ekman, P., Rosenberg, E. (eds.): What the face reveals. Oxford, New York (2005) 388-392
47. Theobald, B.J., Cohn, J.F.: Facial image synthesis. In: Sander, D., Scherer, K.R. (eds.): Oxford companion to affective sciences: An encyclopedic dictionary for the affective sciences. Oxford University Press, NY (In press) xxx-xxx
48. Edwards, K.: The face of time: Temporal cues in facial expressions of emotion. Psychological Science 9 (1998) 270-276
49. Krumhuber, E., Kappas, A.: Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 29 (2005) 3-24
50. Cohn, J.F., Reed, L.I., Moriyama, T., Xiao, J., Schmidt, K.L., Ambadar, Z.: Multimodal coordination of facial action, head rotation, and eye motion. Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Vol. FG'04, Seoul, Korea (2004) 645-650
51. Ambadar, Z., Schooler, J., Cohn, J.F.: Deciphering the enigmatic face: The importance of facial dynamics to interpreting subtle facial expressions. Psychological Science 16 (2005) 403-410
52. Ambadar, Z., Cohn, J.F., Reed, L.I.: All smiles are not created equal: Timing characteristics and interpretation of spontaneous smiles. (2006)
53. Dimberg, U., Thunberg, M., Grunedal, S.: Facial reactions to emotional stimuli: Automatically controlled emotional responses. Cognition and Emotion 16 (2002) 449-471
54. Moore, G.A., Cohn, J.F., Campbell, S.B.: Mothers' affective behavior with infant siblings: Stability and change. Developmental Psychology. 33 (1997) 856-860
55. Oster, H., Camras, L.A., Campos, J., Campos, R., Ujiee, T., Zhao-Lan, M., Lei, W.: The patterning of facial expressions in Chinese, Japanese, and American infants in fear- and anger- eliciting situations. Poster presented at the International Conference on Infant Studies, Providence, RI (1996)
56. Matsumoto, D., Willingham, B.: The thrill of victory and the agony of defeat: spontaneous expressions of medal winners of the 2004 Athens Olympic games. Journal of Personality & Social Psychology 91 (2006) 568-581
57. Camras, L.A., Chen, Y.: Culture, ethnicity, and children's facial expressions: A study of European American, mainland Chinese, Chinese American, and adopted Chinese girls. 6 (2006) 103-114
58. Markus, H.R., Kitayama, S.: Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review 98 (1991) 224-253
59. Tsai, J.L., Levenson, R.W., McCoy, K.: Cultural and temperamental variation in emotional response. Emotion 6 (2006) 484-497
60. Zlochower, A.J., Cohn, J.F.: Vocal timing in face-to-face interaction of clinically depressed and nondepressed mothers and their 4-month-old infants. Infant Behavior and Development 19 (1996) 373-376
61. Haidt, J., Keltner, D.: Culture and facial expression: Open-ended methods find more expressions and a gradient of recognition. Emotion and Cognition 13 (1999) 225-266
62. Jaffe, J., Beebe, B., Feldstein, S., Crown, C.L., Jasnow, M.: Rhythms of dialogue in early infancy. Monographs of the Society for Research in Child Development 66 (2001)
63. Cohn, J.F., Tronick, E.Z.: Mother-Infant face-to-face interaction: Influence is bidirectional and unrelated to periodic cycles in either partner's behavior. Developmental Psychology 34 (1988) 386-392
64. Cohn, J.F., Tronick, E.Z.: Mother infant interaction: The sequence of dyadic states at three, six, and nine months. Developmental Psychology 23 (1987) 68 77
65. Chow, S.M., Ram, N., Boker, S.M., Fujita, F., Clore, G.C.: Emotion as a thermostat: representing emotion regulation using a damped oscillator model. Emotion 5 (2005) 208-225
66. Boker, S.M., Xu, M., Rotondo, J.L., King, K.: Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series. Psychological Methods 7 (2002) 338-355