Fusing face and body gesture for machine recognition of emotions

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

Volumn 2005, Issue , 2005, Pages 306-311

  Gunes, Hatice ^a   Piccardi, Massimo ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Action unit recognition; Body gesture; Emotion recognition; Face expression; Fusion

Indexed keywords

ARTIFICIAL INTELLIGENCE; FACE RECOGNITION; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; INTELLIGENT AGENTS; ROBOT LEARNING;

ACTION UNIT RECOGNITION; BODY GESTURE; EMOTION RECOGNITION; FACE EXPRESSION; FUSION;

ROBOTICS;

EID: 33746596203     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROMAN.2005.1513796     Document Type: Conference Paper

References (24)

1. T. Balomenos et al., "Emotion Analysis in Man-Machine Interaction Systems", Proc. of Machine Learning for Multimodal Interaction, pp. 318-328, 2004.
2. M.S. Bartlett, G. Littlewort, C. Lainscsek, I. Fasel and J. Movellan, "Machine learning methods for fully automatic recognition of face expressions and face actions", Proc. of IEEE SMC, pp. 592-597, 2004.
3. R. T. Boone and J. G. Cunningham, "Children's decoding of emotion in expressive body movement: The development of cue attunement", Developmental Psychology, vol. 34, pp. 1007-1016, 1998.
4. G. R. Bradski, "Computer vision face tracking for use in a perceptual user interface", Intel Technology Journal, 2nd Quarter, 1998.
5. J. Canny, "A computational approach to edge detection", Proc. of IEEE PAMI, vol. 8, no. 6, pp. 679-698, 1986.
6. J. Cassell, "A framework for gesture generation and interpretation", In R. Cipolla and A. Pentland (eds.), Computer vision in human-machine interaction, Cambridge University Press (2000).
7. L.S. Chen and T.S.Huang, "Emotional expressions in audiovisual human computer interaction", Proc. of IEEE ICME, vol. 1, pp. 423-426, 2000.
8. P. Ekman and W. V. Friesen, The Face Action Coding System, Consulting Psychologists Press, San Francisco, CA,1978.
9. P. Ekman and W. V. Friesen, Unmasking the face: a guide to recognizing emotions from facial clues, Imprint Englewood Cliffs, N.J. : Prentice-Hall, 1975.
10. P. Ellis, "Recognizing faces", British J. of Psychology, vol. 66, no.4, pp. 409-426, 1975.
11. N. Eveno, A. Caplier and P.Y. Coulon, "Key points based segmentation of lips", Proc. of IEEE ICME, vol. 22, pp.125-128, 2002.
12. H. Gunes, M. Piccardi and T. Jan, "Bimodal emotion modelling from face and upper-body gesture for affective HCI", Proc. of OZCHI, CD-ROM (ISBN: 1 74128 079), 10 pages, 2004.
13. E. Hudlicka, "To feel or not to feel: The role of affect in human-computer interaction", Int. J. Hum.-Comput. Stud., vol. 59, no. (1-2), pp. 1-32, 2003.
14. A. Kapoor, R. W. Picard and Y. Ivanov, "Probabilistic combination of multiple modalities to detect interest", Proc. of IEEE ICPR, 2004.
15. B.D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision", Proc. of 7th Int. Joint Conference on Artificial Intelligence, pp. 674-680, 1981.
16. A. Mehrabian, Nonverbal Communication, Aldine-Atherton, Chicago, Illinois, 1972.
17. M.D. Meijer, "The contribution of general features of body movement on the attributions of emotions", J. of Nonverbal Behavior, vol. 13, pp. 247-268, 1989.
18. J. MacCormick and M. Isard, "Partitioned sampling, articulated objects, and interface-quality hand tracking", Proc. of ECCV, vol.2, pp. 3-19, 2000.
19. M. Pantic and L.J.M. Rothkrantz, "Towards an affect-sensitive multimodal human-computer interaction", Proc. of the IEEE, vol. 91, no. 9, pp. 1370-1390, 2003.
20. I. H. Witten and E. Frank, Data Mining: Practical machine learning tools with Java implementations, Morgan Kaufmann, San Francisco, 2000.
21. R. E. Schapire, "The boosting approach to machine learning: An overview", Proc. of MSRI Workshop on Nonlinear Estimation and Classification, 2002.
22. L.G. Shapiro and A. Rosenfeld, Computer Vision and Image Processing, Boston, Academic Press, 1992.
23. K. Sobottka and I. Pitas, "A novel method for automatic face segmentation, face feature extraction and tracking", Image Communication, Elsevier, 1997.
24. L. Wu, S. L. Oviatt, and P. R. Cohen, "Multimodal Integration-A Statistical View", IEEE Transactions on Multimedia, vol. 1, no. 4, pp. 334-341, 1999.