Evaluation and discussion of multi-modal emotion recognition

2009 International Conference on Computer and Electrical Engineering, ICCEE 2009

Volumn 1, Issue , 2009, Pages 598-602

  Rabie, Ahmad ^a   Wrede, Britta ^a   Vogt, Thurid ^b   Hanheide, Marc ^c  

^a BIELEFELD UNIVERSITY   (Germany)

^b UNIVERSITY OF AUGSBURG   (Germany)

^c UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Facial expressions; Multimodal integration; Visual and speech based emotion recognition

Indexed keywords

ADAPTIVE INTERFACE; AUDIO SIGNAL; BASIC EMOTIONS; EMOTION RECOGNITION; EMOTIONAL STATE; FACIAL EXPRESSIONS; HUMAN ROBOT INTERACTIONS; HUMAN-MACHINE; INTERACTION INTERFACE; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTIMODAL CUES; MULTIMODAL INTEGRATION; MULTIMODAL RECOGNITION; NATURAL COMMUNICATION; REAL-WORLD; RECOGNITION OF EMOTION; RECOGNITION SYSTEMS; STATE OF THE ART; VISUAL ANALYSIS; VISUAL CUES;

ELECTRICAL ENGINEERING; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION; MACHINE DESIGN;

SPEECH RECOGNITION;

EID: 77950475966     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCEE.2009.192     Document Type: Conference Paper

References (21)

1. A. Battocchi, F. Pianesi, and D. Goren-Bar. A first evaluation study of a database of kinetic facial expressions (dafex). In Proc. Int. Conf. Multimodal Interfaces. ACM, 2005.
2. C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan. Analysis of emotion recognition using facial expressions, speech and multimodal information. In ICMI, 2004.
3. G. Caridakis, L. Malatesta, L. Kessous, N. Amir, A. Raouzaiou, and K. Karpouzis. Modeling naturalistic affective states via facial and vocal expressions recognition. In ICMI, 2006.
4. M. Castrillón, O. Déniz, C. Guerra, and M. Hernández. Encara2: Real-time detection of multiple faces at different resolutions in video streams. Journal of Visual Communication and Image Representation, 18(2):130-140, 2007.
5. T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active appearance models. PAMI, 23(6):681-685, June 2001.
6. P. Ekman and W. Friesen. Unmasking the Face: A Guide to Recognizing Emotions from Facial. Prentice Hall, 1975.
7. S. Fagel. Emotional mcgurk effect. In Proc. Int. Conf. on Speech Prosody, Dresden, Germany, 2006.
8. M. A. Hall. Correlation-based feature subset selection for machine learning. Master's thesis, University of Waikato, New Zealand, 1998.
9. M. Hanheide, S. Wrede, C. Lang, and G. Sagerer. Who am i talking with? a face memory for social robots, 2008.
10. F. Hegel, T. Spexard, T. Vogt, G. Horstmann, and B. Wrede. Playing a different imitation game: Interaction with an empathic android robot. In Proc. Int. Conf. Humanoid Robots, 2006.
11. M. Lugger and B. Yang. Cascaded emotion classification via psychological emotion dimensions using a large set of voice quality parameters. In IEEE ICASSP, 2008.
12. D. W. Massaro and P. B. Egan. Perceiving affect from the voice and the face. Psychonomoic Bulletin and Review, 3:215-221.
13. M. Paleari and C. L. Lisetti. Toward multimodal fusion of affective cues. In Proc. int. workshop on Human-centered multimedia, NY, USA, 2006. ACM.
14. Y. Qi, C. Reynolds, and R. Picard. The bayes point machine for computer-user frustration detection via pressuremouse. In Proceeding of workshop on Perceptive User Inteface, 2001.
15. A. Rabie, C. Lang, M. Hanheide, M. Castrillon-Santana, and G. Sagerer. Automatic initialization for facial analysis in interactive robotics. In ICVS, 2008.
16. J. A. Russell. Culture and the categorization of emotions. Psychological Bulletin, Vol.110, No.3:426-450, 1991.
17. J. L. Schwartz. Why the FLMP should not be applied to McGurk data. or how to better compare models in the bazesian framework. In Int. Conf. Audio-Visual Speech Processing, 2003.
18. T. Vogt and E. André. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In Proc. of IEEE Int. Conf. on Multimedia & Expo, 2005.
19. T. Vogt, E. André, and N. Bee. Emovoice, a framework for online recognition of emotions from voice. In Workshop on Perception and Interactive Technologies for Speech-Based Systems, 2008.
20. Z. Zeng, Y. Hu, Y. Fu, T. S. Huang, G. I. Roisman, and Z. Wen. Audio-visual emotion recognition in adult attachment interview. In Proc. Int. Conf. on Multimodal Interfaces, USA, 2006. ACM.
21. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transaction on Pattern Analysis and Macine Intellegence, 31:39-58, 2009.