Multimodal affect recognition in spontaneous HCI environment

2012 IEEE International Conference on Signal Processing, Communications and Computing, ICSPCC 2012

Volumn , Issue , 2012, Pages 430-435

  Panning, A ^a   Siegert, I ^a   Al Hamadi, A ^a   Wendemuth, A ^a   Rosner, D ^b   Frommer, J ^c   Krell, G ^a   Michaelis, B ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b Faculty of Computer Science   (Germany)

^c Department of Psychosomatic Medicine and Psychotherapy ^*  (Germany)

Author keywords

Affect Recognition; HCI; Multimodal

Indexed keywords

AFFECT RECOGNITION; AFFECTIVE BEHAVIORS; CLASSIFICATION PROCESS; DATA SETS; EYE BLINK; FACIAL EXPRESSIONS; FUSION ARCHITECTURE; MULTI-MODAL; MULTI-MODAL DATA;

HUMAN COMPUTER INTERACTION; SIGNAL PROCESSING;

CLASSIFICATION (OF INFORMATION);

EID: 84869476411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSPCC.2012.6335662     Document Type: Conference Paper

References (16)

1. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, January 2009.
2. M. Soleymani, M. Pantic, and T. Pun, "Multi-modal emotion recognition in response to videos," IEEE Trans. on Affective Computing, vol. 99, pp. PrePrints, November 2011, in press.
3. R. Cowie and R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Commun. , vol. 40, no. 1-2, pp. 5-32, 2003.
4. I. Kanluan, M. Grimm, and K. Kroschel, "Audio-visual emotion recognition using an emotion space concept," in European Signal Processing Conference (EUSIPCO), Lausanne, 2008.
5. M. Paleari, B. Huet, and R. Chellali, "Towards multimodal emotion recognition : A new approach," in ACM Int. Conf. on Image and Video Retrieval, Xi'an, China, July 5-7 2010.
6. A. Metallinou, S. Lee, and S. Narayanan, "Audio-visual emotion recognition using gaussian mixture models for face and voice," in Proc. of the IEEE Int. Symposium on Multimedia, Berkeley, CA, Dec. 2008, pp. 250-257.
7. J. Wagner, F. Lingenfelser, E. Andŕe, and J. Kim, "Exploring fusion methods for multimodal emotion recognition with missing data," IEEE Trans. on Affective Computing, vol. 99, no. PrePrints, 2011.
8. P. Ekman and W. V Friesen, "Facial action coding system: A technique for the measurement of facial movement," Palo Alto: Consulting Psychologist Press. , 1978.
9. Z. Zeng, J. Tu, B. Pianfetti, and T. S. Huang, "Audiovisual affective expression recognition through multistream fused hmm," IEEE Trans. on Multimedia. , vol. 4, pp. 570-577, June 2008. (Pubitemid 351711233)
10. G. Caridakis, K. Karpouzis, M. Wallace, L. Kessous, and N. Amir, "Multimodal user's affective state analysis in naturalistic interaction," in J' on Multimodal User Interfaces, 2009, vol. 3, pp. 49-66.
11. Dietmar Rösner, Jörg Frommer, Rafael Friesen, Matthias Haase, Julia Lange, and Mirko Otto, "LAST MINUTE: a multimodal corpus of speech-based usercompanion interactions," in Eighth international conference on Language Resources and Evaluation (LREC 2012). 2012, accepted.
12. A. Panning, A. Al-Hamadi, and B. Michaelis, "A color based approach for eye blink detection in image sequences," in IEEE Int. Conf. on Signal and Image Processing Applications, 2011, pp. 40-45.
13. J. A. Stern, L. C. Walrath, and R. Goldstein, "The endogenous eyeblink," Psychophysiology, vol. 21, pp. 22-33, 1984. (Pubitemid 14192045)
14. A. Panning, A. Al-Hamadi, and B. Michaelis, "Active shape models on adaptively refined mouth emphasizing color images," in WSCG (communication Papers), Plzen, 2010, pp. 221-228.
15. A. Saeed, R. Niese, A. Al-Hamadi, and A. Panning, "Hand-face-touch measure: a cue for human behavior analysis," in IEEE Int. Conf. on Intelligent Computing and Intelligent Systems, 2011, vol. 3, pp. 605-609.
16. S. Young, G. Evermann, M. J. F. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, The HTK book (for HTK Version 3. 4), Cambridge, UK, 2006.