String-based audiovisual fusion of behavioural events for the assessment of dimensional affect

2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Volumn , Issue , 2011, Pages 322-329

  Eyben, Florian ^a   Wöllmer, Martin ^a   Valstar, Michel F ^b   Gunes, Hatice ^b   Schuller, Björn ^a,b   Pantic, Maja ^b,c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS AND EVALUATION; AUDIO-VISUAL FUSION; AUDIOVISUAL ANALYSIS; AUTOMATIC ASSESSMENT; AUTOMATIC PREDICTION; DIMENSIONAL SPACES; FEATURE LEVEL; PREDICTION PERFORMANCE; SPECTRAL INFORMATION;

FACE RECOGNITION; FEATURE EXTRACTION; FORECASTING; SPEECH RECOGNITION;

GESTURE RECOGNITION;

EID: 79958694881     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2011.5771417     Document Type: Conference Paper

References (35)

1. H. Gunes and M. Pantic, "Automatic, dimensional and continuous emotion recognition," Int. Journal of Synthetic Emotions, vol. 1, no. 1, pp. 68-99, 2010.
2. Z. Zeng, M. Pantic, Glenn I. Roisman, and T.S. Huang, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, 2009.
3. S. Baron-Cohen and T. H. E. Tead, Mind reading: The interactive guide to emotion, Jessica Kingsley Publishers Ltd., 2003.
4. J. A. Russell, "A circumplex model of affect," Journal of Personality and Social Psychology, vol. 39, pp. 1161-1178, 1980.
5. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. G. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Processing Magazine, vol. 18, pp. 33-80, 2001.
6. K.R. Scherer, The Neuropsychology of Emotion, chapter Psychological models of emotion, pp. 137-162, Oxford University Press, 2000.
7. D. Grandjean, D. Sander, and K. R. Scherer, "Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization," Consciousness and Cognition, vol. 17, pp. 484-495, 2008.
8. R. Cowie, H. Gunes, G. McKeown, L. Vaclau-Schneider, J. Armstrong, and E. Douglas-Cowie, "The emotional and communicative significance of head nods and shakes in a naturalistic database," in In Proc. of LREC Int. Workshop on Emotion, 2010, pp. 42-46.
9. M. Grimm, E. Mower, K. Kroschel, and S. Narayanan, "Primitives based estimation and evaluation of emotions in speech," Speech Communication, vol. 49, pp. 787-800, 2007. (Pubitemid 47268568)
10. M. Ẅollmer, F. Eyben, S. Reiter, B. Schuller, C. Cox, E. Douglas-Cowie, and R. Cowie, "Abandoning emotion classes-towards continuous emotion recognition with modelling of long-range dependencies," in Proc. Interspeech, Brisbane, 2008, pp. 597-600.
11. B. Schuller, R. M̈uller, F. Eyben, J. Gast, B. Ḧornler, M. Ẅollmer, G. Rigoll, A. Ḧothker, and H. Konosu, "Being Bored? Recognising Natural Interest by Extensive Audiovisual Integration for Real-Life Application," Image and Vision Computing Journal, vol. 27, pp. 1760-1774, 2009.
12. H. Gunes and M. Pantic, "Automatic measurement of affect in dimensional and continuous spaces: Why, what, and how?," in Proc. of Measuring Behavior, 2010, pp. 122-126.
13. M.A. Nicolaou, H. Gunes, and M. Pantic, "Audio-visual classification and fusion of spontaneous affective data in likelihood space," in Proc. of IEEE Int. Conf. on Pattern Recognition, 2010, pp. 3695-3699.
14. Bj̈orn Schuller, Bogdan Vlasenko, Florian Eyben, Gerhard Rigoll, and Andreas Wendemuth, "Acoustic emotion recognition: A benchmark comparison of performances," in Proceedings of ASRU. 2009, IEEE.
15. G. Caridakis, L. Malatesta, L. Kessous, N. Amir, A. Raouzaiou, and K. Karpouzis, "Modeling naturalistic affective states via facial and vocal expressions recognition," in Proc. of ACM Int. Conf. on Multimodal Interfaces, 2006, pp. 146-154. (Pubitemid 47113445)
16. N. Fragopanagos and J. G. Taylor, "Emotion recognition in humancomputer interaction," Neural Networks, vol. 18, no. 4, pp. 389-405, 2005.
17. D. Glowinski, A. Camurri, G. Volpe, N. Dael, and K. Scherer, "Technique for automatic emotion recognition by body gesture analysis," in Proc. of Computer Vision and Pattern Recognition Workshops, 2008, pp. 1-6.
18. S. Ioannou, A. Raouzaiou, V. Tzouvaras, T. Mailis, K. Karpouzis, and S. Kollias, "Emotion recognition through facial expression analysis based on a neurofuzzy method," Journal of Neural Networks, vol. 18, pp. 423-435, 2005. (Pubitemid 40922649)
19. M. Wollmer, B. Schuller, F. Eyben, and G. Rigoll, "Combining long short-term memory and dynamic bayesian networks for incremental emotion-sensitive artificial listening," IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 5, pp. 867-881, Oct. 2010.
20. A. Kleinsmith and N. Bianchi-Berthouze, "Recognizing affective dimensions from body posture," in Proc. of the Int. Conf. on Affective Computing and Intelligent Interaction, 2007, pp. 48-58.
21. I. Kanluan, M. Grimm, and K. Kroschel, "Audio-visual emotion recognition using an emotion recognition space concept," Proc of the 16th European Signal Processing Conf., 2008.
22. M. Grimm and K. Kroschel, "Emotion estimation in speech using a 3d emotion space concept," in In Proc. IEEE Automatic Speech Recognition and Understanding Workshop, 2005, pp. 381-385.
23. H. Gunes and M. Pantic, "Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners," in Proc. of Int. Conf. on Intelligent Virtual Agents, 2010, pp. 371-377.
24. M.A. Nicolaou, H. Gunes, and M. Pantic, "Output-associative rvm regression for dimensional and continuous emotion prediction," in Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition, 2011.
25. G McKeown, M.F Valstar, M Pantic, and R Cowie, "The semaine corpus of emotionally coloured character interactions," Proc. Int'l Conf. Multimedia & Expo, pp. 1-6, Jan 2010.
26. J.F Lichtenauer, J Shen, M.F Valstar, and M Pantic, "Cost-effective solution to synchronised audio-visual data capture using multiple sensors," Journal of Visual Communication and Image Representation, pp. 1-39, Nov 2010.
27. J.R.J Fontaine, Scherer K.R., E.B Roesch, and P.C Ellsworth, "The world of emotions is not two-dimensional," Psychological science, vol. 18, no. 2, pp. 1050-1057, Feb 2007.
28. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2001, vol. 1, pp. 511-518.
29. B. Jiang, M.F. Valstar, and M. Pantic, "Action unit detection using sparse appearance descriptors in space-time video volumes," in Proc. IEEE Int'l conf. on Face and Gesture recognition, Mar 2011.
30. M.F Valstar and M Pantic, "Induced disgust, happiness and surprise: an addition to the mmi facial expression database," Proceedings of the Language Resources and Evaluation Conf., pp. 65-70, Mar 2010.
31. M. Ẅollmer, F. Eyben, B. Schuller, and G. Rigoll, "Recognition of spontaneous conversational speech using long short-term memory phoneme predictions," in Proc. of Interspeech, Makuhari, Japan, 2010, pp. 1946-1949.
32. M. Ẅollmer, F. Eyben, A. Graves, B. Schuller, and G. Rigoll, "Bidirectional LSTM networks for context-sensitive keyword detection in a cognitive virtual agent framework," Cognitive Computation, vol. 2, no. 3, pp. 180-190, 2010.
33. A. Stupakov, E. Hanusa, J. Bilmes, and D. Fox, "COSINE-a corpus of multi-party conversational speech in noisy environments," in Proc. of ICASSP, Taipei, Taiwan, 2009.
34. F. Eyben, M. Ẅollmer, and B. Schuller, "openSMILE-The Munich Versatile and Fast Open-Source Audio Feature Extractor," in Proc. ACM Multimedia, Firenze, Italy, 2010.
35. B. Schuller, S. Steidl, A. Batliner, F. Burkhardt, L. Devillers, C. M̈uller, and S. Narayanan, "The INTERSPEECH 2010 Paralinguistic Challenge," in Proc. INTERSPEECH 2010, Makuhari, Japan, 2010, pp. 2794-2797.