Fully automatic audiovisual emotion recognition: Voice, words, and the face

Proceedings of 10th ITG Symposium on Speech Communication

Volumn , Issue , 2012, Pages

  Wöllmer, Martin ^a   Kaiser, Moritz ^a   Eyben, Florian ^a   Weninger, Felix ^a   Schuller, Björn ^a   Rigoll, Gerhard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH COMMUNICATION;

AFFECTIVE COMPUTING; AUDIO AND VIDEO; AUDIOVISUAL EMOTION RECOGNITION; CONTEXT SENSITIVE; DIMENSIONAL REPRESENTATION; HUMAN EMOTION; MULTIMODAL RECOGNITION; REAL LIFE DATA;

SPEECH RECOGNITION;

EID: 84947983184     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic, "AVEC - the first international Audio/Visual Emotion Challenge," in Proc. of First International Audio/Visual Emotion Challenge and Workshop (AVEC 2011) held in conjunction with ACII, (Memphis, Tennessee, USA), pp. 415-424, 2011.
2. G. McKeown, M. F. Valstar, M. Pantic, and R. Cowie, "The SEMAINE corpus of emotionally coloured character interactions," in Proc. of ICME, pp. 1-6, 2010.
3. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
4. M. Wöllmer, B. Schuller, F. Eyben, and G. Rigoll, "Combining Long Short-Term Memory and Dynamic Bayesian Networks for Incremental Emotion-Sensitive Artificial Listening," IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 5, pp. 867-881, 2010.
5. F. Eyben, M. Wöllmer, and B. Schuller, "openSMILE-the Munich versatile and fast open-source audio feature extractor," in Proc. of ACM Multimedia, (Firenze, Italy), pp. 1459-1462, 2010.
6. M. Schröder, E. Bevacqua, R. Cowie, F. Eyben, H. Gunes, D. Heylen, M. ter Maat, G. McKeown, S. Pammi, M. Pantic, C. Pelachaud, B. Schuller, E. de Sevin, M. Valstar, and M. Wöllmer, "Building autonomous sensitive artificial listeners," IEEE Transactions on Affective Computing (to appear), 2012.
7. J. R. J. Fontaine, K. R. Scherer, E. B. Roesch, and P. Ellsworth, "The world of emotions is not two-dimensional," Psychological science, vol. 18, no. 2, pp. 1050-1057, 2007.
8. A. Lee and T. Kawahara, "Recent development of open-source speech recognition engine Julius," in Proc. of AP-SIPA ASC, (Sapporo, Japan), pp. 131-137, 2009.
9. A. Stupakov, E. Hanusa, D. Vijaywargi, D. Fox, and J. Bilmes, "The design and collection of COSINE, a multi-microphone in situ speech corpus recorded in noisy environments," Computer Speech and Language, vol. 26, no. 1, pp. 52-66, 2011.
10. E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, M. McRorie, J. C. Martin, L. Devillers, S. Abrilian, A. Batliner, N. Amir, and K. Karpouzis, "The HUMAINE database: addressing the collection and annotation of naturalistic and induced emotional data," in Affective Computing and Intelligent Interaction, vol. 4738/2007, pp. 488-500, Springer, 2007.
11. P. A. Viola and M. J. Jones, "Robust real-time face detection," International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, 2004.
12. G. R. Bradski, "Computer vision face tracking for use in a perceptual user interface," Tech. Rep. Q2, Intel Technology Journal, 1998.
13. F. Gers, J. Schmidhuber, and F. Cummins, "Learning to forget: Continual prediction with LSTM," Neural Computation, vol. 12, no. 10, pp. 2451-2471, 2000.
14. A. Sayedelahl, P. Fewzee, M. Kamel, and F. Karray, "Audio-based emotion recognition from natural conversations based on co-occurrence matrix and frequency domain energy distribution features," in Proc. of First International Audio/Visual Emotion Challenge and Workshop (AVEC 2011) held in conjunction with ACII, (Memphis, Tennessee, USA), pp. 407-414, 2011.
15. M. Wöllmer, F. Weninger, F. Eyben, and B. Schuller, "Acoustic-linguistic recognition of interest in speech with Bottleneck-BLSTM nets," in Proc. of Interspeech, (Florence, Italy), pp. 77-80, 2011.