Emotion recognition and depression diagnosis by acoustic and visual features: A multimodal approach

AVEC 2014 - Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, Workshop of MM 2014

Volumn , Issue , 2014, Pages 81-86

  Sidorov, Maxim ^a   Minker, Wolfgang ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Audio visual features; Emotion and depression recognition; Feature based fusion; Support vector regression

Indexed keywords

SPEECH PROCESSING; SUPPORT VECTOR REGRESSION;

AUDIO-VISUAL FEATURES; EMOTION AND DEPRESSION RECOGNITION; EMOTION RECOGNITION; FEATURE-BASED; MULTI-MODAL APPROACH; SEGMENTATION METHODS; SPEAKER IDENTIFICATION; SPOKEN DIALOGUE SYSTEM;

SPEECH RECOGNITION;

EID: 84919329236     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2661806.2661816     Document Type: Conference Paper

References (31)

1. T. Ahonen, A. Hadid, and M. Pietikainen. Face description with local binary patterns: Application to face recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(12):2037{2041, 2006.
2. T. R. Almaev and M. F. Valstar. Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, pages 356{361. IEEE, 2013.
3. A. T. Beck, C. Ward, M. Mendelson, et al. Beck depression inventory (bdi). Arch Gen Psychiatry, 4(6):561{571, 1961.
4. P. Boersma. Praat, a system for doing phonetics by computer. Glot international, 5(9/10):341{345, 2002.
5. C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan. Analysis of emotion recognition using facial expressions, speech and multimodal information. In Proceedings of the 6th international conference on Multimodal interfaces, pages 205{211. ACM, 2004.
6. A. Dhall, A. Asthana, R. Goecke, and T. Gedeon. Emotion recognition using phog and lpq features. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 878{883. IEEE, 2011.
7. A. Dhall, R. Goecke, J. Joshi, M. Wagner, and T. Gedeon. Emotion recognition in the wild challenge 2013. In Proceedings of the 15th ACM on International conference on multimodal interaction, pages 509{516. ACM, 2013.
8. F. Eyben, F. Weninger, S. Squartini, and B. Schuller. Real-life voice activity detection with lstm recurrent neural networks and an application to hollywood movies. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 483{487. IEEE, 2013.
9. F. Eyben, M. Wollmer, and B. Schuller. Opensmile: the munich versatile and fast open-source audio feature extractor. In Proceedings of the international conference on Multimedia, pages 1459{1462. ACM, 2010.
10. G. W. Flake and S. Lawrence. Effcient svm regression training with smo. Machine Learning, 46(1-3):271{290, 2002.
11. N. H. Frijda. The emotions. Cambridge University Press, 1986.
12. Y.-L. Lin and G. Wei. Speech emotion recognition based on hmm and svm. In Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on, volume 8, 2005.
13. R. W. Picard. A effective computing. MIT press, 2000.
14. J. A. Russell. A circumplex model of affect. Journal of personality and social psychology, 39(6):1161, 1980.
15. E. Sanchez-Lozano, P. Lopez-Otero, L. Docio-Fernandez, E. Argones-Rua, and J. L. Alba-Castro. Audiovisual three-level fusion for continuous estimation of russell's emotion circumplex. In Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge, pages 31{40. ACM, 2013.
16. K. R. Scherer. Emotion. In Sozialpsychologie, pages 293{330. Springer, 1997.
17. B. Schuller, S. Steidl, and A. Batliner. The interspeech 2009 emotion challenge. In INTERSPEECH, volume 2009, pages 312{315. Citeseer, 2009.
18. B. Schuller, S. Steidl, A. Batliner, F. Burkhardt, L. Devillers, C. A. Muller, and S. S. Narayanan. The interspeech 2010 paralinguistic challenge. In INTERSPEECH, pages 2794{2797, 2010.
19. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, F. Weninger, F. Eyben, E. Marchi, et al. The interspeech 2013 computational paralinguistics challenge: social signals, conict, emotion, autism. 2013.
20. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic. Avec 2011-the first international audio/visual emotion challenge. In Affective Computing and Intelligent Interaction, pages 415{424. Springer, 2011.
21. B. Schuller, M. Valster, F. Eyben, R. Cowie, and M. Pantic. Avec 2012: the continuous audio/visual emotion challenge. In Proceedings of the 14th ACM international conference on Multimodal interaction, pages 449{456. ACM, 2012.
22. N. Sebe, I. Cohen, and T. S. Huang. Multimodal emotion recognition. Handbook of Pattern Recognition and Computer Vision, 4:387{419, 2005.
23. S. K. Shevade, S. S. Keerthi, C. Bhattacharyya, and K. R. K. Murthy. Improvements to the smo algorithm for svm regression. Neural Networks, IEEE Transactions on, 11(5):1188{1193, 2000.
24. M. Sidorov, S. Ultes, and A. Schmitt. Comparison of gender- and speaker-adaptive emotion recognition. In International Conference on Language Resources and Evaluation (LREC), pages 3476{3480, May 2014.
25. M. Sidorov, S. Ultes, and A. Schmitt. Emotions are a personal thing: Towards speaker-adaptive emotion recognition. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 4836{4840, May 2014.
26. X. Tan and B. Triggs. Fusing gabor and lbp feature sets for kernel-based face recognition. In Analysis and Modeling of Faces and Gestures, pages 235{249. Springer, 2007.
27. M. Valstar, B. Schuller, K. Smith, T. Almaev, F. Eyben, J. Krajewski, R. Cowie, and M. Pantic. Avec 2014-3d dimensional affect and depression recognition challenge. 2013.
28. M. Valstar, B. Schuller, K. Smith, F. Eyben, B. Jiang, S. Bilakhia, S. Schnieder, R. Cowie, and M. Pantic. Avec 2013: the continuous audio/visual emotion and depression recognition challenge. In Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge, pages 3-10. ACM, 2013.
29. P. Viola and M. J. Jones. Robust real-time face detection. International journal of computer vision, 57(2):137-154, 2004.
30. C.-H. Wu and W.-B. Liang. Emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information and semantic labels. Affective Computing, IEEE Transactions on, 2(1):10{21, 2011.
31. C. Xu, P. Du, Z. Feng, Z. Meng, T. Cao, and C. Dong. Multi-modal emotion recognition fusing video and audio. Appl. Math, 7(2):455{462, 2013.