Ensemble methods for continuous affect recognition: Multi-modality, temporality, and challenges

AVEC 2015 - Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge, co-Located with MM 2015

Volumn , Issue , 2015, Pages 9-16

  Kächele, Markus ^a   Thiam, Patrick ^a   Palm, Günther ^a   Schwenker, Friedhelm ^a   Schels, Martin ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Affect recognition; AVEC 2015; Multi modal fusion

Indexed keywords

AFFECT RECOGNITION; AVEC 2015; CONTINUOUS RECOGNITION; ENSEMBLE CLASSIFIERS; MULTI-MODAL FUSION; PHYSIOLOGICAL FEATURES; PREDICTION QUALITY; STOCHASTIC GRADIENT DESCENT;

STOCHASTIC SYSTEMS;

EID: 84960847562     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2808196.2811637     Document Type: Conference Paper

References (26)

1. B. S. Atal and S. L. Hanauer. Speech analysis and synthesis by linear prediction of the speech wave. Journal of the Acoustical Society of America, 50(2):637{655, 1971.
2. A. Bosch, A. Zisserman, and X. Munoz. Representing shape with a spatial pyramid kernel. In Proceedings of CIVR, CIVR '07, pages 401{408. ACM, 2007.
3. L. Breiman. Random forests. Machine Learning, 45(1):5{32, 2001.
4. L. Chao, J. Tao, M. Yang, Y. Li, and Z. Wen. Multi-scale temporal modeling for dimensional emotion recognition in video. In Proceedings of AVEC, pages 11{18. ACM, 2014.
5. W. Chen, J. Zhuang, W. Yu, and Z. Wang. Measuring complexity using FuzzyEn, ApEn, and SampEn. Medical Engineering & Physics, 31(1):61{68, 2009.
6. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, volume 1, pages 886{893 vol. 1, 2005.
7. S. Davis and P. Mermelstein. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. Acoustics, Speech and Signal Processing, IEEE Transactions on, 28(4):357{366, Aug 1980.
8. J. H. Friedman. Greedy function approximation: A gradient boosting machine. Annals of statistics, pages 1189{1232, 2001.
9. Z. Guoying and M. Pietikainen. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(6):915{928, 2007.
10. R. Gupta, N. Malandrakis, B. Xiao, T. Guha, M. Van Segbroeck, M. Black, A. Potamianos, and S. Narayanan. Multimodal prediction of affective dimensions and depression in human-computer interactions. In Proceedings of AVEC, pages 33{40. ACM, 2014.
11. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. CoRR, abs/1502.01852, 2015.
12. M. Kächele, M. Schels, S. Meudt, V. Kessler, M. Glodek, P. Thiam, S. Tschechne, G. Palm, and F. Schwenker. On annotation and evaluation of multi-modal corpora in affective human-computer interaction. In Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, LNCS, pages 35{44. Springer, 2015.
13. M. Kächele, M. Schels, and F. Schwenker. Inferring depression and affect from application dependent meta knowledge. In Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, AVEC '14, pages 41{48. ACM, 2014.
14. M. Kächele, P. Thiam, M. Amirian, P. Werner, S. Walter, F. Schwenker, and G. Palm. Multimodal data fusion for person-independent, continuous estimation of pain intensity. In Engineering Applications of Neural Networks, Communications in Computer and Information Science, page (to appear). Springer International Publishing, 2015.
15. M. Kächele, D. Zharkov, S. Meudt, and F. Schwenker. Prosodic, spectral and voice quality feature selection using a long-term stopping criterion for audio-based emotion recognition. In Proceedings of ICPR, pages 803{808, 2014.
16. H. Kaya, F. Çilli, and A. A. Salah. Ensemble cca for continuous emotion prediction. In Proceedings of AVEC, AVEC '14, pages 19{26. ACM, 2014.
17. L. I. Lin. A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45(1):255{268, 1989.
18. T. L. Nwe, S. Foo, and L. De Silva. Classification of stress in speech using linear and nonlinear features. In Proceedings of ICASSP., volume 2, pages II9-12 vol.2, April 2003.
19. F. Ringeval, B. Schuller, M. Valstar, S. Jaiswal, E. Marchi, D. Lalanne, R. Cowie, and M. Pantic. The AV+EC 2015 multimodal affect recognition challenge: Bridging across audio, video, and physiological data. In Proceedings of the 5rd ACM International Workshop on Audio/Visual Emotion Challenge. ACM, 2015.
20. F. Ringeval, A. Sonderegger, J. Sauer, and D. Lalanne. Introducing the recola multimodal corpus of remote collaborative and a-ective interactions. In Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on, pages 1{8, April 2013.
21. M. Schels, M. Glodek, G. Palm, and F. Schwenker. Revisiting AVEC 2011 | an information fusion architecture. In Computational Intelligence in Emotional or Affective Systems, Smart Innovation, Systems and Technologies, pages 385{393. Springer, 2013.
22. M. Schels, M. Kächele, M. Glodek, D. Hrabal, S. Walter, and F. Schwenker. Using unlabeled data to improve classification of emotional states in human computer interaction. Journal on Multimodal User Interfaces, 8(1):5{16, 2014.
23. M. Schels and F. Schwenker. A multiple classifler system approach for facial expressions in image sequences utilizing gmm supervectors. In Proceedings of the ICPR, pages 4251{4254. IEEE, 2010.
24. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res., 15(1):1929{1958, 2014.
25. M. Valstar, B. Schuller, K. Smith, T. Almaev, F. Eyben, J. Krajewski, R. Cowie, and M. Pantic. Avec 2014: 3d dimensional affect and depression recognition challenge. In Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, AVEC '14, pages 3{10. ACM, 2014.
26. M. D. Zeiler. Adadelta: An adaptive learning rate method. arXiv preprint arXiv:1212.5701, 2012.