Enhanced semi-supervised learning for multimodal emotion recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5185-5189

  Zhang, Zixing ^a   Ringeval, Fabien ^a   Dong, Bin ^a   Coutinho, Eduardo ^b   Marchi, Erik ^c   Schuller, Bjorn ^a,b  

^a UNIVERSITY OF PASSAU   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

enhanced semi supervised learning; Multimodal emotion recognition

Indexed keywords

EID: 84973353684     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472666     Document Type: Conference Paper

References (29)

1. B. Schuller, E. Marchi, S. Baron-Cohen, A. Lassalle, H. O'Reilly et al., "Recent developments and results of ASCInclusion: An integrated internet-based environment for social inclusion of children with autism spectrum conditions, " in Proc. of IDGEI, Atlanta, GA, 2015, no pagination.
2. E. Marchi, F. Ringeval, and B. Schuller, "Voice-enabled assistive robots for handling autism spectrum conditions: An examination of the role of prosody, " in Speech and Automata in the Health Care, A. Neustein, Ed. Walter de Gruyter GmbH & Co KG, 2014, pp. 207-236.
3. D. Tacconi, O. Mayora, P. Lukowicz, B. Arnrich, C. Setz, G. Troster, and C. Haring, "Activity and emotion recognition to support early diagnosis of psychiatric diseases, " in Proc. of Pervasive Health, Istanbul, Turkey, 2008, pp. 100-102.
4. M. H. Sanchez, D. Vergyri, L. Ferrer, C. Richey, P. Garcia, B. Knoth, and W. Jarrold, "Using prosodic and spectral features in detecting depression in elderly males. " in Proc. INTERSPEECH. Florence, Italy: ISCA, 2011, pp. 3001-3004.
5. T. N. Sainath, R. J. Weiss, A. Senior, K. W. Wilson, and O. Vinyals, "Learning the speech front-end with raw waveform CLDNNs, " in Proc. of INTERSPEECH. Dresden, Germany: ISCA, 2015, pp. 1-5.
6. B. Schuller, Z. Zhang, F. Weninger, and G. Rigoll, "Using multiple databases for training in emotion recognition: To unite or to vote" in Proc. of INTERSPEECH. Florence, Italy: ISCA, 2011, pp. 1553-1556.
7. B. Schuller, B. Vlasenko, F. Eyben, M. Wöllmer, A. Stuhlsatz, A. Wendemuth, and G. Rigoll, "Cross-corpus acoustic emotion recognition: Variances and strategies, " IEEE Transactions on Affective Computing, vol. 1, no. 2, pp. 119-131, 2010.
8. I. Cohen, N. Sebe, F. G. Cozman, and T. S. Huang, "Semisupervised learning for facial expression recognition, " in Proc. of ACM SIGMM international workshop on Multimedia information retrieval, New York, NY, 2003, pp. 17-22.
9. M. Schels, M. Kächele, M. Glodek, D. Hrabal, S. Walter, and F. Schwenker, "Using unlabeled data to improve classification of emotional states in human computer interaction, " Journal on Multimodal User Interfaces, vol. 8, no. 1, pp. 5-16, 2014.
10. I. Cohen, N. Sebe, F. Gozman, M. C. Cirelo, and T. S. Huang, "Learning Bayesian network classifiers for facial expression recognition both labeled and unlabeled data, " in Proc. of CVPR, vol. 1. Madison, WI: IEEE, 2003, pp. I-595.
11. A. Mahdhaoui and M. Chetouani, "Emotional speech classification based on multi-view characterization, " in Proc. of ICPR. Istanbul, Turkey: IEEE, 2010, pp. 4488-4491.
12. Z. Zhang, E. Coutinho, J. Deng, and B. Schuller, "Cooperative learning and its application to emotion recognition from speech, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 23, no. 1, pp. 115-126, 2015.
13. J. Liu, C. Chen, J. Bu, M. You, and J. Tao, "Speech emotion recognition using an enhanced co-training algorithm, " in Proc. of ICME. Beijing, China: IEEE, 2007, pp. 999-1002.
14. R. Calvo and S. D'Mello, "Affect detection: An interdisciplinary review of models, methods, and their applications, " IEEE Transactions on Affective Computing, vol. 1, no. 1, pp. 18-37, 2010.
15. M. Nicolaou, H. Gunes, and M. Pantic, "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space, " IEEE Transactions on Affective Computing, vol. 2, no. 2, pp. 92-105, 2011.
16. A. Metallinou, M. Wöllmer, A. Katsamanis, F. Eyben, B. Schuller, and S. Narayanan, "Context-Sensitive Learning for Enhanced Audiovisual Emotion Classification, " IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 184-198, 2012.
17. M. Soleymani, M. Pantic, and T. Pun, "Multimodal emotion recognition in response to videos, " IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 211-223, 2012.
18. F. Ringeval, B. Schuller, M. Valstar, R. Cowie, and M. Pantic, "AVEC 2015-The 5th International Audio/Visual Emotion Challenge and Workshop, " in Proc. of ACM MM. Brisbane, Australia: ACM, October 2015, pp. 1335-1336.
19. X. Zhu, "Semi-supervised learning literature survey, " Department of Computer Sciences, University of Wisconsin at Madison, Madison, WI, Tech. Rep. TR 1530, 2006.
20. D. Yarowsky, "Unsupervised word sense disambiguation rivaling supervised methods, " in Proc. of ACL. Stroudsburg, PA: ACM, 1995, pp. 189-196.
21. O. Chapelle, B. Schölkopf, A. Zien et al., Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006.
22. Z. Zhang, F. Weninger, M. Wöllmer, and B. Schuller, "Unsupervised learning in cross-corpus acoustic emotion recognition, " in Proc. of IEEE workshop on Automatic Speech Recognition and Understanding, Big Island, HY, 2011, pp. 523-528.
23. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training, " in Proc. of COLT. Madison, WI: ACM, 1998, pp. 92-100.
24. Z. Zhang, J. Deng, and B. Schuller, "Co-training succeeds in computational paralinguistics, " in Proc. of ICASSP. Vancouver, Canada: IEEE, 2013, pp. 8505-8509.
25. C. Xu, D. Tao, and C. Xu, "A survey on multi-view learning, " arXiv preprint arXiv: 1304. 5634, 2013.
26. F. Ringeval, A. Sonderegger, J. Sauer, and D. Lalanne, "Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions, " in Proc. of EmoSPACE 2013. Shanghai, China: IEEE, April 2013.
27. F. Ringeval, F. Eyben, E. Kroupi, A. Yuce, J.-P. Thiran, T. Ebrahimi, D. Lalanne, and B. Schuller, "Prediction of Asynchronous Dimensional Emotion Ratings from Audiovisual and Physiological Data, " Pattern Recognition Letters, vol. 66, pp. 22-30, November 2015.
28. B. Schuller et al., "The INTERSPEECH 2013 Computational Paralinguistics Challenge: Social Signals, Conflict, Emotion, Autism, " in Proc. INTERSPEECH. Lyon, France: ISCA, August 2013, pp. 148-152.
29. M. Valstar, B. Schuller, J. Krajewski, R. Cowie, and M. Pantic, "AVEC 2014: The 4th international audio/visual emotion challenge and workshop, " in Proc. of ACM MM, Orlando, FL, 2014, pp. 1243-1244.