Real-time robust recognition of speakers' emotions and characteristics on mobile platforms

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Volumn , Issue , 2015, Pages 778-780

  Eyben, Florian ^a   Huber, Bernd ^a   Marchi, Erik ^a   Schuller, Dagmar ^a   Schuller, Bjorn ^a  

^a AUDEERING GMBH   (Germany)

Author keywords

Affect; Android; Emotion; Mobile computing; openSMILE; Paralinguistics

Indexed keywords

ANDROID (OPERATING SYSTEM); INTELLIGENT COMPUTING; MOBILE COMPUTING; MOBILE DEVICES; RECURRENT NEURAL NETWORKS;

AFFECT; ANDROID; EMOTION; OPENSMILE; PARALINGUISTICS;

SPEECH RECOGNITION;

EID: 84964066710     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2015.7344658     Document Type: Conference Paper

References (25)

1. K.-K. Lee, Y.-H. Cho, and K.-S. Park, "Robust feature extraction for mobile-based speech emotion recognition system," in Intelligent Computing in Signal Processing and Pattern Recognition. Springer, 2006, pp. 470-477.
2. W.-J. Yoon, Y.-H. Cho, and K.-S. Park, "A study of speech emotion recognition and its application to mobile services," in Ubiquitous Intelligence and Computing. Springer, 2007, pp. 758-766.
3. F. Burkhardt, M. Eckert, W. Johannsen, and J. Stegmann, "A database of age and gender annotated telephone speech." in LREC, 2010.
4. A. Tawari and M. Trivedi, "Speech emotion analysis in noisy real-world environment," in Pattern Recognition (ICPR), 2010 20th International Conference on. IEEE, 2010, pp. 4605-4608.
5. C. McCool, S. Marcel, A. Hadid, M. Pietikainen, P. Matejka, J. Cernocky, N. Poh, J. Kittler, A. Larcher, C. Levy et al., "Bi-modal person recognition on a mobile phone: using mobile phone data," in Multimedia and Expo Workshops (ICMEW), 2012 IEEE International Conference on. IEEE, 2012, pp. 635-640.
6. K. Anderson, E. André, T. Baur, S. Bernardini, M. Chollet, E. Chryssafidou, I. Damian, C. Ennis, A. Egges, P. Gebhard et al., "The tardis framework: intelligent virtual agents for social coaching in job interviews," in Advances in Computer Entertainment. Springer, 2013, pp. 476-491.
7. K.-h. Chang, D. Fisher, J. Canny, and B. Hartmann, "How's my mood and stress?: an efficient speech analysis library for unobtrusive monitoring on mobile phones," in Proceedings of the 6th International Conference on Body Area Networks. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2011, pp. 71-77.
8. O. Amft, M. Stager, P. Lukowicz, and G. Troster, "Analysis of Chewing Sounds for Dietary Monitoring," in UbiComp 2005: Proceedings of the 7th International Conference on Ubiquitous Computing, Tokyo, Japan, 2005, pp. 56-72.
9. Z.-H. Tan and B. Lindberg, Automatic speech recognition on mobile devices and over communication networks. Springer Science &Business Media, 2008.
10. G. Di Fabbrizio, T. Okken, and J. G. Wilpon, "A speech mashup framework for multimodal mobile services," in Proceedings of the 2009 international conference on Multimodal interfaces. ACM, 2009, pp. 71-78.
11. A. Kumar, A. Tewari, S. Horrigan, M. Kam, F. Metze, and J. Canny, "Rethinking speech recognition on mobile devices," in Proc. ACM Conf. on IUI 2011. Citeseer, 2011.
12. W. Han, Z. Zhang, J. Deng, M. Wollmer, F. Weninger, and B. Schuller, "Towards Distributed Recognition of Emotion in Speech," in Proceedings 5th International Symposium on Communications, Control, and Signal Processing, ISCCSP 2012. Rome, Italy: IEEE, May 2012, pp. 1-4.
13. Z. Zhang, E. Coutinho, J. Deng, and B. Schuller, "Distributing Recognition in Computational Paralinguistics," IEEE Transactions on Affective Computing, 2014, 14 pages, to appear.
14. K. K. Rachuri, M. Musolesi, C. Mascolo, P. J. Rentfrow, C. Longworth, and A. Aucinas, "Emotionsense: a mobile phones based adaptive platform for experimental social psychology research," in Proceedings of the 12th ACM international conference on Ubiquitous computing. ACM, 2010, pp. 281-290.
15. F. Eyben, F. Weninger, F. Gross, and B. Schuller, "Recent developments in opensmile, the munich open-source multimedia feature extractor," in Proc. of MM. ACM, pp. 835-838.
16. F. Eyben, F. Weninger, S. Squartini, and B. Schuller, "Real-life Voice Activity Detection with LSTM Recurrent Neural Networks and an Application to Hollywood Movies," in Proceedings 38th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2013. Vancouver, Canada: IEEE, 2013, pp. 483-487.
17. F. Eyben and B. Schuller, "openSMILE: The Munich Open-Source Large-Scale Multimedia Feature Extractor," ACM SIGMM Records, vol. 6, no. 4, December 2014.
18. M. Schroder, L. Devillers, K. Karpouzis, J.-C. Martin, C. Pelachaud, C. Peter, H. Pirker, B. Schuller, J. Tao, and I. Wilson, "What should a generic emotion markup language be able to represent?" in Affective Computing and Intelligent Interaction. Springer, 2007, pp. 440-451.
19. F. Eyben, K. Scherer, B. Schuller, J. Sundberg, and others., "The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing," IEEE Transactions on Affective Computing (TAC), 2015, to appear.
20. B. Schuller, S. Steidl, A. Batliner, and F. Jurcicek, "The INTERSPEECH 2009 Emotion Challenge," in Proc. of INTERSPEECH 2009, Brighton, UK, Sep. 2009, pp. 312-315.
21. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, F. Weninger, F. Eyben, E. Marchi, M. Mortillaro, H. Salamin, A. Polychroniou, F. Valente, and S. Kim, "The INTERSPEECH 2013 Computational Paralinguistics Challenge: Social Signals, Conflict, Emotion, Autism," in Proceedings INTERSPEECH 2013. Lyon, France: ISCA, 2013, pp. 148-152.
22. B. Schuller, S. Steidl, A. Batliner, J. Epps, F. Eyben, F. Ringeval, E. Marchi, and Y. Zhang, "The INTERSPEECH 2014 Computational Paralinguistics Challenge: Cognitive &Physical Load," in Proceedings INTERSPEECH 2014. Singapore, Singapore: ISCA, 2014.
23. B. Schuller, S. Steidl, A. Batliner, S. Hantke, F. Honig, J. R. Orozco-Arroyave, E. Noth, Y. Zhang, and F. Weninger, "The INTERSPEECH 2015 Computational Paralinguistics Challenge: Degree of Nativeness, Parkinson's &Eating Condition," in Proceedings INTERSPEECH 2015. Dresden, Germany: ISCA, September 2015, 5 pages, to appear.
24. B. Schuller, "The Computational Paralinguistics Challenge," IEEE Signal Processing Magazine, vol. 29, no. 4, pp. 97-101, July 2012.
25. Z. Zhang, E. Coutinho, J. Deng, and B. Schuller, "Cooperative Learning and its Application to Emotion Recognition from Speech," IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 23, no. 1, pp. 115-126, 2015.