At the border of acoustics and linguistics: Bag-of-audio-words for the recognition of emotions in speech

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 495-499

  Schmitt, Maximilian ^a   Ringeval, Fabien ^a   Schuller, Björn ^a,b  

^a UNIVERSITY OF PASSAU   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Bag of audio words; Computational paralinguistics; Speech analysis; Speech emotion recognition

Indexed keywords

AUDIO ACOUSTICS; CLASSIFICATION (OF INFORMATION); COMPLEX NETWORKS; LINGUISTICS; SPEECH; SPEECH ANALYSIS; SPEECH COMMUNICATION; SPEECH PROCESSING;

ACOUSTIC EVENT CLASSIFICATION; AUDIO WORDS; LOW LEVEL DESCRIPTORS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; PARALINGUISTICS; RECOGNITION OF EMOTION; SPEECH EMOTION RECOGNITION; SUPPORT VECTOR REGRESSION (SVR);

SPEECH RECOGNITION;

EID: 84994339089     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-1124     Document Type: Conference Paper

References (27)

1. M. Pantic and L. J. Rothkrantz, "Toward an affectsensitive multimodal human-computer interaction," Proceedings of the IEEE, vol. 91, no. 9, pp. 1370-1390, 2003.
2. B. Barry and R. L. Oliver, "Affect in dyadic negotiation: A model and propositions," Organizational Behavior and Human Decision Processes, vol. 67, no. 2, pp. 127-143, 1996.
3. O.-W. Kwon, K. Chan, J. Hao, and T.-W. Lee, "Emotion recognition by speech signals." in Proc. of INTERSPEECH, Geneva, Switzerland, September 2003, pp. 125-128.
4. G. Trigeorgis, F. Ringeval, R. Brueckner, E. Marchi, M. A. Nicolaou, B. Schuller, and S. Zafeiriou, "Adieu features? end-to-end speech emotion recognition using a deep convolutional recurrent network," in Proc. of ICASSP, Shanghai, China, 2016.
5. R. Grzeszick, A. Plinge, and G. A. Fink, "Temporal acoustic words for online acoustic event detection," in Proc. of the 37th German Conf. Pattern Recognition, Aachen, Germany, 2015.
6. S. Rawat, P. F. Schulam, S. Burger, D. Ding, Y. Wang, and F. Metze, "Robust audio-codebooks for large-scale event detection in consumer videos," in Proc. of INTERSPEECH, Lyon, France, August 2013, pp. 2929-2933.
7. A. Plinge, R. Grzeszick, and G. A. Fink, "A bag-offeatures approach to acoustic event detection," in Proc. of the 39th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Florence, Italy: IEEE, 2014, pp. 3732-3736.
8. H. Lim, M. J. Kim, and H. Kim, "Robust sound event classification using lbp-hog based bag-of-audio-words feature representation," in Proc. of INTERSPEECH, Dresden, Germany, September 2015, pp. 3325-3329.
9. J. Joshi, R. Goecke, S. Alghowinem, A. Dhall, M. Wagner, J. Epps, G. Parker, and M. Breakspear, "Multimodal assistive technologies for depression diagnosis and monitoring," Journal on MultiModal User Interfaces, vol. 7, no. 3, pp. 217-228, 2013.
10. M. Riley, E. Heinen, and J. Ghosh, "A text retrieval approach to content-based audio hashing," in Proc. of the 9th International Conference on Music Information Retrieval (ISMIR), Philadelphia, PA, USA, September 2008, pp. 295-300.
11. Y. Liu, W.-L. Zhao, C.-W. Ngo, C.-S. Xu, and H.-Q. Lu, "Coherent bag-of audio words model for efficient largescale video copy detection," in Proc. of the ACM International Conference on Image and Video Retrieval. ACM, 2010, pp. 89-96.
12. S. Pancoast and M. Akbacak, "Bag-of-audio-words approach for multimedia event classification," in Proc. of INTERSPEECH, Portland, USA, September 2012, pp. 2105-2108.
13. - "N-gram extension for bag-of-audio-words," in Proc. of the 38th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vancouver, Canada: IEEE, 2013, pp. 778-782.
14. - "Softening quantization in bag-of-audio-words," in Proc. of the 39th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Florence, Italy: IEEE, 2014, pp. 1370-1374.
15. F. Pokorny, F. Graf, F. Pernkopf, and B. Schuller, "Detection of negative emotions in speech signals using bagsof- audio-words," in Proc. of the 1st International Workshop on Automatic Sentiment Analysis in the Wild (WASA 2015) held in conjunction with ACII 2015, AAAC. Xi'an, China: IEEE, September 2015, pp. 879-884.
16. B. Schuller, S. Steidl, and A. Batliner, "The interspeech 2009 emotion challenge," in Proc. of INTERSPEECH, Brighton, UK, September 2009, pp. 312-315.
17. A. Batliner and R. Huber, Speaker Classification I. Berlin, Heidelberg: Springer, 2007, ch. Speaker Characteristics and Emotion Classification, pp. 138-151.
18. F. Eyben, F. Weninger, F. Groß, and B. Schuller, "Recent developments in openSMILE, the munich open-source multimedia feature extractor," in Proc. of the 21st ACM International Conference on Multimedia (ACM MM). Barcelona, Spain: ACM, October 2013, pp. 835-838.
19. D. Arthur and S. Vassilvitskii, "k-means++: The advantages of careful seeding," in Proc. of the 18th annual ACM-SIAM symposium on Discrete algorithms. Society for Industrial and Applied Mathematics, 2007, pp. 1027- 1035.
20. M. Schmitt and B. W. Schuller, "openxbow-introducing the passau open-source crossmodal bag-of-words toolkit," arXiv preprint arXiv:1605.06778, 2016.
21. A. Barla, R. Odone, and A. Verr, "Histogram intersection kernel for image classification," in Proc. of the International Conference on Image Processing (ICIP), vol. 3. Barcelona, Spain: IEEE, 2003, pp. 513-516.
22. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R.Wang, and C.-J. Lin, "Liblinear: A library for large linear classification," The Journal of Machine Learning Research, vol. 9, pp. 1871-1874, 2008.
23. F. Ringeval, A. Sonderegger, J. Sauer, and D. Lalanne, "Introducing the recola multimodal corpus of remote collaborative and affective interactions," in Face and Gestures 2013, Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space (Emo- SPACE), 2013.
24. B. Schuller, Intelligent Audio Analysis, ser. Signals and Communication Technology. Springer, 2013.
25. F. Ringeval, F. Eyben, E. Kroupi, A. Yuce, J.-P. Thiran, T. Ebrahimi, D. Lalanne, and B. Schuller, "Prediction of asynchronous dimensional emotion ratings from audiovisual and physiological data," Pattern Recognition Letters, vol. 66, pp. 22-30, November 2015.
26. F. Ringeval, B. Schuller, M. Valstar, S. Jaiswal, E. Marchi, D. Lalanne, R. Cowie, and M. Pantic, "AV+EC 2015 - the first affect recognition challenge bridging across audio, video, and physiological data," in Proc. of the 5th International Workshop on Audio/Visual Emotion Challenge, ser. AVEC '15. Brisbane, Australia: ACM, October 2015, pp. 3-8.
27. L. He, D. Jiang, L. Yang, E. Pei, P. Wu, and H. Sahli, "Multimodal affective dimension prediction using deep bidirectional long short-term memory recurrent neural networks," in Proc. of the 5th International Workshop on Audio/Visual Emotion Challenge, ser. AVEC '15. Brisbane, Australia: ACM, October 2015, pp. 73-80.