Representation learning for speech emotion recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 3603-3607

  Ghosh, Sayan ^a   Laksana, Eugene ^a   Morency, Louis Philippe ^b   Scherer, Stefan ^a  

^a University of Southern California   (United States)

^b Carnegie Mellon University ^*  (United States)

Author keywords

Computational paralinguistics; Human computer interaction; Speech emotion classification

Indexed keywords

CHEMICAL ACTIVATION; CLASSIFICATION (OF INFORMATION); HUMAN COMPUTER INTERACTION; LINGUISTICS; RECURRENT NEURAL NETWORKS; SPECTROGRAPHS; SPEECH; SPEECH COMMUNICATION; SPEECH PROCESSING;

AFFECTIVE COMPUTING; CLASSIFICATION PERFORMANCE; EMOTION CLASSIFICATION; HUMAN COMPUTER INTERFACES; PARALINGUISTICS; SPEECH EMOTION CLASSIFICATION; SPEECH EMOTION RECOGNITION; SPEECH EMOTION RECOGNITION SYSTEMS;

SPEECH RECOGNITION;

EID: 84994385043     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-692     Document Type: Conference Paper

References (27)

1. B. Schuller, S. Steidl, and A. Batliner, "The interspeech 2009 emotion challenge." Citeseer, 2009.
2. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 35, no. 8, pp. 1798-1828, 2013.
3. M. F. A. Hady and F. Schwenker, "Semi-supervised learning, " in Handbook on Neural Information Processing. Springer, 2013, pp. 215-239.
4. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng, "Self-taught learning: transfer learning from unlabeled data, " in Proceedings of the 24th international conference on Machine learning. ACM, 2007, pp. 759-766.
5. R. J. Davidson, K. R. Scherer, and H. Goldsmith, Handbook of affective sciences. Oxford University Press, 2003.
6. N. Jaitly and G. E. Hinton, "A new way to learn acoustic events, " Advances in Neural Information Processing Systems, vol. 24, 2011.
7. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 6645-6649.
8. Y. Kim, H. Lee, and E. M. Provost, "Deep learning for robust feature generation in audiovisual emotion recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 3687-3691.
9. K. Han, D. Yu, and I. Tashev, "Speech emotion recognition using deep neural network and extreme learning machine, " Proceedings of INTERSPEECH, ISCA, Singapore, pp. 223-227, 2014.
10. J. Lee and I. Tashev, "High-level feature representation using recurrent neural network for speech emotion recognition, " in Sixteenth Annual Conference of the International Speech Communication Association, 2015.
11. Q. Jin, C. Li, S. Chen, and H. Wu, "Speech emotion recognition with acoustic and lexical features, " in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 4749-4753.
12. G. Trigeorgis, F. Ringeval, R. Brueckner, E. Marchi, M. A. Nicolaou, S. Zafeiriou et al., "Adieu features? end-to-end speech emotion recognition using a deep convolutional recurrent network, " in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2016, pp. 5200-5204.
13. S. Ghosh, E. Laksana, L.-P. Morency, and S. Scherer, "Learning representations of affect from speech, " arXiv preprint arXiv:1511.04747, International Conference on Learning Representations (ICLR) 2016 Workshop, 2015.
14. P. Baldi, "Autoencoders, unsupervised learning, and deep architectures, " Unsupervised and Transfer Learning Challenges in Machine Learning, Volume 7, p. 43, 2012.
15. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, "Extracting and composing robust features with denoising autoencoders, " in Proceedings of the 25th international conference on Machine learning. ACM, 2008, pp. 1096-1103.
16. J. Masci, U. Meier, G. Fricout, and J. Schmidhuber, "Multi-scale pyramidal pooling network for generic steel defect classification, " in Neural Networks (IJCNN), The 2013 International Joint Conference on. IEEE, 2013, pp. 1-8.
17. S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
18. F.Weninger, J. Bergmann, and B. Schuller, "Introducing currennt: The munich open-source cuda recurrent neural network toolkit, " The Journal of Machine Learning Research, vol. 16, no. 1, pp. 547-551, 2015.
19. C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. S. Narayanan, "Iemocap: Interactive emotional dyadic motion capture database, " Language resources and evaluation, vol. 42, no. 4, pp. 335-359, 2008.
20. P. Alku, "Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering, " Speech communication, vol. 11, no. 2- 3, pp. 109-118, 1992.
21. N. Cummins, S. Scherer, J. Krajewski, S. Schnieder, J. Epps, and T. F. Quatieri, "A review of depression and suicide risk assessment using speech analysis, " Speech Communication, vol. 71, pp. 10- 49, 2015.
22. S. Scherer, J. Kane, C. Gobl, and F. Schwenker, "Investigating fuzzy-input fuzzy-output support vector machines for robust voice quality classification, " Computer Speech & Language, vol. 27, no. 1, pp. 263-287, 2013.
23. Y. Kim and E. M. Provost, "Emotion classification via utterancelevel dynamics: A pattern-based approach to characterizing affective expressions, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 3677-3681.
24. D. Le and E. M. Provost, "Emotion recognition from spontaneous speech using hidden markov models with deep belief networks, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 2013, pp. 216-221.
25. G. Degottex, J. Kane, T. Drugman, T. Raitio, and S. Scherer, "Covarepa collaborative voice analysis repository for speech technologies, " in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 960- 964.
26. M. Brilman and S. Scherer, "A multimodal predictive model of successful debaters or how i learned to sway votes, " in Proceedings of the 23rd Annual ACM Conference on Multimedia Conference. ACM, 2015, pp. 149-158.
27. R. Sun and E. I. Moore, "Empirical study of dimensional and categorical emotion descriptors in emotional speech perception, " in Twenty-Fifth International FLAIRS Conference, 2012.