Emotion recognition from spontaneous speech using Hidden Markov models with deep belief networks

2013 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2013 - Proceedings

Volumn , Issue , 2013, Pages 216-221

  Le, Duc ^a   Provost, Emily Mower ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

deep belief networks; dynamic modeling; emotion classification; FAU Aibo; spontaneous speech

Indexed keywords

AUTOMATIC EMOTION RECOGNITION; BENCHMARK DATASETS; DEEP BELIEF NETWORKS; EMOTION CLASSIFICATION; EMOTION RECOGNITION; FAU AIBO; HIGH DIMENSIONAL DATA; SPONTANEOUS SPEECH;

DYNAMIC MODELS;

HIDDEN MARKOV MODELS;

EID: 84893690785     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2013.6707732     Document Type: Conference Paper

References (33)

1. S. Steidl, Automatic classification of emotion related user states in spontaneous children's speech, Ph.D. thesis, 2009.
2. A. Mohamed, G. E. Dahl, and G. E. Hinton, Acoustic modeling using deep belief networks, IEEE Transactions on Audio, Speech & Language Processing, vol. 20, no. 1, pp. 14-22, 2012.
3. Y. Attabi, J. Alam, P. Dumouchel, P. Kenny, and D. O'Shaughnessy, Multiple windowed spectral features for emotion recognition, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, 2013.
4. H. Cao, R. Verma, and A. Nenkova, Combining ranking and classification to improve emotion recognition in spontaneous speech, in Proc. of the 13th Annual Conference of the International Speech Communication Association (INTERSPEECH), Portland, OR, USA, 2012.
5. B. Schuller, S. Steidl, and A. Batliner, The interspeech 2009 emotion challenge, in Proc. of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH), Brighton, United Kingdom, 2009, pp. 312-315.
6. M. Kockmann, L. Burget, and J. Cernocký, Brno university of technology system for interspeech 2009 emotion challenge, in Proc. of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH), Brighton, United Kingdom, 2009, number 9, pp. 348-351.
7. B. Schuller, A. Batliner, S. Steidl, and D. Seppi, Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge, Speech Communication, vol. 53, no. 910, pp. 1062 - 1087, 2011, Sensing Emotion and Affect - Facing Realism in Speech Processing.
8. A. Hassan, R. Damper, and M. Niranjan, On acoustic emotion recognition: Compensating for covariate shift, IEEE Transactions on Audio, Speech & Language Processing, vol. 21, no. 7, pp. 1458-1468, 2013.
9. G. E. Hinton, Training products of experts by minimizing contrastive divergence, Neural Computation, vol. 14, no. 8, pp. 1771-1800, Aug. 2002.
10. G. E. Hinton, S. Osindero, and Y. Teh, A fast learning algorithm for deep belief nets, Neural Computation, vol. 18, no. 7, pp. 1527-1554, July 2006. (Pubitemid 44024729)
11. G. E. Hinton, A practical guide to training restricted boltzmann machines, Tech. Rep., 2010.
12. H. Lee, C. Ekanadham, and A. Y. Ng, Sparse deep belief net model for visual area v2, in Proc. of the 22nd Annual Conference on Neural Information Processing Systems (NIPS). 2008, MIT Press.
13. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, in Proc. of the 26th Annual International Conference on Machine Learning (ICML), Montreal, QC, Canada, 2009, pp. 609-616, ACM.
14. Y. Tang and C. Eliasmith, Deep networks for robust visual recognition, in Proc. of the 27th Annual International Conference on Machine Learning (ICML), Haifa, Israel, 2010, pp. 1055-1062, Omnipress.
15. A. Krizhevsky, I. Sutskever, and G. E. Hinton, Imagenet classification with deep convolutional neural networks, in Proc. of the 26th Annual Conference on Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA, 2012, pp. 1106-1114.
16. G. E. Hinton, D. Li, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, Deep neural networks for acoustic modeling in speech recognition, IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
17. N. Morgan, Deep and wide: Multiple layers in automatic speech recognition., IEEE Transactions on Audio, Speech & Language Processing, vol. 20, no. 1, pp. 7-13, 2012.
18. G.S.V.S. Sivaram and H. Hermansky, Sparse multilayer perceptron for phoneme recognition, IEEE Transactions on Audio, Speech & Language Processing, vol. 20, no. 1, pp. 23-29, 2012.
19. A. Stuhlsatz, C. Meyer, F. Eyben, T. ZieIke, G. Meier, and B. Schuller, Deep neural networks for acoustic emotion recognition: Raising the benchmarks, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 2011, pp. 5688-5691.
20. E. M. Schmidt and Y. E. Kim, Learning emotion-based acoustic features with deep belief networks, in IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA, 2011, pp. 65-68.
21. R. Brueckner and B. Schuller, Likability classification - A not so deep neural network approach, in Proc. of the 13th Annual Conference of the International Speech Communication Association (INTERSPEECH), Portland, OR, USA, 2012.
22. Y. Kim, H. Lee, and E. Mower Provost, Deep learning for robust feature generation in audio-visual emotion recognition, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada.
23. B. Schuller, S. Steidl, A. Batliner, E. Noth, A. Vinciarelli, F. Burkhardt, R. van Son, F. Weninger, F. Eyben, T. Bocklet, G. Mohammadi, and B. Weiss, The interspeech 2012 speaker trait challenge, in 13th Annual Conference of the International Speech Communication Association (INTERSPEECH), Portland, OR, USA, 2012.
24. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, Theano: A CPU and GPU math expression compiler, in Proc. of the Python for Scientific Computing Conference (SciPy), Austin, TX, USA, June 2010.
25. B. Schuller and L. Devillers, Incremental acoustic valence recognition: An inter-corpus perspective on features, matching, and performance in a gating paradigm, in Proc. of the 11th Annual Conference of the International Speech Communication Association (INTERSPEECH), Makuhari, Japan, 2010, pp. 801-804.
26. J. H. Jeon, R. Xia, and Y. Liu, Sentence level emotion recognition based on decisions from subsentence segments, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 2011, pp. 4940-4943.
27. E. Mower and S. Narayanan, A hierarchical static-dynamic framework for emotion classification, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 2011, pp. 2372-2375.
28. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, Smote: Synthetic minority over-sampling technique, Journal of Artificial Intelligence Research (JAIR), vol. 16, pp. 321-357, 2002. (Pubitemid 43057176)
29. D. Opitz and R. Maclin, Popular ensemble methods: An empirical study, Journal of Artificial Intelligence Research (JAIR), vol. 11, pp. 169-198, 1999. (Pubitemid 129628763)
30. D. A. Reynolds, An overview of automatic speaker recognition technology, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Orlando, FL, USA, 2002, vol. 4, pp. 4072-4075.
31. T. Kinnunen and H. Li, An overview of text-independent speaker recognition: From features to supervectors, Speech Communication, vol. 52, no. 1, pp. 12-40, Jan. 2010.
32. R. Togneri and D. Pullella, An overview of speaker identification: Accuracy and robustness issues, Circuits and Systems Magazine, vol. 11, no. 2, pp. 23-61, 2011.
33. C. Busso, S. Lee, and S. Narayanan, Using neutral speech models for emotional speech analysis, in Proc. of the 8th Annual Conference of the International Speech Communication Association (INTERSPEECH), Antwerp, Belgium, 2007, p. 22252228.