Towards real-time Speech Emotion Recognition using deep neural networks

2015, 9th International Conference on Signal Processing and Communication Systems, ICSPCS 2015 - Proceedings

Volumn , Issue , 2015, Pages

  Fayek, H M ^a   Lech, M ^a   Cavedon, L ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

affective computing; deep learning; deep neural networks; emotion recognition; spectrograms; speech processing

Indexed keywords

DATABASE SYSTEMS; DEEP LEARNING; DEEP NEURAL NETWORKS; PIPELINE PROCESSING SYSTEMS; SIGNAL PROCESSING; SPECTROGRAPHS; SPEECH PROCESSING;

AFFECTIVE COMPUTING; EMOTION RECOGNITION; HIERARCHICAL ARCHITECTURES; PRE-PROCESSING STEP; RECOGNIZING EMOTIONS; SPECTROGRAMS; SPEECH EMOTION RECOGNITION; SPEECH EMOTION RECOGNITIONS (SER);

SPEECH RECOGNITION;

EID: 84963682340     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSPCS.2015.7391796     Document Type: Conference Paper

References (23)

1. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods, " Speech Communication, vol. 48, pp. 1162-1181, 2006.
2. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, et al., "Emotion recognition in human-computer interaction, " Ieee Signal Processing Magazine, vol. 18, pp. 32-80, Jan 2001.
3. P. Petta, C. Pelachaud, and R. Cowie, Emotion-Oriented Systems: Springer-Verlag Berlin Heidelberg, 2011.
4. G. Hinton, D. Li, Y. Dong, G. E. Dahl, A. Mohamed, N. Jaitly, et al., "Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups, " Signal Processing Magazine, IEEE, vol. 29, pp. 82-97, 2012.
5. A. Mohamed, G. E. Dahl, and G. Hinton, "Acoustic Modeling Using Deep Belief Networks, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, pp. 14-22, 2012.
6. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning, " Nature, vol. 521, pp. 436-444, 05/28/print 2015.
7. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, pp. 504-7, Jul 28 2006.
8. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks, " in Advances in Neural Information Processing Systems 25, ed: Curran Associates, Inc., 2012, pp. 1097-1105.
9. A. Stuhlsatz, C. Meyer, F. Eyben, T. ZieIke, G. Meier, and B. Schuller, "Deep neural networks for acoustic emotion recognition: Raising the benchmarks, " in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, 2011, pp. 5688-5691.
10. L. Longfei, Z. Yong, J. Dongmei, Z. Yanning, W. Fengna, I. Gonzalez, et al., "Hybrid Deep Neural Network - Hidden Markov Model (DNN-HMM) Based Speech Emotion Recognition, " in Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, 2013, pp. 312-317.
11. M. N. Stolar, M. Lech, and I. S. Burnett, "Optimized multi-channel deep neural network with 2D graphical representation of acoustic speech features for emotion recognition, " in Signal Processing and Communication Systems (ICSPCS), 2014 8th International Conference on, 2014, pp. 1-6.
12. K. Han, D. Yu, and I. Tashev, "Speech Emotion Recognition Using Deep Neural Network and Extreme Learning Machine, " in Annual Conference of the International Speech Communication Association (Interspeech-2014), Singapore, 2014.
13. F. Eyben, M. Wöllmer, A. Graves, B. Schuller, E. Douglas-Cowie, and R. Cowie, "On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cues, " Journal on Multimodal User Interfaces, vol. 3, pp. 7-19, 2010.
14. Y. Bengio, "Learning Deep Architectures for AI, " Foundations and Trends in Machine Learning, vol. 2, pp. 1-127, 2009.
15. L. Deng, "A tutorial survey of architectures, algorithms, and applications for deep learning, " APSIPA Transactions on Signal and Information Processing, vol. 3, pp. null-null, 2014.
16. M. D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. V. Le, et al., "On rectified linear units for speech processing, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, 2013, pp. 3517-3521.
17. X. Glorot, A. Bordes, and Y. Bengio, "Deep Sparse Rectifier Neural Networks, " in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS-11) vol. 15, ed: Journal of Machine Learning Research-Workshop and Conference Proceedings, 2011, pp. 315-323.
18. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting, " J. Mach. Learn. Res., vol. 15, pp. 1929-1958, 2014.
19. O. Martin, I. Kotsia, B. Macq, and I. Pitas, "The eNTERFACE'05 Audio-Visual Emotion Database, " presented at the Proceedings of the 22nd International Conference on Data Engineering Workshops, 2006.
20. S. Haq and P. J. B. Jackson, "Machine Audition: Principles, Algorithms and Systems, " Hershey PA, 2010, pp. 398-423.
21. C. Xiaodong, V. Goel, and B. Kingsbury, "Data Augmentation for deep neural network acoustic modeling, " in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, 2014, pp. 5582-5586.
22. A. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, et al., "Deep Speech: Scaling up end-to-end speech recognition, " ArXiv e-prints, December 2014.
23. N. Jaitly and G. E. Hinton, "Vocal tract length perturbation (VTLP) improves speech recognition, " in Proc. ICML Workshop on Deep Learning for Audio, Speech and Language, 2013.