Modeling subjectiveness in emotion recognition with deep neural networks: Ensembles vs soft labels

Proceedings of the International Joint Conference on Neural Networks

Volumn 2016-October, Issue , 2016, Pages 566-570

  Fayek, H M ^a   Lech, M ^a   Cavedon, L ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS;

BASELINE MODELS; DEEP NEURAL NETWORKS; EMOTION RECOGNITION; GROUND TRUTH; NOCV1; PERFORMANCE GAIN; REAL TIME; SOFT LABELS; SPECTROGRAMS;

SPEECH RECOGNITION;

EID: 85007168680     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2016.7727250     Document Type: Conference Paper

References (28)

1. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction", Signal Processing Magazine, IEEE, vol. 18, no. 1, pp. 32-80, 2001.
2. R. Fernandez, "A computational model for the automatic recognition of affect in speech", Ph. D. dissertation, School of Architecture and Planning, Massachusetts Institute of Technology, 2004.
3. P. Kleinginna Jr and A. Kleinginna, "A categorized list of emotion definitions, with suggestions for a consensual definition", Motivation and Emotion, vol. 5, no. 4, pp. 345-379, 1981.
4. R. Picard, "Emotion research by the people, for the people", Emotion Review, 2010.
5. P. Shaver, J. Schwartz, D. Kirson, and C. O'Connor, "Emotion knowledge: Further exploration of a prototype approach", Journal of Personality and Social Psychology, vol. 52, no. 6, pp. 1061-1086, 1987.
6. B. Schuller, B. Vlasenko, F. Eyben, M. Wöllmer, A. Stuhlsatz, A. Wendemuth, and G. Rigoll, "Cross-corpus acoustic emotion recognition: variances and strategies", IEEE Transactions on Affective Computing, vol. 1, no. 2, pp. 119-131, 2010.
7. D. Seppi, A. Batliner, B. Schuller, S. Steidl, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, N. Amir, and V. Aharonson, "Patterns, prototypes, performance: classifying emotional user states." in INTERSPEECH, 2008, pp. 601-604.
8. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods", Speech Communication, vol. 48, no. 9, pp. 1162-1181, 2006.
9. F. Eyben, M. Wllmer, A. Graves, B. Schuller, E. Douglas-Cowie, and R. Cowie, "On-line emotion recognition in a 3-d activation-valence-time continuum using acoustic and linguistic cues", Journal on Multimodal User Interfaces, vol. 3, no. 1-2, pp. 7-19, 2010.
10. H. M. Fayek, M. Lech, and L. Cavedon, "Towards real-time speech emotion recognition using deep neural networks", in Signal Processing and Communication Systems (ICSPCS), 2015 9th International Conference on, December 2015.
11. C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. Chang, S. Lee, and S. Narayanan, "IEMOCAP: interactive emotional dyadic motion capture database", Language Resources and Evaluation, vol. 42, no. 4, pp. 335-359, 2008.
12. G. Hinton, O. Vinyals, and J. Dean, "Distilling the knowledge in a neural network", arXiv preprint arXiv:1503.02531, 2015.
13. C. Bucilu, R. Caruana, and A. Niculescu-Mizil, "Model compression", in Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006, pp. 535-541.
14. S. Steidl, M. Levit, A. Batliner, E. Noth, and H. Niemann, "of all things the measure is man: Automatic classification of emotions and interlabeler consistency", in Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP'05). IEEE International Conference on, vol. 1, March 2005, pp. 317-320.
15. F. Eyben, M. Wöllmer, and B. Schuller, "A multitask approach to continuous five-dimensional affect sensing in natural speech", ACM Trans. Interact. Intell. Syst., vol. 2, no. 1, pp. 6:1-6:29, Mar. 2012.
16. B. Schuller, S. Steidl, and A. Batliner, "The interspeech 2009 emotion challenge." in INTERSPEECH, vol. 2009, 2009, pp. 312-315.
17. M. Shah, C. Chakrabarti, and A. Spanias, "A multi-modal approach to emotion recognition using undirected topic models", in IEEE International Symposium on Circuits and Systems (ISCAS), June 2014, pp. 754-757.
18. K. Han, D. Yu, and I. Tashev, "Speech emotion recognition using deep neural network and extreme learning machine", in INTERSPEECH 2014, 2014.
19. S. Mariooryad and C. Busso, "Exploring cross-modality affective reactions for audiovisual emotion recognition", IEEE Transactions on Affective Computing, vol. 4, no. 2, pp. 183-196, April 2013.
20. Y. Kim, H. Lee, and E. Provost, "Deep learning for robust feature generation in audiovisual emotion recognition", in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, May 2013, pp. 3687-3691.
21. P. Refaeilzadeh, L. Tang, and H. Liu, "Cross-validation", in Encyclopedia of database systems. Springer, 2009, pp. 532-538.
22. A.-R. Mohamed, G. Dahl, and G. Hinton, "Acoustic modeling using deep belief networks", IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 14-22, 2012.
23. M. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. Le, P. Nguyen, A. Senior, V. Vanhoucke, J. Dean et al., "On rectified linear units for speech processing", in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 3517-3521.
24. T. Tieleman and G. Hinton, "Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude", COURSERA: Neural Networks for Machine Learning, vol. 4, 2012.
25. Y. Dauphin, H. de Vries, J. Chung, and Y. Bengio, "RMSProp and equilibrated adaptive learning rates for non-convex optimization", arXiv preprint arXiv:1502.04390, 2015.
26. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting", Journal of Machine Learning Research, vol. 15, pp. 1929-1958, 2014.
27. K. He, X. Zhang, S. Ren, and J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on imagenet classification", arXiv preprint arXiv:1502.01852, 2015.
28. C. Bishop, Pattern Recognition and Machine Learning. Springer, 2006.