Emotion recognition in spontaneous and acted dialogues

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Volumn , Issue , 2015, Pages 698-704

  Tian, Leimin ^a   Moore, Johanna D ^a   Lai, Catherine ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

dialogue; disfluency; emotion recognition; LSTM

Indexed keywords

COMPLEX NETWORKS; DATABASE SYSTEMS; INTELLIGENT COMPUTING; RECURRENT NEURAL NETWORKS; SUPPORT VECTOR MACHINES;

COMPLEX STRUCTURE; DIALOGUE; DISFLUENCY; EMOTION RECOGNITION; EMOTIONAL DATABASE; LONG SHORT TERM MEMORY; LSTM; RECOGNIZING EMOTIONS;

SPEECH RECOGNITION;

EID: 84964039845     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2015.7344645     Document Type: Conference Paper

References (41)

1. R. W. Picard, Affective computing. MIT press, 2000.
2. J. A. Singer and P. Salovey, Remembered Self: Emotion and Memory in Personality. Simon and Schuster, 2010.
3. A. Bechara, "The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage," Brain and cognition, vol. 55, no. 1, pp. 30-40, 2004.
4. S. Shott, "Emotion and social life: A symbolic interactionist analysis," American journal of Sociology, pp. 1317-1334, 1979.
5. F. Pecune, M. Mancini, B. Biancardi, G. Varni, Y. Ding, and C. Pelachaud, "Laughing with a virtual agent," 2015.
6. A. Popescu, J. Broekens, and M. van Someren, "Gamygdala: An emotion engine for games," Affective Computing, IEEE Transactions on, vol. 5, no. 1, pp. 32-44, 2014.
7. J. Xu, J. Broekens, K. Hindriks, and M. A. Neerincx, "Effects of bodily mood expression of a robotic teacher on students," in Intelligent Robots and Systems (IROS 2014), 2014 IEEE/RSJ International Conference on. IEEE, 2014, pp. 2614-2620.
8. P. Vuilleumier, "How brains beware: neural mechanisms of emotional attention," Trends in cognitive sciences, vol. 9, no. 12, pp. 585-594, 2005.
9. L. Vidrascu and L. Devillers, "Detection of real-life emotions in call centers." in INTERSPEECH, vol. 2005, no. 10, 2005, pp. 1841-1844.
10. R. Lickley, "Fluency and disfluency," 2015, to appear.
11. C. McGettigan, E. Walsh, R. Jessop, Z. Agnew, D. Sauter, J. Warren, and S. Scott, "Individual differences in laughter perception reveal roles for mentalizing and sensorimotor systems in the evaluation of emotional authenticity." Cerebral cortex (New York, NY: 1991), vol. 25, no. 1, pp. 246-257, 2015.
12. J. Moore, L. Tian, and C. Lai, "Word-level emotion recognition using high-level features," in Computational Linguistics and Intelligent Text Processing. Springer, 2014, pp. 17-31.
13. L. Tian, C. Lai, and J. Moore, "Recognizing emotions in dialogues with disfluencies and non-verbal vocalisations," in Proceedings of the 4th Interdisciplinary Workshop on Laughter and Other Non-verbal Vocalisations in Speech, 2015.
14. N. Lubis, S. Sakti, G. Neubig, T. Toda, A. Purwarianti, and S. Nakamura, "Emotion and its triggers in human spoken dialogue: Recognition and analysis," 2014.
15. D. Ozkan, S. Scherer, and L.-P. Morency, "Step-wise emotion recognition using concatenated-HMM," in Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 2012, pp. 477-484.
16. T. Baltrusaitis, N. Banda, and P. Robinson, "Dimensional affect recognition using continuous conditional random fields," in Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on. IEEE, 2013, pp. 1-8.
17. H. Kaya, F. Eyben, A. A. Salah, and B. Schuller, "Cca based feature selection with application to continuous depression recognition from acoustic speech features," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 3729-3733.
18. K. Forbes-Riley and D. Litman, "Benefits and challenges of real-time uncertainty detection and adaptation in a spoken dialogue computer tutor," Speech Communication, vol. 53, no. 9, pp. 1115-1136, 2011.
19. J. Schmidhuber, "Deep learning in neural networks: An overview," CoRR, vol. abs/1404.7828, 2014.
20. R. Brueckner and B. Schuller, "Be at odds? deep and hierarchical neural networks for classification and regression of conflict in speech," in Conflict and Multimodal Communication. Springer, 2015, pp. 403-429.
21. J. Deng, Z. Zhang, F. Eyben, and B. Schuller, "Autoencoder-based unsupervised domain adaptation for speech emotion recognition," 2014.
22. B. Schuller, M. Valster, F. Eyben, R. Cowie, and M. Pantic, "AVEC 2012: the continuous audio/visual emotion challenge," in Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 2012, pp. 449-456.
23. C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. S. Narayanan, "IEMOCAP: Interactive emotional dyadic motion capture database," Language resources and evaluation, vol. 42, no. 4, pp. 335-359, 2008.
24. F. Eyben, M. Wollmer, and B. Schuller, "OpenSMILE: the munich versatile and fast open-source audio feature extractor," in Proceedings of the international conference on Multimedia. ACM, 2010, pp. 1459-1462.
25. C. Shawe-Taylor and S. Scholkopf, "The support vector machine," 2000.
26. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
27. J. R. Fontaine, K. R. Scherer, E. B. Roesch, and P. C. Ellsworth, "The world of emotions is not two-dimensional," Psychological science, vol. 18, no. 12, pp. 1050-1057, 2007.
28. G. McKeown, M. F. Valstar, R. Cowie, and M. Pantic, "The SEMAINE corpus of emotionally coloured character interactions," in Multimedia and Expo (ICME), 2010 IEEE International Conference on. IEEE, 2010, pp. 1079-1084.
29. A. Savran, H. Cao, M. Shah, A. Nenkova, and R. Verma, "Combining video, audio and lexical indicators of affect in spontaneous conversation via particle filtering," in Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 2012, pp. 485-492.
30. A. Chen, S. Yuan, and D. Jiang, "Bagging based feature selection for dimensional affect recognition in the continuous emotion space," 2013.
31. L. van der Maaten, "Audio-visual emotion challenge 2012: a simple approach," in Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, 2012, pp. 473-476.
32. J. Wei, E. Pei, D. Jiang, H. Sahli, L. Xie, and Z. Fu, "Multimodal continuous affect recognition based on lstm and multiple kernel learning," in Asia-Pacific Signal and Information Processing Association, 2014 Annual Summit and Conference (APSIPA). IEEE, 2014, pp. 1-4.
33. M. Wollmer, A. Metallinou, N. Katsamanis, B. Schuller, and S. Narayanan, "Analyzing the memory of blstm neural networks for enhanced emotion classification in dyadic spoken interactions," in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on. IEEE, 2012, pp. 4157-4160.
34. A. Metallinou, M. Wollmer, A. Katsamanis, F. Eyben, B. Schuller, and S. Narayanan, "Context-sensitive learning for enhanced audiovisual emotion classification," Affective Computing, IEEE Transactions on, vol. 3, no. 2, pp. 184-198, 2012.
35. D. Bone, C. Lee, and S. Narayanan, "Robust unsupervised arousal rating: A rule-based framework with knowledge-inspired vocal features," Affective Computing, IEEE Transactions on, vol. 5, no. 2, pp. 201-213, 2014.
36. M. Wollmer, A. Metallinou, F. Eyben, B. Schuller, and S. S. Narayanan, "Context-sensitive multimodal emotion recognition from speech and facial expression using bidirectional lstm modeling." in INTERSPEECH, 2010, pp. 2362-2365.
37. R. Xia, J. Deng, B. Schuller, and Y. Liu, "Modeling gender information for emotion recognition using denoising autoencoder," in Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, 2014, pp. 990-994.
38. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines," ACM Transactions on Intelligent Systems and Technology (TIST), vol. 2, no. 3, p. 27, 2011.
39. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA data mining software: an update," ACM SIGKDD Explorations Newsletter, vol. 11, no. 1, pp. 10-18, 2009.
40. T. Schaul, J. Bayer, D. Wierstra, Y. Sun, M. Felder, F. Sehnke, T. Ruckstieß, and J. Schmidhuber, "PyBrain," Journal of Machine Learning Research, 2010.
41. E. Douglas-Cowie, N. Campbell, R. Cowie, and P. Roach, "Emotional speech: Towards a new generation of databases," Speech communication, vol. 40, no. 1, pp. 33-60, 2003.