Multi-modal emotion recognition fusing video and audio

Applied Mathematics and Information Sciences

Volumn 7, Issue 2, 2013, Pages 455-462

  Xu, Chao ^a   Du, Pufeng ^a   Feng, Zhiyong ^a   Meng, Zhaopeng ^a   Cao, Tianyi ^a   Dong, Caichao ^a  

^a TIANJIN UNIVERSITY   (China)

Author keywords

Emotion recognition; HMM,; Multi layer perceptron; Multi modal fusion

Indexed keywords

EID: 84873438812     PISSN: 19350090     EISSN: None     Source Type: Journal    
DOI: 10.12785/amis/070205     Document Type: Article

References (16)

1. P. Ekman, R. Davidson, The Nature of Emotion: Fundamental Questions. Oxford University Press, New York, (1994).
2. Wang Xue-guang, Chen Shu-hong, An Improved Image Segmentation Algorithm Based on Two-Dimensional Otsu Method, Inf. Sci. Lett. 1 (2012) Vol. 1, No. 2, 77-83.
3. L. Franco, A. Treves, A neural network facial expression recognition system using unsupervised local processing. In Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. (2001), 628-632.
4. Z. Ying, J. Tang, J. Li, et al., Support Vector Discriminant Analysis and Its Application to Facial Expression Recognition. Chinese Journal of Electronics, (2008), Vol. 36, No.4, 725-730.
5. J. Bassili, Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, (1979), Vol. 37, No. 11, 2049-2058.
6. N. Zhao, Y. Liu, Product Approximate Reasoning of Online Reviews Applying to Consumer Affective and Psychological Motives Research. Applied Mathematics & Information Sciences, (2011), Vol. 5, No. 2, 45-51.
7. P. Ekman, W. Friesen, Facial Action Coding System. Consulting Psychologists Press, California, (1978).
8. M. Yu, S. Li, Dynamic Facial Expression Recognition Based on Optical Flow. Microelectronics and computer, (2005), No. 7, 113-115.
9. G. Yang, Z. Yu, Facial Expression Recognition Based on Improved Optical Flow Algorithm and HMM. Micro computer information, (2008), No. 1, 284-286.
10. J. Yeh, M. Yen, Speech Recognition with Word Fragment Detection Using Prosody Features for Spontaneous Speech. Applied Mathematics & Information Sciences, (2012), Vol. 6, No. 2, 669-675.
11. L. Zhao, C. Jiang, C. Zou et al., A Study on Emotional Feature Analysis and Recognition in Speech. Chinese Journal of Electronics, (2004), Vol. 32, No. 4, 606-609.
12. Y. Lin, G.Wei, Speech emotion recognition based on HMM and SVM. In Proceedings of the Fourth International Conference on Machine Learning and Cybernetics. (2005), 4898-4901.
13. J. Ye, M. Zhang, X. Gong, Speech emotion recognition based on MF-DFA. Computer engineering and applications, (2012), Vol. 48, No. 18, 119-122.
14. Z. Zeng, J. Tu, M. Brian, T.S. Huang, Audio-visual affective expression recognition through multistream fused HMM. IEEE Transactions on Multimedia, (2008), Vol. 10, No. 4, 570-577.
15. H. Go, K. Kwak, D. Lee et al., Emotion recognition from facial image and speech signal. In Proceedings of International Conference on Instrument and Control Engineers. (2003), 2890-2895.
16. P. Lucey, J.F. Cohn, T. Kanade et al., The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In Proceedings of IEEE workshop on CVPR for Human Communicative Behavior Analysis. (2010), 94-101.