Audio-visual emotion recognition based on a DBN model with constrained asynchrony

Proceedings of the 5th International Conference on Image and Graphics, ICIG 2009

Volumn , Issue , 2009, Pages 912-916

  Chen, Danqi ^a,b   Jiang, Dongmei ^a,b   Ravyse, Ilse ^c   Sahli, Hichem ^c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b Shaanxi Provincial Key Laboratory on Speech   (China)

^c Interdisciplinary Institute for Broadband Technology   (Belgium)

Author keywords

Asynchronous DBN model; Audio visual multi stream

Indexed keywords

ASYNCHRONY; AUDIO-VISUAL; AUDIO-VISUAL SPEECH; EMOTION RECOGNITION; MULTI-STREAM;

SPEECH RECOGNITION;

EID: 77952284882     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIG.2009.120     Document Type: Conference Paper

References (21)

1. C.M. Lee, and S.S. Narayanan. "Toward detecting emotions in spoken dialogs." IEEE Tran. on Speech and Audio Processing, Vol. 13(2), pp. 293-303, 2005.
2. D. Neiberg, K. Elenius, and K. Laskowski. "Emotion recognition in spontaneous speech using GMMs." Proceedings ICSLP-2006, Pittsburgh, pp. 809-812, 2006.
3. J. Wang, L. Yin, X. Wei, and Y. Sun. "3D facial expression recognition based on primitive surface feature Distribution." IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 1399-1406, June, 2006. (Pubitemid 44931484)
4. Z. Zeng, Y. Fu, G.I. Roisman, Z.Wen, Y. Hu and T.S. Huang. "Spontaneous Emotional Facial Expression Detection." Journal of Multi-media, 1(5): 1-8, 2006.
5. M. Pantic and L.J.M. Rothkrantz. "Toward an affect-sensitive multimodal human-computer interaction." Proc of the IEEE, Vol. 91, No. 9, pp. 1370-1390, Sept, 2003.
6. C. Busso, Z. Deng, S. Yildirim, M.Bulut, C.M. Lee, et al. "Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information." ACM Int. Conf. on Multimodal Interfaces, pp. 205-211, Oct 2004.
7. B. Schuller, R. Müller, B. Hörnler, A. Höthker, H. Konosu, G. Rigoll. "Audiovisual recognition of spontaneous Interest within conversations." ACM Int. Conf. on Multimodal Interfaces, pp. 30-37, 2007.
8. P. Pal, A.N. Iyer and R. E. Yantorno. "Emotion detection from infant facial expressions and cries." Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Toulouse, France, vol. 2, pp. 721-724, 2006.
9. S. Petridis and M. Pantic. "Audiovisual discrimination between laughter and speech." Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Las Vegas, USA, pp. 5117-5120, April, 2008.
10. Z. Zeng, J. Tu, P. Pianfetti, M. Liu, T. Zhang, Z. Zhang, T.S. Huang and S. Levinson. "Audio-visual Affect Recognition through Multi-stream Fused HMM for HCI." Int. Conf. on Computer Vision and Pattern Recognition, pp. 967-972, 2005.
11. Z.Zeng, Y.Hu, G.I.Roisman, Z.Wen, Y.Fu and T.S.Huang. "AudioVisual Emotion Recognition in Adult Attachment Interview." Int. Conf. on Multimodal Interfaces, pp. 139-145, 2006.
12. M. Song, M. You, N. Li and C. Chen. "A robust multimodal approach for emotion recognition." Neurocomputing. v.71, n.10-12, pp. 1913-1920, June, 2008.
13. N. Sebe, I. Cohen, T. Gevers and T.S. Huang. "Emotion recognition based on joint visual and audio cues." Int. Conf. on Pattern Recognition, pp. 1136-1139, 2006.
14. J.N. Gowdy, A. Subramanya, C. Bartels, and J. Bilmes. "DBN-based multistream models for audio-visual speech recognition." Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 1, pp. 993-996, May 2004.
15. I. Ravyse, D. Jiang, X. Jiang, G. Lv. "DBN based Models for Audio-Visual Speech Analysis and Recognition." Proc. Int. Conf. PCM 2006, pp. 19-30, Nov, 2006.
16. K. Saenko, K. Livescu. "An asynchronous DBN for audio-visual speech recognition." Proc. IEEE 2006 Workshop on Spoken Language Technology (SLT), 2006.
17. K. Livescu, O. Cetin, et al. "Articulatory feature-based methods for acoustic and audio-visual speech recognition: summary from the 2006 JHU Summer workshop." Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, pp. 621-624, 2007.
18. G. Zweig, Bayesian network Structures and Inference Techniques for Automatic Speech Recognition. Computer Speech and Language, no.17, pp.173-193, 2003.
19. S. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, and P. Woodland. "The HTK Book". Entropic Ltd., Cambridge, 1999.
20. Y. Hou, H. Sahli, I. Ravyse, Y. Zhang and R. Zhao. "Robust Shape-based Head Tracking." Proc. Advanced Concepts for Intelligent Vision Systems, pp. 340-351, 2007.
21. J. Bilmes and G. Zweig. "The Graphical Models Toolkit:" An open source software system for speech and time series processing. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2002.