Audio visual emotion recognition based on triple-stream dynamic bayesian network models

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6974 LNCS, Issue PART 1, 2011, Pages 609-618

  Jiang, Dongmei ^a,b   Cui, Yulu ^a,b   Zhang, Xiaojing ^a,b   Fan, Ping ^b   Ganzalez, Isabel ^b   Sahli, Hichem ^b,c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^c IMEC   (Belgium)

Author keywords

Asy DBN; asynchronous; MSHMM; triple stream DBN model

Indexed keywords

ASY-DBN; ASYNCHRONOUS; ASYNCHRONY; AUDIO FEATURES; AUDIO STREAM; AUDIO-VISUAL; DYNAMIC BAYESIAN NETWORK MODELS; EMOTION RECOGNITION; FACIAL ANIMATION; FACIAL FEATURE; FEATURE DIMENSIONS; MSHMM; MULTI-STREAM; PRINCIPLE COMPONENT ANALYSIS; PROSODIC FEATURES; TRIPLE STREAM DBN MODEL; TWO-STREAM; VISUAL FEATURE;

ANIMATION; BAYESIAN NETWORKS; INFERENCE ENGINES; INTELLIGENT COMPUTING; PRINCIPAL COMPONENT ANALYSIS;

FEATURE EXTRACTION;

EID: 80054842041     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24600-5_64     Document Type: Conference Paper

References (19)

1. Ekman, P., Friesen, W.V.: Constants across Cultures in the Face and Emotion. Journal of Personality and Social Psychology 17(2), 124-129 (1971)
2. Lee, C.M., Narayanan, S.S.: Toward Detecting Emotions In Spoken Dialogs. IEEE Tran. on Speech and Audio Processing 13(2), 293-303 (2005)
3. Neiberg, D., Elenius, K., Laskowski, K.: Emotion Recognition In Spontaneous Speech Using GMMs. In: Proceedings ICSLP 2006, Pittsburgh, pp. 809-812 (2006)
4. Wang, J., Yin, L., Wei, X., Sun, Y.: 3D Facial Expression Recognition Based on Primitive Surface Feature Distribution. In: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 1399-1406 (2006)
5. Zeng, Z., Fu, Y., Roisman, G.I., Wen, Z., Hu, Y., Huang, T.S.: Spontaneous Emotional Facial Expression Detection. Journal of Multimedia 1(5), 1-8 (2006)
6. Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C.M., et al.: Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information. In: ACM Int. Conf. on Multimodal Interfaces, pp. 205-211 (2004)
7. Schuller, B., Müller, R., Hörnler, B., et al.: Audiovisual Recognition of Spontaneous Interest Within Conversations. In: ACM Int. Conf. on Multimodal Interfaces, pp. 30-37 (2007)
8. Pal, P., Iyer, A.N., Yantorno, R.E.: Emotion Detection from Infant Facial Expressions and Cries. In: Proc. ICASSP, vol. 2, pp. 721-724 (2006)
9. Petridis, S., Pantic, M.: Audiovisual Discrimination between Laughter and Speech. In: Proc. ICASSP, pp. 5117-5120 (2008)
10. Zeng, Z., Hu, Y., Roisman, G.I., Wen, Z., Fu, Y., et al.: Audio-Visual Emotion Recognition in Adult Attachment Interview. In: Int. Conf. on Multimodal Interfaces, pp. 139-145 (2006)
11. Zeng, Z., Tu, J., Pianfetti, et al.: Audio-visual Affective Expression Recognition through Multi-stream Fused HMM. IEEE Transactions on Multimedia 10(4), 570-577 (2008)
12. Song, M., You, M., Li, N., Chen, C.: A Robust Multimodal Approach for Emotion Recognition. Neurocomputing 71(10-12), 1913-1920 (2008)
13. Chen, D., Jiang, D., Ravyse, I., Sahli, H.: Audio-Visual Emotion Recognition Based on a DBN Model with Constrained Asynchrony. In: Proc. ICIG, pp. 912-916 (2009)
14. Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologist Press, Palo Alto (1978)
15. Young, S., Kershaw, O.D., Ollason, J., Valtchev, D.V., Woodland, P.: The HTK Book. Entropic Ltd., Cambridge (1999)
16. Hou, Y., Sahli, H., Ravyse, I., Zhang, Y., Zhao, R.: Robust Shape-based Head Tracking. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 340-351. Springer, Heidelberg (2007)
17. Hou, Y., Fan, P., Ravyse, I., Sahli, H.: 3D Face Alignment via Cascade 2D Shape Alignment and Constrained Structure from Motion. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2009. LNCS, vol. 5807, pp. 550-561. Springer, Heidelberg (2009)
18. Bilmes, J., Zweig, G.: The Graphical Models Toolkit: An Open Source Software System for Speech and Time Series Processing. In: Proc. ICASSP, pp. 3916-3919 (2002)
19. Martin, O., Kotsia, I., Macq, B., et al.: The eNTERFACE'05 Audio-visual Emotion Database. In: Proceedings of the 22nd Int. Conf. on Data Engineering Workshops (2006)