Combining video, audio and lexical indicators of affect in spontaneous conversation via particle filtering

ICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction

Volumn , Issue , 2012, Pages 485-492

  Savran, Arman ^a   Cao, Houwei ^a   Shah, Miraj ^a   Nenkova, Ani ^b   Verma, Ragini ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Adaboost; Affective computing; Class spectral features; Emotion dynamics; Emotion recognition; Lexical analysis; Local binary patterns; Multi modality fusion; Particle filtering; Svm

Indexed keywords

AFFECTIVE COMPUTING; CLASS-SPECTRAL FEATURES; EMOTION RECOGNITION; LEXICAL ANALYSIS; LOCAL BINARY PATTERNS; MULTI-MODALITY FUSION; PARTICLE FILTERING; SVM;

ADAPTIVE BOOSTING; DYNAMICS; ESTIMATION; INTERACTIVE COMPUTER SYSTEMS; MONTE CARLO METHODS;

SIGNAL FILTERING AND PREDICTION;

EID: 84870177354     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2388676.2388781     Document Type: Conference Paper

References (20)

1. D. Bitouk, A. Nenkova, and R. Verma. Class-level spectral features for emotion recognition. Speech communication, pages 613-625, 2010.
2. C. M. de Melo, P. Carnevale, D. Antos, and J. Gratch. A computer model of the interpersonal effect of emotion displayed in a social dilemma. In ACII 2011, Memphis, TN, Oct. 2011.
3. P. Ekman, W. V. Friesen, and J. C. Hager. Facial Action Coding System. 2002.
4. F. Eyben, M. Wöllmer, and B. Schuller. Opensmile: the munich versatile and fast open-source audio feature extractor. In ACM Multimedia, 2010.
5. B. Fasel and J. Luettin. Automatic Facial Expression Analysis: A Survey. Pattern Recognition, 36(1):259-275, 2003.
6. M. Glodek, S. Tschechne, G. Layher, M. Schels, T. Brosch, S. Scherer, M. KAdchele, M. Schmidt, H. Neumann, G. Palm, and F. Schwenker. Multiple classiffier systems for the classification of audio-visual emotional states. In IJATEM'11, pages 359-368, 2011.
7. S. Kay. Prentice Hall, Englewood Cliffs, NJ, 1988.
8. C. Lee, S. Yildirim, M. Bulut, A. Kazemzadeh, C. Busso, Z. Deng, S. Lee, and S. Narayanan. Emotion recognition based on phoneme classes. In Interspeech, pages 205-211, 2004.
9. C. M. Lee and S. S. Narayanan. Toward detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing, 13:293-303, 2005.
10. M. Nicolaou, H. Gunes, and M. Pantic. Output-associative rvm regression for dimensional and continuous emotion prediction. In FG 2011, 2011.
11. B. Pang and L. Lee. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1-2):1-135, 2007.
12. M. K. Pitt and N. Shephard. In N. de Freitas, A. Doucet, and N. J. Gordon, editors, Sequential Monte Carlo Methods in Practice. Springer-Verlag, New York, 2001.
13. A. Savran, B. Sankur, and M. T. Bilge. Regression-based intensity estimation of facial action units. Image and Vision Computing, 2011. in press.
14. B. Schuller, R. Müller, M. K. Lang, and G. Rigoll. Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensembles. In INTERSPEECH, pages 805-808, 2005.
15. B. Schuller, M. Valstar, F. Eyben, R. Cowie, and M. Pantic. Avec 2012, the continuous audio/visual emotion challenge. In AVEC 2012 Grand Challenge.
16. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic. Avec 2011, the audio/visual emotion challenge. In AVEC 2011 Grand Challenge.
17. P. D. Turney and P. Pantel. From frequency to meaning: vector space models of semantics. J. Artif. Int. Res., 37(1):141-188, 2010.
18. D. Ververidis and C. Kotropoulos. Emotional speech recognition: Resources, features, and methods. Speech communication, pages 1162-1181, 2006.
19. S. J. Young, D. Kershaw, J. Odell, D. Ollason, V. Valtchev, and P. Woodland. The HTK Book Version 3.4. 2006.
20. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE TPAMI, 31(1):39-58, January 2009.