Robust continuous prediction of human emotions using multiscale dynamic cues

ICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction

Volumn , Issue , 2012, Pages 501-508

  Nicolle, Jérémie ^a   Rapp, Vincent ^a   Bailly, Kévin ^a   Prevost, Lionel ^b   Chetouani, Mohamed ^a  

^a SORBONNE UNIVERSITÉ   (France)

^b University of the French West Indies and Guiana   (Guadeloupe)

Author keywords

Affective computing; Dynamic features; Facial expressions; Feature selection; Multimodal fusion

Indexed keywords

AFFECTIVE COMPUTING; DESIGNING SYSTEMS; DYNAMIC FEATURES; FACIAL EXPRESSIONS; FOURIER SPECTRA; HEAD MOVEMENTS; HUMAN EMOTION; KERNEL REGRESSION; KEYPOINTS; MULTI-MODAL FUSION; MULTI-SCALE DYNAMICS; NATURAL INTERACTIONS; REPRESENTATIVE SAMPLE;

FEATURE EXTRACTION;

INTERACTIVE COMPUTER SYSTEMS;

EID: 84870210348     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2388676.2388783     Document Type: Conference Paper

References (23)

1. A. Cruz, B. Bhanu, and S. Yang. A psychologically-inspired match-score fusion model for video-based facial expression recognition. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 341-350, 2011.
2. M. Dahmane and J. Meunier. Continuous emotion recognition using gabor energy filters. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 351-358, 2011.
3. P. Ekman. Facial expression and emotion. American Psychologist, 48(4):384, 1993.
4. P. Ekman and W. Friesen. Facial action coding system: A technique for the measurement of facial action. Manual for the Facial Action Coding System, 1978.
5. J. Fontaine, K. Scherer, E. Roesch, and P. Ellsworth. The world of emotions is not two-dimensional. Psychological science, 18(12):1050, 2007.
6. H. Gunes and M. Pantic. Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners. In Proc. of Intelligent Virtual Agents (IVA'10), pages 371-377, 2010.
7. H. Gunes, B. Schuller, M. Pantic, and R. Cowie. Emotion representation, analysis and synthesis in continuous space: A survey. In Proc. IEEE Int'l Conf. Face & Gesture Recognition(FG'11), pages 827-834, 2011.
8. B. Jiang, M. Valstar, and M. Pantic. Action unit detection using sparse appearance descriptors in space-time video volumes. In Proc. IEEE Int'l Conf. Face & Gesture Recognition(FG'11), pages 314-321, 2011.
9. D. McDuff, R. El Kaliouby, K. Kassam, and R. Picard. Affect valence inference from facial action unit spectrograms. In Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition Workshops (CVPRW'10), pages 17-24, 2010.
10. G. McKeown, M. Valstar, R. Cowie, and M. Pantic. The semaine corpus of emotionally coloured character interactions. In Proc. IEEE Int'l Conf. on Multimedia and Expo (ICME'10), pages 1079-1084, 2010.
11. H. Meng and N. Bianchi-Berthouze. Naturalistic affective expression classification by a multi-stage approach based on hidden markov models. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 378-387, 2011.
12. E. Nadaraya. On estimating regression. Theory of Prob. and Appl., 9:141-142, 1964.
13. M. Nicolaou, H. Gunes, and M. Pantic. Automatic segmentation of spontaneous data using dimensional labels from multiple coders. In Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, pages 43-48, 2010.
14. M. Nicolaou, H. Gunes, and M. Pantic. Output-associative rvm regression for dimensional and continuous emotion prediction. Image and Vision Computing, 2012.
15. G. Ramirez, T. Baltrušaitis, and L. Morency. Modeling latent discriminative dynamic of multi-dimensional affective signals. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 396-406, 2011.
16. J. M. Saragih, S. Lucey, and J. F. Cohn. Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision, 91(2):200-215, Sept. 2010.
17. A. Sayedelahl, P. Fewzee, M. Kamel, and F. Karray. Audio-based emotion recognition from natural conversations based on co-occurrence matrix and frequency domain energy distribution features. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 407-414, 2011.
18. B. Schuller, M. Valstar, F. Eyben, R. Cowie, and M. Pantic. Avec 2012 - the continuous audio/visual emotion challenge. In Proc. Second International Audio/Visual Emotion Challenge and Workshop (AVEC'12) to appear, 2012.
19. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic. Avec 2011-the first international audio/visual emotion challenge. In Proc. of Affective Computing and Intelligent Interaction (ACII'11), pages 415-424, 2011.
20. T. Senechal, V. Rapp, H. Salam, R. Seguier, K. Bailly, and L. Prevost. Facial action recognition combining heterogeneous features via multi-kernel learning. IEEE Transactions on Systems, Man, and Cybernetics-Part B, 42(4):993-1005, 2012.
21. M. Valstar, M. Mehu, B. Jiang, M. Pantic, K. Scherer, B. Jiang, M. Valstar, M. Pantic, M. Valstar, B. Jiang, et al. Meta-analysis of the first facial expression recognition challenge. IEEE Transactions on Systems, Man, and Cybernetics-Part B, 2012.
22. P. Viola and M. Jones. Robust real-time face detection. International journal of computer vision, 57(2):137-154, 2004.
23. M. Wöllmer, M. Kaiser, F. Eyben, and B. Schuller. Lstm-modeling of continuous emotions in an audiovisual affect recognition framework. Image and Vision Computing, 2012.