Cascaded fusion of dynamic, spatial, and textural feature sets for person-independent facial emotion recognition

Proceedings - International Conference on Pattern Recognition

Volumn , Issue , 2014, Pages 4660-4665

  Kachele, Markus ^a   Schwenker, Friedhelm ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; MEMORY ARCHITECTURE; NETWORK ARCHITECTURE; SCALES (WEIGHING INSTRUMENTS); SPEECH RECOGNITION;

ADAPTIVE WEIGHTING; EMOTION RECOGNITION; FACIAL EXPRESSIONS; FUSION ARCHITECTURE; INTERMEDIATE RESULTS; MULTI-LEVEL FUSIONS; PERSON-INDEPENDENT; PROPOSED ARCHITECTURES;

FACE RECOGNITION;

EID: 84910095079     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPR.2014.797     Document Type: Conference Paper

References (25)

1. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, 2009.
2. T. Kanade, J. Cohn, and Y. Tian, "Comprehensive database for facial expression analysis," in Automatic Face and Gesture Recognition, 2000. Proceedings. 4th IEEE International Conference on, 2000, pp. 46-53.
3. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic, "AVEC 2011 - the first international audio visual emotion challenges," in Proceedings of ACII (2011), ser. LNCS, vol. 6975, 2011, pp. 415-424, part II.
4. M. Glodek, S. Tschechne, G. Layher, M. Schels, T. Brosch, S. Scherer, M. Kächele, M. Schmidt, H. Neumann, G. Palm, and F. Schwenker, "Multiple classifier systems for the classification of audio-visual emotional states," in ACII, ser. LNCS, S. D'Mello, A. Graesser, B. Schuller, and J.-C. Martin, Eds. Springer, 2011, vol. 6975, pp. 359-368.
5. J. M. Saragih, S. Lucey, and J. F. Cohn, "Deformable model fitting by regularized landmark mean-shift," International Journal of Computer Vision, vol. 91, no. 2, pp. 200-215, Jan. 2011.
6. H. Meng, B. Romera-Paredes, and N. Bianchi-Berthouze, "Emotion recognition by two view svm-2k classifier on dynamic facial expression features," in Automatic Face Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, 2011, pp. 854-859.
7. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," in Proceedings of the 6th ACM international conference on image and video retrieval, ser. CIVR '07. New York, NY, USA: ACM, 2007, pp. 401-408.
8. T. Ojala, M. Pietikäinen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 24, no. 7, pp. 971-987, 2002.
9. M. Glodek, M. Schels, G. Palm, and F. Schwenker, "Multi-modal fusion based on classification using rejection option and Markov fusion networks," in Proceedings of the International Conference on Pattern Recognition (ICPR). IEEE, 2012, pp. 1084-1087.
10. H. Meng and N. Pears, "Descriptive temporal template features for visual motion recognition," Pattern Recognition Letters, vol. 30, no. 12, pp. 1049-1058, 2009.
11. M. Schels, M. Kächele, M. Glodek, D. Hrabal, S. Walter, and F. Schwenker, "Using unlabeled data to improve classification of emotional states in human computer interaction," Journal on Multimodal User Interfaces (JMUI), 2013.
12. J. A. Russell, "A circumplex model of affect," Journal of Personality and Social Psychology, vol. 39, no. 6, pp. 1161-1178, 1980.
13. T. Bänziger and K. R. Scherer, "Introducing the geneva multimodal emotion portrayal (gemep) corpus," Blueprint for affective computing: A sourcebook, pp. 271-294, 2010.
14. M. Valstar, B. Jiang, M. Mehu, M. Pantic, and K. Scherer, "The first facial expression recognition and analysis challenge," in Automatic Face Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, 2011, pp. 921-926.
15. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in CVPR 2005. IEEE Computer Society Conference on, vol. 1, 2005, pp. 886-893.
16. A. Bobick and J. Davis, "The recognition of human movement using temporal templates," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 23, no. 3, pp. 257-267, 2001.
17. K. Levi and Y. Weiss, "Learning object detection from a small number of examples: the importance of good features," in Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, vol. 2, 2004, pp. II-53-II-60.
18. J. C. Platt, "Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods," in Advances in large margin classifiers, 1999, pp. 61-74.
19. A. Liu, J. Ghosh, and C. Martin, "Generative oversampling for mining imbalanced datasets," in DMIN'07, 2007, pp. 66-72.
20. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience, 2004.
21. F. Roli and G. Fumera, "Analysis of linear and order statistics combiners for fusion of imbalanced classifiers," in 3rd Int. Workshop on Multiple Classifier Systems (MCS 2002. Springer, 2002, pp. 252-261.
22. M. Glodek, S. Scherer, and F. Schwenker, "Conditioned hidden Markov model fusion for multimodal classification," in Proceedings of Interspeech (2011), ISCA. ISCA, 2011, pp. 2269-2272.
23. M. Kächele, M. Glodek, D. Zharkov, S. Meudt, and F. Schwenker, "Fusion of audio-visual features using hierarchical classifier systems for the recognition of affective states and the state of depression," in Proceedings of the International Conference on Pattern Recognition Applications and Methods (ICPRAM), M. De Marsico, A. Tabbone, and A. Fred, Eds. SciTePress, 2014, pp. 671-678.
24. A. Kumar and H. S. Sheshadri, "Article: On the classification of imbalanced datasets," International Journal of Computer Applications, vol. 44, no. 8, pp. 1-7, April 2012, published by Foundation of Computer Science, New York, USA.
25. R. E. Schapire, "The strength of weak learnability," Mach. Learn., vol. 5, no. 2, pp. 197-227, Jul. 1990.