The impact of weak ground truth and facial expressiveness on affect detection accuracy from time-continuous videos of facial expressions

Information Sciences

Volumn 249, Issue , 2013, Pages 13-23

  Tkalčič, Marko ^a   Odić, Ante ^a   Košir, Andrej ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Emotion detection; Emotion induction; Facial expression; Facial expressiveness; Weak ground truth

Indexed keywords

EMOTION DETECTION; EMOTION INDUCTIONS; FACIAL EXPRESSIONS; FACIAL EXPRESSIVENESS; GROUND TRUTH;

ARTIFICIAL INTELLIGENCE;

SOFTWARE ENGINEERING;

EID: 84883178380     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.06.006     Document Type: Article

References (28)

1. J.S. Albus A model of computation and representation in the brain Information Sciences 180 2010 1519 1554
2. M.S. Bartlett, G.C. Littlewort, M.G. Frank, C. Lainscsek, I.R. Fasel, and J.R. Movellan Automatic recognition of facial actions in spontaneous expressions Journal of Multimedia 1 2006 22 35
3. J.F. Connolly, E. Granger, and R. Sabourin An adaptive classification system for video-based face recognition Information Sciences 192 2012 50 70
4. C. Darwin The Expression of the Emotions in Man and Animals 1872 D. Appleton and Company
5. P. Ekman Facial expression and emotion American Psychologist 48 1993 384
6. P. Ekman, Basic emotions, in: T. Dalgleish, M.J. Power (Eds), Handbook of Cognition and Emotion, John Wiley & Sons, Ltd., Chichester, UK. http://dx.doi.org/10.1002/0470013494.ch3.
7. J. Fleiss Measuring nominal scale agreement among many raters Psychological Bulletin 76 1971 378
8. T. Kanade, J. Cohn, Y. Tian, Comprehensive database for facial expression analysis, in: Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000, pp. 46-53.
9. R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, in: IJCAI'95 Proceedings of the 14th International Joint Conference on Artificial intelligence, vol. 2, pp. 1137-1145.
10. P.J. Lang, M.M. Bradley, B.N. Cuthbert, International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8., Technical Report, University of Florida, 2005.
11. H.X. Li, J.L. Yang, G. Zhang, and B. Fan Probabilistic support vector machines for classification of noise affected data Information Sciences 221 2013 60 71
12. G.C. Littlewort, M.S. Bartlett, and K. Lee Automatic coding of facial expressions displayed during posed and genuine pain Image and Vision Computing 27 2009 1797 1803
13. P. Melin, O. Mendoza, and O. Castillo Face recognition with an improved interval type-2 fuzzy logic Sugeno integral and modular neural networks IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 41 2011 1001 1012
14. P. Melin, D. Sánchez, and O. Castillo Genetic optimization of modular neural networks with fuzzy response integration for human recognition Information Sciences 197 2012 1 19
15. F. Nasoz, C.L. Lisetti, and A.V. Vasilakos Affectively intelligent and adaptive car interfaces Information Sciences 180 2010 3817 3836
16. M.A. Nicolaou, H. Gunes, and M. Pantic Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space IEEE Transactions on Affective Computing 2011 1 15
17. R.W. Picard Affective Computing 1997 The MIT Press
18. J. Posner, J.A. Russell, and B.S. Peterson The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology Development and Psychopathology 17 2005 715 734
19. M. Soleymani, G. Chanel, J.J.M. Kierkels, and T. Pun Affective characterization of movie scenes based on content analysis and physiological changes International Journal of Semantic Computing 3 2009 235 254
20. Y. Sun, N. Sebe, M. Lew, and T. Gevers Authentic emotion detection in real-time video Computer Vision in Human-Computer Interaction 2004 94 104
21. M. Tkalcic, A. Odic, A. Kosir, and J. Tasic Affective labeling in a content-based recommender system for images IEEE Transactions on Multimedia 15 2013 391 400
22. M. Tkalčič, U. Burnik, and A. Košir Using affective parameters in a content-based recommender system for images User Modeling and User-Adapted Interaction 20 2010 279 311
23. M. Tkalčič, A. Košir, and J. Tasič The LDOS-PerAff-1 corpus of facial-expression video clips with affective, personality and user-interaction metadata Journal on Multimodal User Interfaces 7 2013 143 155
24. M. Tkalčič, A. Odić, A. Košir, J. Tasič, Comparison of an emotion detection technique on posed and spontaneous datasets, in: Proceedings of the 19th ERK Conference, Portorož, 2010b.
25. M. Tkalčič, A. Odić, A. Košir, J. Tasič, Impact of implicit and explicit affective labeling on a recommender system's performance, in: Joint Proceedings of the Workshop on Decision Making and Recommendation Acceptance Issues in Recommender Systems (DEMRA 2011) and the 2nd Workshop on User Models for Motivational Systems: The affective and the rational routes to persuasion (UMMS 2011), 2011, pp. 112.
26. R. Valenti, Z. Yucel, T. Gevers, Robustifying eye center localization by head pose cues, in: 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 612-618.
27. A. Vinciarelli, M. Pantic, and H. Bourlard Social signal processing: survey of an emerging domain Image and Vision Computing 27 2009 1743 1759
28. G. Yang, Y. Lin, and P. Bhattacharya A driver fatigue recognition model based on information fusion and dynamic Bayesian network Information Sciences 180 2010 1942 1954