Grounding truth via ordinal annotation

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Volumn , Issue , 2015, Pages 574-580

  Yannakakis, Georgios N ^a   Martinez, Hector P ^a  

^a UNIVERSITY OF MALTA   (Malta)

Author keywords

affect annotation; AffectRank; FeelTrace; inter rater agreement; Krippendorff's alpha; ranking

Indexed keywords

CHEMICAL DETECTION;

AFFECT ANNOTATION; AFFECTRANK; FEELTRACE; INTER-RATER AGREEMENTS; KRIPPENDORFF'S ALPHAS; RANKING;

INTELLIGENT COMPUTING;

EID: 84964091609     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2015.7344627     Document Type: Conference Paper

References (25)

1. A. Metallinou and S. Narayanan, "Annotation and processing of continuous emotional attributes: Challenges and opportunities," in Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on. IEEE, 2013, pp. 1-8.
2. G. N. Yannakakis and J. Hallam, "Rating vs. preference: a comparative study of self-reporting," in Affective Computing and Intelligent Interaction. Springer, 2011, pp. 437-446.
3. G. N. Yannakakis and H. P. Martinez, "Ratings are Overrated!" Frontiers on Human-Media Interaction, 2015.
4. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schroder, "'FEELTRACE': An instrument for recording perceived emotion in real time," in ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion, 2000.
5. S. Tognetti, M. Garbarino, A. Bonarini, and M. Matteucci, "Modeling enjoyment preference from physiological responses in a car racing game," in Computational Intelligence and Games (CIG), 2010 IEEE Symposium on. IEEE, 2010, pp. 321-328.
6. H. Martinez, G. Yannakakis, and J. Hallam, "Dont classify ratings of affect; rank them!" Affective Computing, IEEE Transactions on, vol. 5, no. 3, pp. 314-326, 2014.
7. Y.-H. Yang and H. H. Chen, "Ranking-based emotion recognition for music organization and retrieval," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 19, no. 4, pp. 762-774, 2011.
8. R. Cowie and R. R. Cornelius, "Describing the emotional states that are expressed in speech," Speech communication, vol. 40, no. 1, pp. 5-32, 2003.
9. J. A. Russell, "A circumplex model of affect." Journal of personality and social psychology, vol. 39, no. 6, p. 1161, 1980.
10. R. Cowie and M. Sawey, "Gtrace-general trace program from queens, belfast," 2011.
11. D. S. Messinger, T. D. Cassel, S. I. Acosta, Z. Ambadar, and J. F. Cohn, "Infant smiling dynamics and perceived positive emotion," Journal of Nonverbal Behavior, vol. 32, no. 3, pp. 133-155, 2008.
12. F. Nagel, R. Kopiez, O. Grewe, and E. Altenmuller, "Emujoy: Software for continuous measurement of perceived emotions in music," Behavior Research Methods, vol. 39, no. 2, pp. 283-290, 2007.
13. L. Devillers, R. Cowie, J. Martin, E. Douglas-Cowie, S. Abrilian, and M. McRorie, "Real life emotions in french and english tv video clips: an integrated annotation protocol combining continuous and discrete approaches," in 5th international conference on Language Resources and Evaluation (LREC 2006), Genoa, Italy, 2006, p. 22.
14. N. Malandrakis, A. Potamianos, G. Evangelopoulos, and A. Zlatintsi, "A supervised approach to movie emotion tracking," in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 2376-2379.
15. G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schroder, "The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent," Affective Computing, IEEE Transactions on, vol. 3, no. 1, pp. 5-17, 2012.
16. L. J. Cronbach, "Coefficient alpha and the internal structure of tests," psychometrika, vol. 16, no. 3, pp. 297-334, 1951.
17. K. Krippendorff, Content analysis: An introduction to its methodology. Sage, 2012.
18. F. Wilcoxon, "Individual comparisons by ranking methods," Biometrics bulletin, pp. 80-83, 1945.
19. M. G. Kendall, "A new measure of rank correlation," Biometrika, pp. 81-93, 1938.
20. W. H. Kruskal and W. A. Wallis, "Use of ranks in one-criterion variance analysis," Journal of the American statistical Association, vol. 47, no. 260, pp. 583-621, 1952.
21. M. Friedman, "A comparison of alternative tests of significance for the problem of m rankings," The Annals of Mathematical Statistics, vol. 11, no. 1, pp. 86-92, 1940.
22. J. Furnkranz and E. Hullermeier, Preference learning. Springer, 2010.
23. G. N. Yannakakis, "Preference learning for affective modeling," in Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on. IEEE, 2009, pp. 1-6.
24. H. P. Martinez, Y. Bengio, and G. N. Yannakakis, "Learning deep physiological models of affect," Computational Intelligence Magazine, IEEE, vol. 8, no. 2, pp. 20-33, 2013.
25. V. E. Farrugia, H. P. Martínez, and G. N. Yannakakis, "The preference learning toolbox," arXiv preprint arXiv:1506.01709, 2015.