Annotation and processing of continuous emotional attributes: Challenges and opportunities

2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013

Volumn , Issue , 2013, Pages

  Metallinou, Angeliki ^a   Narayanan, Shrikanth ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

continuous emotion estimation; continuous emotional annotation; dyadic multimodal database; emotional representations

Indexed keywords

AFFECTIVE COMPUTING; CONTINUOUS ASSESSMENT; CONTINUOUS EMOTIONAL ANNOTATION; CONTINUOUS VARIABLES; EMOTION ESTIMATION; EMOTIONAL REPRESENTATIONS; MULTI-MODAL INFORMATION; MULTIMODAL DATABASE;

HUMAN COMPUTER INTERACTION;

EID: 84881537375     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2013.6553804     Document Type: Conference Paper

References (36)

1. J. Russell and A. Mehrabian, "Evidence for a three-factor theory of emotions," Journal of Research in Personality, vol. 11, pp. 273-294, 1977.
2. H. Schlosberg, "Three dimensions of emotion," Psychology Review, vol. 61, pp. 81-88, 1954.
3. D.G. Dastidar M. Grimm and K. Kroschel, "Recognizing emotions in spontaneous facial expressions," in Proc. of Int. Conf. on Intelligent Systems And Computing (ISYC), 2006.
4. A. Metallinou, M. Woellmer, A. Katsamanis, F. Eyben, B. Schuller, and S. Narayanan, "Context-sensitive learning for enhanced audiovisual emotion classification," IEEE Trans. of Affective Computing, vol. 3, pp. 184-198, 2012.
5. A Kleinsmith and N. Bianchi-Berthouze, "Recognizing affective dimensions from body posture," in Proc. of Affective Computing and Intelligent Interaction (ACII), 2007.
6. M. Grimm, E. Mower, K. Kroschel, and S. Narayanan, "Primitives based estimation and evaluation of emotions in speech," Speech Communication, vol. 49, pp. 787-800, 2007.
7. D. Wu, T. Parsons, E. Mower, and S. S. Narayanan, "Speech emotion estimation in 3d space," in Proc. of IEEE Intl. Conf. on Multimedia & Expo (ICME) 2010, 2010.
8. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schroder, "FEELTRACE: An instrument for recording perceived emotion in real time," in ISCA Workshop on Speech and Emotion, 2000, 2000, pp. 19-24.
9. F. Nagel, R. Kopiez, O. Grewe, and E. Altenmuller, "Emujoy: Software for continuous measurement of perceived emotions in music," Behavior Research Methods, vol. 39, pp. 283-290, 2007.
10. D.S. Messinger, T. Cassel, S. Acosta, Z. Ambadar, and J.F. Cohn, "Infant smiling dynamics and perceived positive emotion," Journal of Nonverbal Behavior, vol. 32, pp. 133-155, 2008.
11. R. Cowie and M. Sawey, "GTrace-General trace program from Queen's, Belfast," http://www.dfki.de/schroed/feeltrace/, 2011.
12. E. Douglas-Cowie, N. Campbell, and R.P. Cowie, "Emotional speech: Towards a new generation of databases," Speech Communication, vol. 40, pp. 3360, 2003.
13. G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schroder, "The SEMAINE database: annotated multimodal records of emotionally coloured conversations between a person and a limited agent.," IEEE Trans. of Affective Computing, Special issue of Resources for Affective Computing., vol. 6, 2011.
14. A. Metallinou, C.-C. Lee, C. Busso, S. Carnicke, and S. Narayanan, "The USC CreativeIT database: A multimodal database of theatrical improvisation," in Workshop on Multimodal Corpora, LREC, 2010.
15. A. Metallinou, A. Katsamanis, Y. Wang, and S. Narayanan, "Tracking changes in continuous emotion states using body language and prosodic cues," in Proc. of ICASSP, 2011.
16. L. Devillers, R. Cowie, J. C. Martin, E. Douglas-Cowie, S. Abrilian, and M. McRorie, "Real life emotions in french and english tv video clips: an integrated annotation protocol combining continuous and discrete approaches," in Proc. of LREC, 2006.
17. N. Malandrakis, A. Potamianos, G. Evangelopoulos, and A. Zlatintsi, "A supervised approach to movie emotion tracking.," in Proc. of ICASSP 2011, 2011.
18. M.A. Nicolaou, H. Gunes, and M. Pantic, "Continuous prediction of spontaneous affect from multiple cues and modalities in valencearousal space," IEEE Transactions on Affective Computing, vol. 2, pp. 92-105, 2011.
19. M. Woellmer, F. Eyben, S. Reiter, B. Schuller, C. Cox, E. Douglas-Cowie, and R. Cowie, "Abandoning emotion classes-towards continuous emotion recognition with modelling of long-range dependencies," in Proc. of Interspeech, 2008.
20. M. Wollmer, B. Schuller, F. Eyben, and G. Rigoll, "Combining long short-term memory and dynamic bayesian networks for incremental emotion-sensitive artificial listening," IEEE Journal of Selected Topics in Signal Processing, vol. 4, pp. 867-881, 2010.
21. A. Metallinou, A. Katsamanis, and S. Narayanan, "Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information," Image and Vision Computing (IMAVIS), Special Issue on Continuous Affect Analysis, in press, 2012.
22. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. On Multimedia, vol. 7, pp. 143-154, 2005.
23. A. Hanjalic, "Extracting moods from pictures and sounds: Towards truly personalized TV," IEEE Signal Processing Magazine, pp. 90-100, 2006.
24. C. Busso, M. Bulut, C-C Lee, A.Kazemzadeh, E. Mower, S. Kim, J. Chang, S.Lee, and S.Narayanan, "IEMOCAP: interactive emotional dyadic motion capture database," Language Resources and Evaluation, vol. 42, pp. 335-359, 2008.
25. M. Grimm, K. Kroschel, and S. Narayanan, "The Vera am Mittag german audio-visual emotional speech database," in In Proc. of the IEEE Intl. Conf. on Multimedia and Expo (ICME), 2008.
26. Yi-Hsuan Yang and Homer H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Trans. on Audio, Speech and Language Processing, vol. 19, 2011.
27. K. Audhkhasi and S. Narayanan, "A globally-variant locally-constant model for fusion of labels from multiple diverse experts without using reference labels.," IEEE Trans. on Pattern Analysis and Machine Intelligence., 2012.
28. H. Meng, A. Kleinsmith, and N. Bianchi-Berthouze, "Multi-score learning for affect recognition: the case of body postures," in Proc. of ACII, 2011.
29. M. Nikolaou, V. Pavlovic, and M. Pantic, "Dynamic probabilistic cca for analysis of affective behaviour," in Proc. of the 12th European conference on Computer Vision (ECCV), 2012.
30. I. Sneddon, G. McKeown, M. McRorie, and T. Vukicevic, "Crosscultural patterns in dynamic ratings of positive and negative natural emotional behaviour," PLoS ONE, vol. 6, 2011.
31. P.E. Shrout and J.L. Fleiss, "Intraclass correlations: uses in assessing rater reliability," Psychological Bulletin, vol. 86, pp. 420-428, 1979.
32. C. Busso and S. Narayanan, "The expression and perception of emotions: Comparing assessments of self versus others," in Proc. of InterSpeech, 2008.
33. A. Kittur, E. H. Chi, and B. Suh, "Crowdsourcing user studies with mechanical turk," in Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 2008.
34. M. Buhrmester, T. Kwang, and S. D. Gosling, "Amazon's mechanical turk : A new source of inexpensive, yet high-quality, data?," Perspectives on Psychological Science, vol. 6, 2011.
35. C. Callison-Burch, "Fast, cheap, and creative: evaluating translation quality using amazon's mechanical turk," in Proc. of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2009.
36. S. Narayanan and P. Georgiou, "Behavioral signal processing: Deriving human behavioral informatics from speech and language," Proceedings of IEEE, in press.