Analysis and compensation of the reaction lag of evaluators in continuous emotional annotations

Proceedings - 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, ACII 2013

Volumn , Issue , 2013, Pages 85-90

  Mariooryad, Soroosh ^a   Busso, Carlos ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

Continuous emotion annotation; Emotion recognition

Indexed keywords

AFFECTIVE COMPUTING; COMPENSATION SCHEME; CONTINUOUS ASSESSMENT; CONTINUOUS EMOTION ANNOTATION; DESCRIPTORS; EMOTION RECOGNITION; MUTUAL INFORMATIONS; TEMPORAL DYNAMICS;

ASSOCIATION REACTIONS;

BEHAVIORAL RESEARCH;

EID: 84893230462     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2013.21     Document Type: Conference Paper

References (29)

1. C. Busso, M. Bulut, and S.S. Narayanan, "Toward effective automatic recognition systems of emotion in speech," in Social emotions in nature and artifact: emotions in human and human-computer interaction, J. Gratch and S. Marsella, Eds. Oxford University Press, New York, NY, USA, 2013.
2. R. Cowie and R.R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Communication, vol. 40, no. 1-2, pp. 5-32, April 2003.
3. A. Metallinou and S.S. Narayanan, "Annotation and processing of continuous emotional attributes: Challenges and opportunities," in 2nd International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space (EmoSPACE 2013), Shanghai, China, April 2013.
4. R. Cowie, G. McKeown, and E. Douglas-Cowie, "Tracing emotion: An overview," International Journal of Synthetic Emotions, vol. 3, no. 1, pp. 1-17, January-June 2012.
5. A. Batliner, S. Steidl, and E. Nöth, "Releasing a thoroughly annotated and processed spontaneous emotional database: the FAU Aibo emotion corpus," in Second International Workshop on Emotion: Corpora for Research on Emotion and Affect, International conference on Language Resources and Evaluation (LREC 2008), Philadelphia, PA, USA, May 2008, pp. 28-31.
6. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schröder, "'FEELTRACE': An instrument for recording perceived emotion in real time," in ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion, Newcastle, Northern Ireland, UK, September 2000, ISCA, pp. 19-24.
7. Y.E. Kim, E. Schmidt, and L. Emelle, "MoodSwings: A collaborative game for music mood label collection," in International Symposium on Music Information Retrieval (ISMIR 2008), Marrakech, Morocco, September 2008, pp. 28-31.
8. F. Nagel, R. Kopiez, O. Grewe, and E. Altenmüller, "EMuJoy: Software for continuous measurement of perceived emotions in music," Behavior Research Methods, vol. 39, no. 2, pp. 283-290, May 2007.
9. K.R. Scherer, "Vocal communication of emotion: A review of research paradigms," Speech Communication, vol. 40, no. 1-2, pp. 227-256, April 2003.
10. G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schröder, "The SEMAINE database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent," IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 5-17, January-March 2012.
11. L. Devillers, R. Cowie, J. C. Martin, E. Douglas-Cowie, S. Abrilian, and M. McRorie, "Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches," in International conference on Language Resources and Evaluation (LREC 2006), Genoa, Italy, May 2006, pp. 1105-1110.
12. N. Malandrakis, A. Potamianos, G. Evangelopoulos, and A. Zlatintsi, "A supervised approach to movie emotion tracking," in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2011), Prague, Czech Republic, May 2011, pp. 2376-2379.
13. J. Nicolle, V. Rapp, K. Bailly, L. Prevost, and M. Chetouani, "Robust continuous prediction of human emotions using multiscale dynamic cues," in International conference on Multimodal interaction (ICMI 2012), Santa Monica, CA, USA, October 2012, pp. 501-508.
14. J. C. Kim, H. Rao, and M.A. Clements, "Investigating the use of formant based features for detection of affective dimensions in speech," in Affective Computing and Intelligent Interaction (ACII 2011), S. DMello, A. Graesser, B. Schuller, and J.-C. Martin, Eds., vol. 6975/2011 of Lecture Notes in Computer Science, pp. 369-377. Springer Berlin/Heidelberg, Memphis, TN, USA, October 2011.
15. H. Meng and N. Bianchi-Berthouze, "Naturalistic affective expression classification by a multi-stage approach based on hidden Markov models," in Affective Computing and Intelligent Interaction (ACII 2011), S. DMello, A. Graesser, B. Schuller, and J.-C. Martin, Eds., vol. 6975/2011 of Lecture Notes in Computer Science, pp. 378-387. Springer Berlin/Heidelberg, Memphis, TN, USA, October 2011.
16. L. Cen, Z. L. Yu, and M.H. Dong, "Speech emotion recognition system based on L1 regularized linear regression and decision fusion," in Affective Computing and Intelligent Interaction (ACII 2011), S. DMello, A. Graesser, B. Schuller, and J.-C. Martin, Eds., vol. 6975/2011 of Lecture Notes in Computer Science, pp. 332-340. Springer Berlin/Heidelberg, Memphis, TN, USA, October 2011.
17. M.A. Nicolaou, H. Gunes, and M. Pantic, "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space," IEEE Transactions on Affective Computing, vol. 2, pp. 92-105, April-June 2011.
18. M.A. Nicolaou, V. Pavlovic, and M. Pantic, "Dynamic probabilistic CCA for analysis of affective behaviour," in European Conference on Computer Vision (ECCV 2012), Florence, Italy, October 2012, pp. 98-111.
19. E. Douglas-Cowie, R. Cowie, C. Cox, N. Amir, and D. Heylen, "The sensitive artificial listener: an induction technique for generating emotionally coloured conversation," in Second International Workshop on Emotion: Corpora for Research on Emotion and Affect, International conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco, May 2008, pp. 1-8.
20. M.S. Bartlett, G.C. Littlewort, M.G. Frank, C. Lainscsek, I. Fasel, and J.R. Movellan, "Automatic recognition of facial actions in spontaneous expressions," Journal of Multimedia, vol. 1, pp. 22-35, September 2006.
21. P. Ekman and W.V. Friesen, Facial Action Coding System: A Technique for Measurement of Facial Movement, Consulting Psychologists Press, Palo Alto, CA, USA, 1978.
22. B. Schuller, S. Steidl, A. Batliner, F. Schiel, and J. Krajewski, "The INTERSPEECH 2011 speaker state challenge," in 12th Annual Conference of the International Speech Communication Association (Interspeech'2011), Florence, Italy, August 2011.
23. F. Eyben, M. Wöllmer, and B. Schuller, "OpenSMILE: the Munich versatile and fast open-source audio feature extractor," in ACM International conference on Multimedia (MM 2010), Firenze, Italy, October 2010, pp. 1459-1462.
24. C.-C. Lee, C. Busso, S. Lee, and S.S. Narayanan, "Modeling mutual influence of interlocutor emotion states in dyadic spoken interactions," in Interspeech 2009, Brighton, UK, September 2009, pp. 1983-1986.
25. M. Wöllmer, F. Eyben, B. Schuller, E. Douglas-Cowie, and R. Cowie, "Data-driven clustering in emotional space for affect recognition using discriminatively trained LSTM networks," in Interspeech 2009, Brighton, UK, September 2009, pp. 1595-1598.
26. A. Metallinou, M. Wöllmer, A. Katsamanis, F. Eyben, B. Schuller, and S.S. Narayanan, "Context-sensitive learning for enhanced audiovisual emotion classification," IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 184-198, April-June 2012.
27. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten, "The WEKA data mining software: An update," ACM SIGKDD Explorations Newsletter, vol. 11, no. 1, pp. 10-18, June 2009.
28. C. Busso and T. Rahman, "Unveiling the acoustic properties that describe the valence dimension," in Interspeech 2012, Portland, OR, USA, September 2012, pp. 1179-1182.
29. J.P. Arias, C. Busso, and N.B. Yoma, "Energy and F0 contour modeling with functional data analysis for emotional speech detection," in Interspeech 2013, Lyon, France, August 2013.