Interpreting ambiguous emotional expressions

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Mower, Emily ^a   Metallinou, Angeliki ^a   Lee, Chi Chun ^a   Kazemzadeh, Abe ^a   Busso, Carlos ^a   Lee, Sungbok ^a   Narayanan, Shrikanth ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC FEATURES; ALGORITHMIC DESIGN; CLASSIFICATION PERFORMANCE; COMPLEX PROCESSES; EMOTION CLASSIFICATION; EMOTION EXPRESSION; EMOTIONAL EXPRESSIONS; LABORATORY ENVIRONMENT; MODELING INTERACTIONS; MULTIPLE TIMESCALES; ON TIME; REAL-WORLD APPLICATION;

INTELLIGENT COMPUTING; LABELS;

COMPLEXATION;

EID: 77949402327     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349500     Document Type: Conference Paper

References (35)

1. R. Banse and K. Scherer. Acoustic profiles in vocal emotion expression. Journal of personality and social psychology, 70:614-636, 1996.
2. J. Burgoon, L. Stern, and L. Dillman. Interpersonal adaptation: Dyadic interaction patterns. Cambridge University Press, 1995.
3. C. Busso, M. Bulut, C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. Chang, S. Lee, and S. Narayanan. IEMOCAP: Interactive emotional dyadic motion capture database. Journal of Language Resources and Evaluation, pages 335-359, Nov. 5 2008.
4. C. Busso, S. Lee, and S. Narayanan. Using neutral speech models for emotional speech analysis. In InterSpeech ICSLP, pages 2225-2228, Antwerp, Belgium, Aug. 2007.
5. C. Busso, S. Lee, and S. Narayanan. Analysis of emotionally salient aspects of fundamental frequency for emotion detection. IEEE Transactions on Audio, Speech and Language Processing, 17(4):582-596, May 2009.
6. C. Busso and S. Narayanan. Interrelation between speech and facial gestures in emotional utterances: a single subject study. IEEE Transactions on Audio, Speech and Language Processing, 15(8):2331-2347, Nov. 2007.
7. C. Busso and S. Narayanan. Recording audio-visual emotional databases from actors: a closer look. In Second International Workshop on Emotion: Corpora for Research on Emotion and Affect, International conference on Language Resources and Evaluation (LREC 2008), pages 17-22, Marrakech, Morocco, May 2008.
8. C. Busso and S. Narayanan. Scripted dialogs versus improvisation: Lessons learned about emotional elicitation techniques from the IEMOCAP database. In Interspeech 2008 - Eurospeech, pages 1670-1673, Brisbane, Australia, Sept. 2008.
9. R. Cauldwell. Where did the anger go? the role of context in interpreting emotion in speech. In ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion, pages 127-131, Newcastle, Northern Ireland, UK, Sept. 2000.
10. R. Cowie and R. Cornelius. Describing the emotional states that are expressed in speech. Speech Communication, 40(1-2):5-32, 2003.
11. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor. Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine, pages 32-80, Jan. 2001.
12. K. Dautenhahn, C. Numaoka, and AAAI. Socially intelligent agents. Springer, 2002.
13. L. De Silva, T. Miyasato, and R. Nakatsu. Facial emotion recognition using multi-modal information. In International Conference on Information, Communications and Signal Processing (ICICS), volume I, pages 397-401, Singapore, 1997.
14. L. Devillers, L. Vidrascu, and L. Lamel. Challenges in real-life emotion annotation and machine learning based detection. Neural Networks, 18(4):407-422, May 2005.
15. E. Douglas-Cowie, L. Devillers, J. Martin, R. Cowie, S. Savvidou, S. Abrilian, and C. Cox. Multimodal databases of everyday emotion: Facing up to complexity. In 9th European Conference on Speech Communication and Technology (Interspeech'2005), pages 813-816, Lisbon, Portugal, Sept. 2005.
16. F. Enos and J. Hirschberg. A framework for eliciting emotional speech: Capitalizing on the actors process. In First International Workshop on Emotion: Corpora for Research on Emotion and Affect (International conference on Language Resources and Evaluation (LREC 2006)), pages 6-10, Genoa, Italy, May 2006.
17. M. Grimm, K. Kroschel, E. Mower, and S. Narayanan. Primitives-based evaluation and estimation of emotions in speech. Speech Communication, 49:787-800, 2007.
18. A. Hanjalic. Extracting moods from pictures and sounds: Towards truly personalized tv. IEEE Signal Processing Magazine, 23(2):90-100, March 2006.
19. A. Kazemzadeh, S. Lee, and S. Narayanan. An interval type-2 fuzzy logic system to translate between emotion-related vocabularies. In In Proceedings of Interspeech, Brisbane, Australia, Sept. 2008.
20. C.-C. Lee, C. Busso, S. Lee, and S. Narayanan. Modeling mutual influence of interlocutor emotion states in dyadic spoken interactions. In 10th Annual Conference of the International Speech Communication Association (Interspeech), Brighton, UK, Sept. 2009.
21. Y. Lin and G. Wei. Speech emotion recognition based on HMM and SVM. Proc. of Int. Conf. on Machine Learning and Cybernetics, 8:4898-4901, Aug. 2005.
22. A.Mehrabian. Nonverbal communication, chapter 6, pages 104-132. Aldine, 2007.
23. A. Metallinou, S. Lee, and S. Narayanan. Audio-visual emotion recognition using gaussian mixture models for face and voice. In IEEE International Symposium on Multimedia, Berkeley, California, Dec. 2008.
24. E. Mower, M. Mataric, and S. Narayanan. Evaluating evaluators: A case study in understanding the benefits and pitfalls of multi-evaluator modeling. In 10th Annual Conference of the International Speech Communication Association (Interspeech), Brighton, UK, Sept. 2009.
25. E. Mower, M. Matarić, and S. Narayanan. Human perception of audio-visual synthetic character emotion expression in the presence of ambiguous and conflicting information. IEEE Transactions on Multimedia, 11(4), 2009.
26. M. Pantic, N. Sebe, J. Cohn, and T. Huang. Affective multimodal human-computer interaction. In Proceedings of the 13th annual ACM international conference on Multimedia, pages 669-676. ACM New York, NY, USA, 2005.
27. L. R. Rabiner and B. H. Juang. An introduction to hidden Markov models. IEEE ASSP Magazine, pages 4-15, Jan. 1986.
28. J. Russell and L. Barrett. Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76(5):805-819, 1999.
29. K. Scherer. On the nature and function of emotion: A component process approach. Approaches to emotion, pages 293-317, 1984.
30. K. Scherer. Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2):143-165, 1986.
31. K. R. Scherer. Vocal communication of emotion: A review of research paradigms. Speech Communication, 40(1-2):227-256, 2003.
32. D. Seppi, A. Batliner, B. Schuller, S. Steidl, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, N. Amir, and V. Aharonson. Patterns, Prototypes, Performance: Classifying Emotional User States. Interspeech, 2008.
33. S. Steidl, M. Levit, A. Batliner, E. Noth, and H. Niemann. "Of all things the measure is man": Automatic classification of emotions and inter-labeler consistency. In ICASSP, 2005., volume 1, pages 317-320, 2005.
34. M. Swerts and E. Krahmer. The importance of different facial areas for signalling visual prominence. In International Conference on Spoken Language (ICSLP), pages 1280-1283, Pittsburgh, PA, USA, Sept. 2006.
35. S. Young, J. Odell, D. Ollason, V. Valtchev, and P. Woodland. The HTK book. Entropic Cambridge Research Laboratory Cambridge, England, 1997.