Real-time vocal emotion recognition in artistic installations and interactive storytelling: Experiences and lessons learnt from CALLAS and IRIS

Proceedings - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Volumn , Issue , 2009, Pages

  Vogt, Thurid ^a   André, Elisabeth ^a   Wagner, Johannes ^a   Gilroy, Steve ^b   Charles, Fred ^b   Cavazza, Marc ^b  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b TEESSIDE UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EMOTION RECOGNITION; EXTREME CASE; INTERACTIVE ARTS; INTERACTIVE STORYTELLING; MULTI-MODAL; REALISTIC APPLICATIONS; RESEARCH INITIATIVES; VOCAL EXPRESSION;

INTELLIGENT COMPUTING;

EID: 77949371114     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2009.5349501     Document Type: Conference Paper

References (17)

1. A. Batliner, S. Steidl, C. Hacker, E. Nöth, and H. Niemann. Tales of tuning - prototyping for automatic classification of emotional user states. In Interspeech [7], pages 489-492.
2. A. Batliner, V. Zeißler, C. Frank, J. Adelhardt, R. P. Shi, and E. Nöth. We are not amused - but how do you know? User states in a multi-modal dialogue system. In Proceedings of Eurospeech 2003, pages 733-736, Geneva, Switzerland, September 2003.
3. M. Benzeghiba, R. D. Mori, O. Deroo, S. Dupont, T. Erbes, D. Jouvet, L. Fissore, P. Laface, A. Mertins, C. Ris, R. Rose, V. Tyagi, and C. Wellekens. Automatic speech recognition and speech variability: A review. Speech Communication, 49(10-11):763-786, October-November 2007.
4. M. Cavazza, D. Pizzi, F. Charles, T. Vogt, and E. André. Emotional input for character-based interactive storytelling. In Conf. on Autonomous Agents and Multiagent Systems, Budapest, Hungary, May 2009.
5. G. G. Jacucci, A. Spagnolli, A. Chalambalakis, A. Morrison, L. Liikkanen, S. Roveda, and M. Bertoncini. Bodily explorations in space: Social experience of a multimodal art installation. In Proc. of the twelfth IFIP conference on Human-Computer Interaction: Interact 2009. to appear.
6. S. W. Gilroy, M. Cavazza, R. Chaignon, S.-M. Mäkelä, M. Niranen, E. André, T. Vogt, J. Urbain, M. Billinghurst, H. Seichter, and M. Benayoun. E-tree: emotionally driven augmented reality art. In Proc. ACM Multimedia, pages 945-948, Vancouver, BC, Canada, 2008. ACM.
7. Proceedings of Interspeech 2005, Lisbon, Portugal, September 2005.
8. C. M. Lee and S. S. Narayanan. Toward detecting emotions in spoken dialogs. IEEE Transaction on speech and audio processing, 13(2):293-303, March 2005.
9. L. A. Liikkanen, G. Jacucci, E. Huvio, T. Laitinen, and E. André. Exploring emotions and multimodality in digitally augmented puppeteering. In Advanced Visual Interfaces, Naples, Italy, May 2008.
10. L. A. Liikkanen and L. Pearce. MusicKiosk: When listeners become composers. An exploration into affective, interactive music. In Conf. of Music Perception and Cognition, Sapporo, Japan, August 2008.
11. M. Lugger and B. Yang. Cascaded emotion classification via psychological emotion dimensions using a large set of voice quality parameters. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, USA, March-April 2008.
12. A. Mehrabian. Framework for a comprehensive description and measurement of emotional states. Genetic, Social, and General Psychology Monographs, 121:339-361, 1995.
13. B. Schuller, A. Batliner, D. Seppi, S. Steidl, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, N. Amir, L. Kessous, and V. Aharonson. The relevance of feature type for the automatic classification of emotional user states: Low level descriptors and functionals. In Proceedings of Interspeech, Antwerp, Belgium, August 2007.
14. B. Schuller, R. Müller, M. Lang, and G. Rigoll. Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensembles. In Interspeech [7].
15. E. Velten. A laboratory task for induction of mood states. Behavior Research & Therapy, 6(4):473-482, 1968.
16. T. Vogt and E. André. Improving automatic emotion recognition from speech via gender differentiation. In Proc. Language Resources and Evaluation Conference (LREC 2006), Genoa, Italy, 2006.
17. T. Vogt, E. André, and N. Bee. EmoVoice - A framework for online recognition of emotions from voice. In Proc. Workshop on Perception and Interactive Technologies for Speech-Based Systems, Kloster Irsee, Germany, June 2008.