The social signal interpretation framework (SSI) for real time signal processing and recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 3245-3248

  Wagner, Johannes ^a   Lingenfelser, Florian ^a   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

Author keywords

Machine learning; Multimodal fusion; Real time recognition; Social signal processing; Speech processing

Indexed keywords

EXTERNAL CODE; FLEXIBLE ARCHITECTURES; MULTI-MODAL FUSION; MULTIPLE MODALITIES; OFF-LINE RECOGNITION; PLUG-INS; REAL TIME RECOGNITION; REAL-TIME SIGNAL PROCESSING; SOCIAL SIGNALS; SUBTASKS;

GRAPHICAL USER INTERFACES; LEARNING SYSTEMS; SPEECH PROCESSING;

SIGNAL PROCESSING;

EID: 84865737002     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. J. Wagner, E. André, and F. Jung, "Smart sensor integration: A framework for multimodal emotion recognition in real-time," in Affective Computing and Intelligent Interaction (ACII 2009). IEEE, 2009.
2. M. Puckette, "Pure data: another integrated computer music environment," in Proc. of the Second Intercollege Computer Music Concerts, 1996, pp. 37-41.
3. A. Camurri, P. Coletta, G. Varni, and S. Ghisio, "Developing multimodal interactive systems with eyesweb xmi," in NIME '07: Proc. of the 7th international conference on New interfaces for musical expression. New York, NY, USA: ACM, 2007, pp. 305-308.
4. M. Serrano, L. Nigay, J.-Y. L. Lawson, A. Ramsay, R. Murray-Smith, and S. Denef, "The openinterface framework: a tool for multimodal interaction." in CHI '08: CHI '08 extended abstracts on Human factors in computing systems. New York, NY, USA: ACM, 2008, pp. 3501-3506.
5. F. Eyben, M. Wöllmer, and B. Schuller, "openear - introducing the munich open-source emotion and affect recognition toolkit," in 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. IEEE, 2009, pp. 1-6.
6. - "Opensmile: the munich versatile and fast open-source audio feature extractor," in Proceedings of the international conference on Multimedia, ser. MM '10. New York, NY, USA: ACM, 2010, pp. 1459-1462.
7. T. Vogt, E. André, J. Wagner, S. Gilroy, F. Charles, and M. Cavazza, "Real-time vocal emotion recognition in artistic installations and interactive storytelling: Experiences and lessons learnt from callas and iris," in Proceedings of the International Conference on Affective Computing and Intelligent Interaction (ACII), Amsterdam, The Netherlands, September 2009.
8. A. Mehrabian, "Framework for a comprehensive description and measurement of emotional states." Genetic, social, and general psychology monographs, vol. 121, no. 3, pp. 339-361, August 1995.
9. F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss, "A database of german emotional speech," in in Proceedings of Interspeech, Lissabon, 2005, pp. 1517-1520.
10. S. Steidl, Automatic Classification of Emotion-Related User States in Spontaneous Childrens Speech. Logos Verlag, Berlin, 2009.
11. T. Vogt, E. André, and N. Bee, "Emovoice - a framework for online recognitionof emotions from voice," in Proceedings of Workshop on Perception and Interactive Technologies for Speech-Based Systems. Kloster Irsee, Germany: Springer, June 2008.
12. S. W. Gilroy, M. Cavazza, R. Chaignon, S.-M. Mäkelä, M. Niranen, E. André, T. Vogt, J. Urbain, H. Seichter, M. Billinghurst, and M. Benayoun, "An affective model of user experience for interactive art," in ACE '08: Proc. of the 2008 International Conference on Advances in Computer Entertainment Technology. New York, NY, USA: ACM, 2008, pp. 107-110.
13. F. Charles, D. Pizzi, M. Cavazza, T. Vogt, and E. André, "Emotional input for character-based interactive storytelling," in The 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Budapest, Hungary, 2009.
14. G. Caridakis, J. Wagner, A. Raouzaiou, Z. Curto, E. André, and K. Karpouzis, "A multimodal corpus for gesture expressivity analysis." Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, LREC, Malta, May 17-23, 2010, 2010.
15. J. Urbain, R. Niewiadomski, E. Bevacqua, T. Dutoit, A. Moinet, C. Pelachaud, B. Picart, J. Tilmanne, and J. Wagner, "Avlaughtercycle," Journal on Multimodal User Interfaces, vol. 4, pp. 47-58, 2010.