Intraindividual and interindividual multimodal emotion analyses in human-machine-interaction

2012 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support, CogSIMA 2012

Volumn , Issue , 2012, Pages 59-64

  Böck, Ronald ^a   Glüge, Stefan ^a   Wendemuth, Andreas ^a   Limbrecht, Kerstin ^b   Walter, Steffen ^b   Hrabal, David ^b   Traue, Harald C ^b  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

Audio Analysis; Biopsychological Analysis; FACS; Individual Calibration; Multimodality

Indexed keywords

AUDIO ANALYSIS; BIOPSYCHOLOGICAL ANALYSIS; FACS; INDIVIDUAL CALIBRATIONS; MULTI-MODALITY;

INTELLIGENT SYSTEMS; INTERACTIVE COMPUTER SYSTEMS;

DECISION SUPPORT SYSTEMS;

EID: 84861155992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CogSIMA.2012.6188409     Document Type: Conference Paper

References (27)

1. E. Hudlicka, "To feel or not to feel: The role of affect in human-computer interaction," International Journal of Human Computer Studies, vol. 59, no. 1-2, pp. 1-32, 2003.
2. A. Wendemuth and S. Biundo, "A companion technology for cognitive technical systems," in COST 2012 Conference "Cross Modal Analysis of Verbal and Nonverbal Communication", Dresden, Germany, 2011.
3. K. R. Scherer, "Appraisal considered as a process of multilevel sequential checking," Appraisal processes in emotion: Theory, methods, research, pp. 92-120, 2001.
4. M. Holodynski and W. Friedlmeier, Development of emotions and emotion regulation. Springer, 2006.
5. S. Walter, D. Hrabal, A. Scheck, H. Kessler, G. Bertrand, F. Nothdurft, W. Minker, and H. Traue, "Individual emotional profiles in wizard-of-oz-experiments," in ACM International Conference Proceeding Series, 2010.
6. R. W. Picard, Affective Computing. Cambridge, MA: MIT Press, 2000.
7. L. Kuncheva, Combining pattern classifiers: methods and algorithms. Wiley, 2004.
8. J. Kim and E. André, "Emotion recognition based on physiological changes in listening music," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2067-2083, 2008.
9. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, 2009.
10. H. Gunes and M. Pantic, "Automatic, dimensional and continuous emotion recognition," International Journal of Synthetic Emotions, vol. 1, no. 1, pp. 68-99, 2010.
11. S. Walter, S. Scherer, M. Schels, M. Glodek, D. Hrabal, M. Schmidt, R. Böck, K. Limbrecht, H. Traue, and F. Schwenker, "Multimodal Emotion Classification in Naturalistic User Behavior," in Proc. of the 14th International Conference on Human-Computer Interaction, Orlando, USA, 2011.
12. P. Lang, M. Bradley, and B. Cuthbert, "International affective picture system (iaps): Affective ratings of pictures and instruction manual,"University of Florida, Gainesville, FL., Technical Report A-8, 2008.
13. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods," Speech Communication, vol. 48, no. 9, pp. 1162-1181, 2006.
14. A. Mehrabian, "Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament," Current Psychology, vol. 14, no. 4, pp. 261-292, 1996.
15. B. Vlasenko and A. Wendemuth, "Processing affected speech within human machine interaction," in INTERSPEECH-2009, vol. 3, Brighton, 2009, pp. 2039-2042.
16. C. E. Izard, The Psychology of Emotions, 1st ed. Springer, 2004.
17. P. Ekman and W. V. Friesen, "Facial action coding system: A technique for the measurement of facial movement." Consulting Psychologists, 1978.
18. P. Ekman, Basic Emotions. John Wiley & Sons, Ltd, 2005, pp. 45-60.
19. P. Ekman and W. V. Friesen, "Emfacs," Unpublished Document. San Franciso, USA, 1982.
20. M. M. Bradley and P. J. Lang, "Measuring emotion: The self-assessment manikin and the semantic differential," Journal of Behavioral Therapy and Experimental Psychiatry, vol. 25, no. 1, pp. 49-59, 1994.
21. S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland, The HTK Book, version 3.4. Cambridge University Engineering Department, 2009.
22. T. L. Nwe, S. W. Foo, and L. C. De Silva, "Speech emotion recognition using hidden markov models," Speech Communication, vol. 41, no. 4, pp. 603-623, 2003.
23. R. Böck, D. Hübner, and A. Wendemuth, "Determining Optimal Signal Features and Parameters for HMM-Based Emotion Classification," in Proc. of the 15th IEEE Mediterranean Electrotechnical Conference. IEEE, 2010, pp. 1586-1590.
24. J. Cohen, "A power primer," Psychological Bulletin, vol. 112, no. 1, pp. 155-159, 1992.
25. D. Freedman, R. Pisani, and R. Purves, Statistics. Norton, 2007.
26. B. Schuller, B. Vlasenko, R. Minguez, G. Rigoll, and A. Wendemuth, "Comparing one and two-stage acoustic modeling in the recognition of emotion in speech," in 2007 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), 2007, pp. 596-600.
27. B. Vlasenko, D. Philippou-Hübner, D. Prylipko, R. Böck, I. Siegert, and A. Wendemuth, "Vowels formants analysis allows straightforward detection of high arousal emotions," in 2011 IEEE International Conference on Multimedia and Expo (ICME), 2011.