Using speaker group dependent modelling to improve fusion of fragmentary classifier decisions

2013 IEEE International Conference on Cybernetics, CYBCONF 2013

Volumn , Issue , 2013, Pages 132-137

  Siegert, Ingo ^a   Glodek, Michael ^b   Panning, Axel ^a   Krell, Gerald ^a   Schwenker, Friedhelm ^b   Al Hamadi, Ayoub ^a   Wendemuth, Andreas ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

^b UNIVERSITY OF ULM   (Germany)

Author keywords

Affect Recognition; Companion Systems; Human Computer Interaction; Multimodal Pattern Recognition

Indexed keywords

AFFECT RECOGNITION; CLASSIFIER DECISIONS; CLASSIFIER MODELS; FACIAL EXPRESSIONS; INDIVIDUAL SKILLS; MULTI-MODAL; MULTIPLE MODALITIES; REAL-LIFE APPLICATIONS;

HUMAN COMPUTER INTERACTION; PATTERN RECOGNITION; SENSORS;

CYBERNETICS;

EID: 84888875025     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CYBConf.2013.6617458     Document Type: Conference Paper

References (46)

1. A. Wendemuth and S. Biundo, "A Companion Technology for Cognitive Technical Systems," in Cognitive Behavioural Systems, ser. LNCS. Berlin, Heidelberg: Springer, 2012, vol. 7403, pp. 89-103.
2. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 31, pp. 39-58, 2009.
3. F. Schwenker, S. Scherer, M. Schmidt, M. Schels, and M. Glodek, "Multiple classifier systems for the recogonition of human emotions," in Multiple Classifier Systems, ser. LNCS, N. Gayar, J. Kittler, and F. Roli, Eds. Berlin, Heidelberg: Springer, 2010, vol. 5997, pp. 315-324.
4. B. Schuller, M. Wöllmer, F. Eyben, and G. Rigoll, "Spectral or Voice Quality? Feature Type Relevance for the Discrimination of Emotion Pairs," in The Role of Prosody in Affective Speech, ser. Linguistic Insights, Studies in Language and Communication, S. Hancil, Ed. Peter Lang Publishing Group, 2009, vol. 97, pp. 285-307.
5. E. Douglas-Cowie, L. Devillers, J.-C. Martin, R. Cowie, S. Savvidou, S. Abrilian, and C. Cox, "Multimodal databases of everyday emotion: facing up to complexity," in European Conf. on Speech Communication and Technology, 2005, pp. 813-816.
6. G. Palm and M. Glodek, "Towards emotion recognition in human computer interaction," in Neural Nets and Surroundings, ser. Smart Innovation, Systems and Technologies. Berlin, Heidelberg: Springer, 2013, vol. 19, pp. 323-336.
7. Z. Zeng, J. Tu, B. M. Pianfetti, and T. S. Huang, "Audio-visual affective expression recognition through multistream fused hmm," Trans. Multi., Vol. 10, no. 4, pp. 570-577, Jun. 2008.
8. R. Gajsek, V. Struc, B. Vesnicer, A. Podlesek, L. Komidar, and F. Mihelic, "Analysis and Assessment of AvID: Multi-Modal Emotional Database," in Proc. of 12th TSD, 2009.
9. E. Navas, A. Castelruiz, I. Luengo, J. Sánchez, and I. Hernáez, "Designing and recording an audiovisual database of emotional speech in basque," in Proc. of LREC'04. ELRA, 2004.
10. J. Wagner, E. Andre, F. Lingenfelser, and J. Kim, "Exploring fusion methods for multimodal emotion recognition with missing data," IEEE Trans. on Affective Computing, Vol. 2, no. 4, pp. 206-218, 2011.
11. S. Scherer, M. Glodek, G. Layher, M. Schels, M. Schmidt, T. Brosch, S. Tschechne, F. Schwenker, H. Neumann, and G. Palm, "A generic framework for the inference of user states in human computer interaction: How patterns of low level communicational cues support complex affective states," JMUI, Vol. 6, no. 3-4, pp. 117-141, 2012.
12. P. Chowdhury, S. Das, S. Samanta, and U. Mangai, "A Survey of Decision Fusion and Feature Fusion Strategies for Pattern Classification," IETE Technical Review, Vol. 27, no. 4, pp. 293-307, 2010.
13. M. Glodek, M. Schels, G. Palm, and F. Schwenker, "Multi-modal fusion based on classification using rejection option and Markov fusion network," in Proc. of ICPR. IEEE, 2012, pp. 1084-1087.
14. W. McDougall, An introduction to social psychology. London, UK: J.W. Luce & Co, 1919/2001.
15. P. Ekman, Handbook of Cognition and Emotion. Sussex, UK: John Wiley & Sons, Ltd, 2005, ch. Basic Emotions, pp. 45-60.
16. K. Scherer, Appraisal considered as a process of multi-level sequential checking. Oxford University Press, 2001, pp. 92-120.
17. H. Meinedo and I. Trancoso, "Age and gender detection in the i-dash project," ACM Trans. Speech Lang. Process., Vol. 7, no. 4, pp. 13:1-13:16, August 2011.
18. M. Li, K. Han, and S. Narayanan, "Automatic speaker age and gender recognition using acoustic and prosodic level information fusion," Comput Speech Langu, Vol. 27, pp. 151-167, January 2012.
19. E. Dmitrieva and V. Gelman, "The relationship between the perception of emotional intonation of speech in conditions of interference and the acoustic parameters of speech signals in adults of different gender and age," Neuroscience and Behavioral Physiology, Vol. 42, pp. 920-928, 2012.
20. W. Wundt, Vorlesungen über die Menschen- und Tierseele. Leipzig: L. Voss, 1922/1863.
21. R. Plutchik, Emotion, a psychoevolutionary synthesis. New York: Harper & Row, 1980.
22. K. Scherer, E. Dan, and A. Flykt, "What determines a feeling's position in affective space? A case for appraisal," Cognition and Emotion, Vol. 20, pp. 92-113, 2006.
23. K. Scherer, "Appraisal Considered as a Process of Multilevel Sequential Checking," in Appraisal Processes in Emotion: Theory, Methods, Research. Oxford University Press, 2001, pp. 92-120.
24. B. Schuller, B. Vlasenko, F. Eyben, M. Wollmer, A. Stuhlsatz, A. Wendemuth, and G. Rigoll, "Cross-Corpus Acoustic Emotion Recognition: Variances and Strategies," IEEE Trans. on Affective Computing, Vol. I, pp. 119-131, 2010.
25. R. Böck, D. Hübner, and A. Wendemuth, "Determining optimal signal features and parameters for hmm-based emotion classification," in Proc. of the 15th IEEE MELECON, 2010, pp. 1586-1590.
26. D. Neiberg, K. Elenius, and K. Laskowski, "A database of german emotional speech," in Proc. of Interspeech'06, 2006, pp. 809-812.
27. B. Schuller, A. Batliner, S. Steidl, and D. Seppi, "Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge," Speech Commun., Vol. 53, no. 9-10, pp. 1062-1087, Nov. 2011.
28. I. Siegert, R. Böck, D. Philippou-Hübner, and A. Wendemuth, "Investigation of hierarchical classification for simultaneous gender and age recognitions," in Proc. of the 23. ESSV 2012, 2012.
29. F. Burkhardt, M. Eckert, W. Johannsen, and J. Stegmann, "A database of age and gender annotated telephone speech," in Proc. of LREC'10. ELRA, 2010.
30. A. Potamianos and S. Narayanan, "A review of the acoustic and linguistic properties of children's speech," in IEEE 9th Workshop on Multimedia Signal Processing (MMSP 2007), October 2007, pp. 22-25.
31. S. Lee, A. Potamianos, and S. Narayanan, "Analysis of children's speech: Duration, pitch and formants," in Proc. of Interspeech'97, Vol. 1, 1997, pp. 473-476.
32. T. Bocklet, A. Maier, J. Bauer, F. Burkhardt, and E. Noth, "Age and gender recognition for telephone applications based on gmm supervec-tors and support vector machines," in Proc. of ICASSP'08, 2008, pp. 1605-1608.
33. M. Bahari and H. Van Hamme, "Speaker age estimation using hidden markov model weight supervectors," in Proc. of the 11th ISSPA, 2012, pp. 517-521.
34. R. Gajsek, J. Zibert, T. Justin, V. Struc, B. Vesnicer, and F. Mihelic, "Gender and affect recognition based on gmm and gmm-ubm modeling with relevance map estimation," in Proc. of Interspeech'10, 2010, pp. 2810-2813.
35. M. Li, C.-S. Jung, and K. J. Han, "Combining five acoustic level modeling methods for automatic speaker age and gender recognition," in Proc. of Interspeech'10, 2010, pp. 2826-2829.
36. D. Rösner, R. Friesen, M. Otto, J. Lange, M. Haase, and J. Frommer, "Intentionality in interacting with companion systems - an empirical approach," in Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments, ser. LNCS. Berlin, Heidelberg: Springer, 2011, vol. 6763, pp. 593-602.
37. I. Siegert, R. Böck, and A. Wendemuth, "The influence of context knowledge for multimodal annotation on natural material." in Joint Proc. of the IVA 2012 Workshops, 2012, pp. 25-32.
38. J. Frommer, B. Michaelis, D. Rösner, A. Wendemuth, R. Friesen, M. Haase, M. Kunze, R. Andrich, J. Lange, A. Panning, and I. Siegert, "Towards emotion and affect detection in the multimodal last minute corpus," in Proc. of LREC'12. ELRA, 2012.
39. A. Panning, I. Siegert, A. Al-Hamadi, A. Wendemuth, D. Rösner, J. Frommer, G. Krell, and B. Michaelis, "Multimodal affect recognition in spontaneous hci environment," in Proc. of ICSPCC, 2012, pp. 430-435.
40. G. Krell, M. Glodek, A. Panning, I. Siegert, B. Michaelis, A. Wende-muth, and F. Schwenker, "Fusion of fragmentary classifier decisions for affective state recognition," in Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction. First IAPR TC3 Workshop, MPRSS 2012, Tsukuba, Japan, November 11, 2012, Revised Selected Papers, ser. LNAI. Berlin, Heidelberg: Springer, 2013, vol. 7742, pp. 116-130.
41. S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. Woodland, The HTK book (for HTK Version 3.4). Cambridge, UK: Cambridge University Press, 2006, no. July 2000.
42. T. Vogt and E. André, "Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition," in Proc. of ICME'05, 2005, pp. 474-477.
43. A. Panning, A. Al-Hamadi, and B. Michaelis, "Active shape models on adaptively refined mouth emphasizing color images," in Proc. of the 19th WSCG (Communication Papers), 2010, pp. 221-228.
44. -, "A color based approach for eye blink detection in image sequences," in Proc. of ICSIPA, 2011, pp. 40-45.
45. H. L. und M. Kryger, "Gestisches Verhalten als Indikator therapeutischer Prozesse in der verbalen Psychotherapie: Zur Funktion der Selbst-berührungen und zur Repräsentation von Objektbeziehungen in gestischen Darstellungen," Psychotherapie-Wissenschaft, Vol. 1, no. 1, 2011.
46. M. Glodek, S. Reuter, M. Schels, K. Dietmayer, and F. Schwenker, "Kalman filter based classifier fusion for affective state recognition," in Proc of Int. Workshop on Multiple Classifier Systems (MCS), ser. LNCS, Vol. 7872. Springer, 2013, pp. 85-94.