A systematic discussion of fusion techniques for multi-modal affect recognition tasks

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 19-25

  Lingenfelser, Florian ^a   Wagner, Johannes ^a   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

Author keywords

emotion recognition; multi modal fusion

Indexed keywords

AFFECT RECOGNITION; COMBINATION RULES; DECISION LEVELS; EMOTION RECOGNITION; EMOTIONAL STATE; FEATURE FUSION; FUSION METHODS; FUSION STRATEGIES; FUSION TECHNIQUES; MULTI-MODAL; MULTI-MODAL FUSION; MULTIPLE CHANNELS; PRODUCT RULE; RESEARCH TOPICS; SINGLE CHANNELS; SINGLE-CHANNEL; VISUALIZATION TECHNIQUE;

FACE RECOGNITION; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; VISUALIZATION;

BEHAVIORAL RESEARCH;

EID: 83455176853     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070487     Document Type: Conference Paper

References (17)

1. A. Battocchi, F. Pianesi, and D. Goren-Bar. Dafex: Database of facial expressions. In M. T. Maybury, O. Stock, and W. Wahlster, editors, INTETAIN, volume 3814 of Lecture Notes in Computer Science, pages 303-306. Springer, 2005.
2. G. Caridakis, J. Wagner, A. Raouzaiou, Z. Curto, E. Andrapose, and K. Karpouzis. A multimodal corpus for gesture expressivity analysis. Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, LREC, Malta, 2010.
3. R. Duin and D. Tax. Experiments with classifier combining rules. In Lecture Notes in Computer Science, volume 1857, pages 16-29. Springer, 2000.
4. G. Fumera and F. Roli. A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(6):942-956, 2005. (Pubitemid 40889844)
5. Y. S. Huang and C. Y. Suen. Behavior-knowledge space method for combination of multiple classifiers. Proc. of IEEE Computer Vision and Pattern Rcog., 20:347-352, 1993.
6. J. Kim and F. Lingenfelser. Ensemble approaches to parametric decision fusion for bimodal emotion recognition. In Int. Conf. on Bio-inspired Systems and Signal Processing (Biosignals 2010), 2010.
7. C. Küblbeck and A. Ernst. Face detection and tracking in video sequences using the modifiedcensus transformation. Image Vision Comput., 24:564-572, June 2006. (Pubitemid 43867832)
8. L. I. Kuncheva. Switching between selection and fusion in combining classifiers: An experiment. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 32(2):146-156, 2002.
9. L. I. Kuncheva. A theoretical study on six classifier fusion strategies. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(2):281-286, 2002.
10. A. Rabie, B. Wrede, T. Vogt, and M. Hanheide. Evaluation and discussion of multi-modal emotion recognition. In Proceedings of the 2009 Second International Conference on Computer and Electrical Engineering - Volume 01, ICCEE '09, pages 598-602, Washington, DC, USA, 2009. IEEE Computer Society.
11. A. K. Seewald and J. Fuernkranz. An evaluation of grading classifiers. In Advances in In Intelligent Data Analysis, 4th International Conference, IDA 2001, Proceedings, volume 10, pages 271-289. Springer, 2001.
12. G. Shafer. A Mathematical Theory of Evidence. NJ: Princeton Univ. Press, Princeton, 1976.
13. K. M. Ting and I. H. Witten. Issues in stacked generalization. Journal of Artificial Intelligence Research, 10:115-124, 1999.
14. T. Vogt and E. Andrapose. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In IEEE International Conference on Multimedia & Expo (ICME 2005), 2005.
15. D. H. Wolpert and W. G. Macready. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1):67-82, 1996.
16. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE transactions on pattern analysis and machine intelligence, 31(1):39-58, January 2009.
17. Z. Zeng, J. Tu, M. Liu, T. Zhang, N. Rizzolo, Z. Zhang, T. S. Huang, D. Roth, and S. Levinson. Bimodal hci-related affect recognition. In Proceedings of the 6th international conference on Multimodal interfaces, pages 137-143, 2004.