Towards efficient multi-modal emotion recognition

International Journal of Advanced Robotic Systems

Volumn 10, Issue , 2013, Pages

  Dobrišek, Simon ^a   Gajšek, Rok ^a   Mihelič, France ^a   Pavešić, Nikola ^a   Štruc, Vitomir ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Canonical correlations; Emotion recognition; GMM UBM; Speech processing; Video processing

Indexed keywords

AUDIO AND VIDEO; CANONICAL CORRELATIONS; CLASSIFICATION DECISION; COMBINED SYSTEM; COMMON SOURCE; EMOTION RECOGNITION; FACIAL EXPRESSIONS; FACIAL LANDMARK; FEASIBLE SOLUTION; GAUSSIAN MIXTURE MODELS; GMM-UBM; HUMANOID ROBOT; MATCHING SCORE; MAXIMUM A POSTERIORI PROBABILITY ESTIMATIONS (MAP); MULTI-MODAL; SMART SURVEILLANCE SYSTEMS; UNIVERSAL BACKGROUND MODEL; VIDEO PROCESSING; VIDEO SEQUENCES;

ANTHROPOMORPHIC ROBOTS; CLASSIFICATION (OF INFORMATION); FACE RECOGNITION; PROBABILITY DISTRIBUTIONS; SPEECH PROCESSING; SPEECH RECOGNITION;

VIDEO SIGNAL PROCESSING;

EID: 84872968777     PISSN: 17298806     EISSN: 17298814     Source Type: Journal    
DOI: 10.5772/54002     Document Type: Article

References (26)

1. R. Gajšek, V. Štruc and F. Mihelič, "Multi-modal emotion recognition using canonical correlations and acoustic features", Proceeding of ICPR 2010, Istanbul, Turky, pp. 4133-4136, 2010.
2. R. Gajšek, V. štruc and F. Mihelič, "Multimodal emotion recognition based on the decoupling of emotion and speaker recognition", Proceeding of TSD 2010, Springer, LNCS vol. 6231, pp. 275-282, 2010.
3. N. Sebe, I. Cohen, T. Gevers and T. S. Huang", Multimodal approaches for emotion recognition: A survey", Proc. of SPIE, pp. 56-67, 2005. (Pubitemid 40949372)
4. T. K. Kim, J. Kittler and R. Cipolla, "Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations". IEEE Transactions on PAMI, vol. 29, no. 6, pp. 1005-1018, 2007. (Pubitemid 46667413)
5. O. Yamaguchi, K. Fukui and K. I. Maeda, "Face Recognition using Temporal Image Sequence", Proc of AFGR, pp. 318-323, 1998.
6. P. Viola and M. Jones, "Robust Real-Time Face Detection", Int. J. Comp. Vis., vol. 57, no. 2, pp. 137-154, 2004.
7. B. Schuller, B. Vlasenko, F. Eyben, G. Rigoll and A. Wendemuth, "Acoustic Emotion Recognition: A Benchmark Comparison of Performances", Proc. of ASRU, 2009.
8. C. Busso, S. Lee and S. Narayanan, "Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection", IEEE Trans. on Audio, Speech, and Lang. Proc., vol. 17, no. 4, pp. 582-596, 2009.
9. B. Schuller, S. Steidl and A. Batliner, "The Interspeech 2009 Emotion Challenge", Proc. of Interspeech 2009, Brighton, UK, pp. 312-315, 2009.
10. M. Kockmann, L. Burget and J. Cernocky, "Brno University of Technology System for Interspeech 2009 Emotion Challenge", Proc. of Interspeech 2009, Brighton, UK, pp. 348-351, 2009.
11. O. Martin, I. Kotsia, B. Macq and I. Pitas, "The eNTERFACE'05 Audio-Visual Emotion Database", 22nd Int. Conf. Data Engineering Workshops, pages 8, 2006.
12. M. Paleari and B. Huet, "Toward emotion indexing of multimedia excerpts", CBMI, London, UK, June 2008.
13. M. Mansoorizadeh and N. M. Charkari, "Multimodal information fusion application to human emotion recognition from face and speech", Multimedia Tools Appl., vol. 49, no. 2, pp. 277-297, 2010.
14. D. Datcu and L. Rothkrantz, "Multimodal recognition of emotions in car environments", DCI&I 2009, Prag, Czech Republic, 2009.
15. M. Turk, A. Pentland, "Eigenfaces for Recognition", Journal of Cognitive Neurosicence, vol. 3, no. 1, pp. 71-86, 1991.
16. F. Eyben, M. Wöllmer and B. Schuller, "openEAR - Introducing the Munich Open-Source Emotion and Affect Recognition Toolkit", Proc. ACII 2009, Amsterdam, Netherlands, pp. 576-581, 2009.
17. B. Vesnicer, J. Žganec-Gros, N. Pavešić and V. Štruc, "Face Recognition using Simplified Probabilistic Linear Discriminant Analysis", International Journal of Advanced Robotic Systems, vol. 9, pp. 1-10, 2012.
18. J. Križaj, V. štruc and S. Dobrišek, "Towards Robust 3D Face Verification using Gaussian Mixture Models", International Journal of Advanced Robotic Systems, vol. 9, pp. 1-10, 2012.
19. D. A. Reynolds, T. F. Quatieri and Robert B. Dunn, "Speaker Verification Using Adapted Gaussian Mixture Models", Digital Signal Processing, vol. 10, no. 1-3, pp. 19-40, 2000.
20. T. Bocklet, A. Maier, J. G Bauer, F. Burkhardt and E. Noth, "Age and gender recognition for telephone applications based on GMM supervectors and support vector machines", Proc. of ICASSP, pp. 1605-1608, 2008.
21. J. Kittler, "Combining classifiers: A theoretical framework ", Pattern Analysis and Applications, vol. 1, pp. 18-27, 1998. (Pubitemid 128697160)
22. A. Jain, K. Nandakumar and A. Ross, "Score normalization in multimodal biometric systems", Pattern Recognition, vol. 38, pp. 2270-2285, 2005. (Pubitemid 41336698)
23. P. Eckman, "Facial expression and Emotion", American Psychologist, vol. 48, pp. 384-392, 1993.
24. M. Paleari, R. Benmokhtar and B. Huet, "Evidence Theory-Based Multimodal Emotion Recognition", MMM'09: Proc. of the 15th Inter. Multimedia Modeling Conf. on Advances in Multimedia Modeling, Springer, Berlin Heidelberg, pp. 435-446, 2008.
25. S. Y. Huang H. H. Lee and C. K. Hsiao, "Kernel Canonical Correlation Analysis and its Application to Nonlinear Measure of Association and Test of Independence", 2006.
26. T. Melzer, M. Reiter, H. Bischof, "Appearance models based on kernel canonical correlation analysis", Pattern Recognition, vol. 36, no. 9, pp. 1961-1971, 2003. (Pubitemid 36726816)