Multimodal information fusion of audiovisual emotion recognition using novel information theoretic tools

Proceedings - IEEE International Conference on Multimedia and Expo

Volumn , Issue , 2013, Pages

  Xie, Zhibing ^a   Guan, Ling ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Audiovisual emotion recognition; Kernel entropy component analysis; Multimodal information fusion

Indexed keywords

AUDIOVISUAL EMOTION RECOGNITION; COMPONENT ANALYSIS; FEATURE TRANSFORMATIONS; GAUSSIAN-LIKE DISTRIBUTIONS; INFORMATION ENTROPY; MULTIMEDIA APPLICATIONS; MULTIMODAL INFORMATION FUSION; SECOND ORDER STATISTICS;

EXHIBITIONS; INFORMATION THEORY; TOOLS;

INFORMATION FUSION;

EID: 84885595835     PISSN: 19457871     EISSN: 1945788X     Source Type: Conference Proceeding    
DOI: 10.1109/ICME.2013.6607464     Document Type: Conference Paper

References (17)

1. P.K. Atrey, M.A. Hossain, A. El Saddik, and M.S. Kankanhalli, "Multimodal fusion for multimedia anal-ysis: a survey," Multimedia Systems, vol. 16, no. 6, pp. 345-379, 2010.
2. Y.J. Shin and C.H. Park, "Analysis of correlation based dimension reduction methods," International Journal of Applied Mathematics and Computer Science, vol. 21, no. 3, pp. 549-558, 2011.
3. Y. Wang, L. Guan, and A.N. Venetsanopoulos, "Audio-visual emotion recognition via cross-modal association in kernel space," in Multimedia and Expo (ICME), 2011 IEEE International Conference on, 2011, pp. 1-6.
4. R. Jenssen, "Kernel entropy component analysis," Pat-tern Analysis and Machine Intelligence, IEEE Transac-tions on, vol. 32, no. 5, pp. 847-860, 2010.
5. A. RRNYI, "On measures of entropy and information," in Fourth Berkeley Symposium on Mathematical Statis-tics and Probability, 1961, pp. 547-561.
6. E. Parzen, "On estimation of a probability density func-tion and mode," The annals of mathematical statistics, vol. 33, no. 3, pp. 1065-1076, 1962.
7. R. Jenssen, "Information theoretic learning and kernel methods," Information Theory and Statistical Learning, pp. 209-230, 2009.
8. R. Jenssen, T. Eltoft, M. Girolami, and D. Erdogmus, "Kernel maximum entropy data transformation and an enhanced spectral clustering algorithm," Advances in Neural Information Processing Systems, vol. 19, pp. 633, 2007.
9. R. Jenssen, "Kernel entropy component analysis: New theory and semi-supervised learning," in Machine Learning for Signal Processing (MLSP), 2011 IEEE In-ternational Workshop on. IEEE, 2011, pp. 1-6.
10. L. Ǵomez-Chova, R. Jenssen, and G. Camps-Valls, "K-ernel entropy component analysis in remote sensing data clustering," in Geoscience and Remote Sensing Sympo-sium (IGARSS), 2011 IEEE International. IEEE, 2011, pp. 3728-3731.
11. X. Huahu, Y. Jian, and G. Jue, "Application of speech e-motion recognition in intelligent household robot," in Artificial Intelligence and Computational Intelligence (AICI), 2010 International Conference on. IEEE, 2010, vol. 1, pp. 537-541.
12. C. Clavel, I. Vasilescu, L. Devillers, G. Richard, and T. Ehrette, "Fear-type emotion recognition for future audio-based surveillance systems," Speech Communi-cation, vol. 50, no. 6, pp. 487-503, 2008.
13. M. El Ayadi, M.S. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recognition, vol. 44, no. 3, pp. 572-587, 2011.
14. Y. Wang, L. Guan, and A.N. Venetsanopoulos, "Kernel cross-modal factor analysis for information fusion with application to bimodal emotion recognition," Multime-dia, IEEE Transactions on, vol. 14, no. 3, pp. 597-607, 2012.
15. S. Bashyal and G.K. Venayagamoorthy, "Recognition of facial expressions using gabor wavelets and learning vector quantization," Engineering Applications of Arti-ficial Intelligence, vol. 21, no. 7, pp. 1056-1064, 2008.
16. M. Gurban and J.P. Thiran, "Using entropy as a stream reliability estimate for audio-visual speech recognition," in Proceedings of the 16th European Signal Processing Conference, 2008.
17. O. Martin, I. Kotsia, B. Macq, and I. Pitas, "The en-terface'05 audio-visual emotion database," in Data En-gineering Workshops, 2006. Proceedings. 22nd Interna-tional Conference on. IEEE, 2006, pp. 8-8.