Multimodal information fusion of audio emotion recognition based on kernel entropy component analysis

Proceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012

Volumn , Issue , 2012, Pages 1-8

  Xie, Zhibing ^a   Guan, Ling ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Emotion recognition; Kernel entropy component analysis; Multimodal information fusion

Indexed keywords

COMPONENT ANALYSIS; DESCRIPTORS; EMOTION RECOGNITION; ENTROPY ESTIMATION; FEATURE SPACE; FEATURE TRANSFORMATIONS; FUSION OF FEATURES; GAUSSIAN-LIKE DISTRIBUTIONS; INFORMATION ENTROPY; INFORMATION FUSION TECHNIQUES; MULTIMEDIA RESEARCH; MULTIMODAL INFORMATION FUSION; NOVEL INFORMATION; SECOND ORDER STATISTICS;

INFORMATION THEORY; OPTIMIZATION;

INFORMATION FUSION;

EID: 84874225299     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISM.2012.9     Document Type: Conference Paper

References (29)

1. L. Guan, Y. Wang, R. Zhang, Y. Tie, A. Bulzacki, and M. Ibrahim, "Multimodal information fusion for selected multimedia applications," International Journal of Multimedia Intelligence and Security, vol. 1, no. 1, pp. 5-32, 2010.
2. T. Joshi, S. Dey, and D. Samanta, "Multimodal biometrics: state of the art in fusion techniques," International Journal of Biometrics, vol. 1, no. 4, pp. 393-417, 2009.
3. P. Atrey, M. Hossain, A. El Saddik, and M. Kankanhalli, "Multimodal fusion for multimedia analysis: a survey," Multimedia Systems, vol. 16, no. 6, pp. 345-379, 2010.
4. S. Shivappa, M. Trivedi, and B. Rao, "Audiovisual information fusion in human-computer interfaces and intelligent environments: A survey," Proceedings of the IEEE, vol. 98, no. 10, pp. 1692-1715, 2010.
5. M. Lazaridis, A. Axenopoulos, D. Rafailidis, and P. Daras, "Multimedia search and retrieval using multimodal annotation propagation and indexing techniques," Signal Processing: Image Communication, 2012.
6. Y. Shin and C. Park, "Analysis of correlation based dimension reduction methods," International Journal of Applied Mathematics and Computer Science, vol. 21, no. 3, pp. 549-558, 2011.
7. Y. Wang, L. Guan, and A. Venetsanopoulos, "Audiovisual emotion recognition via cross-modal association in kernel space," in Multimedia and Expo (ICME), 2011 IEEE International Conference on. IEEE, 2011, pp. 1-6.
8. B. Schölkopf, A. Smola, and K. Müller, "Kernel principal component analysis," Artificial Neural NetworkslICANN'97, pp. 583-588, 1997.
9. X. Xu and Z. Mu, "Feature fusion method based on kcca for ear and profile face based multimodal recognition," in Automation and Logistics, 2007 IEEE International Conference on. IEEE, 2007, pp. 620-623.
10. Y. Wang, L. Guan, and A. Venetsanopoulos, "Kernel crossmodal factor analysis for multimodal information fusion," in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 2384-2387.
11. R. Jenssen, "Kernel entropy component analysis," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 32, no. 5, pp. 847-860, 2010.
12. C. Shannon, "A mathematical theory of communication," ACM SIGMOBILE Mobile Computing and Communications Review, vol. 5, no. 1, pp. 3-55, 2001.
13. A. RRNYI, "On measures of entropy and information," in Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1961, pp. 547-561.
14. R. Jenssen, "Information theoretic learning and kernel methods," Information Theory and Statistical Learning, pp. 209-230, 2009.
15. E. Parzen, "On estimation of a probability density function and mode," The annals of mathematical statistics, vol. 33, no. 3, pp. 1065-1076, 1962.
16. R. Jenssen, T. Eltoft, M. Girolami, and D. Erdogmus, "Kernel maximum entropy data transformation and an enhanced spectral clustering algorithm," Advances in Neural Information Processing Systems, vol. 19, p. 633, 2007.
17. R. Jenssen, "Kernel entropy component analysis: New theory and semi-supervised learning," in Machine Learning for Signal Processing (MLSP), 2011 IEEE International Workshop on. IEEE, 2011, pp. 1-6.
18. L. Gómez-Chova, R. Jenssen, and G. Camps-Valls, "Kernel entropy component analysis in remote sensing data clustering," in Geoscience and Remote Sensing Symposium (IGARSS), 2011 IEEE International. IEEE, 2011, pp. 3728-3731.
19. L. Guan, Y. Wang, and Y. Tie, "Toward natural and efficient human computer interaction," in Multimedia and Expo, 2009. ICME 2009. IEEE International Conference on. IEEE, 2009, pp. 1560-1561.
20. X. Huahu, Y. Jian, and G. Jue, "Application of speech emotion recognition in intelligent household robot," in Artificial Intelligence and Computational Intelligence (AICI), 2010 International Conference on, vol. 1. IEEE, 2010, pp. 537-541.
21. C. Clavel, I. Vasilescu, L. Devillers, G. Richard, and T. Ehrette, "Fear-type emotion recognition for future audio-based surveillance systems," Speech Communication, vol. 50, no. 6, pp. 487-503, 2008.
22. M. El Ayadi, M. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recognition, vol. 44, no. 3, pp. 572-587, 2011.
23. Y. Lin and G. Wei, "Speech emotion recognition based on hmm and svm," in Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on, vol. 8. Ieee, 2005, pp. 4898-4901.
24. T. Nwe, S. Foo, and L. De Silva, "Speech emotion recognition using hidden markov models," Speech communication, vol. 41, no. 4, pp. 603-623, 2003.
25. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 31, no. 1, pp. 39-58, 2009.
26. Y. Wang and L. Guan, "Recognizing human emotional state from audiovisual signals," Multimedia, IEEE Transactions on, vol. 10, no. 5, pp. 936-946, 2008.
27. Y. Wang, R. Zhang, L. Guan, and A. Venetsanopoulos, "Kernel fusion of audio and visual information for emotion recognition," Image Analysis and Recognition, pp. 140-150, 2011.
28. Y. Wang, L. Guan, and A. Venetsanopoulos, "Kernel cross-modal factor analysis for information fusion with application to bimodal emotion recognition," Multimedia, IEEE Transactions on, vol. 14, no. 3, pp. 597-607, 2012.
29. O. Martin, I. Kotsia, B. Macq, and I. Pitas, "The enterface'05 audio-visual emotion database," in Data Engineering Workshops, 2006. Proceedings. 22nd International Conference on. IEEE, 2006, pp. 8-8.