Kernel fusion of audio and visual information for emotion recognition

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6754 LNCS, Issue PART 2, 2011, Pages 140-150

  Wang, Yongjin ^a   Zhang, Rui ^a   Guan, Ling ^a   Venetsanopoulos, A N ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Audiovisual emotion recognition; kernel methods; multimodal information fusion

Indexed keywords

ALGEBRAIC OPERATIONS; AUDIO AND VISUAL INFORMATION; AUDIOVISUAL EMOTION RECOGNITION; DIMENSIONALITY REDUCTION TECHNIQUES; EFFECTIVE ANALYSIS; EMOTION RECOGNITION; EMOTIONAL BEHAVIOR; JOINT SUBSPACES; KERNEL FUSION; KERNEL MATRICES; KERNEL METHODS; MULTIMODAL EMOTION RECOGNITION; MULTIMODAL INFORMATION FUSION; STATISTICAL DEPENDENCE; TEMPORAL STRUCTURES;

HIDDEN MARKOV MODELS; HUMAN COMPUTER INTERACTION; IMAGE ANALYSIS;

BEHAVIORAL RESEARCH;

EID: 79960288837     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-21596-4_15     Document Type: Conference Paper

References (12)

1. De Silva, L.C., Miyasato, T., Nakatsu, R.: 'Facial emotion recognition using multimodal information'. In: Proceedings of IEEE International Conference on Information, Communications and Signal Processing, vol. 1, pp. 397-401 (1997)
2. Go, H., Kwak, K., Lee, D., Chun, M.: Emotion recognition from the facial image and speech signal. In: Proceedings of SICE Annual Conference, Japan, vol. 3, pp. 2890-2895 (2003)
3. Kanluan, I., Grimm, M., Kroschel, K.: Audio-visual emotion recognition using an emotion space concept. In: Proceedings of 16th European Signal Processing Conference, Lausanne, Switzerland (2008)
4. Metallinou, A., Lee, S., Narayanan, S.: Audio-visual emotion recognition using Gaussian mixture models for face and voice. In: Proceedings of 10th IEEE International Symposium on Multimedia, pp. 250-257 (2008)
5. Han, M., Hus, J.H., Song, K.T.: A new information fusion method for bimodal robotic emotion recognition. Journal of Computers 3(7), 39-47 (2008)
6. Song, M., Chen, C., You, M.: Audio-visual based emotion recognition using tripled hidden Markov model. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Montreal, Canada, vol. 5, pp. 877-880 (2004)
7. Zeng, Z., Tu, J., Pianfetti, B., Huang, T.S.: Audio-visual Affective Expression Recognition through Multi-stream Fused HMM. IEEE Transactions on Multimedia 10(4), 570-577 (2008)
8. Wang, Y., Guan, L.: Recognizing human emotional state from audiovisual signals. IEEE Transactions on Multimedia 10(5), 936-946 (2008)
9. Muller, K.R., Mika, S., Ratsch, G., Tsuda, K., Scholkopf, B.: An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 12, 181-201 (2001)
10. Scholkopf, B., Smola, A., Muller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10(5), 1299-1319 (1998)
11. Baudat, G., Anouar, F.: Generalized discriminant analysis using a kernel approach. Neural Computing 12(10), 2385-2404 (2000)
12. Yang, J., Jin, Z., Yang, J.Y., Zhang, D., Frangi, A.F.: Essence of kernel Fisher discriminant: KPCA plus LDA. Pattern Recognition 37(10), 2097-2100 (2004)