Training combination strategy of multi-stream fused hidden Markov model for audio-visual affect recognition

Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006

Volumn , Issue , 2006, Pages 65-68

  Zeng, Zhihong ^a   Hu, Yuxiao ^a   Liu, Ming ^a   Fu, Yun ^a   Huang, Thomas S ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Affect recognition; Affective computing; Emotion recognition; Multimodal human computer interaction

Indexed keywords

AFFECT RECOGNITION; AFFECTIVE COMPUTING; MULTI-STREAM FUSED HIDDEN MARKOV MODEL (MFHMM); MULTIMODAL HUMAN-COMPUTER INTERACTION;

ACOUSTIC NOISE; DATA FUSION; GESTURE RECOGNITION; HIDDEN MARKOV MODELS; HUMAN COMPUTER INTERACTION; SPEECH RECOGNITION;

VIDEO STREAMING;

EID: 34547223416     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1180639.1180661     Document Type: Conference Paper

References (13)

1. Pantic M., Rothkrantz, L.J.M., Toward an affect-sensitive multimodal human-computer interaction, Proceedings of the IEEE, Vol. 91, No. 9, Sept. 2003, 1370-1390.
2. Picard, R.W., Affective Computing, MIT Press, Cambridge, 1997.
3. Jam, A.K., Duin, R.P.W. and Mao, J., "Statistical pattern recognition: a review," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 1, 2000, 4-37
4. Mehrabian, A., Communication without words, Psychol. Today, vol.2, no.4, 53-56, 1968
5. Zeng, Z., Tu, J., Pianfetti, B., Liu, M., Zhang, T., Zhang, Z., Huang, T.S., Levinson, S.E., Audio-Visual Affect Recognition through Multi-Stream Fused HMM for HCI. CVPR (2) 2005: 967-972
6. Potamianos, G., Neti, C., Gravier, G., and Garg, A., Automatic Recognition of audio-visual speech: Recent progress and challenges, Proceedings of the IEEE, vol. 91, no. 9, Sep. 2003
7. Bourlard, H. and Dupont, S., A new ASR approach based on independent processing and recombination of partial frequency bands, ICSLP 1996
8. Okawa, S., Bocchieri, E. and Potamianos, A., Multi-band Speech Recognition in noisy environments, ICASSP, 1998, 641-644
9. Garg, A., Potamianos, G., Neti, C. & Huang, T.S., Frame-dependent multi-stream reliability indicators for audio-visual speech recognition, ICASSP, 2003.
10. Chen, L.S, Joint Processing of Audio-Visual Informa-tion for the Recognition of Emotional Expressions in HumanComputer Interaction, PhD thesis, UIUC, 2000
11. Zeng, Z., Tu, J., Liu, M., Zhang, T., Rizzolo, N., Zhang, Z., Huang, T.S., Roth, D., and Levinson, S., Bimodal HCI-related Emotion Recognition, Int. Conf. on Multimodal Interfaces, 137-143, 2004
12. Brand, M. and Oliver, N., Coupled hidden Markov models for complex action recognition, In Proc. Computer Vision Pattern Recognition, 201-206, 1997
13. Saul, L.k. and Jordan, M.I., Mixed memory Markov model: Decomposing complex stochastic processes as mixture of simpler ones, Machine Learning, Vol.37, 75-88, Oct. 1999