Decision level combination of multiple modalities for recognition and analysis of emotional expression

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2010, Pages 2462-2465

  Metallinou, Angeliki ^a   Lee, Sungbok ^a   Narayanan, Shrikanth ^a  

^a University of Southern California   (United States)

Author keywords

Bayesian information fusion; Hidden Markov model; Multimodal emotion recognition; Perceptual salience

Indexed keywords

BEHAVIORAL RESEARCH; CLASSIFICATION (OF INFORMATION); EMOTION RECOGNITION; INFORMATION FUSION; SPEECH RECOGNITION;

BAYESIAN INFORMATION; BAYESIAN INFORMATION FUSION; DECISION LEVELS; EMOTION RECOGNITION; EMOTIONAL EXPRESSIONS; HEAD MOVEMENTS; HIDDEN-MARKOV MODELS; MULTIMODAL EMOTION RECOGNITION; MULTIPLE MODALITIES; PERCEPTUAL SALIENCE;

HIDDEN MARKOV MODELS;

EID: 78049362386     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2010.5494890     Document Type: Conference Paper

References (18)

1. A. Mehrabian, "Communication without words," Psychology today, vol. 2, pp. 53-56, 1968.
2. M. Pantic and L.J.M. Rothkrantz, "Toward an affect-sensitive multi-modal human-computer interaction," Proceedings of the IEEE, vol. 91, pp. 1370-1390, 2003.
3. Z. Zeng, J. Tu, M. Liu, T.S. Huang, B. Pianfetti, D. Roth, and S. Levinson, "Audio-visual affect recognition," IEEE Transactions on Multimedia, vol. 9, pp. 424-428, 2007.
4. L.S. Chen and T.S. Huang, "Emotional expressions in audiovisual human computer interaction," in IEEE ICME, 2000.
5. C. Busso, Z. Deng, S. Yildirim, M. Bulut, C.M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan, "Analysis of emotion recognition using facial expressions, speech and multimodal information," in ICMI, State College, PA, October 2004, pp. 205-211, ACM Press.
6. A. Metallinou, S. Lee, and S. Narayanan, "Audio-visual emotion recognition using gaussian mixture models for face and voice," in In proc of the IEEE ISM, 2008.
7. D. Ruta and B. Gabrys, "An overview of classifier fusion methods," 2000.
8. T. Serre Y. Ivanov and J. Bouvrie., "Error weighted classifier combination for multi-modal human identification.," Tech. Rep., MIT, Cambridge, MA, 2005.
9. C. Busso, M. Bulut, C-C Lee, A.Kazemzadeh, E. Mower, S. Kim, J. Chang, S.Lee, and S.Narayanan, "IEMOCAP: interactive emotional dyadic motion capture database," Language Resources and Evaluation, vol. 42, pp. 335-359, 2008.
10. A. Metallinou, C.Busso, S. Lee, and S. Narayanan, "Visual emotion recognition using compact facial representations and viseme information," Submitted to ICASSP10, 2009.
11. I. Cohen, Q. T. Xiang, S. Zhou, X. Sean, Z. Thomas, and T. S. Huang, "Feature selection using principal feature analysis," 2002.
12. S. Lee and D. Yook, "Audio-to-visual conversion using hidden markov models," in Proc. 7th Pacific Rim Int. Conf. on Artificial Intelligence, 2002.
13. S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P.Woodland, The HTK Book, Entropic Cambridge Research Laboratory, Cambridge, England, 2006.
14. C. Busso, S. Lee, and S.S. Narayanan, "Using neutral speech models for emotional speech analysis," in Interspeech 2007, 2007.
15. J.R. Deller, J.H.L. Hansen, and J.G. Proakis, Discrete-Time Processing of Speech Signals, IEEE Press, 2000.
16. R. Duda, P. Hart, and D. Stork, Pattern Classification, John Wiley and Sons, 2001.
17. E. Mower, A. Metallinou, C.-C. Lee, A. Kazemzadeh, C. Busso, S. Lee, and S. Narayanan, "Interpreting ambiguous emotional expressions," in In proc of ACII Special Session, 2009.
18. K. P. Kording and D. M. Wolpert, "Bayesian decision theory in sensorimotor control," TRENDS in Cognitive Sciences, vol. 10, pp. 319-326, 2006.