Audio-visual Emotion recognition using Gaussian Mixture Models for face and voice

Proceedings - 10th IEEE International Symposium on Multimedia, ISM 2008

Volumn , Issue , 2008, Pages 250-257

  Metallinou, Angeliki ^a   Lee, Sungbok ^a   Narayanan, Shrikanth ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO VISUALS; BAYESIAN CLASSIFIERS; CLASSIFIER COMBINATIONS; EMOTION EXPRESSIONS; EMOTION RECOGNITION; EMOTIONAL INFORMATIONS; FACIAL EXPRESSIONS; FACIAL REGIONS; GAUSSIAN MIXTURE MODELS; HUMAN COMMUNICATIONS; MULTI MODALS; MULTIPLE MODALITIES; NEUTRAL STATE; POST CLASSIFICATIONS; RECOGNITION PERFORMANCE; SUPPORT VECTORS; WEIGHTING SCHEMES;

CLASSIFIERS; COMMUNICATION CHANNELS (INFORMATION THEORY); OBJECT RECOGNITION; SUPPORT VECTOR MACHINES; TRELLIS CODES;

FACE RECOGNITION;

EID: 62949227381     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISM.2008.40     Document Type: Conference Paper

References (24)

1. M. S. Bartlett, G. C. Littlewort, M. G. Frank, C. Lainscsek, I. R. Fasel, and J. R. Movellan. Automatic recognition of facial actions in spontaneous expressions. Journal Of Multimedia, 1(6):22-35, September 2006.
2. C. Busso, M. Bulut, C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. Chang, S. Lee, and S. Narayanan. IEMOCAP: Interactive emotional dyadic motion capture database. Journal of Language Resources and Evaluation, In press, 2008.
3. C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan. Analysis of emotion recognition using facial expressions, speech and multimodal information. In Sixth International Conference on Multimodal Interfaces ICMI 2004, pages 205-211, State College, PA, October 2004. ACM Press.
4. C. Busso and S. Narayanan. Interrelation between speech and facial gestures in emotional utterances: a single subject study. IEEE Transactions on Audio, Speech and Language Processing, 15(8):2331-2347, November 2007.
5. C. Busso and S. Narayanan. Recording audio-visual emotional databases from actors: a closer look. In Second International Workshop on Emotion: Corpora for Research on Emotion and Affect, International conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco, May 2008.
6. J. Cohn, L. Reed, Z. Ambadar, J. Xiao, and T. Moriyama. Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior. In IEEE International Conference on Systems, Man and Cybernetics, 2004.
7. P. Ekman and W. Friesen. Facial action coding system (FACS): Manual. Palo Alto: Consulting Psychologists Press, 1978.
8. P. Ekman, W. V. Friesen, and J. C. Hager. Facial Action Coding System (FACS). Research Nexus division of Network Information Research Corporation, 2002.
9. Y. Ivanov, B. Heisele, and T. Serre. Using component features for face recognition. In International Conference on Automatic Face and Gesture Recognition,Seoul, Korea., May 2004.
10. Y. Ivanov, T. Serre, and J. Bouvrie. Error weighted classifier combination for multi-modal human identification. Technical Report CBCL Paper 258, Massachusetts Institute of Technology, Cambridge, MA, 2005.
11. K. P. Kording and D. M. Wolpert. Bayesian decision theory in sensorimotor control. TRENDS in Cognitive Sciences, 10(7):319-326, July 2006.
12. G. Littlewort, M. S. Bartlett, I. Fasel, J. Susskind, and J. Movellan. Dynamics of facial expression extracted automatically from video. In Conference on Computer Vision and Pattern Recognition Workshop, 2004.
13. J. Luettin, G. Potamianos, and C. Neti. Asynchronous stream modeling for large vocabulary audio-visual speech recognition. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 1, 2001.
14. I. Matthews and S. Baker. Active appearance models revisited. Technical Report CMU-RI-TR-03-02, Robotics Institute, Carnegie Mellon University, April 2003.
15. A. Mehrabian. Communication without words. Psychology Today, 2:53-56, 1968.
16. M. Ostendorf, V. Digalakis, and O. Kimball. From HMM'S to segment models: A unified view of stochastic modelingfor speech recognition. IEEE Transactions on Speech and Audio Processing, 4:360-378, September 1996.
17. M. Pantic and L. Rothkrantz. Toward an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE, 91(9):1370-1390, September 2003.
18. M. Pantic and L. J. Rothkrantz. Automatic analysis of facial expressions: The state of the art. IEEE Transactions On Pattern Analysis And Machine Intelligence, 22(12):1424-1445, December 2000.
19. M. Pantic and L. J. M. Rothkrantz. An expert system for recognition of facial actions and their intensity. In Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, 2000.
20. R. W. Picard. Affective computing. Technical Report 321, MIT Media Laboratory Perceptual Computing Section, Cambridge, MA,USA, November 1995.
21. J. Rottenberg and J. Gross. Emotion and emotion regulation: A map for psychotherapy researchers. Clinical Psychology: Science and Practice, 14(4):323-328, December 2007.
22. P. Sinha, B. Balas, Y. Ostrovsky, and R. Russell. Face recognition by humans: Nineteen results all computer vision researchers should know about. In Proceedings of the IEEE, volume 94, November 2006.
23. S.J.Young, J.Jansen, J.J.Odell, D.G.Ollason, and P.C.Woodland. The HTK Book. Cambridge University Engineering Department and Entrophic Cambridge Research Laboratory, Cambridge, UK., 1995.
24. D. M. Sloan and A. M. Kring. Measuring changes in emotion during psychotherapy: Conceptual and methodological issues. Clinical Psychology: Science and Practice, 14(4):307-322, December 2007.