Towards multimodal emotion recognition: A new approach

CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval

Volumn , Issue , 2010, Pages 174-181

  Paleari, Marco ^a   Huet, Benoit ^b   Chellali, Ryad ^a  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b EURECOM   (France)

Author keywords

Affective computing; Emotion recognition; Facial expressions; Human centered computing; Indexing and retrieval; Prosody; Vocal expressions

Indexed keywords

AFFECTIVE COMPUTING; EMOTION RECOGNITION; FACIAL EXPRESSIONS; HUMAN-CENTERED COMPUTING; INDEXING AND RETRIEVAL; PROSODY; VOCAL EXPRESSION;

DECISION MAKING; FEATURE EXTRACTION; IMAGE RETRIEVAL;

INDEXING (OF INFORMATION);

EID: 77955912111     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1816041.1816069     Document Type: Conference Paper

References (31)

1. S. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek1, I. Fasel, and J. Movellan. Fully automatic facial action recognition in spontaneous behavior. In FGR '06, Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, pages 223-230, Washington, DC, USA, 2006. IEEE Computer Society.
2. P. Boersma and D. Weenink. Praat: doing phonetics by computer, January 2008. [http://www.praat.org/].
3. C. H. Chan and G. J. F. Jones. Affect-based indexing and retrieval of films. In Proc. of ACM MM '05, 13th ACM international conference on Multimedia, pages 427-430, New York, NY, USA, 2005. ACM.
4. D. Datcu and L. Rothkrantz. Semantic audio-visual data fusion for automatic emotion recognition. In Euromedia' 2008, Porto, 2008.
5. N. Dimitrova. Multimedia content analysis: the next wave. In Springer, editor, Proceedings of Image and Video Retrieval, volume 2728 of Lecture Notes in Computer Science, pages 415-420, 2003.
6. P. Ekman and W. V. Friesen. A new pan cultural facial expression of emotion. Motivation and Emotion, 10(2):159-168, 1986.
7. I. Essa and A. Pentland. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):757-763, 1997.
8. B. Fasel, F. Monay, and D. Gatica-Perez. Latent semantic analysis of facial action codes for automatic facial expression recognition. In MIR '04, Proceedings of the 6th ACM SIGMM international workshop on Multimedia Information Retrieval, pages 181-188, New York, NY, USA, 2004. ACM.
9. E. Kim, S. Kim, H. Koo, K. Jeong, and J. Kim. Emotion-based textile indexing using colors and texture. In L. Wang and Y. Jin, editors, Proceedings of Fuzzy Systems and Knowledge Discovery, volume 3613 of LNCS, pages 1077-1080. Springer, 2005.
10. F. Kuo, M. Chiang, M. Shan, and S. Lee. Emotion-based music recommendation by association discovery from film music. In ACM MM'05 Proceedings of ACM International Conference on Multimedia, pages 507-510, Singapore, 2005.
11. M. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. ACM Transactions on Multimedia Computing, Communications and Applications, 2(1):1-19, February 2006.
12. O. Martin, I. Kotsia, B. Macq, and I. Pitas. The eNTERFACEŠ05 audio-visual emotion database. In Proc. of the 22nd International Conference on Data Engineering Workshops (ICDEW'06). IEEE, 2006.
13. H. Miyamori, S. Nakamura, and K. Tanaka. Generation of views of TV content using TV viewers' perspectives expressed in live chats on the web. In Proc. of ACM MM'05 ACM International Conference on Multimedia, pages 853-861, Singapore, 2005.
14. J. Noble. Spoken emotion recognition with support vector machines. PhD Thesis, 2003.
15. th Intl Conference on MultiMedia Modeling, Sophia Antipolis, France, January 2009.
16. M. Paleari, R. Chellali, and B. Huet. Features for multimodal emotion recognition: An extensive study. In Proc. of IEEE CIS'10 Intl. Conf. on Cybernetics and Intelligence Systems, Singapore, June 2010.
17. M. Paleari and B. Huet. Toward emotion indexing of multimedia excerpts. In CBMI '08 Sixth International Workshop on Content-Based Multimedia Indexing, London, June 2008. IEEE.
18. M. Paleari, B. Huet, and B. Duffy. SAMMI, Semantic Affect-enhanced MultiMedia Indexing. In SAMT 2007, 2nd International Conference on Semantic and Digital Media Technologies, Dec 2007.
19. M. Paleari, C. Velardo, J.-L. Dugelay, and B. Huet. Face dynamics for biometric people recognition. In MMSP 2009, IEEE International Workshop on Multimedia Signal Processing, October 5-7, 2009, Rio de Janeiro, Brazil, October 2009.
20. M. Pantic and L. J. M. Rothkrantz. Expert system for automatic analysis of facial expressions. Image Vision Comput., 18(11):881-905, 2000.
21. R. Picard. Affective Computing. MIT Press, Cambridge (MA), 1997.
22. A. Salway and M. Graham. Extracting information about emotions in films. In Proc. of ACM MM '03, 11th ACM international conference on Multimedia, pages 299-302, New York, NY, USA, 2003. ACM.
23. K. Scherer. Appraisal processes in emotion: Theory, methods, research, chapter Appraisal considered as a process of multilevel sequential checking, pages 92-120. New York: Oxford University Press, 2001.
24. N. Sebe, M. S. Lew, I. Cohen, A. Garg, and T. S. Huang. Emotion recognition using a cauchy naive bayes classifier. In ICPR'02, Proceedings of the 12th International Conference on Pattern Recognition, volume 1, pages 17-20, 2002.
25. J. Shi and C. Tomasi. Good features to track. In Proceedings of CVPR'94 IEEE International Conference on Computer Vision and Pattern Recognition, pages 593-600, Seattle, WA, June 1994.
26. A. Sohail and P. Bhattacharya. Signal Processing for Image Enhancement and Multimedia Processing, chapter Detection of facial feature points using anthropometric face model, pages 189-200. Springer US, 2007.
27. C. Tomasi and T. Kanade. Detection and tracking of point features, April 1991. CMU-CS-91-132.
28. R. Valenti, N. Sebe, and T. Gevers. Facial expression recognition: A fully integrated approach. In ICIAPW '07: Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops, pages 125-130, Washington, DC, USA, 2007. IEEE Computer Society.
29. P. Viola and M. Jones. Robust real-time object detection. Intl Journal of Computer Vision, 2001.
30. J. Whitehill and C. W. Omlin. Haar features for facs au recognition. In FGR '06, Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, pages 97-101, Washington, DC, USA, 2006. IEEE Computer Society.
31. Z. Zeng, M. Pantic, G. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1):39-58, January 2009.