Features for multimodal emotion recognition: An extensive study

2010 IEEE Conference on Cybernetics and Intelligent Systems, CIS 2010

Volumn , Issue , 2010, Pages 90-95

  Paleari, Marco ^a   Chellali, Ryad ^a   Huet, Benoit ^b  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b EURECOM   (France)

Author keywords

Affective computing; Emotion recognition; Facial expressions; Prosody; Vocal expressions

Indexed keywords

AFFECTIVE COMPUTING; EMOTION RECOGNITION; FACIAL EXPRESSIONS; PROSODY; VOCAL EXPRESSION;

CYBERNETICS; HEALTH CARE; INTELLIGENT SYSTEMS; NEURAL NETWORKS;

FEATURE EXTRACTION;

EID: 77956080077     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCIS.2010.5518574     Document Type: Conference Paper

References (22)

1. A. R. Damasio, Descartes' Error: Emotion, Reason, and the Human Brain, Avon Books, NY, 1994.
2. R. Picard, Affective Computing, MIT Press, Cambridge (MA), 1997.
3. A. Mehrabian, Nonverbal Communication, Aldine-Atherton, 1972.
4. B. Fasel and J. Luettin, "Automatic Facial Expression Analysis: A Survey," Pattern Recognition, vol. 36, no. 1, pp. 259-275, 2003.
5. Z. Zeng, M. Pantic, G.I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, January 2009.
6. I. Cohen, N. Sebe, A. Garg, S.W. Lew, and T.S. Huang, "Facial expression recognition from video sequences," in Proceedings of ICME 2002, 2002, pp. 121,124.
7. C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, and S. Narayanan, "Analysis of emotion recognition using facial expressions, speech and multimodal information," in Proceedings of ICMI, 2004, pp. 205-211, State College, PA, USA.
8. R. Valenti, N. Sebe, and T. Gevers, "Facial expression recognition: A fully integrated approach," in ICIAPW '07: Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops, Washington, DC, USA, 2007, pp. 125-130, IEEE Computer Society.
9. M. Paleari and B. Huet, "Toward Emotion Indexing of Multimedia Excerpts," in CBMI '08 Sixth International Workshop on Content-Based Multimedia Indexing, London, June 2008, IEEE.
10. D. Datcu and L.J.M. Rothkrantz, "Semantic audio-visual data fusion for automatic emotion recognition," in Euromedia' 2008, Porto, 2008.
11. J. Noble, "Spoken emotion recognition with support vector machines," PhD Thesis, 2003.
12. F. Nasoz, K. Alvarez, C.L. Lisetti, and N. Finkelstein, "Emotion recognition from physiological signals using wireless sensors for presence technologies," Cognition, Technology & Work, vol. 6, no. 1, pp. 4-14, February 2004.
13. O. Villon, Modeling affective evaluation of multimedia contents: user models to associate subjective experience, physiological expression and contents description, Ph.D. thesis, Thesis, Oct 2007.
14. M. Paleari, B. Huet, and B. Duffy, "SAMMI, Semantic Affect-enhanced MultiMedia Indexing," in SAMT 2007, 2nd International Conference on Semantic and Digital Media Technologies, Dec 2007.
15. th Intl Conference on MultiMedia Modeling, Sophia Antipolis, France, January 2009.
16. O. Martin, I. Kotsia, B. Macq, and I. Pitas, "The eNTERFACE05 AudioVisual Emotion Database," in Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW'06). IEEE, 2006.
17. P. Ekman and W. V. Friesen, "A new pan cultural facial expression of emotion," Motivation and Emotion, vol. 10(2), pp. 159-168, 1986.
18. C. Tomasi and T. Kanade, "Detection and tracking of point features," April 1991, CMU-CS-91-132.
19. A.S.M. Sohail and P. Bhattacharya, Signal Processing for Image Enhancement and Multimedia Processing, vol. 31, chapter Detection of Facial Feature Points Using Anthropometric Face Model, pp. 189-200, Springer US, 2007.
20. Paul Boersma and David Weenink, "Praat: doing phonetics by computer," January 2008, [http://www.praat.org/].
21. K. Scherer, Appraisal processes in emotion: Theory, methods, research, chapter Appraisal Considered as a Process of Multilevel Sequential Checking, pp. 92-120, New York: Oxford University Press, 2001.
22. M. Paleari, B. Huet, and R. Chellali, "Towards multimodal emotion recognition: A new approach," in Proc. of ACM CIVR 2010 Intl. Conf. on Image and Video Retrieval, Xi'An, China, July 2010.