Unobtrusive multimodal emotion detection in adaptive interfaces: Speech and facial expressions

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4565 LNAI, Issue , 2007, Pages 354-363

  Truong, Khiet P ^a   Van Leeuwen, David A ^a   Neerincx, Mark A ^a  

^a TNO   (Netherlands)

Author keywords

Classification; Emotion database; Emotion detection; Emotion recognition; Facial expression; Speech

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATABASE SYSTEMS; FACE RECOGNITION; GESTURE RECOGNITION; PATIENT MONITORING;

EMOTION DATABASE; EMOTION DETECTION; EMOTION RECOGNITION; FACIAL EXPRESSION;

BEHAVIORAL RESEARCH;

EID: 38049063641     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-73216-7_40     Document Type: Conference Paper

References (30)

1. Cowie, R., Schröder, M.: Piecing together the emotion jigsaw. In: Machine Learning for Multimodal Interaction, pp. 305-317 (2005)
2. Kapoor, A., Picard, R.W.: Multimodal affect recognition in learning environments. In: Proceedings of the ACM International Conference on Multimedia, pp. 677-682 (2005)
3. Kim, J., André, E., Rehm, M., Vogt, T., Wagner, J.: Integrating information from speech and physiological signals to achieve emotional sensitivity. In: Proceedings of Interspeech, pp. 809-812 (2005)
4. Zhai, J., Barreto, A.: Stress Recognition Using Non-invasive Technology. In: Proceedings of the 19th International Florida Artificial Intelligence Research Society Conference FLAIRS, pp. 395-400 (2006)
5. Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology 70, 614-636 (1996)
6. Ang, J., Dhillon, R., Krupski, A., Shriberg, E., Stoicke, A.: Prosody-based automatic detection of annoyance and frustration in Human-Computer Dialog. In: Proceedings of the ICSLP International Conference on Spoken Language Processing, pp. 2037-2040 (2002)
7. Nwe, T.L., Foo, S.W, De Silva, L.C.: Speech emotion recognition using hidden Markov models. Speech Communication 41, 603-623 (2003)
8. Vidrascu, L., Devillers, L.: Detection of real-life emotions in call centers. In: Proceedings of Interspeech, pp. 1841-1844 (2005)
9. Batliner, A., Steidl, S., Hacker, C., Nöth, E., Niemann, H.: Tales of tuning - prototyping for automatic classification of emotional user states. In: Proceedings of Interspeech, pp. 489-492 (2005)
10. Pantic, M., Rothkrantz, L.J.M.: Towards an Affect-Sensitive Multimodal Human-Computer Interaction. Proceedings of the IEEE 91, 1370-1390 (2003)
11. Ekman, P., Friesen, W.V.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto (1978)
12. Pantic, M., Rothkrantz, L.J.M.: Automatic Analysis of Facial Expressions: The State of the Art. IEEE Transaction on Pattern Analysis and Machine Intelligence 22, 1424-1445 (2000)
13. Pantic, M., Rothkrantz, L.J.M.: Expert system for automatic analysis of facial expression. Image and Vision Computing Journal 18, 881-905 (2000)
14. Cohen, I., Sebe, N., Chen, L., Garg, A., Huang, T.S.: Facial Expression Recognition from Video Sequences: Temporal and Static Modeling. Computer Vision and Image Understanding 91, 160-187 (2003)
15. Sebe, N., Sun, Y., Bakker, E., Lew, M.S., Cohen, I., Huang, T.S.: Towards Aumentic Emotion Recognition. In: IEEE SMC International Conference on Systems, Man, and Cybernetics, pp. 623-628 (2004)
16. Den Uyl, M., Van Kuilenburg, H.: FaceReader: an online facial expression recognition system. In: Proceedings of 5th International Conference on Methods and Techniques in Behavorial Research, pp. 589-590 (2005)
17. De Silva, L.C., Miyasato, T., Nakatsu, R.: Facial emotion recognition using multi-modal information. In: Proceedings of the ICICS International Conference on Information, Communications and Signal Processing, pp. 397-401 (1997)
18. Chen, L.S., Tao, H., Huang, T.S., Miyasato, T., Nakatsu, R.: Emotion recognition from audiovisual information. In: Proceedings of the IEEE Workshop on Multimedia Signal Processing, pp. 83-88 (1998)
19. De Silva, L.C, Ng, P.C.: Bimodal Emotion Recognition. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp. 332-335 (2000)
20. Sebe, N., Cohen, I., Gevers, T., Huang, T.: Emotion Recognition Based on Joint Visual and Audio Cues. In: Proceedings of the ICPR International Conference on Pattern Recognition, pp. 1136-1139 (2006)
21. Chen, L.S.: Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction. Phd thesis (2000)
22. Douglas-Cowie, E., Cowie, R., Schröder, M.: A new emotion database: Considerations, sources and scope. In: Proceedings of ISCAITRW Workshop on Speech and Emotion, pp. 39-44 (2000)
23. Lang, P.J.: The emotion probe - studies of motivation and attention. American Psychologist 50, 371-385 (1995)
24. Wagner, J., Kim, J., André, E.: From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: Proceedings of the IEEE ICME International Conference on Multimedia & Expo, pp. 940-943 (2005)
25. Cox, C.: SALAS Sensitive Artificial Listener induction techniques. Paper presented to HUMAINE Network of Excellence Summer School (2004), Retrieved 5 Februay 2007 from http://emotion-research.net/ws/summerschooll/SALAS.ppt#259
26. Lazarro, N.: Why we play games: 4 keys to more emotion. Paper retrieved February 5, 2007 from http://www.xeodesign.com/xeodesign_whyweplaygames.pdf
27. Douglas-Cowie, E., Devillers, L., Martin, J., Cowie, R., Savvidou, S., Abrilian, S., Cox, C.: Multimodal databases of everyday emotion: facing up to complexity. In: Proceedings of Interspeech, pp. 813-816 (2005)
28. AMI project, http://www.amiproject.org
29. Grootjen, M., Neerincx, M.A., Weert, J.C.M., Truong, K.P.: Measuring Cognitive Task Load on a Naval Ship: Implications of a Real World Environment. In: Proceedings of ACI (this volume) (2007)
30. HUMAINE project, http://emotion-research.net/