User and context adaptive neural networks for emotion recognition

Neurocomputing

Volumn 71, Issue 13-15, 2008, Pages 2553-2562

  Caridakis, George ^a   Karpouzis, Kostas ^a   Kollias, Stefanos ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Emotion recognition; Neural networks; User and context adaptation

Indexed keywords

NETWORK ARCHITECTURE; NEURAL NETWORKS; SPEECH RECOGNITION;

ADAPTATION REQUIREMENTS; ADAPTIVE NEURAL NETWORKS; EFFECTIVE APPROACHES; EMOTION ANALYSIS; EMOTION RECOGNITION; EMOTIONAL STATE; HUMAN COMPUTER INTERACTION (HCI); USER AND CONTEXT ADAPTATION;

HUMAN COMPUTER INTERACTION;

ACCURACY; ADAPTIVE BEHAVIOR; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER INTERFACE; COMPUTER SYSTEM; CONCEPTUAL FRAMEWORK; CONFERENCE PAPER; CONTROLLED STUDY; EMOTIONAL INTELLIGENCE; EXPERIMENTAL STUDY; FACIAL EXPRESSION; FEMALE; HUMAN; HUMAN COMPUTER INTERACTION; HUMAN EXPERIMENT; LEARNING ENVIRONMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL;

EID: 56449106584     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.11.043     Document Type: Conference Paper

References (39)

1. T. Balomenos, A. Raouzaiou, S. Ioannou, A. Drosopoulos, K. Karpouzis, S. Kollias, Emotion analysis in man-machine interaction systems, in: Samy Bengio, Hervé Bourlard (Eds.), Machine Learning for Multimodal Interaction, Lecture Notes in Computer Science, vol. 3361, Springer, New York, 2004, pp. 318-328.
2. M. Bartlett, G. Littlewort, M.G. Frank, C. Lainscsek, I. Fasel, J. Movellan, Fully automatic facial action recognition in spontaneous behaviour, Proc. IEEE Conf. Automat. Face Gesture Recogn. (2006) 223-230.
3. A. Blum, T. Mitchell, Combining labeled and unlabeled data with co-training, in: Proceedings of 11th Annual Conference on Computational Learning Theory, 1998, pp. 92-100.
4. R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey,M. Schroeder, 'Feeltrace': An instrument for recording perceived emotion in real time, in: Proceedings of the ISCA Workshop on Speech and Emotion, 2000, pp. 19-24.
5. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, J.G. Taylor, Emotion recognition in human-computer interaction, IEEE Signal Processing Magazine, January 2001.
6. N. Doulamis, A. Doulamis, S. Kollias, On-line retrainable neural networks: Improving performance of neural networks in image analysis problems, IEEE Trans. Neural Networks 11 (1) (2000) 1-20.
7. P. Ekman, T.S. Huang, T.J. Sejnowski, J.C. Hager, (Eds.), NSF understanding the face, A Human Face eStore, Salt Lake City, USA (see Library), 1993.
8. P. Ekman, W.F. Friesen, The repertoire of nonverbal behavioural categories - origins, usage, and coding, Semiotica 1 (1969) 49-98.
9. P. Ekman, W.F. Friesen, J.C. Hager, Facial action coding system, A Human Face, Salt Lake City, USA, 2002.
10. B. Fasel, F. Monay, D. Gatica-Perez, Latent semantic analysis of facial action codes for automatic facial expression recognition, in: Proceedings of the ACM International Workshop on Multimedia Information Retrieval, 2004, pp. 181-188.
11. A. Fridlund, The new ethology of human facial expression, in: J.A. Russell, J.M. Fernandez-Dols (Eds.), The Psychology of Facial Expression, Cambridge University Press, Cambridge, MA, USA, 1997, pp. 103-129.
12. D. Goleman, Emotional Intelligence, Bantam Books, New York, NY, USA, 1995.
13. U. Hess, S. Blairy, R.E. Kleck, The intensity of emotional facial expressions and decoding accuracy, J. Nonverbal Behav. 21 (4) (1997) 241-257.
14. S. Ioannou, A. Raouzaiou, V. Tzouvaras, T. Mailis, K. Karpouzis, S. Kollias, Emotion recognition through facial expression analysis based on a neurofuzzy network, Special Issue on Emotion: Understanding & Recognition, Neural Networks, Elsevier, vol. 18(4), May 2005, pp. 423-435.
15. A. Jaimes, N. Sebe, Multimodal Human Computer Interaction: A Survey, Computer Vision and Image Understanding, 2007 (available online).
16. J. Kelley, Natural language and computers: Six empirical steps for writing an easy-to-use computer application, unpublished Doctoral Dissertation, The Johns Hopkins University, 1983.
17. D. Keltner, P. Ekman, Facial expression of emotion, in: M. Lewis, J.M. Haviland-Jones (Eds.), Handbook of Emotions, Guilford Press, New York, NY, USA, 2000, pp. 236-249.
18. Promises and problems with the circumplex model of emotion, in: M.S. Clark (Ed.), Review of Personality and Social Psychology, Sage Publications, Newbury Park, USA, 1992.
19. A. Legin, A. Rudnitskaya, B. Seleznev, Yu. Vlasov, Electronic tongue for quality assessment of ethanol, vodka and eau-de-vie, Anal. Chim. Acta 534 (2005) 129-135.
20. C. Mario Christoudias, Kate Saenko, Louis-Philippe Morency, Trevor Darrell, Co-adaptation of audio-visual speech and gesture classifiers, in: Proceedings of the Eighth International Conference on Multimodal Interfaces, Banff, Alberta, Canada, 2006, pp. 84-91.
21. D. Matsumoto, Cultural similarities and differences in display rules, Motiv. Emotion 14 (1990) 195-214.
22. Humaine Network of Excellence on Emotions, .
23. S. Oviatt, Ten myths of multimodal interaction, Commun. ACM 42 (11) (1999) 74-81.
24. M. Pantic, Affective computing, in: M. Pagani, (Ed.), Encyclopedia of Multimedia Technology and Networking, vol. 1, Idea Group Reference, Hershy, PA, USA, 2005, pp. 8-14.
25. M. Pantic, N. Sebe, J.F. Cohn, T.S. Huang, Affective multimodal human-computer interaction, in: Proceedings of the ACM International Conference on Multimedia, 2005, pp. 669-676.
26. M. Pantic, A. Pentland, A. Nijholt, T.S. Huang, Human computing and machine understanding of human behaviour: A survey, in: Proceedings of the ACM International Conference on Multimodal Interfaces, 2006, pp. 239-248.
27. D. Park, M.A. EL-Sharkawi, R.J. Marks II, An adaptively trained neural network, IEEE Trans. Neural Networks 2 (1991) 334-345.
28. C. Pelachaud, V. Carofiglio, B. De Carolis, F. de Rosis, I. Poggi, Embodied contextual agent in information delivering application, in: Proceedings of the International Conference on Autonomous Agents & Multi-Agent Systems, 2002.
29. A. Pentland, Socially aware computation and communication, IEEE Comput. 38 (3) (2005) 33-40.
30. R. Picard, Affective Computing, The MIT Press, Cambridge, MA, USA, 1997.
31. R. Picard, Affective computing: Challenges, Int. J. Hum.-Comput. Stud. 59 (1-2) (2003) 55-64.
32. J.A. Russell, Is there universal recognition of emotion from facial expression?, Psychol. Bull. 115 (1) (1994) 102-141.
33. J. Taylor, N. Fragopanagos, The interaction of attention and emotion, Neural Networks 18 (4) (2005) 353-369.
34. J. Taylor, N. Fragopanagos, Modelling human attention and emotions, in: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, 2004, pp. 501-506.
35. D. Watson, L.A. Clark, K. Weber, J. Smith-Assenheimer, M.E. Strauss, R.A. McCormick, Testing a tripartite model: II. Exploring the symptom structure of anxiety and depression in student, adult, and patient samples, J. Abnorm. Psychol. 104 (1995) 15-25.
36. D. Watson, K. Weber, J.S. Assenheimer, L.A. Clark, M.E. Strauss, R.A. McCormick, Testing a tripartite model: I. Evaluating the convergent and discriminant validity of anxiety and depression symptom scales, J. Abnorm. Psychol. 104 (1995) 3-14.
37. C. Whissel, The dictionary of affect in language, in: R. Plutchnik, H. Kellerman (Eds.), Emotion: Theory, Research and Experience: The Measurement of Emotions, vol. 4, Academic Press, New York, 1989, pp. 113-131.
38. A. Wierzbicka, Reading human faces, Pragmatics Cognit. 1 (1) (1993) 1-23.
39. L. Wu, S. Oviatt, P. Cohen, Multimodal integration - a statistical view, IEEE Trans. Multimedia 1 (4) (1999) 334-341.