Emotion recognition from body expressions with a neural network architecture

HAI 2017 - Proceedings of the 5th International Conference on Human Agent Interaction

Volumn , Issue , 2017, Pages 143-149

  Elfaramawy, Nourhan ^a   Barros, Pablo ^a   Parisi, German I ^a   Wermter, Stefan ^a  

^a UNIVERSITY OF HAMBURG   (Germany)

Author keywords

Emotion recognition; Learning systems; Neural networks

Indexed keywords

HUMAN ROBOT INTERACTION; LEARNING SYSTEMS; NETWORK ARCHITECTURE; NEURAL NETWORKS; ROBOTS; SPEECH RECOGNITION; TIME AND MOTION STUDY;

ADDITIONAL EXPERIMENTS; EMOTION RECOGNITION; FACIAL EXPRESSIONS; FULL-BODY MOTIONS; NEURAL ARCHITECTURES; RECOGNITION ACCURACY; RECOGNITION OF EMOTION; SOCIAL COMMUNICATIONS;

PATTERN RECOGNITION SYSTEMS;

EID: 85034853449     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3125739.3125772     Document Type: Conference Paper

References (27)

1. Fernando Alonso-Martin, Maria Malfaz, Joao Sequeira, Javier F. Gorostiza, and Miguel A. Salichs. 2013. A Multimodal Emotion Detection System during Human-Robot Interaction. Sensors 13, 11 (2013), 15549-15581
2. Pablo Barros and Stefan Wermter. 2016. Developing crossmodal expression recognition based on a deep neural model. Adaptive Behavior 24, 5 (2016), 373-396
3. I. Bartenieff and D. Lewis. 1980. Body movement. Coping with the environment. Psychology Press
4. Domenic V. Cicchetti. 1994. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment 6, 4 (1994), 284-290
5. Mark Coulson. 2004. Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence. Journal of Nonverbal Behavior 28, 2 (2004), 117-139
6. Charles Darwin. 1872. The expression of the emotions in man and animals. London, John Murray
7. Paul Ekman and Wallace V. Friesen. 1971. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology 17, 2 (1971), 124-129
8. P. Ekman and W. V. Friesen. 2001. Head and body cues in the judgment of emotion: A reformulation. Perceptual and motor skills 24, 3 (2001), 711-724
9. Michael A. Goodrich and Alan C. Schultz. 2007. Human-robot Interaction: A Survey. Found. Trends Hum.-Comput. Interact. 1, 3 (2007), 203-275
10. Y. Gu, X. Mai, and Y. J. Luo. 2013. Do bodily expressions compete with facial expressions? Time course of integration of emotional signals from the face and the body. PLoS ONE (2013)
11. A. Kleinsmith, T. Fushimi, and N. Bianchi-Berthouze. 2005. An incremental and interactive affective posture recognition system. In In International Workshop on Adapting the Interaction Style to Affective Factors. 378-387
12. P.N. Lopes, P. Salovey, and R. Straus. 2003. Emotional intelligence, personality, and the perceived quality of social relationships. Personality and Individual Differences 35, 3 (2003), 641-658
13. Muharram Mansoorizadeh and Nasrollah Moghaddam Charkari. 2010. Multimodal information fusion application to human emotion recognition from face and speech. Multimedia Tools and Applications 49, 2 (2010), 277-297
14. Hazel Rose Markus and Shinobu Kitayama. 1991. Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review (1991), 224-253
15. Stephen Marsland, Jonathan Shapiro, and Ulrich Nehmzow. 2002. A self-organising network that grows when required. Neural Networks 15, 8-9 (2002), 1041-1058
16. Jacob M.J. Murre, R. Hans Phaf, and Gezinus Wolters. 1992. CALM: Categorizing and learning module. Neural Networks 5, 1 (1992), 55-82
17. Tin Lay Nwe, Say Wei Foo, and Liyanage C Silva. 2003. Speech emotion recognition using hidden Markov models. Speech Communication 41, 4 (2003), 603-623
18. German Ignacio Parisi, Sven Magg, and Stefan Wermter. 2016. Human Motion Assessment in Real Time Using Recurrent Self-Organization. In Proc. of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, US. 71-76
19. German Ignacio Parisi, Cornelius Weber, and Stefan Wermter. 2015. Self-Organizing neural integration of pose-motion features for human action recognition. Frontiers in Neurorobotics 9, 3 (2015)
20. German Ignacio Parisi and Stefan Wermter. 2017. Lifelong Learning of Action Representations with Deep Neural Self-Organization. In The AAAI 2017 Spring Symposium on Science of Intelligence: Computational Principles of Natural and Artificial Intelligence, Standford, US. 608-612
21. A. Patwardhan and G. Knapp. 2016. Multimodal Affect Recognition using Kinect. arXiv:1607.02652 (2016)
22. S. Piana, A. Stagliano, F. Odone, A. Verri, and A. Camurri. 2014. Real-time automatic emotion recognition from body gestures. arXiv:1402.5047 (2014)
23. Rosalind W. Picard. 1997. Affective Computing. MIT Press, Cambridge, MA, USA
24. Robert Plutchik. 1991. The Emotions. University Press of America
25. Frank E. Pollick, Helena M. Paterson, Armin Bruderlin, and Anthony J. Sanford. 2001. Perceiving affect from arm movement. Cognition 82, 2 (2001), B51-B61
26. Misako Sawada, Kazuhiro Suda, and Motonobu Ishii. 2003. Expression of Emotions in Dance: Relation between Arm Movement Characteristics and Emotion. Perceptual and Motor Skills 97, 3 (2003), 697-708
27. Konrad Schindler, Luc Van Gool, and Beatrice Gelder. 2008. Recognizing emotions expressed by body pose: A biologically inspired neural model. Neural Networks 21, 9 (2008), 1238-1246