Automatic analysis of affective postures and body motion to detect engagement with a game companion

HRI 2011 - Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction

Volumn , Issue , 2011, Pages 305-311

  Sanghvi, Jyotirmay ^a   Castellano, Ginevra ^a   Leite, Iolanda ^b   Pereira, André ^b   McOwan, Peter W ^a   Paiva, Ana ^b  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Affect recognition; Affective body movement and posture; Human robot interaction; Robot companions

Indexed keywords

AFFECT RECOGNITION; AUTOMATIC ANALYSIS; AUTOMATIC EXTRACTION; BODY MOTIONS; BODY MOVEMENTS; COMPUTATIONAL MODEL; HUMAN POSTURES; REAL-WORLD SCENARIO; RECOGNITION MODELS; ROBOT COMPANIONS; ROBOT INTERACTIONS; TARGET APPLICATION; VISION BASED;

GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; KNOWLEDGE BASED SYSTEMS; MACHINE DESIGN; MAN MACHINE SYSTEMS; MATHEMATICAL MODELS; PATTERN RECOGNITION SYSTEMS;

HUMAN ROBOT INTERACTION;

EID: 79953150939     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1957656.1957781     Document Type: Conference Paper

References (34)

1. S. Afzal and P. Robinson. Natural affect data collection and annotation in learning context. In Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII 2009), pages 22-28. IEEE, 2009.
2. D. Bernhardt and P. Robinson. Detecting affect from non-stylised body motions. In A. Paiva, R. Prada, and R. W. Picard, editors, Affective Computing and Intelligent Interaction, Second International Conference, ACII 2007, Lisbon, Portugal, September 12-14, 2007, Proceedings, volume 4738 of LNCS, pages 59-70. Berlin: Springer-Verlag, 2007.
3. N. Bianchi-Berthouze and A. Kleinsmith. A categorical approach to affective gesture recognition. Connection Science, 15(4):259-269, December 2003. (Pubitemid 38474544)
4. R. T. Boone and J. G. Cunningham. Children's Decoding of Emotion in Expressive Body Movement: The Development of Cue Attunement. Developmental psychology, 34(5):1007-1016, September 1998.
5. G. Bradski and A. Kaehler. Learning OpenCV: Computer Vision with the OpenCV Library. O'Reilly, 2008.
6. C. Breazeal. Role of expressive behaviour for robots that learn from people. Philosophical Transactions of the Royal Society B, 364: 3527-3538, 2009.
7. A. Camurri, I. Lagerlof, and G. Volpe. Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies, 59(1-2):213-225, July 2003.
8. G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. McOwan. It's all in the game: Towards an affect sensitive and context aware game companion. In Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII 2009), pages 29-36. IEEE, 2009.
9. G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. McOwan. Affect recognition for interactive companions: Challenges and design in real-world scenarios. Journal on Multimodal User Interfaces, 3(1-2):89-98, 2010.
10. G. Castellano, A. Pereira, I. Leite, A. Paiva, and P. W. McOwan. Detecting user engagement with a robot companion using task and social interaction-based features. In International Conference on Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction(ICMI-MLMI'09), pages 119-126, Cambridge, MA, USA, 2009. ACM Press.
11. G. Castellano and C. Peters. Socially perceptive robots: Challenges and concerns. Interaction Studies, 11(2): 201-207, 2010.
12. G. Castellano, S. D. Villalba, and A. Camurri. Recognising Human Emotions from Body Movement and Gesture Dynamics. In A. Paiva, R. Prada, and R. W. Picard, editors, Affective Computing and Intelligent Interaction, Second International Conference, ACII 2007, Lisbon, Portugal, September 12-14, 2007, Proceedings, volume 4738 of LNCS, pages 71-82. Berlin: Springer-Verlag, 2007.
13. K. Dautenhahn. Socially intelligent robots: Dimensions of human-robot interaction. Philosophical Transactions of the Royal Society B: Biological Sciences, 362(1480): 679-704, 2007. (Pubitemid 47056835)
14. S. K. D'Mello and A. C. Graesser. Automatic detection of learners' emotions from gross body language. Applied Artificial Intelligence, 23(2): 123-150, 2009.
15. H. Gunes and M. Piccardi. Automatic temporal segment detection and affect recognition from face and body display. IEEE Transactions on Systems, Man and Cybernetics - Part B, 39(1): 64-84, February 2009.
16. T. Kanda, H. Ishiguro, M. Imai, and T. Ono. Body movement analysis of human-robot interaction. In Proceedings of the 18th International Joint Conference on Artificial Intelligence, pages 177-182, San Francisco, CA, USA, 2003. Morgan Kaufmann Publishers Inc.
17. A. Kapoor, W. Burleson, and R. W. Picard. Automatic prediction of frustration. International Journal of Human-Computer Studies, 65(8): 724-736, 2007.
18. M. Kipp. Spatiotemporal coding in ANVIL. In E. L. R. A. (ELRA), editor, Proceedings of the Sixth International Language Resources and Evaluation (LREC'08), Marrakech, Morocco, may 2008.
19. D. Kulic and E. A. Croft. Affective state estimation for human-robot interaction. IEEE Transactions on Robotics, 23(25): 991-1000, 2007. (Pubitemid 47577975)
20. I. Leite, A. Pereira, C. Martinho, and A. Paiva. Are emotional robots more fun to play with? In Robot and Human Interactive Communication, 2008. RO-MAN 2008. The 17th IEEE International Symposium on, pages 77-82, Aug. 2008.
21. M. P. Michalowski, R. Simmons, and H. Kozima. Rhythmic attention in child-robot dance play. In IEEE International Workshop on Robot and Human Interactive Communication, RO-MAN '09, pages 816 -821. IEEE, 2009.
22. S. Mota and R. W. Picard. Automated posture analysis for detecting learner's interest level. Computer Vision and Pattern Recognition Workshop, 5:49, 2003.
23. Y. I. Nakano and R. Ishii. Estimating user's engagement from eye-gaze behaviors in human-agent conversations. In IUI '10: Proceeding of the 14th international conference on Intelligent user interfaces, pages 139-148, New York, NY, USA, 2010. ACM.
24. C. Peters, S. Asteriadis, and K. Karpouzis. Investigating shared attention with a virtual agent using a gaze-based interface. Journal on Multimodal User Interfaces, 3(1-2): 119-130, 2010.
25. I. Poggi. Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin, 2007.
26. C. Rich, B. Ponsler, A. Holroyd, and C. L. Sidner. Recognizing engagement in human-robot interaction. In HRI '10: Proceeding of the 5th ACM/IEEE international conference on Human-robot interaction, pages 375-382, New York, NY, USA, 2010. ACM.
27. B. Robins, K. Dautenhahn, R. te Boekhorst, and C. L. Nehaniv. Behaviour delay and robot expressiveness in child-robot interactions: a user study on interaction kinesics. In Proceedings of the 3rd ACM/IEEE International Conference on Human-Robot Interaction, HRI '08, pages 17-24, New York, NY, USA, 2008. ACM.
28. F. Tanaka, A. Cicourel, and J. R. Movellan. Socialization between toddlers and robots at an early childhood education center. Proceedings of the National Academy of Science, 194(46): 17954-17958, 2007. (Pubitemid 350210803)
29. A. van Breemen, X. Yan, and B. Meerbeek. iCat: An animated user-interface robot with personality. In AAMAS '05: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, pages 143-144, New York, NY, USA, 2005. ACM.
30. G. Volpe. Computational models of expressive gesture in multimedia systems. Ph.D. Dissertation, Faculty of Engineering, University of Genova, April 2003.
31. H. G. Wallbott. Bodily expression of emotion. European Journal of Social Psychology, 28(6): 879-896, December 1998.
32. H. G. Wallbott and K. R. Scherer. Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51(4): 690-699, 1986.
33. I. H. Witten and E. Frank. Data mining: Practical machine learning tools and techniques (2nd ed.). San Francisco: Morgan Kaufmann, 2005.
34. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1): 39-58, January 2009.