Detecting user engagement with a robot companion using task and social interaction-based features

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 119-125

  Castellano, Ginevra ^a   Pereira, André ^b   Leite, Iolanda ^b   Paiva, Ana ^b   McOwan, Peter W ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Affect recognition; Contextual information; Human robot interaction; Non verbal expressive behaviour

Indexed keywords

AFFECT RECOGNITION; BAYESIAN APPROACHES; CONTEXTUAL INFORMATION; FRAMEWORK MODELS; HUMAN ROBOT INTERACTIONS; LONG-TERM INTERACTION; MULTIMODAL INTEGRATION; PERSON-INDEPENDENT; ROBOT COMPANION; SOCIAL INTERACTIONS; USER ENGAGEMENT;

BAYESIAN NETWORKS; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; MAN MACHINE SYSTEMS; SPEECH;

HUMAN ROBOT INTERACTION;

EID: 74049156694     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647336     Document Type: Conference Paper

References (20)

1. C. Bartneck, J. Reichenbach, and A. Breemen. In your face, robot! The influence of a character's embodiment on how users perceive its emotional expressions. In Proceedings of the Design and Emotion Conference 2004, pages 32-51, Ankara, Turkey, 2004.
2. C. Breazeal. Emotion and sociable humanoid robots. International Journal of Human-Computer Studies, 59(1-2):119-155, July 2003.
3. G. Castellano, R. Aylett, A. Paiva, and P. W. McOwan. Affect recognition for interactive companions. In Workshop on Affective Interaction in Natural Environments (AFFINE), ACM International Conference on Multimodal Interfaces (ICMI'08), Chania, Crete, Greece, 2008.
4. G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. W. McOwan. It's all in the game: Towards an affect sensitive and context aware game companion. In International Conference on Affective Computing and Intelligent Interaction, Amsterdam, 2009.
5. G. Castellano and P. W. McOwan. Analysis of affective cues in human-robot interaction: A multi-level approach. In 10th International Workshop on Image Analysis for Multimedia Interactive Services, pages 258-261, London, 2009.
6. C. Conati and H. Maclaren. Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, January 2009.
7. K. Dautenhahn. Socially intelligent robots: Dimensions of human-robot interaction. Philosophical Transactions of the Royal Society B: Biological Sciences, 362(1480):679-704, 2007.
8. A. Kapoor, W. Burleson, and R. W. Picard. Automatic prediction of frustration. International Journal of Human-Computer Studies, 65(8):724-736, 2007.
9. A. Kapoor and R. W. Picard. Multimodal affect recognition in learning environments. In ACM International Conference on Multimedia, pages 677-682, 2005.
10. M. Kipp. Spatiotemporal coding in ANVIL. In E. L. R. A. (ELRA), editor, Proceedings of the Sixth International Language Resources and Evaluation (LREC'08), Marrakech, Morocco, May 2008.
11. I. Leite, A. Pereira, C. Martinho, and A. Paiva. Are emotional robots more fun to play with? In 17th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2008), pages 77-82, August 2008.
12. L. Malta, C. Miyajima, and K. Takeda. Multimodal estimation of a driver's affective state. In Workshop on Affective Interaction in Natural Environments (AFFINE), ACM International Conference on Multimodal Interfaces (ICMI'08), Chania, Crete, Greece, 2008.
13. C. Martinho and A. Paiva. Using anticipation to create believable behaviour. In American Association for Artificial Intelligence Technical Conference, pages 1-6, Boston, July 2006.
14. L.-P. Morency, I. de Kok, and J. Gratch. Context-based recognition during human interactions: Automatic feature selection and encoding dictionary. In ACM International Conference on Multimodal Interfaces (ICMI'08), pages 181-188, Chania, Crete, Greece, 2008.
15. A. Ortony, G. L. Clore, and A. Collins. The Cognitive Structure of Emotions. Cambridge University Press, July 1988.
16. C. Peters, S. Asteriadis, K. Karpouzis, and E. de Sevin. Towards a real-time gaze-based shared attention for a virtual agent. In Workshop on Affective Interaction in Natural Environments (AFFINE), ACM International Conference on Multimodal Interfaces (ICMI'08), Chania, Crete, Greece, 2008.
17. I. Poggi. Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin, 2007.
18. S. J. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Pearson Education, 2003.
19. A. van Breemen, X. Yan, and B. Meerbeek. iCat: An animated user-interface robot with personality. In AAMAS '05: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, pages 143-144, New York, NY, USA, 2005. ACM.
20. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1):39-58, January 2009.