Detecting engagement in hri: An exploration of social and task-based context

Proceedings - 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust and 2012 ASE/IEEE International Conference on Social Computing, SocialCom/PASSAT 2012

Volumn , Issue , 2012, Pages 421-428

  Castellano, Ginevra ^a   Leite, Iolanda ^b   Pereira, Andre ^b   Martinho, Carlos ^b   Paiva, Ana ^b   McOwan, Peter W ^c  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECT RECOGNITION; AUTOMATIC PREDICTION; CONTEXT-BASED; EXPERIMENTAL EVALUATION; FIELD EXPERIMENT; INTERACTION LEVELS; RECOGNITION PERFORMANCE; SOCIAL CONTEXT; STATE OF THE ART; TASK-BASED; USER ENGAGEMENT; YOUNG CHILDREN;

ENCODING (SYMBOLS);

FORECASTING;

EID: 84873653734     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SocialCom-PASSAT.2012.51     Document Type: Conference Paper

References (25)

1. G. Castellano, M. Mancini, C. Peters, and P. W. McOwan, "Expressive copying behavior for social agents: A perceptual analysis," IEEE Transactions on Systems, Man and Cybernetics Part A-Systems and Humans, vol. 42, no. 3, pp. 776-783, May 2012
2. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, January 2009
3. M. Ochs, R. Niewiadomski, P. Brunet, and C. Pelachaud, "Smiling virtual agent in social context," Cognitive Processing. Special Issue on "Social Agents. From Theory to Applications", September 2011
4. L. Riek and P. Robinson, "Challenges and opportunities in building socially intelligent machines," IEEE Signal Processing, vol. 28, no. 3, pp. 146-149, 2011
5. R. Aylett, G. Castellano, B. Raducanu, A. Paiva, and M. Hanheide, "Long-term socially perceptive and interactive robot companions: Challenges and future perspectives," in Proceedings of the 13th International Conference on Multimodal Interaction (ICMI'11). ACM, New York, NY, USA, 2011
6. A. Kapoor and R. W. Picard, "Multimodal affect recognition in learning environments," in ACM International Conference on Multimedia, 2005, pp. 677-682
7. H. P. Martinez and G. N. Yannakakis, "Mining multimodal sequential patterns: A case study on affect detection," in Proceedings of the 13th International Conference on Multimodal Interaction (ICMI'11). ACM, New York, NY, USA, 2011
8. J. Sabourin, B. Mott, and J. Lester, "Modeling learner affect with theoreticallly grounded dynamic bayesian networks," in Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII'11). Springer, 2011
9. I. Poggi, Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin, 2007
10. C. L. Sidner, C. D. Kidd, C. H. Lee, and N. B. Lesh, "Where to look: A study of human-robot engagement," in IUI '04: Proceedings of the 9th international conference on Intelligent user interfaces. Funchal, Madeira, Portugal: ACM, New York, NY, USA, 2004, pp. 78-84
11. A. van Breemen, X. Yan, and B. Meerbeek, "iCat: An animated user-interface robot with personality," in AAMAS '05: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems. New York, NY, USA: ACM, 2005, pp. 143-144
12. C. Peters, S. Asteriadis, and K. Karpouzis, "Investigating shared attention with a virtual agent using a gaze-based interface," Journal on Multimodal User Interfaces, vol. 3, no. 1-2, pp. 119-130, 2010
13. L. Malta, C. Miyajima, and K. Takeda, "Multimodal estimation of a driver's affective state," in Workshop on Affective Interaction in Natural Environments (AFFINE), ACM International Conference on Multimodal Interfaces (ICMI'08), Chania, Crete, Greece, 2008
14. G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. McOwan, "It's all in the game: Towards an affect sensitive and context aware game companion," in Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII 2009). IEEE, 2009, pp. 29-36
15. J. Sanghvi, G. Castellano, I. Leite, A. Pereira, P. W. McOwan, and A. Paiva, "Automatic analysis of affective postures and body motion to detect engagement with a game companion," in ACM/IEEE International Conference on Human-Robot Interaction. Lausanne, Switzerland: ACM, 2011
16. G. Castellano, A. Pereira, I. Leite, A. Paiva, and P. W. McOwan, "Detecting user engagement with a robot companion using task and social interaction-based features," in International Conference on Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction(ICMI- MLMI'09). Cambridge, MA, USA: ACM Press, 2009, pp. 119-126
17. L.-P. Morency, I. de Kok, and J. Gratch, "Context-based recognition during human interactions: Automatic feature selection and encoding dictionary," in ACM International Conference on Multimodal Interfaces (ICMI'08), Chania, Crete, Greece, 2008, pp. 181-188
18. I. Leite, A. Pereira, C. Martinho, and A. Paiva, "Are emotional robots more fun to play with?" in Robot and Human Interactive Communication, 2008. RO-MAN 2008. The 17th IEEE International Symposium on, Aug. 2008, pp. 77-82
19. I. Leite, A. Pereira, G. Castellano, S. Mascarenhas, C. Martinho, and A. Paiva, "Modelling empathy in social robotic companions," in Advances in User Modeling: Selected Papers from UMAP 2011 Workshops. Lecture Notes in Computer Science, vol. 7138. Springer, 2012
20. I. Leite, G. Castellano, A. Pereira, C. Martinho, and A. Paiva, "Modelling empathic behaviour in a robotic game companion for children: an ethnographic study in real-world settings," in ACM/IEEE International Conference on Human-Robot Interaction (HRI). Boston, MA, USA: ACM, 2012
21. N. Borgers, E. de Leeuw, and J. Hox, "Children as respondents in survey research: Cognitive development and response quality," Bulletin de Methodologie Sociologique, vol. 66, no. 1, p. 60, 2000
22. C. Martinho and A. Paiva, "Using anticipation to create believable behaviour," in American Association for Artificial Intelligence Technical Conference, Boston, july 2006, pp. 1-6
23. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Transactions on Intelligent Systems and Technology, vol. 2, pp. 27:1-27:27, 2011, software available at: http://www.csie.ntu.edu.tw/cjlin/ libsvm
24. Y.-W. Chen and C.-J. Lin, "Combining svms with various feature selection strategies," in Feature extraction, foundations and applications, I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh, Eds. Springer, 2006
25. G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. McOwan, "Affect recognition for interactive companions: Challenges and design in real-world scenarios," Journal on Multimodal User Interfaces, vol. 3, no. 1-2, pp. 89-98, 2010.