Estimating user's engagement from eye-gaze behaviors in human-agent conversations

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2010, Pages 139-148

  Nakano, Yukiko I ^a   Ishii, Ryo ^b  

^a SEIKEI UNIVERSITY   (Japan)

^b NTT CORPORATION   (Japan)

Author keywords

Conversational agent; Conversational engagement; Dialogue management; Eye gaze

Indexed keywords

CONVERSATIONAL AGENTS; CONVERSATIONAL ENGAGEMENT; DIALOGUE MANAGEMENT; ESTIMATION FUNCTION; ESTIMATION METHODS; EVALUATION EXPERIMENTS; EYE-GAZE; FACE-TO-FACE CONVERSATION; GAZE BEHAVIOR; MULTIMODAL DIALOGUE; POSITIVE EFFECTS; WIZARD OF OZ;

ESTIMATION; MAN MACHINE SYSTEMS; USER INTERFACES;

SPEECH COMMUNICATION;

EID: 77951131776     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1719970.1719990     Document Type: Conference Paper

References (27)

1. Sidner, C.L., et al., Explorations in engagement for humans and robots. Artificial Intelligence, (2005). 166(1- 2): pp. 140-164.
2. Peters, C. Direction of Attention Perception for Conversation Initiation in Virtual Environments. in Intelligent Virtual Agents. (2005). p. 215-228.
3. Sidner, C.L., et al. Where to Look: A Study of Human- Robot Engagement. in ACM International Conference on Intelligent User Interfaces (IUI). (2004). p. 78-84.
4. Argyle, M. and Cook, M., Gaze and Mutual Gaze. (1976), Cambridge: Cambridge University Press.
5. Duncan, S., On the structure of speaker-auditor interaction during speaking turns. Language in Society, (1974). 3: pp. 161-180.
6. Novick, D.G., Hansen, B., and Ward, K. Coordinating turn-taking with gaze. in ICSLP-96. (1996). Philadelphia, PA. p. 1888-1891.
7. Kendon, A., Some Functions of Gaze Direction in Social Interaction. Acta Psychologica, (1967). 26: pp. 22- 63.
8. Argyle, M., et al., The different functions of gaze. Semiotica, (1973). 7: pp. 19-32.
9. Argyle, M. and Graham, J., The Central Europe Experiment - looking at persons and looking at things. Journal of Environmental Psychology and Nonverbal Behaviour, (1977). 1: pp. 6-16.
10. Anderson, A.H., et al., The effects of face-to-face communication on the intelligibility of speech. Perception and Psychophysics, (1997). 59: pp. 580-592.
11. Prasov, Z. and Chai, J.Y. What's in a Gaze? The Role of Eye-Gaze in Reference Resolution in Multimodal Conversational Interfaces. in the 13th international conference on Intelligent user interfaces (2008). p. 20-29.
12. Qvarfordt, P. and Zhai, S. Conversing with the User Based on Eye-Gaze Patterns. in the Conference on Human- Factors in Computing Systems, CHI 2005. (2005).
13. Eichner, T., et al. Attentive Presentation Agents. in The 7th International Conference on Intelligent Virtual Agents (IVA). (2007). p. 283-295.
14. Nakano, I.Y. and Nishida, T., Attentional Behaviors as Nonverbal Communicative Signals in Situated Interactions with Conversational Agents, in Engineering Approaches to Conversational Informatics, Nishida, T., Editor. (2007), John Wiley & Sons Inc.
15. Pelachaud, C. and Bilvi, M. Modelling Gaze Behavior for Conversational Agents. in IVA03 International Working Conference on Intelligent Virtual Agents. (2003). Germany.
16. Gratch, J., et al., Virtual Rapport, in 6th International Conference on Intelligent Virtual Agents. (2006), Springer: Marina del Rey, CA.
17. Nakano, Y.I., et al. Towards a Model of Face-to-Face Grounding. in the 41st Annual Meeting of the Association for Computational Linguistics (ACL03). (2003). Sapporo, Japan. p. 553-561.
18. Morency, L.-P., Kok, I.d., and Gratch, J. Predicting Listener Backchannels: A Probabilistic Multimodal Approach. in The 8th International Conference Intelligent Virtual Agents (IVA'08). (2008): Springer. p. 176-190.
19. Morency, L.-P., et al., Head gestures for perceptual interfaces: The role of context in improving recognition. Artificial Intelligence (2007). 171(8-9): pp. 568-585.
20. Bohus, D. and Horvitz, E. Learning to Predict Engagement with a Spoken Dialog System in Open-World Settings. in SIGdial'09. (2009). London, UK.
21. Kendon, A., Spatial organization in social encounters: the F-formation system, Conducting Interaction: Patterns of behavior in focused encounters. Studies in International Sociolinguistics, ed. Gumperz, J.J. (1990): Cambridge University Press.
22. Schober, M.F. and Clark, H.H., Understanding by addressees and overhearers. Cognitive Psychology, (1989). 21: pp. 211-232.
23. Ishii, R. and Nakano, Y. Estimating User's Conversational Engagement based on Gaze Behaviors. in The 8th International Conference Intelligent Virtual Agents (IVA'08). (2008): Springer. p. 200-207.
24. Matheson, C., Poesio, M., and Traum, D. Modelling Grounding and Discourse Obligations Using Update Rules. in 1st Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL2000). (2000). p. 1-8.
25. Nakano, Y.I., et al. Converting Text into Agent Animations: Assigning Gestures to Text. in Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL 2004), Companion Volume. (2004). Boston. p. 153-156.
26. Larsson, S., et al., TrindiKit 1.0 (Manual). (1999). p. http://www.ling.gu.se/projekt/trindi//.
27. MIDIKI. [cited; Available from: http://midiki.sourceforge.net/.