Exploring a model of gaze for grounding in multimodal HRI

ICMI 2014 - Proceedings of the 2014 International Conference on Multimodal Interaction

Volumn , Issue , 2014, Pages 247-254

  Mehlmann, Gregor ^a   Janowski, Kathrin ^a   Häring, Markus ^a   Baur, Tobias ^a   Gebhard, Patrick ^b   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

Dialog modeling; Human robot interaction; Multi modal fusion

Indexed keywords

ANTHROPOMORPHIC ROBOTS; BEHAVIORAL RESEARCH; INTERACTIVE COMPUTER SYSTEMS; ROBOTS; USER INTERFACES;

BI-DIRECTIONAL; DIALOG MODELING; HUMAN INTERACTIONS; HUMANOID ROBOT; MULTI-MODAL FUSION; MULTIPLE PROCESS; SHARED-WORKSPACE; TASK MANAGEMENT;

HUMAN ROBOT INTERACTION;

EID: 84947226669     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2663204.2663275     Document Type: Conference Paper

References (35)

1. M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press, 1976.
2. M. Argyle and J. Graham. The central europe experiment: Looking at persons and looking at objects. Environmental psychology and nonverbal behavior, 1(1):6-16, 1976.
3. M. Argyle, R. Ingham, F. Alkema, and M. McCallin. The different functions of gaze. Semiotica, 7:19-32, 1973.
4. A. Bangerter. Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15:415-419, 2004.
5. J. Bavelas, L. Coates, and T. Johnson. Listener responses as a collaborative process: The role of gaze. Communication, 52:566-580, 2002.
6. J. Brusk, T. Lager, A. Hjalmarsson, and P. Wik. Deal: Dialogue management in scxml for believable game characters. In Proceedings of Future Play 7, pages 137-144. ACM, New York, NY, 2007.
7. H. Clark. Using Language. Cambridge University Press, May 1996.
8. H. H. Clark. Coordinating with each other in a material world. Discourse Studies, 1:507-525, 2005.
9. H. H. Clark and D. Wilkes-Gibbs. Referring as a collaborative process. Cognition, 22:1-39, 1986.
10. S. Duncan. Some signals and rules for taking speaking turns in conversations. Personality and Social Psychology, 23:283-292, 1972.
11. P. Gebhard, G. Mehlmann, and M. Kipp. Visual scenemaker: A tool for authoring interactive virtual characters. Journal on Multimodal User Interfaces, 6:3-11, 2012.
12. Z. Griffin and K. Bock. What the eyes say about speaking. Psychological Science, 11:274-279, 2000.
13. A. Holroyd, C. Rich, C. Sidner, and B. Ponsler. Generating connection events for human-robot collaboration. In RO-MAN, pages 241-246, 2011.
14. C.-M. Huang and A. Thomaz. Effects of responding to, initiating and ensuring joint attention in human-robot interaction. In RO-MAN, pages 65-71, 2011.
15. A. Kendon. Some functions of gaze-direction in social interaction. Acta Psychologica, 26:22-63, 1967.
16. D. Lalanne, L. Nigay, P. Palanque, P. Robinson, J. Vanderdonckt, and J. F. Ladry. Fusion engines for multimodal input: A survey. In Proceedings of ICMI' 09, pages 153-160. ACM, New York, NY, USA, 2009.
17. G. U. Mehlmann and E. André. Modeling multimodal integration with event logic charts. In ICMI, pages 125-132, 2012.
18. A. Meyer, A. Sleiderink, and W. Levelt. Viewing and naming objects: Eye movements during noun phrase production. Cognition, 66:25-33, 1998.
19. P. Mundy and L. Newell. Attention, joint attention, and social cognition. Current Directions in Psychological Science, 16:269-274, 2007.
20. B. Mutlu, T. Kanda, J. Forlizzi, J. Hodgins, and H. Ishiguro. Conversational gaze mechanisms for humanlike robots. ACM Trans. Interact. Intell. Syst., 1(2):12:1-12:33, Jan. 2012.
21. B. Mutlu, A. Terrell, and C.-M. Huang. Coordination mechanisms in human-robot collaboration. In Workshop on Collaborative Manipulation at ACM/IEEE HRI, 2013.
22. G. Nielsen. Studies in Self Confrontation. Munksgaard, Copenhagen, 1962.
23. S. Oviatt. Advances in robust multimodal interface design. IEEE Comput. Graph. Appl., 23(5):62-68, September 2003.
24. S. Oviatt. The Human-Computer Interaction Handbook, chapter Multimodal Interfaces, pages 413-432. Mahwah, NJ: Lawrence Erlbaum and Associates, 2008.
25. C. Rich, B. Ponsler, A. Holroyd, and C. Sidner. Recognizing engagement in human-robot interaction. In HRI, pages 375-382, 2010.
26. D. C. Richardson and R. Dale. Looking to understand - The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cognitive Science, 29:1045-1060, 2005.
27. R. Ros, S. Lemaignan, E. Sisbot, R. Alami, J. Steinwender, K. Hamann, and F. Warneken. Which one? grounding the referent based on efficient human-robot interaction. In RO-MAN, 2010 IEEE, pages 570-575, 2010.
28. H. Sacks, E. Schlegloff, and G. Jefferson. A simplest systematics for the organization of turn-taking. Language, 50:696-735, 1974.
29. C. L. Sidner, C. Lee, C. D. Kidd, N. Lesh, and C. Rich. Explorations in engagement for humans and robots. Artificial Intelligence, 166(1-2):140-164, 2005.
30. M. Staudte and M. W. Crocker. Investigating joint attention mechanisms through spoken human-robot interaction. Cognition, 120:268-291, 2011.
31. R. Stiefelhagen, H. K. Ekenel, C. Fugen, P. Gieselmann, H. Holzapfel, F. Kraft, K. Nickel, M. Voit, and A. Waibel. Enabling multimodal human-robot interaction for the karlsruhe humanoid robot. Robotics, IEEE Transactions on, 23(5):840-851, 2007.
32. D. Traum, A. Leuski, A. Roque, S. Gandhe, D. DeVault, J. Gerten, S. Robinson, and B. Martinovski. Natural language dialogue architectures for tactical questioning characters. In Army Science Conference, 2008.
33. J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, and E. André. The social signal interpretation (ssi) framework: Multimodal signal processing and recognition in real-time. In Proceedings of the ACM International Conference on Multimedia, pages 831-834, New York, NY, USA, 2013.
34. J. Wielemaker, T. Schrijvers, M. Triska, and T. Lager. SWI-Prolog. Theory and Practice of Logic Programming, 12(1-2):67-96, 2012.
35. V. H. Yngve. On getting a word in edgewise. In Regional Meeting of the Chicago Linguistic Society, pages 657-677, 1970.