Robot deictics: How gesture and context shape referential communication

ACM/IEEE International Conference on Human-Robot Interaction

Volumn , Issue , 2014, Pages 342-349

  Sauppé, Allison ^a   Mutlu, Bilge ^a  

^a University of Wisconsin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION; HUMAN ROBOT INTERACTION; MAN MACHINE SYSTEMS;

DESIGN SPACES; HUMANLIKE ROBOTS; PHYSICAL CONTACTS; REFERENTIAL COMMUNICATIONS;

MACHINE DESIGN;

EID: 84896987516     PISSN: None     EISSN: 21672148     Source Type: Conference Proceeding    
DOI: 10.1145/2559636.2559657     Document Type: Conference Paper

References (30)

1. M. W. Alibali, L. M. Flevares, and S. Goldin-Meadow. Assessing knowledge conveyed in gesture: Do teachers have the upper hand? Journal of Educational Psychology, 89(1):183, 1997.
2. A. Bangerter. Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15(6):415-419, 2004.
3. D. Bolinger. Intonation and gesture. American speech, 58(2):156-174, 1983.
4. C. Breazeal, C. D. Kidd, A. L. Thomaz, G. Hoffman, and M. Berlin. Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In Proc. IROS 2005, pages 708-713, 2005.
5. A. G. Brooks and C. Breazeal. Working with robots and objects: Revisiting deictic reference for achieving spatial common ground. In Proc. HRI 2006, pages 297-304, 2006.
6. M. C. Caselli. Communicative gestures and first words. In V. Volterra and C. Erting, editors, From gesture to language in hearing and deaf children, pages 56-67. Springer, 1990.
7. H. H. Clark. Coordinating with each other in a material world. Discourse studies, 7(4-5):507-525, 2005.
8. C. J. Fillmore. Towards a descriptive framework for spatial deixis. In R. Jarvella and W. Klein, editors, Speech, Place and Action, pages 31-59. John Wiley, 1982.
9. S. Goldin-Meadow. The role of gesture in communication and thinking. Trends in cognitive sciences, 3(11):419-429, 1999.
10. S. Harrison. The creation and implementation of a gesture code for factory communication. In Proc. GESPIN 2011, 2011.
11. Y. Hato, S. Satake, T. Kanda, M. Imai, and N. Hagita. Pointing to space: modeling of deictic interaction referring to regions. In Proc. HRI 2010, pages 301-308, 2010.
12. C.-M. Huang and B. Mutlu. Modeling and evaluating narrative gestures for humanlike robots. In Proc. RSS 2013, 2013.
13. M. Jancovic, S. Devoe, and M. Wiener. Age-related changes in hand and arm movements as nonverbal communication: Some conceptualizations and an empirical exploration. Child Development, pages 922-928, 1975.
14. A. Kendon. Gesture: Visible action as utterance. Cambridge U, 2004.
15. S. Kita. Pointing: A foundational building block of human communication. Pointing: Where Language, Culture, and Cognition Meet, 1:1-8, 2003.
16. A. Kobsa, J. Allgayer, C. Reddig, N. Reithinger, D. Schmauks, K. Harbusch, and W. Wahlster. Combining deictic gestures and natural language for referent identification. In Proc. COLING 1986, pages 356-361, 1986.
17. J. D. Lempers. Young children's production and comprehension of nonverbal deictic behaviors. The Journal of Genetic Psychology, 135(1):93-102, 1979.
18. P. Liu, D. F. Glas, T. Kanda, H. Ishiguro, and N. Hagita. It's not polite to point: generating socially-appropriate deictic behaviors towards people. In Proc. HRI 2013, pages 267-274, 2013.
19. S. C. Lozano and B. Tversky. Communicative gestures facilitate problem solving for both communicators and recipients. Journal of Memory and Language, 55(1):47-63, 2006.
20. D. McNeill. Hand and mind: What gestures reveal about thought. U Chicago, 1992.
21. Á. Miklósi and K. Soproni. A comparative analysis of animals' understanding of the human pointing gesture. Animal cognition, 9(2):81-93, 2006.
22. G. R. Morrison and G. J. Anglin. Research on cognitive load theory: Application to e-learning. Educational Technology Research and Development, 53(3):94-104, 2005.
23. C. M. Murphy. Pointing in the context of a shared activity. Child Development, 49(2):371-380, 1978.
24. Y. Okuno, T. Kanda, M. Imai, H. Ishiguro, and N. Hagita. Providing route directions: design of robot's utterance, gesture, and timing. In Proc. HRI 2009, pages 53-60, 2009.
25. M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin. Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, 4(2):201-217, 2012.
26. J. Shah and C. Breazeal. An empirical analysis of team coordination behaviors and action planning with application to human-robot teaming. Human Factors, 52(2):234-245, 2010.
27. A. St Clair, R. Mead, and M. J. Mataric. Investigating the effects of visual saliency on deictic gesture production by a humanoid robot. In Proc. RO-MAN 2011, pages 210-216, 2011.
28. O. Sugiyama, T. Kanda, M. Imai, H. Ishiguro, and N. Hagita. Natural deictic communication with humanoid robots. In Proc. IROS 2007, pages 1441-1448, 2007.
29. J. G. Trafton, N. L. Cassimatis, M. D. Bugajska, D. P. Brock, F. E. Mintz, and A. C. Schultz. Enabling effective human-robot interaction using perspective-taking in robots. Systems, Man and Cybernetics, Part A: Systems and Humans, 35(4):460-470, 2005.
30. D. Vogel and R. Balakrishnan. Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proc. UIST 2004, pages 137-146, 2004.