Learning from unscripted deictic gesture and language for human-robot interactions

Proceedings of the National Conference on Artificial Intelligence

Volumn 4, Issue , 2014, Pages 2556-2563

  Matuszek, Cynthia ^a   Bo, Liefeng ^a   Zettlemoyer, Luke ^a   Fox, Dieter ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84908213909     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Bo, L.; Ren, X.; and Fox, D. 2011. Hierarchical Matching Pursuit for image classification: architecture and fast algorithms. In Advances in Neural Information Processing Systems.
2. Clark, H. H. 2003. Pointing and placing. Pointing: Where language, culture, and cognition meet 243-268.
3. Clark, H. H. 2005. Coordinating with each other in a material world. Discourse studies 7(4-5):507-525.
4. Farhadi, A.;Endres, I.; Hoiem, D.; and Forsyth, D. 2009. Describing objects by their attributes. In Computer Vision and Pattern Recognition, 2009 CVPR 2009 IEEE Conference on, 1778-1785. IEEE.
5. FitzGerald, N.; Artzi, Y.; and Zettlemoyer, L. 2013. Learning distributions over logical forms for referring expression generation. In Empirical Methods in Natural Language Processing (EMNLP).
6. Goodrich, M. A., and Schultz, A. C. 2007. Human- robot interaction: a survey. Foundations and Trends in HCI 1(3):203-275.
7. Lai, K.; Bo, L.; Ren, X.; and Fox, D. 2013. RGB-D object recognition: Features, algorithms, and a large scale benchmark. In Fossati, A.; Gall, J.; Grabner, H.; Ren, X.; and Konolige, K., eds., Consumer Depth Cameras for Computer Vision: Research Topics and Applications. Springer. 167- 192.
8. Liu, P.; Glas, D. F.; Kanda, T.; Ishiguro, H.; and Hagita, N. 2013. It's not polite to point: generating socially-appropriate deictic behaviors towards people. In Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction, 267-274. IEEE Press.
9. Mallat, S. G., and Zhang, Z. 1993. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing 41(12):3397-3415.
10. Matuszek, C.; FitzGerald, N.; Zettlemoyer, L.; Bo, L.; and Fox, D. 2012a. A joint model of language and perception for grounded attribute learning. In Proc. of the 2012 Int'l Conference on Machine Learning.
11. Matuszek, C.; Herbst, E.; Zettlemoyer, L.; and Fox, D. 2012b. Learning to parse natural language commands to a robot control system. In Proc. of the 13th Int'l Symposium on Experimental Robotics (ISER).
12. McGregor, K. K.; Rohlfing, K. J.; Bean, A.; and Marschner, E. 2009. Gesture as a support for word learning: The case of under. Journal of Child Language 36.
13. Mitra, S., and Acharya, T. 2007. Gesture recognition: A survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on 37(3):311-324.
14. Mooney, R. 2008. Learning to connect language and perception. In Fox, D., and Gomes, C. P., eds., Proc. of the Twenty-Third AAA1 Conf. on Artificial Intelligence, AAAI 2008, 1598-1601. Chicago, Illinois: AAAI Press.
15. Nickel, K., and Stiefelhagen, R. 2007. Visual recognition of pointing gestures for human-robot interaction. Image and Vision Computing 25(12): 1875-1884.
16. Obaid, M.; Haring, M.; Kistler, F.; Buhling, R.; and Andre, E. 2012. User-defined body gestures for navigational control of a humanoid robot. In Social Robotics, volume 7621. Springer Berlin Heidelberg. 367-377.
17. Peltason, J.; Riether, N.; Wrede, B.; and Liitkebohle, I. 2012. Talking with robots about objects: a system-level evaluation in hri. In Proceedings of the 7th annual ACM/IEEE international conference on Human-Robot Interaction. ACM.
18. Perzanowski, D.; Schultz, A. C.; Adams, W.; Marsh, E.; and Bugajska, M. 2001. Building a multimodal human-robot interface. Intelligent Systems, IEEE 16(1): 16-21.
19. Ramey, A.; Gonzdlez-Pacheco, V.; and Salichs, M. A. 2011. Integration of a low-cost rgb-d sensor in a social robot for gesture recognition. In Human-Robot Interaction (HRI), 2011 6th ACM/IEEE International Conference on, 229-230. IEEE.
20. Rouanet, P.; Danieau, F.; and Oudeyer, P.-Y. 2011. A robotic game to evaluate interfaces used to show and teach visual objects to a robot in real world condition. In Human-Robot Interaction (HRI), 2011 6th ACM/IEEE International Conference on, 313-320. IEEE.
21. Sandygulova, A.; Campbell, A. G.; Dragone, M.; and O'Hare, G. 2012. Immersive human-robot interaction. In Proc. of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, HRI' 12, 227-228. New York, NY, USA: ACM.
22. Steels, L., and Loetzsch, M. 2012. The grounded naming game. In Experiments in Cultural Language Evolution.
23. Steels, L. 2001. Language games for autonomous robots. IEEE Intelligent systems 16-22.
24. Suay, H., and Chernova, S. 2011. Humanoid robot control using depth camera. In Human-Robot Interaction (HRI), 2011 6th ACM/IEEE International Conference on, 401-401.
25. Sun, Y.; Bo, L.; and Fox, D. 2013. Attribute Based Object Identification. In IEEE International Conference on on Robotics and Automation.
26. Tellex, S.; Thaker, P.; Joseph, J.; and Rot, N. 2013. Learning perceptually grounded word meanings from unaligned parallel data. Machine Learning Journal (Special Issue on Learning Semantics in Machine Learning).
27. Vollmer, A.-L.; Lohan, K. S.; Fischer, K.; Nagai, Y.; Pitsch, K.; Fritsch, J.; Rohlfing, K.; and Wrede, B. 2009. People modify their tutoring behavior in robot-directed interaction for action learning. Development and Learning, 2009. ICDL 2009. IEEE 8th International Conference on Development and Learning, 1-6. IEEE.
28. Wachs, J. P.; Kolsch, M.; Stern, H.; and Edan, Y. 2011. Vision-based hand-gesture applications. Commun. ACM 54(2):60-71.
29. Yang, J.; Yu, K.; Gong, Y.; and Huang, T. 2009. Linear spatial pyramid matching using sparse coding for image classification. In Computer Vision and Pattern Recognition (CVPR). IEEE.
30. Yang, H.-D.; Park, A.-Y.; and Lee, S.-W. 2007. Gesture spotting and recognition for human-robot interaction. Robotics, IEEE Transactions on 23(2):256-270.