Learning to recognize novel objects in one shot through human-robot interactions in natural language dialogues

Proceedings of the National Conference on Artificial Intelligence

Volumn 4, Issue , 2014, Pages 2796-2802

  Krause, Evan ^a   Williams, Thomas ^a   Zillich, Michael ^b   Scheutz, Matthias ^a  

^a TUFTS UNIVERSITY   (United States)

^b VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE DIALOGUE; SHOT-THROUGH;

EID: 84908180972     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Bart, E., and Ullman, S. 2005. Cross-generalization: learning novel classes from a single example by feature replacement. CVPR'05.
2. Belongie, S.; Malik, J.; and Puzicha, J. 2002. Shape Matching and Object Recognition Using Shape Contexts. Pattern Analysis and Machine Intelligence 24:509-522.
3. Briggs, G., and Scheutz, M. 2013. A hybrid architectural approach to understanding and appropriately generating indirect speech acts. In Proceedings of Twenty-Seventh AAAI Conference on Artificial Intelligence, 1213-1219.
4. Cantrell, R; Scheutz, M.; Schermerhorn, P.; and Wu, X. 2010. Robust spoken instruction understanding for HRI. In Proceedings of the 2010 Human-Robot Interaction Conference, 275-282.
5. Cantrell, R.; Talamadupula, K.; Schermerhorn, P.; Benton, J.; Kambhampati, S.; and Scheutz, M. 2012. Tell me when and why to do it!: Run-time planner model updates via natural language instruction. In Proceedings of the IEEE Human-Robot Interaction Conference, 471-478.
6. Collet, A.; Berenson, D.; Srinivasa, S. S.; and Ferguson, D. 2009. Object Recognition and Full Pose Registration from a Single Image for Robotic Manipulation. In ICRA'09.
7. Farhadi, A.; Endres, I.; Hoiem, D.; and Forsyth, D. 2009. Describing objects by their attributes. In CVPR'09.
8. Fei-Fei, L.; Fergus, R.; and Perona, P. 2006. One-shot learning of object categories. Pattern Analysis and Machine Intelligence 28(4).
9. Fei-Fei, L.; Fergus, R.; and Perona, P. 2007. Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Computer Vision and Image Understanding 106(1):59-70.
10. Fergus, R.; Fei-Fei, L.; Perona, P.; and Zisserman, A. 2005. Learning Object Categories from Google's Image Search. In CVPR'05.
11. Fergus, R.; Weiss, Y.; and Torralba, A. 2009. Semi-Supervised Learning in Gigantic Image Collections. In NIPS'09.
12. Ferrari, V., and Zisserman, A. 2007. Learning Visual Attributes. In NIPS'07.
13. Fitzpatrick, P.; Metta, G.; Natale, L.; Rao, S.; and Sandini, G. 2003. Learning about Objects through Action Initial Steps Towards Artificial Cognition. In ICRA'03.
14. Herbst, E.; Ren, X.; and Fox, D. 2011. RGB-D Object Discovery Via Multi-Scene Analysis. In IROS'11.
15. Hwang, S. J.; Sha, F.; and Grauman, K. 2011. Sharing features between objects and their attributes. In CVPR'11.
16. Itti, L., and Koch, C. 2001. Computational modeling of visual attention. In Nature reviews, Neumscience, 194-203.
17. Kalal, Z.; Mikolajczyk, K.; and Matas, J. 2012. Tracking Learning-Detection. Pattern Analysis and Machine Intelligence 34(7): 1409-1422.
18. Kang, H.; Hebert, M.; and Kanade, T. 2011. Discovering Object Instances from Scenes of Daily Living. In ICCV'11.
19. Karpathy, A.; Miller, S.; and Fei-Fei, L. 2013. Object Discovery in 3D Scenes via Shape Analysis. In ICRA'13.
20. Katz, D.; Venkatraman, A.; Kazemi, M.; Bagnell, D.; and Stentz, A. 2013. Perceiving, Learning, and Exploiting Object Affordances for Autonomous Pile Manipulation. In Robotics Science and Systems.
21. Krainin, M.; Henry, P.; Ren, X.; and Fox, D. 2011. Manipulator and object tracking for in-hand 3D object modeling. The International Journal of Robotics Research 30(11):1311-1327.
22. Krause, E.; Cantrell, R.; Potapova, E.; Zillich, M.; and Scheutz, M. 2013. Incrementally Biasing Visual Search Using Natural Language Input. In AAMAS'13.
23. Lake, B. M.; Salakhutdinov, R.; and Tenenbaum, J. B. 2012. Concept learning as motor program induction: A large-scale empirical study. In Cognitive Science Conference.
24. Leibe, B.; Leonardis, A.; and Schiele, B. 2008. Robust Object Detection with Interleaved Categorization and Segmentation. International Journal of Computer Vision 77(1-3):259-289.
25. Logothetis, N and Sheinberg, D. L. 1996. Visual object recognition. Annual Review of Neumscience 19:577-621.
26. Miller, E.; Matsakis, N.; and Viola, P. 2000. Learning from one example through shared densities on transforms. In CVPR'00.
27. Mohan, S.; Mininger, A.; Kirk, J.; and Laird, J. E. 2012. Learning grounded language through situated interactive instruction. In AAAI Fall Symposium Series, 30-37.
28. Ozuysal, M.; Calonder, M.; Lepetit, V.; and Fua, P. 2009. Fast Keypoint Recognition Using Random Ferns. Pattern Analysis and Machine Intelligence 32(3):448-461.
29. Richtsfeld, A.; Morwald, T.; Prankl, J.; Zillich, M.; and Vincze, M. 2014. Learning of perceptual grouping for object segmentation on RGB-D data. Journal of Visual Communication and Image Representation 25(1):64-73.
30. Salakhutdinov, R.; Tenenbaum, J.; and Torralba, A. 2012. One-Shot Learning with a Hierarchical Nonparametric Bayesian Model. JMLR Workshop on Unsupervised and Transfer Learning 27:195-207.
31. Scheutz, M.; Schermerhorn, P.; Kramer, J.; and Anderson, D. 2007. First steps toward natural human-like HRI. Autonomous Robots 22(4):411-423.
32. Scheutz, M.; Briggs, G.; Cantrell, R.; Krause, E.; Williams, T.; and Veale, R. 2013. Novel mechanisms for natural human-robot interactions in the diarc architecture. In Proceedings of AAAI Workshop on Intelligent Robotic Systems.
33. Skocaj, D.; Kristan, M.; Vrecko, A.; Marko, M.; Miroslav, J.; Kruijff, G.-J. M.; Hanheide, M.; Hawes, N.; Keller, T.; Zillich, M.; and Zhou, K. 2011. A system for interactive learning in dialogue with a tutor. In IROS'11.
34. Uckermann, A.; Haschke, R.; and Ritter, H. 2012. Real-Time 3D Segmentation of Cluttered Scenes for Robot Grasping. In IROS'12.
35. Varadarajan, K. M., and Vincze, M. 2012. AfRob: The affordance network ontology for robots. In IROS'12.
36. Wohlkinger, W.; Buchaca, A. A.; Rusu, R.; and Vincze, M. 2012. 3DNet: Large-Scale Object Class Recognition from CAD Models. In ICRA'12.