Enhanced visual scene understanding through human-robot dialog

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2011, Pages 3342-3348

  Johnson Roberson, Matthew ^a   Bohg, Jeannette ^a   Skantze, Gabriel ^a   Gustafson, Joakim ^a   Carlson, Rolf ^a   Rasolzadeh, Babak ^a   Kragic, Danica ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

DIALOG SYSTEMS; HUMAN-IN-THE-LOOP; SCENE SEGMENTATION; SEGMENTATION PERFORMANCE; VISUAL SCENE;

COMPUTER VISION; INTELLIGENT ROBOTS; ROBOTICS;

HUMAN ROBOT INTERACTION;

EID: 84455206614     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2011.6048219     Document Type: Conference Paper

References (34)

1. J. Maitin-Shepard, M. Cusumano-Towner, J. Lei, and P. Abbeel, "Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Anchorage, Alaska, USA, May 2010.
2. A. Saxena, J. Driemeyer, and A. Ng, "Robotic Grasping of Novel Objects using Vision," Int. J. of Robotics Research, 2008.
3. S. Calinon, Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press, 2009.
4. M. Björkman and J.-O. Eklundh, "Foveated Figure-Ground Segmentation and Its Role in Recognition," Proc. of British Machine Vision Conference, 2005.
5. J. Bohg and D. Kragic, "Learning grasping points with shape context,"Robotics and Autonomous Systems, vol. 58, no. 4, pp. 362-377, 2010.
6. M. Johnson-Roberson, J. Bohg, M. Björkman, and D. Kragic, "Attention Based Active 3D Point Cloud Segmentation," in IROS 2010, Taipeh, Taiwan, October 2010, accepted.
7. S. Harnad, "The symbol grounding problem," in PhysicaD: Nonlinear phenomena, vol. 42, 1990, pp. 335-346.
8. J. Kenney, T. Buckley, and O. Brock, "Interactive Segmentation for Manipulation in Unstructured Environments," in IEEE Int. Conf. on Robotics and Automation, 2009, pp. 1377-1382.
9. G. Metta and P. Fitzpatrick, "Better Vision through Manipulation,"Adaptive Behavior, vol. 11, no. 2, pp. 109-128, 2003.
10. D. Katz and O. Brock, "Manipulating articulated objects with interactive perception," in Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, May 2008, pp. 272-277.
11. A. Kapoor, K. Grauman, R. Urtasun, and T. Darrell, "Gaussian Processes for Object Categorization," International Journal of Computer Vision, vol. 88, pp. 169-188, 2010.
12. A. Vrečko, D. Skočaj, N. Hawes, and A. Leonardis, "A computer vision integration model for a multi-modal cognitive system," in The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, October 2009, pp. 3140-3147.
13. J. R. Hedvig Kjellström and D. Kragic, "Visual Object-Action Recognition: Inferring Object Affordances from Human Demonstration, "Computer Vision and Image Understanding, 2010, (to appear).
14. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: interactive foreground extraction using iterated graph cuts," ACM Transactions on Graphics, vol. 23, no. 3, pp. 309-314, August 2004.
15. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy snapping," in ACM SIGGRAPH 2004 Papers, ser. SIGGRAPH '04. New York, NY, USA: ACM, 2004, pp. 303-308.
16. A. Steinfeld, T. Fong, D. Kaber, M. Lewis, J. Scholtz, A. Schultz, and M. Goodrich, "Common metrics for human-robot interaction," in HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. New York, NY, USA: ACM, 2006, pp. 33-40.
17. P. Sturgess, K. Alahari, L. Ladicky, and P. H. S. Torr, "Combining appearance and structure from motion features for road scene understanding,"in Proceedings of British Machine Vision Conference, 2009.
18. T. Malisiewicz and A. A. Efros, "Beyond categories: The visual memex model for reasoning about object relationships," in NIPS, December 2009.
19. R. S. Li-Jia Li and L. Fei-Fei, "Towards total scene understanding: Classification, annotation and segmentation in an automatic framework."in IEEE Computer Vision and Pattern Recognition (CVPR), 2009.
20. J. Bohg, M. Johnson-Roberson, M. Björkman, and D. Kragic, "Strategies for multi-modal scene exploration." in Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010.
21. T. Asfour, K. Welke, P. Azad, A. Ude, and R. Dillmann, "The Karlsruhe Humanoid Head," in IEEE/RAS International Conference on Humanoid Robots (Humanoids), Daejeon, Korea, December 2008.
22. B. Rasolzadeh, M. Björkman, K. Huebner, and D. Kragic, "An Active Vision System for Detecting, Fixating and Manipulating Objects in the Real World," The International Journal of Robotics Research, vol. 29, no. 2-3, pp. 133-154, 2010.
23. Y. Boykov, O. Veksler, and R. Zabih, "Markov random fields with efficient approximations," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998, pp. 648-655.
24. -, "Fast approximate energy minimization via graph cuts," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1222-1239, 2001.
25. V. Kolmogorov and R. Zabih, "What energy functions can be minimized via graph cuts?" IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 147-159, 2004.
26. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/max-flow algorithms for energy minimization in vision," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1124-1137, 2004.
27. G. Skantze, "Jindigo: A Javabased Framework for Incremental Dialogue Systems," 2010, www.jidingo.net.
28. D. Schlangen and G. Skantze, "A General, Abstract Model of Incremental Dialogue Processing," in Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL09), Athens, Greece, 2009.
29. P. Lamere, P. Kwok, E. Gouvea, B. Raj, R. Singh, W. Walker, M. Warmuth, and P. Wolf, "The cmu sphinx4 speech recognition system," in Proceedings of the IEEE Intl. Conf. on Acoustics, Speech and Signal Processing, HongKong, 2003.
30. G. Skantze and J. Edlund, "Robust interpretation in the higgins spoken dialogue system," in Proceedings of ISCA Tutorial and Research Workshop (ITRW) on Robustness Issues in Conversational Interaction, Norwich, UK, 2004.
31. G. Skantze, "Galatea: A discourse modeller supporting concept-level error handling in spoken dialogue systems," in Recent Trends in Discourse and Dialogue, L. Dybkjær and W. Minker, Eds. Springer, Aug. 2008.
32. M. Schröder and J. Trouvain, "The german text-to-speech synthesis system mary: A tool for research, development and teaching." International Journal of Speech Technology, pp. 365-377, 2003.
33. C.-C. Chang and C.-J. Lin, LIBSVM: a library for support vector machines, 2001, software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
34. K. Lai, L. Bo, X. Ren, and D. Fox, "A Large-Scale Hierarchical Multi-View RGB-D Object Dataset," in IEEE International Conference on on Robotics and Automation, 2011.