Learning grasping points with shape context

Robotics and Autonomous Systems

Volumn 58, Issue 4, 2010, Pages 362-377

  Bohg, Jeannette ^a   Kragic, Danica ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Affordances; Grasping; Shape context; SVM

Indexed keywords

AFFORDANCES; DESCRIPTORS; LEARNING FRAMEWORKS; NONLINEAR CLASSIFICATION; NONLINEAR CLASSIFIERS; ROBOTIC GRASPING; SHAPE CONTEXTS; SYNTHETIC IMAGES; VISION BASED;

CLASSIFIERS;

SUPPORT VECTOR MACHINES;

EID: 77249167134     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2009.10.003     Document Type: Article

References (61)

1. Goodale M. Separate visual pathways for perception and action. Trends in Neurosciences 15 1 (1992) 20-25
2. Borghi A. Object concepts and action. Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking (2005), Cambridge University Press
3. Creem S.H., and Proffitt D.R. Grasping objects by their handles: A necessary interaction between cognition and action. Journal of Experimental Psychology: Human Perception and Performance 27 1 (2001) 218-228
4. Gibson J. The Ecological Approach to Visual Perception (1979), Lawrence Erlbaum Associates
5. Castiello U., and Jeannerod M. Measuring time to awareness. Neuroreport 2 12 (1991) 797-800
6. Webster M.J., Bachevalier J., and Ungerleider L.G. Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cerebral Cortex 4 5 (1994) 470-483
7. S. Ekvall, D. Kragic, Learning and evaluation of the approach vector for automatic grasp generation and planning, in: IEEE International Conference on Robotics and Automation, 2007, pp. 4715-4720
8. A. Morales, P. Azad, T. Asfour, D. Kraft, S. Knoop, R. Dillmann, A. Kargov, C. Pylatiuk, S. Schulz, An anthropomorphic grasping approach for an assistant humanoid robot, in: 37th International Symposium on Robotics, 2006, pp. 149-152
9. J. Glover, D. Rus, N. Roy, Probabilistic models of object geometry for grasp planning, in: IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 2008
10. K. Hübner, D. Kragic, Selection of robot pre-grasps using box-based shape approximation, in: IEEE Int. Conference on Intelligent Robots and Systems, 2008, pp. 1765-1770
11. C. Dunes, E. Marchand, C. Collowet, C. Leroux, Active rough shape estimation of unknown objects, in: IEEE International Conference on Robotics and Automation, 2008 pp. 3622-3627
12. M. Richtsfeld, M. Vincze, Grasping of unknown objects from a table top, in: ECCV Workshop on 'Vision in Action: Efficient Strategies for Cognitive Agents in Complex Environments', Marseille, France, 2008
13. Kraft D., Pugeault N., Baseski E., Popovic M., Kragic D., Kalkan S., Wörgötter F., and Krueger N. Birth of the object: Detection of objectness and extraction of object shape through object action complexes. International Journal of Humanoid Robotics 5 2 (2008) 247-265
14. G.M. Bone, A. Lambert, M. Edwards, Automated modelling and robotic grasping of unknown three-dimensional objects, in: IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 2008, pp. 292-298
15. Saxena A., Driemeyer J., Kearns J., and Ng A.Y. Robotic grasping of novel objects. Neural Information Processing Systems 19 (2007) 1209-1216
16. Morales A., Chinellato E., Fagg A., and del Pobil A. Using experience for assessing grasp reliability. International Journal of Humanoid Robotics 1 4 (2004) 671-691
17. Stark M., Lies P., Zillich M., Wyatt J., and Schiele B. Functional object class detection based on learned affordance cues. 6th International Conference on Computer Vision Systems. LNAI vol. 5008 (2008), Springer-Verlag 435-444
18. Goodale M.A., Meenan J.P., Bülthoff H.H., Nicolle D.A., Murphy K.J., and Racicot C.I. Separate neural pathways for the visual analysis of object shape in perception and prehension. Current Biology 4 7 (1994) 604-610
19. Cuijpers R.H., Smeets J.B.J., and Brenner E. On the relation between object shape and grasping kinematics. Journal of Neurophysiology 91 (2004) 2598-2606
20. Gentilucci M. Object motor representation and reaching-grasping control. Neuropsychologia 40 8 (2002) 1139-1153
21. Belongie S., Malik J., and Puzicha J. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 (2002) 509-522
22. J. Speth, A. Morales, P.J. Sanz, Vision-based grasp planning of 3D objects by extending 2D contour based algorithms, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008, pp. 2240-2245
23. Nguyen V.-D. Constructing stable grasps. International Journal on Robotics Research 8 1 (1989) 26-37
24. Shimoga K. Robot grasp synthesis algorithms: A survey. International Journal of Robotic Research 15 3 (1996) 230-266
25. A.T. Miller, S. Knoop, H.I. Christensen, P.K. Allen, Automatic grasp planning using shape primitives, in: IEEE Int. Conf. on Robotics and Automation, 2003, pp. 1824-1829
26. C. Goldfeder, P.K. Allen, C. Lackner, R. Pelossof, Grasp planning via decomposition trees, in: IEEE International Conference on Robotics and Automation, 2007, pp. 4679-4684
27. M. Ciorcarlie, C. Goldfeder, P. Allen, Dexterous grasping via eigengrasps: A low-dimensional approach to a high-complexity problem, in: Robotics: Science and Systems Manipulation Workshop
28. C. Borst, M. Fischer, G. Hirzinger, Grasping the dice by dicing the grasp, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003, pp. 3692-3697
29. Y. Li, N. Pollard, A shape matching algorithm for synthesizing humanlike enveloping grasps, in: Humanoid Robots, 2005 5th IEEE-RAS International Conference on, 2005, pp. 442-449
30. T. Asfour, K. Regenstein, P. Azad, J. Schröder, A. Bierbaum, N. Vahrenkamp, R. Dillmann, ARMAR-III: An integrated humanoid platform for sensory-motor control, in: 6th IEEE-RAS International Conference on Humanoid Robots, 2006, pp. 169-175
31. J. Shotton, J. Winn, C. Rother, A. Criminisi, TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation, in: Proceedings of European Conference Computer Vision, ECCV, 2006
32. Ferrari V., Fevrier L., Jurie F., and Schmid C. Groups of adjacent contour segments for object detection. IEEE Transactions on Pattern Analysis Machine Intelligence 30 1 (2008) 36-51
33. C. Dance, J. Willamowski, L. Fan, C. Bray, G. Csurka, Visual categorization with bags of keypoints, in: ECCV International Workshop on Statistical Learning in Computer Vision, 2004
34. F.-F. L, P. Perona, A bayesian hierarchical model for learning natural scene categories, in: Computer Vision and Pattern Recognition, IEEE Computer Society Conference on, vol 2, 2005 524-531
35. B. Leibe, A. Leonardis, B. Schiele, An implicit shape model for combined object categorization and segmentation in: Toward Category-Level Object Recognition, 2006 pp. 508-524
36. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories, in: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 2169-2178
37. Rosch E., Mervis C.B., Gray W.D., Johnson D.M., and Boyes-Braem P. Basic objects in natural categories. Cognitive Psychology 8 3 (1976) 382-439
38. S. El-Khoury, A. Sahbani, Handling objects by their handles, in: IROS-2008 Workshop on Grasp and Task Learning by Imitation, 2008
39. R. Pelossof, A. Miller, P. Allen, T. Jebera, An SVM learning approach to robotic grasping, in: IEEE International Conference on Robotics and Automation, 2004, 3512-3518
40. N. Curtis, J. Xiao, Efficient and effective grasping of novel objects through learning and adapting a knowledge base, in: IEEE International Conference on Robotics and Automation, 2008 pp. 2252-2257
41. Grezes J., and Decety J. Does visual perception of object afford action? Evidence from a neuroimaging study. Neuropsychologia 40 2 (2002) 212-222
42. Bohg J., Barck-Holst C., Hübner K., Ralph M., Song D., and Kragic D. Towards grasp-oriented visual perception in humanoid robotics. International Journal of Humanoid Robotics 6 3 (2009) 387-434
43. A. Saxena, L. Wong, A.Y. Ng, Learning grasp strategies with partial shape information, in: 23rd AAAI Conference on Artificial Intelligence, 2008, pp. 1491-1494
44. KUKA, KR 5 sixx R650, www.kuka-robotics.com, last visited 2009
45. SCHUNK, SDH, www.schunk.com, last visited 2009
46. M. Björkman, D. Kragic, Combination of foveal and peripheral vision for object recognition and pose estimation, in: Proceedings IEEE International Conference on Robotics and Automation, ICRA'04, vol. 5, 2004, pp. 5135-5140
47. Kragic D., Bjorkman M., Christensen H.I., and Eklundh J.-O. Vision for robotic object manipulation is domestic settings. Robotics and Autonomous Systems (2005) 85-100
48. M. Björkman, J. Eklundh, Foveated figure-ground segmentation and its role in recognition, in: British Machine Vision Conference, 2005
49. B. Rasolzadeh, A.T. Targhi, J.-O. Eklundh, An attentional system combining top-down and bottom-up influences, in: Workshop on Attention and Performance in Computational Vision, 2007, pp. 123-140
50. K. Grauman, T. Darrell, The pyramid match kernel: Discriminative classification with sets of image features, in: Proceedings of IEEE International Conference on Computer Vision, vol. 2, 2005, pp. 1458-1465
51. Ek C.H., Torr P.H., and Lawrence N.D. Gaussian process latent variable models for human pose estimation. 4th Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms. MLMI 2007. LNCS vol. 4892 (2007), Springer-Verlag, Brno, Czech Republic 132-143
52. Mori G., Belongie S., Malik J., and Member S. Efficient shape matching using shape contexts. IEEE Transactions Pattern Analysis and Machine Intelligence 27 (2005) 1832-1837
53. Bishop C. Pattern Recognition and Machine, Learning (Information Science and Statistics) (2006), Springer
54. C.-C. Chang, C.-J. Lin, LIBSVM: A library for support vector machines, software available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm, 2001
55. Craven M., and Shavlik J. Extracting tree-structured representations of trained networks. Advances in Neural Information Processing Systems. NIPS-8 (1995), MIT Press 24-30
56. Martens D., Baesens B., Gestel T.V., and Vanthienen J. Comprehensible credit scoring models using rule extraction from support vector machines. European Journal of Operational Research 183 3 (2007) 1466-1476
57. Kragic D., and Christensen H.I. Cue integration for visual servoing. IEEE Transactions on Robotics and Automation 17 1 (2001) 18-27
58. S. Ekvall, D. Kragic, Receptive field cooccurrence histograms for object detection, in: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'05, 2005, pp. 84-89
59. Kragic D., Petersson L., and Christensen H.I. Visually guided manipulation tasks. Robotics and Autonomous Systems 40 2-3 (2001) 193-203
60. Tegin J., Ekvall S., Kragic D., Iliev B., and Wikander J. Demonstration based learning and control for automatic grasping. Journal of Intelligent Service Robotics 2 1 (2008) 23-30
61. Bergström N., Bohg J., and Kragic D. Integration of visual cues for robotic grasping. Computer Vision Systems. Lecture Notes in Computer Science vol. 5815 (2009), Springer, Berlin/Heidelberg 245-254 (Computer Science)