A strategy for grasping unknown objects based on co-planarity and colour information

Robotics and Autonomous Systems

Volumn 58, Issue 5, 2010, Pages 551-565

  Popović, Mila ^a   Kraft, Dirk ^a   Bodenhagen, Leon ^a   Başeski, Emre ^a   Pugeault, Nicolas ^b   Kragic, Danica ^c   Asfour, Tamim ^d   Krüger, Norbert ^a  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b UNIVERSITY OF SURREY   (United Kingdom)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^d KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

Cognitive systems; Early cognitive vision; Vision based grasping

Indexed keywords

ACTION SEQUENCES; APPEARANCE BASED; AUTONOMOUS EXPLORATION; CLUTTERED SCENES; CO-OCCURRENCE; COLOUR PROPERTIES; COMPLEX ENVIRONMENTS; COPLANARITY; EARLY COGNITIVE VISION; FORCE-TORQUE SENSORS; GEOMETRIC INFORMATION; GRASPING MECHANISMS; HAPTIC FEEDBACKS; LEVEL PROCESS; MULTI-MODAL; MULTIPLE OBJECTS; OBJECT LEARNING; PRIOR KNOWLEDGE; SECOND ORDERS; UNKNOWN OBJECTS; VISION BASED; VISION BASED GRASPING;

BRAIN; COMPUTER VISION; LEARNING ALGORITHMS; NAVIGATION;

COGNITIVE SYSTEMS;

EID: 77950188636     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2010.01.003     Document Type: Article

References (68)

1. A. Bicchi, V. Kumar, Robotic grasping and contact: A review, in: Proceedings of IEEE International Conference on Robotics and Automation, 2000, pp. 348-353.
2. L. Natale, F. Orabona, G. Metta, G. Sandini, Exploring the world through grasping: A developmental approach, in: Computational Intelligence in Robotics and Automation, 2005. CIRA 2005. Proceedings. 2005 IEEE International Symposium on, 2005, 559-565.
3. Recatalá G., Chinellato E., Pobil A.P.D., Mezouar Y., and Martinet P. Biologically-inspired 3D grasp synthesis based on visual exploration. Autonomous Robots 25 1-2 (2008) 59-70
4. K. Huebner, S. Ruthotto, D. Kragic, Minimum volume bounding box decomposition for shape approximation in robot grasping, in: Proceedings of the 2008 IEEE International Conference on Robotics and Automation, 2008, pp. 1628-1633.
5. C. Borst, M. Fischer, G. Hirzinger, Grasp planning: How to choose a Suitable Task Wrench space New Orleans, LA, USA, 2004 pp. 319-325.
6. Ding D., Liu Y.-H., and Wang S. The synthesis of 3-d form-closure grasps. Robotica 18 1 (2000) 51-58
7. Buss M., Hashimoto H., and Moore J.B. Dextrous hand grasping force optimization. Robotics and Automation, IEEE Transactions on 12 3 (1996) 406-418
8. R. Platt, Learning grasp strategies composed of contact relative motions, in: IEEE-RAS International Conference on Humanoid Robotsm, 2007.
9. R. Pelossof, A. Miller, P. Allen, T. Jebara, An SVM learning approach to robotic grasping, in: Robotics and Automation, 2004. Proceedings. ICRA'04. 2004 IEEE International Conference on, vol. 4, 2004, pp. 3512-3518.
10. A. Saxena, J. Driemeyer, J. Kearns, C. Osondu, A.Y. Ng, Learning to grasp novel objects using vision, in: 10th International Symposium of Experimental Robotics, ISER, 2006.
11. Kellman P.J., and Arterberry M.E. The Cradle of Knowledge: Development of Perception in Infancy (Learning, Development, and Conceptual Change) (1998), The MIT Press
12. D. Kraft, N. Pugeault, E. Başeski, M. Popović, D. Kragic, S. Kalkan, F. Wörgötter, N. Krüger, Birth of the object: Detection of objectness and extraction of object shape through object action complexes, in: Cognitive Humanoid Robots, International Journal of Humanoid Robotics (special issue) (in press).
13. R. Detry, M. Popović, Y.P. Touati, E. Başeski, N. Krüger, J. Piater, Autonomous learning of object-specific grasp affordance densities, in: 8th International Conference on Development and Learning,.
14. N. Pugeault, F. Wörgötter, N. Krüger, Accumulated visual representation for cognitive vision, in: British Machine Vision Conference, 2008.
15. D. Aarno, J. Sommerfeld, D. Kragić, N. Pugeault, S. Kalkan, F. Wörgötter, D. Kraft, N. Krüger, Early reactive grasping with second order 3d feature relations, in: IEEE International Conference on Robotics and Automation, ICRA, Workshop: From Features to Actions - Unifying Perspectives in Computational and Robot Vision, 2007.
16. R. Detry, N. Pugeault, J.H. Piater, Probabilistic pose recovery using learned hierarchical object models, in: International Cognitive Vision Workshop (Workshop at the 6th International Conference on Vision Systems), 2008.
17. R. Detry, J. Piater, A probabilistic framework for 3d visual object representation, IEEE PAMI.
18. Bicchi A. On the closure properties of robotic grasping. International Journal of Robotics Research 14 (1995) 319-334
19. Maekawa H., Tanie K., and Komoriya K. Tactile feedback for multifingered dynamic grasping. Control Systems Magazine, IEEE 17 1 (1997) 63-71
20. J. Tegin, S. Ekvall, D. Kragic, B. Iliev, J. Wikander, Demonstration based learning and control for automatic grasping, in: Proc. of the International Conference on Advanced Robotics, 2007.
21. A.T. Miller, S. Knoop, H. Christensen, P.K. Allen, Automatic grasp planning using shape primitives, in: Proceedings of the IEEE International Conference on Robotics and Automation, 2003, vol. 2, 2003, pp. 1824-1829.
22. Aydin K.K. Fuzzy logic, grasp preshaping for robot hands. ISUMA'95: Proceedings of the 3rd International Symposium on Uncertainty Modelling and Analysis (1995), IEEE Computer Society, Washington, DC, USA 520-523
23. Cutkosky M.R. On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Transactions on Robotics and Automation 5 3 (1989) 269-279
24. Iberall T. Human prehension and dexterous robot hands. The International Journal of Robotics Research 16 3 (1997) 285-299
25. Miller A.T., and Allen P.K. GraspIt!: A Versatile Simulator for Robotic Grasping. Robotics & Automation Magazine, IEEE 11 4 (2004) 110-122
26. J. Jørgensen, H. Petersen, Usage of simulations to plan stable grasping of unknown objects with a 3-fingered Schunk hand, in: Workshop on Robot Simulators: Available Software, Scientific Applications and Future Trends, ICRA, 2008.
27. S. Ekvall, D. Kragic, Integrating object and grasp recognition for dynamic scene interpretation, in: IEEE International Conference on Advanced Robotics, 2005. ICAR'05, 2005, pp. 331-336.
28. Steil J., Röthling F., Haschke R., and Ritter H. Situated robot learning for multi-modal instruction and imitation of grasping. Robotics and Autonomous Systems 47 (2004) 129-141 (special issue)
29. R. Dillmann, M. Kaiser, A. Ude, Acquisition of elementary robot skills from human demonstration, in: International Symposium on Intelligent Robotics Systems, 1995, pp. 185-192.
30. Scape Technologies, http://www.scapetechnologies.com/.
31. Salganicoff M., Ungar L.H., and Bajcsy R. Active learning for vision-based robot grasping. Machine Learning 23 2-3 (1996) 251-278
32. R. Mario, V. Markus, Grasping of unknown objects from a table top, in: Workshop on Vision in Action: Efficient Strategies for Cognitive Agents in Complex Environments, ViA08, 2008.
33. Taylor M.J., and Blake A. Grasping the Apparent Contour. ECCV '94: Proceedings of the Third European Conference-Volume II on Computer Vision (1994), Springer-Verlag, London, UK 25-34
34. Bekey G., Liu H., Tomović R., and Karplus W. Knowledge-based control of grasping in robot hands using heuristics from human motor skills. IEEE Transactions on Robotics and Automation 9 6 (1993) 709-722
35. E. Chinellato, R.B. Fisher, A. Morales, A.P.D. Pobil, Ranking planar grasp configurations for a three-finger hand, in: ICRA, 2003, pp. 1133-1138.
36. Morales A., Sanz P.J., Pobil A.P.D., and Fagg A.H. Vision-based three-finger grasp synthesis constrained by hand geometry. Robotics and Autonomous Systems 54 6 (2006) 496-512
37. D.P. Perrin, C.E. Smith, O. Masoud, N. Papanikolopoulos, Unknown object grasping using statistical pressure models, in: Proceedings of the 2000 IEEE International Conference on Robotics and Automation, ICRA 2000, April 24-28, 2000, San Francisco, CA, USA, 2000, pp. 1054-1059.
38. G. Taylor, L. Kleeman, Grasping unknown objects with a humanoid Robot, in: Proceedings 2002 Australasian Conference on Robotics and Automation, 2002, pp. 191-196.
39. F. Ade, M. Rutishauser, M. Trobina, Grasping unknown objects, in: Proceedings of Dagstuhl Seminar: Environment Modeling and Motion Planning for Autonomous Robots, World, 1995, pp. 445-459.
40. B. Wang, L. Jiang, J. LI, H. Cai, Grasping unknown objects based on 3D model reconstruction, in: Advanced Intelligent Mechatronics. Proceedings, 2005 IEEE/ASME International Conference on, 2005 pp. 461-466.
41. Jefferson A., Coelho J., Piater J.H., and Grupen R.A. Developing haptic and visual perceptual categories for reaching and grasping with a humanoid robot. Robotics and Autonomous Systems 37 2-3 (2001) 195-218
42. J.J. Gibson, The Ecological Approach to Visual Perception, Lawrence Erlbaum Associates.
43. Fritz G., Paletta L., Kumar M., Dorffner G., Breithaupt R., and Rome E. Visual learning of affordance based cues. Simulation of Adaptive Behavior, vol. 4095 (2006) 52-64
44. J. Steffen, R. Haschke, H. Ritter, Experience-based and tactile-driven dynamic grasp control, in: Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on, 2007, pp. 2938-2943.
45. J. Tegin, S. Ekvall, D. Kragic, B. Iliev, J. Wikander, Demonstration based learning and control for automatic grasping, in: Int. Conf. on Advanced Robotics, Jeju, Korea, 2007.
46. Grasping Video, http://www.mip.sdu.dk/covig/videos/graspingReflexCompressed.divx.
47. Krüger N., Lappe M., and Wörgötter F. Biologically motivated multi-modal processing of visual primitives. The Interdisciplinary Journal of Artificial Intelligence and the Simulation of Behaviour 1 5 (2004) 417-428
48. Pugeault N. Early Cognitive Vision: Feedback Mechanisms for the Disambiguation of Early Visual Representation (2008), VDM Verlag Dr. Müller
49. N. Pugeault, F. Wörgötter, N. Krüger, Multi-modal scene reconstruction using perceptual grouping constraints, in: Proc. IEEE Workshop on Perceptual Organization in Computer Vision (in conjunction with CVPR'06), 2006.
50. S. Kalkan, Multi-modal statistics of local image structures and its applications for depth prediction, Ph. D. thesis, University of Goettingen, Germany, 2008.
51. RobWork, http://www.mip.sdu.dk/robwork/.
52. The Orocos real-time toolkit, http://www.orocos.org/rtt.
53. J.J. Kuffner, J. Steven, M. Lavalle, Rrt-connect: An efficient approach to single-query path planning, in: In Proc. IEEE Intl Conf. on Robotics and Automation, 2000, pp. 995-1001.
54. E. Larsen, S. Gottshalck, M. Lin, D. Manocha, Fast proximity queries with swept sphere volumes, Tech. Rep. TR99-018, Department of Computer Science, University of North Carolina, 1999.
55. M. Popović, An early grasping reflex in a cognitive robot vision system, Master's thesis. Cognitive Vision Lab, The Mærsk Mc-Kinney Møller Institute, University of Southern Denmark, 2008.
56. A. Dollar, R. Howe, Simple, reliable robotic grasping for human environments, in: Technologies for Practical Robot Applications, 2008. TePRA 2008. IEEE International Conference on, 2008, pp. 156-161.
57. Jiang L., Sun D., and Liu H. An inverse-kinematics table-based solution of a humanoid robot finger with nonlinearly coupled joints. Mechatronics, IEEE/ASME Transactions on 14 3 (2009) 273-281
58. T. Asfour, K. Regenstein, P. Azad, J. Schroder, A. Bierbaum, N. Vahrenkamp, R. Dillmann, ARMAR-III: An integrated humanoid platform for sensory-motor control, in: Humanoid Robots, 2006 6th IEEE-RAS International Conference on, 2006, pp. 169-175.
59. Arbib M., Iberall T., and Lyons D. Coordinated control programs for movements of the hand. Experimental Brain Research (1985) 111-129
60. M.R. Cutkosky, R.D. Howe, Human grasp choice and robotic grasp analysis, 1990, pp. 5-31.
61. I. Gaiser, S. Schulz, A. Kargov, H. Klosek, A. Bierbaum, C. Pylatiuk, R. Oberle, T. Werner, T. Asfour, G. Bretthauer, R. Dillmann, A new anthropomorphic robotic hand, in: Humanoid Robots, 2008. Humanoids 2008, 8th IEEE-RAS International Conference on, 2008, pp. 418-422.
62. Grasping reflex on the humanoid robot ARMAR-III, http://www.mip.sdu.dk/covig/videos/GraspReflexHumanoid.avi.
63. PACO-PLUS: Perception, Action and Cognition through learning of Object-Action Complexes, IST-FP6-IP-027657, Integrated Project, 2006-2010.
64. Baddeley A.D. Essentials of Human Memory (1999), Psychology Press, Taylor and Francis
65. N. Pugeault, S. Kalkan, E. Başeski, F. Wörgötter, N. Krüger, Reconstruction uncertainty and 3D relations, in: Proceedings of Int. Conf. on Computer Vision Theory and Applications, VISAPP'08, 2008.
66. L. Bodenhagen, Project in artificial intelligence, http://www.mip.sdu.dk/covig/publications/reportAIP.pdf, 2008.
67. L. Bodenhagen, D. Kraft, M. Popović, E. Başeski, P.E. Hotz, N. Krüger, Learning to grasp unknown objects based on 3d edge information, in: IEEE International Symposium on Computational Intelligence in Robotics and Automation.
68. Pauli J., Hexmoor H., and Mataric M. Learning to recognize and grasp objects. Autonomous Robots 5 (1998) 239-258