Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 3406-3413

  Pinto, Lerrel ^a   Gupta, Abhinav ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS; ROBOT LEARNING; ROBOTS; SEMANTICS;

BINARY CLASSIFICATION; CONVOLUTIONAL NEURAL NETWORK; CURRENT MODELING; LABELED DATASETS; LARGE-SCALE DATASETS; LEARNING APPROACH; REGRESSION PROBLEM; STATE-OF-THE-ART PERFORMANCE;

ROBOTICS;

EID: 84977599666     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487517     Document Type: Conference Paper

References (36)

1. Rodney A Brooks. Planning collision-free motions for pick-and-place operations. IJRR, 2 (4): 19-44, 1983.
2. Karun B Shimoga. Robot grasp synthesis algorithms: A survey. IJRR, 15 (3): 230-266, 1996.
3. Tomás Lozano-Pérez, Joseph L. Jones, Emmanuel Mazer, and Patrick A. O'Donnell. Task-level planning of pick-and-place robot motions. IEEE Computer, 22 (3): 21-29, 1989.
4. Van-Duc Nguyen. Constructing force-closure grasps. IJRR, 7 (3): 3-16, 1988.
5. B Boser Le Cun, John S Denker, D Henderson, Richard E Howard, W Hubbard, and Lawrence D Jackel. Handwritten digit recognition with a back-propagation network. In NIPS. Citeseer, 1990.
6. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097-1105, 2012.
7. Bruno A Olshausen and David J Field. Sparse coding with an overcomplete basis set: A strategy employed by v1 Vision research, 37 (23): 3311-3325, 1997.
8. Yun Jiang, Stephen Moseson, and Ashutosh Saxena. Efficient grasping from rgbd images: Learning using a new rectangle representation. In ICRA 2011, pages 3304-3311. IEEE, 2011.
9. Sergey Levine, Chelsea Finn, Trevor Darrell, and Pieter Abbeel. End-to-end training of deep visuomotor policies. ArXiv preprint arXiv: 1504. 00702, 2015.
10. Stéphane Ross, Geoffrey J Gordon, and J Andrew Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. ArXiv preprint arXiv: 1011. 0686, 2010.
11. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al. Human-level control through deep reinforcement learning. Nature, 518 (7540): 529-533, 2015.
12. Antonio Bicchi and Vijay Kumar. Robotic grasping and contact: A review. In ICRA, pages 348-353. Citeseer, 2000.
13. Jeannette Bohg, Antonio Morales, Tamim Asfour, and Danica Kragic. Data-driven grasp synthesisa survey. Robotics, IEEE Transactions on, 30 (2): 289-309, 2014.
14. Corey Goldfeder, Matei Ciocarlie, Hao Dang, and Peter K Allen. The columbia grasp database. In ICRA 2009, pages 1710-1716. IEEE, 2009.
15. Gert Kootstra, Mila Popovíc, Jimmy Alison Jørgensen, Danica Kragic, Henrik Gordon Petersen, and Norbert Krüger. Visgrab: A benchmark for vision-based grasping. Paladyn, 3 (2): 54-62, 2012.
16. D. Kappler, B. Bohg, and S. Schaal. Leveraging big data for grasp planning. In Proceedings of the IEEE International Conference on Robotics and Automation, may 2015.
17. Andrew T Miller and Peter K Allen. Graspit a versatile simulator for robotic grasping. Robotics & Automation Magazine, IEEE, 11 (4): 110-122, 2004.
18. Andrew T Miller, Steffen Knoop, Henrik I Christensen, and Peter K Allen. Automatic grasp planning using shape primitives. In ICRA 2003.
19. Rosen Diankov. Automated construction of robotic manipulation programs. PhD thesis, Citeseer, 2010.
20. Jonathan Weisz and Peter K Allen. Pose error robust grasping from contact wrench space metrics. In ICRA 2012.
21. Ashutosh Saxena, Justin Driemeyer, and Andrew Y Ng. Robotic grasping of novel objects using vision. IJRR, 27 (2): 157-173, 2008.
22. Luis Montesano and Manuel Lopes. Active learning of visual descriptors for grasping using non-parametric smoothed beta distributions. Robotics and Autonomous Systems, 60 (3): 452-462, 2012.
23. Ian Lenz, Honglak Lee, and Ashutosh Saxena. Deep learning for detecting robotic grasps. ArXiv preprint arXiv: 1301. 3592, 2013.
24. Arnau Ramisa, Guillem Alenya, Francesc Moreno-Noguer, and Carme Torras. Using depth and appearance features for informed robot grasping of highly wrinkled clothes. In ICRA 2012, pages 1703-1708. IEEE, 2012.
25. Antonio Morales, Eris Chinellato, Andrew H Fagg, and Angel P Del Pobil. Using experience for assessing grasp reliability. IJRR.
26. Renaud Detry, Emre Baseski, Mila Popovic, Younes Touati, N Kruger, Oliver Kroemer, Jan Peters, and Justus Piater. Learning object-specific grasp affordance densities. In ICDL 2009.
27. Robert Paolini, Alberto Rodriguez, Siddhartha Srinivasa, and Matthew T. Mason. A data-driven statistical framework for postgrasp manipulation. IJRR, 33 (4): 600-615, April 2014.
28. Sergey Levine, Nolan Wagener, and Pieter Abbeel. Learning contactrich manipulation skills with guided policy search. ArXiv preprint arXiv: 1501. 05611, 2015.
29. Abdeslam Boularias, James Andrew Bagnell, and Anthony Stentz. Learning to manipulate unknown objects in clutter by reinforcement. In AAAI 2015.
30. Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR 2014, pages 580-587. IEEE, 2014.
31. Joseph Redmon and Anelia Angelova. Real-time grasp detection using convolutional neural networks. ArXiv preprint arXiv: 1412. 3128, 2014.
32. Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y Ng. Ros: An open-source robot operating system. In ICRA, volume 3, page 5, 2009.
33. Ioan A. şucan, Mark Moll, and Lydia E. Kavraki. IEEE Robotics & Automation Magazine.
34. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. Caffe: Convolutional architecture for fast feature embedding. ArXiv preprint arXiv: 1408. 5093, 2014.
35. Dov Katz, Arun Venkatraman, Moslem Kazemi, J Andrew Bagnell, and Anthony Stentz. Perceiving, learning, and exploiting object affordances for autonomous pile manipulation. Autonomous Robots.
36. Navneet Dalal and Bill Triggs. Histograms of oriented gradients for human detection. In CVPR 2005.