Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 1957-1964

  Mahler, Jeffrey ^a   Pokorny, Florian T ^a   Hou, Brian ^a   Roderick, Melrose ^a   Laskey, Michael ^a   Aubry, Mathieu ^a   Kohlhoff, Kai ^b   Kroger, Torsten ^b   Kuffner, James ^b   Goldberg, Ken ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FRICTION; IMAGE CLASSIFICATION; MOTION PLANNING; NEURAL NETWORKS; OBJECT RECOGNITION; ROBOT PROGRAMMING; ROBOTICS; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS;

3D OBJECT CLASSIFICATIONS; CONVOLUTIONAL NEURAL NETWORK; MULTI ARMED BANDIT; SAMPLING-BASED PLANNING; SIMILARITY METRICS; SYSTEM SENSITIVITY; THREE ORDERS OF MAGNITUDE; UPDATED INFORMATIONS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84977518138     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487342     Document Type: Conference Paper

References (47)

1. M. Aubry and B. Russell, "Understanding deep features with computergenerated imagery, " arXiv preprint arXiv: 1506. 01151, 2015.
2. R. Balasubramanian, L. Xu, P. D. Brook, J. R. Smith, and Y. Matsuoka, "Physical human interactive guidance: Identifying grasping principles from human-planned grasps, " Robotics, IEEE Transactions on, vol. 28, no. 4, pp. 899-910, 2012.
3. T. D. Barfoot and P. T. Furgale, "Associating uncertainty with threedimensional poses for use in estimation problems, " Robotics, IEEE Transactions on, vol. 30, no. 3, pp. 679-693, 2014.
4. C. Batty, "Sdfgen, " https: //github. com/christopherbatty/SDFGen.
5. J. Bohg, A. Morales, T. Asfour, and D. Kragic, "Data-driven grasp synthesisa survey, " Robotics, IEEE Transactions on, vol. 30, no. 2, pp. 289-309, 2014.
6. A. M. Bronstein, M. M. Bronstein, L. J. Guibas, and M. Ovsjanikov, "Shape google: Geometric words and expressions for invariant shape retrieval, " ACM Transactions on Graphics (TOG), vol. 30, 2011.
7. P. Brook, M. Ciocarlie, and K. Hsiao, "Collaborative grasp planning with multiple object representations, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA). IEEE, 2011, pp. 2851-2858.
8. B. Calli, A. Walsman, A. Singh, S. Srinivasa, P. Abbeel, and A. M. Dollar, "Benchmarking in manipulation research: The ycb object and model set and benchmarking protocols, " arXiv preprint arXiv: 1502. 03143, 2015.
9. R. Detry, C. H. Ek, M. Madry, and D. Kragic, "Learning a dictionary of prototypical grasp-predicting parts from grasping experience, " in Robotics and Automation (ICRA), 2013 IEEE International Conference on. IEEE, 2013, pp. 601-608.
10. R. Detry, D. Kraft, O. Kroemer, L. Bodenhagen, J. Peters, N. Krüger, and J. Piater, "Learning grasp affordance densities, " Paladyn, Journal of Behavioral Robotics, vol. 2, no. 1, pp. 1-17, 2011.
11. R. Goetschalckx, P. Poupart, and J. Hoey, "Continuous correlated beta processes, " in IJCAI Proceedings-International Joint Conference on Artificial Intelligence, vol. 22, no. 1. Citeseer, 2011, p. 1269.
12. C. Goldfeder and P. K. Allen, "Data-driven grasping, " Autonomous Robots, vol. 31, no. 1, pp. 1-20, 2011.
13. C. Goldfeder, M. Ciocarlie, H. Dang, and P. K. Allen, "The columbia grasp database, " in Robotics and Automation, 2009. ICRA'09. IEEE International Conference on. IEEE, 2009, pp. 1710-1716.
14. A. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger, S. Satheesh, S. Sengupta, A. Coates, et al., "Deepspeech: Scaling up end-to-end speech recognition, " arXiv preprint arXiv: 1412. 5567, 2014.
15. A. Herzog, P. Pastor, M. Kalakrishnan, L. Righetti, J. Bohg, T. Asfour, and S. Schaal, "Learning of grasp selection based on shape-templates, " Autonomous Robots, vol. 36, no. 1-2, pp. 51-65, 2014.
16. M. W. Hoffman, B. Shahriari, and N. de Freitas, "Exploiting correlation and budget constraints in Bayesian multi-armed bandit optimization, " arXiv preprint arXiv: 1303. 6746, 2013.
17. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding, " arXiv preprint arXiv: 1408. 5093, 2014.
18. D. Kappler, J. Bohg, and S. Schaal, "Leveraging big data for grasp planning, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2015.
19. A. Kasper, Z. Xue, and R. Dillmann, "The kit object models database: An object model database for object recognition, localization and manipulation in service robotics, " The International Journal of Robotics Research, vol. 31, no. 8, pp. 927-934, 2012.
20. B. Kehoe, D. Berenson, and K. Goldberg, "Toward cloud-based grasping with uncertainty in shape: Estimating lower bounds on achieving force closure with zero-slip push grasps, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA). IEEE, 2012, pp. 576-583.
21. B. Kehoe, A. Matsukawa, S. Candido, J. Kuffner, and K. Goldberg, "Cloud-based robot grasping with the google object recognition engine, " in Robotics and Automation (ICRA), 2013 IEEE International Conference on. IEEE, 2013, pp. 4263-4270.
22. B. Kehoe, S. Patil, P. Abbeel, and K. Goldberg, "A survey of research on cloud robotics and automation, " Automation Science and Engineering, IEEE Transactions on, vol. 12, no. 2, pp. 398-409, 2015.
23. J. Kim, K. Iwamoto, J. J. Kuffner, Y. Ota, and N. S. Pollard, "Physically based grasp quality evaluation under pose uncertainty, " IEEE Trans. Robotics, vol. 29, no. 6, pp. 1424-1439, 2013.
24. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in Advances in neural information processing systems, 2012, pp. 1097-1105.
25. O. Kroemer, R. Detry, J. Piater, and J. Peters, "Combining active learning and reactive control for robot grasping, " Robotics and Autonomous Systems, vol. 58, no. 9, pp. 1105-1116, 2010.
26. M. Laskey, J. Mahler, Z. McCarthy, F. Pokorny, S. Patil, J. van den Berg, D. Kragic, P. Abbeel, and K. Goldberg, "Multi-arm bandit models for 2d sample based grasp planning with uncertainty. " in Proc. IEEE Conf. on Automation Science and Engineering (CASE). IEEE, 2015.
27. I. Lenz, H. Lee, and A. Saxena, "Deep learning for detecting robotic grasps, " The International Journal of Robotics Research, vol. 34, no. 4-5, pp. 705-724, 2015.
28. B. Li, Y. Lu, C. Li, A. Godil, T. Schreck, M. Aono, M. Burtscher, Q. Chen, N. K. Chowdhury, B. Fang, et al., "A comparison of 3d shape retrieval methods based on a large-scale benchmark supporting multimodal queries, " Computer Vision and Image Understanding, vol. 131, pp. 1-27, 2015.
29. J. Mahler, S. Patil, B. Kehoe, J. van den Berg, M. Ciocarlie, P. Abbeel, and K. Goldberg, "Gp-gpis-opt: Grasp planning under shape uncertainty using Gaussian process implicit surfaces and sequential convex programming, " 2015.
30. D. Maturana and S. Scherer, "Voxnet: A 3d convolutional neural network for real-time object recognition, " in Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2015.
31. L. Montesano and M. Lopes, "Active learning of visual descriptors for grasping using non-parametric smoothed beta distributions, " Robotics and Autonomous Systems, vol. 60, no. 3, pp. 452-462, 2012.
32. J. Oberlin and S. Tellex, "Autonomously acquiring instance-based object models from experience, " in Int. S. Robotics Research (ISRR), 2015.
33. L. Pinto and A. Gupta, "Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2016.
34. F. T. Pokorny, K. Hang, and D. Kragic, "Grasp moduli spaces. " in Robotics: Science and Systems, 2013.
35. F. T. Pokorny and D. Kragic, "Classical grasp quality evaluation: New theory and algorithms, " in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2013.
36. M. Salganicoff, L. H. Ungar, and R. Bajcsy, "Active learning for vision-based robot grasping, " Machine Learning, vol. 23, no. 2-3, pp. 251-278, 1996.
37. S. Salti, F. Tombari, and L. Di Stefano, "Shot: Unique signatures of histograms for surface and texture description, " Computer Vision and Image Understanding, vol. 125, pp. 251-264, 2014.
38. A. Singh, J. Sha, K. S. Narayan, T. Achim, and P. Abbeel, "Bigbird: A large-scale 3d database of object instances, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2014.
39. G. Smith, E. Lee, K. Goldberg, K. Bohringer, and J. Craig, "Computing parallel-jaw grips, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 1999.
40. N. Srinivas, A. Krause, S. Kakade, and M. Seeger, "Gaussian process optimization in the bandit setting: No regret and experimental design, " in Proc. International Conference on Machine Learning (ICML), 2010.
41. T. Stouraitis, U. Hillenbrand, and M. A. Roa, "Functional power grasps transferred through warping and replanning, " in Robotics and Automation (ICRA), 2015 IEEE International Conference on. IEEE, 2015, pp. 4933-4940.
42. H. Su, S. Maji, E. Kalogerakis, and E. Learned-Miller, "Multi-view convolutional neural networks for 3d shape recognition, " arXiv preprint arXiv: 1505. 00880, 2015.
43. J. Weisz and P. K. Allen, "Pose error robust grasping from contact wrench space metrics, " in Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012, pp. 557-562.
44. W. Wohlkinger, A. Aldoma, R. B. Rusu, and M. Vincze, "3dnet: Largescale object class recognition from cad models, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2012.
45. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao, "3d shapenets: A deep representation for volumetric shape modeling, " in CVPR, vol. 1, no. 2, 2015, p. 3.
46. L. E. Zhang, M. Ciocarlie, and K. Hsiao, "Grasp evaluation with graspable feature matching, " in RSS Workshop on Mobile Manipulation: Learning to Manipulate, 2011.
47. Y. Zheng and W.-H. Qian, "Coping with the grasping uncertainties in force-closure analysis, " Int. J. Robotics Research (IJRR), vol. 24, no. 4, pp. 311-327, 2005.