Multi-armed bandit models for 2D grasp planning with uncertainty

IEEE International Conference on Automation Science and Engineering

Volumn 2015-October, Issue , 2015, Pages 572-579

  Laskey, Michael ^a   Mahler, Jeff ^a   McCarthy, Zoe ^a   Pokorny, Florian T ^a   Patil, Sachin ^a   Van Den Berg, Jur ^d   Kragic, Danica ^c   Abbeel, Pieter ^a   Goldberg, Ken ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DEPARTMENT OF INDUSTRIAL ENGINEERING AND OPERATIONS RESEARCH   (United States)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^d GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; COMPUTATIONAL EFFICIENCY; FRICTION; GRIPPERS; ITERATIVE METHODS;

COEFFICIENT OF FRICTIONS; CONVERGENCE TIME; GAUSSIAN PROCESSES; IMPLICIT SURFACES; ITERATIVE PRUNING; MULTI ARMED BANDIT; ORDER FULFILLMENT; THOMPSON SAMPLINGS;

QUALITY CONTROL;

EID: 84952776707     PISSN: 21618070     EISSN: 21618089     Source Type: Conference Proceeding    
DOI: 10.1109/CoASE.2015.7294140     Document Type: Conference Paper

References (44)

1. S. Agrawal and N. Goyal, "Analysis of thompson sampling for the multi-armed bandit problem, " arXiv preprint arXiv: 1111. 1797, 2011.
2. P. Bachman and D. Precup, "Greedy confidence pursuit: A pragmatic approach to multi-bandit optimization, " in Machine Learning and Knowledge Discovery in Databases. Springer, 2013, pp. 241-256.
3. A. G. Barto, Reinforcement learning: An introduction. MIT press, 1998.
4. P. Brook, M. Ciocarlie, and K. Hsiao, "Collaborative grasp planning with multiple object representations, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA). IEEE, 2011, pp. 2851-2858.
5. Brown University Vision Lab, "2d planar database, " https: //vision. lems. brown. edu/content/available-software-and-databases.
6. R. E. Caflisch, "Monte carlo and quasi-monte carlo methods, " Acta numerica, vol. 7, pp. 1-49, 1998.
7. O. Chapelle and L. Li, "An empirical evaluation of thompson sampling, " in Advances in Neural Information Processing Systems, 2011, pp. 2249-2257.
8. J.-S. Cheong, H. Kruger, and A. F. van der Stappen, "Output-sensitive computation of force-closure grasps of a semi-algebraic object, " vol. 8, no. 3, pp. 495-505, 2011.
9. V. N. Christopoulos and P. Schrater, "Handling shape and contact location uncertainty in grasping two-dimensional planar objects, " in Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on. IEEE, 2007, pp. 1557-1563.
10. M. T. Ciocarlie and P. K. Allen, "Hand posture subspaces for dexterous robotic grasping, " Int. J. Robotics Research (IJRR), vol. 28, no. 7, pp. 851-867, 2009.
11. S. Dragiev, M. Toussaint, and M. Gienger, "Gaussian process implicit surfaces for shape estimation and grasping, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2011, pp. 2845-2850.
12. -, "Uncertainty aware grasping and tactile exploration, " in Robotics and Automation (ICRA), 2013 IEEE International Conference on. IEEE, 2013, pp. 113-119.
13. C. Ferrari and J. Canny, "Planning optimal grasps, " in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 1992, pp. 2290-2295.
14. J. Gittins, K. Glazebrook, and R. Weber, Multi-armed bandit allocation indices. John Wiley & Sons, 2011.
15. K. Glazebrook and D. Wilkinson, "Index-based policies for discounted multi-armed bandits on parallel machines, " Annals of Applied Probability, pp. 877-896, 2000.
16. K. Y. Goldberg and M. T. Mason, "Bayesian grasping, " in Robotics and Automation, 1990. Proceedings., 1990 IEEE International Conference on. IEEE, 1990, pp. 1264-1269.
17. K. Hang, F. T. Pokorny, and D. Kragic, "Friction coefficients and grasp synthesis, " in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan, 2013.
18. G. A. Hollinger, B. Englot, F. S. Hover, U. Mitra, and G. S. Sukhatme, "Active planning for underwater inspection and the benefit of adaptivity, " Int. J. Robotics Research (IJRR), vol. 32, no. 1, pp. 3-18, 2013.
19. K. Hsiao, M. Ciocarlie, and P. Brook, "Bayesian grasp planning, " in ICRA 2011 Workshop on Mobile Manipulation: Integrating Perception and Manipulation, 2011.
20. D. Hsu, G. Sánchez-Ante, and Z. Sun, "Hybrid prm sampling with a cost-sensitive adaptive strategy, " in Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on. IEEE, 2005, pp. 3874-3880.
21. B. Kehoe, D. Berenson, and K. Goldberg, "Estimating part tolerance bounds based on adaptive cloud-based grasp planning with slip, " in Automation Science and Engineering (CASE), 2012 IEEE International Conference on. IEEE, 2012, pp. 1106-1113.
22. -, "Toward cloud-based grasping with uncertainty in shape: Estimating lower bounds on achieving force closure with zero-slip push grasps, " in Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012, pp. 576-583.
23. B. Kehoe, S. Patil, P. Abbeel, and K. Goldberg, "A survey of research on cloud robotics and automation, " Automation Science and Engineering, IEEE Transactions on, vol. 12, no. 2, pp. 398-409, 2015.
24. F. Kelly et al., "Multi-armed bandits with discount factor near one: The bernoulli case, " The Annals of Statistics, vol. 9, no. 5, pp. 987-1001, 1981.
25. J. Kim, K. Iwamoto, J. J. Kuffner, Y. Ota, and N. S. Pollard, "Physically-based grasp quality evaluation under uncertainty, " in Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012, pp. 3258-3263.
26. T. L. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules, " Advances in applied mathematics, vol. 6, no. 1, pp. 4-22, 1985.
27. M. Lauri and R. Ritala, "Optimal sensing via multi-armed bandit relaxations in mixed observability domains, " in Robotics and Automation, 2015. ICRA 2015. Proceedings of the 2005 IEEE International Conference on. IEEE, 2015.
28. Z. Li and S. S. Sastry, "Task-oriented optimal grasping by multifingered robot hands, " Robotics and Automation, IEEE Journal of, vol. 4, no. 1, pp. 32-44, 1988.
29. G. Liu, J. Xu, X. Wang, and Z. Li, "On quality functions for grasp synthesis, fixture planning, and coordinated manipulation, " Automation Science and Engineering, IEEE Transactions on, vol. 1, no. 2, pp. 146-162, 2004.
30. J. Mahler, S. Patil, B. Kehoe, J. van den Berg, M. Ciocarlie, P. Abbeel, and K. Goldberg, "Gp-gpis-opt: Grasp planning under shape uncertainty using gaussian process implicit surfaces and sequential convex programming. "
31. P. Matikainen, P. M. Furlong, R. Sukthankar, and M. Hebert, "Multiarmed recommendation bandits for selecting state machine policies for robotic systems, " in Robotics and Automation (ICRA), 2013 IEEE International Conference on. IEEE, 2013, pp. 4545-4551.
32. MATLAB, version 7. 10. 0 (R2010a). Natick, Massachusetts: The MathWorks Inc., 2010.
33. A. T. Miller and P. K. Allen, "Graspit! a versatile simulator for robotic grasping, " Robotics & Automation Magazine, IEEE, vol. 11, no. 4, pp. 110-122, 2004.
34. B. Mooring and T. Pack, "Determination and specification of robot repeatability, " in Robotics and Automation. Proceedings. 1986 IEEE International Conference on, vol. 3. IEEE, 1986, pp. 1017-1023.
35. C. Rasmussen and C. Williams, Gaussian processes for machine learning. MIT Press, 2006.
36. H. Robbins, "Some aspects of the sequential design of experiments, " in Herbert Robbins Selected Papers. Springer, 1985, pp. 169-177.
37. M. Rothschild, "A two-armed bandit theory of market pricing, " Journal of Economic Theory, vol. 9, no. 2, pp. 185-202, 1974.
38. R. Simon, "Optimal two-stage designs for phase ii clinical trials, " Controlled clinical trials, vol. 10, no. 1, pp. 1-10, 1989.
39. N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger, "Gaussian process optimization in the bandit setting: No regret and experimental design, " arXiv preprint arXiv: 0912. 3995, 2009.
40. D. L. St-Pierre, Q. Louveaux, and O. Teytaud, "Online sparse bandit for card games, " in Advances in Computer Games. Springer, 2012, pp. 295-305.
41. F. Stulp, E. Theodorou, J. Buchli, and S. Schaal, "Learning to grasp under uncertainty, " in Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 2011, pp. 5703-5708.
42. R. Weber et al., "On the gittins index for multiarmed bandits, " The Annals of Applied Probability, vol. 2, no. 4, pp. 1024-1033, 1992.
43. J. Weisz and P. K. Allen, "Pose error robust grasping from contact wrench space metrics, " in Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012, pp. 557-562.
44. Y. Zheng and W.-H. Qian, "Coping with the grasping uncertainties in force-closure analysis, " Int. J. Robotics Research (IJRR), vol. 24, no. 4, pp. 311-327, 2005.