Physical modeling of a bag knot in a robot learning system

IEEE Transactions on Automation Science and Engineering

Volumn 7, Issue 1, 2010, Pages 172-177

  Kartoun, Uri ^a   Shapiro, Amir ^a   Stern, Helman ^a   Edan, Yael ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Intelligent robots; Reinforcement learning; Robot kinematics; Robot learning

Indexed keywords

EXPERIMENTAL ROBOTICS; EXPERIMENTAL SYSTEM; LEARNING TASKS; MINIMUM TIME; NEWTON'S LAWS OF MOTION; OPTIMAL POLICIES; OPTIMAL SEQUENCE; PHYSICAL MODEL; PHYSICAL MODELING; ROBOT KINEMATICS; ROBOT SYSTEM;

INTELLIGENT ROBOTS; KINEMATICS; MODELS; OPTIMIZATION; PHILOSOPHICAL ASPECTS; PLASTIC CONTAINERS; PLASTICS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOT LEARNING;

LEARNING ALGORITHMS;

EID: 73849115394     PISSN: 15455955     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASE.2009.2013133     Document Type: Article

References (23)

1. W. Zhu and S. Levinson, "Vision-based reinforcement learning for robot navigation," in Proc. Int. Joint Conf. Neural Netw., Washington, DC, 2001, vol. 2, pp. 1025-1030.
2. V. N. Papudesi and M. Huber, "Learning from reinforcement and advice using composite reward functions," in Proc. 16th Int. FLAIRS Conf., St. Augustine, FL, 2003, pp. 361-365.
3. V. N. Papudesi, Y. Wang, M. Huber, and D. J. Cook, "Integrating user commands and autonomous task performance in a reinforcement learning framework," in Proc. AAAI Spring Symp. Human Interaction Autonom. Syst.Complex Environ., Stanford, CA, 2003, pp. 160-165, Stanford Univ.
4. P. Kui-Hong, J. Jun, and K. Jong-Hwan, "Stabilization of biped robot based on two mode Q-learning," in Proc. 2nd Int. Conf. Autonom. Robots Agents, 2004, pp. 446-451.
5. R. Broadbent and T. Peterson, "Robot learning in partially observable, noisy, continuous worlds," in Proc. 2005 IEEE Int. Conf. Robot. Autom., Barcelona, Spain, 2005, pp. 4386-4393.
6. B. Bakker, V. Zhumatiy, G. Gruener, and J. Schmidhuber, "Quasi-online reinforcement learning for robots," in Proc. 2006 IEEE Int. Conf. Robot. Autom., 2006, pp. 2997-3002.
7. U. Kartoun, H. Stern, and Y. Edan, "Human-robot collaborative learning system for inspection," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Taipei, Taiwan, Oct. 2006, pp. 4249-4255.
8. L. Mihalkova and R. Mooney, "Using active relocation to aid reinforcement," in Proc. 19th Int. FLAIRS Conf. (FLAIRS-2006), Melbourne Beach, FL, 2006, pp. 580-585.
9. R. Ganesan, T. K. Das, and K. M. Ramachandran, "A multiresolution analysis-assisted reinforcement learning approach to run-by-run control," IEEE Trans. Autom. Sci. Eng., vol. 4, no. 2, pp. 182-193, 2007.
10. C. J. C. H. Watkins, "Learning from delayed rewards," Ph.D. dissertation, Psychol. Dept., Cambridge Univ., Cambridge, U.K., 1989.
11. J. Peng and R. Williams, "Incremental multi-step Q-learning," Mach. Learn., vol. 22, no. 1-3, pp. 283-290, 1996.
12. Y. Dahmani and A. Benyettou, "Seek of an optimal way by Q-learning," J. Comput. Sci., vol. 1, no. 1, pp. 28-30, 2005.
13. J. Takamatsu, T. Morita, K. Ogawara, H. Kimura, and K. Ikeuchi, "Representation for knot-tying tasks," IEEE Trans. Robot., vol. 22, no. 1, pp. 65-78, 2006.
14. H. Wakamatsu, A. Eiji, and H. Shinichi, "Knotting/unknotting manipulation of deformable linear objects," Int. J. Robot. Res., vol. 25, no. 4, pp. 371-395, 2006.
15. T. Matsuno and T. Fukuda, "Manipulation of flexible rope using topological model based on sensor information," in Proc. Int. Conf. Intell. Robots Syst., 2006, pp. 2638-2643.
16. M. Saha and P. Isto, "Motion planning for robotic manipulation of deformable linear objects," in Proc. Int. Conf. Intell. Robots Autom., 2007, vol. 23, no. 6, pp. 1141-1150.
17. C. Ribeiro, "Reinforcement learning agents," Artificial Intelligence Review, vol. 17, no. 3, pp. 223-250, 2002.
18. W. D. Smart and L. Kaelbling, "Practical reinforcement learning in continuous spaces," in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 903-910.
19. C. J. C. H. Watkins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, pp. 279-292, 1992.
20. P. Y. Glorennec, "Reinforcement learning: An overview," in Eur. Symp. Intell. Tech., Aachen, Germany, 2000, pp. 17-35.
21. Y. Wang, M. Huber, V. N. Papudesi, and D. J. Cook, "User-guided reinforcement learning of robot assistive tasks for an intelligent environment," in Proc. IEEE/RJS Int. Conf. Intell. Robots Syst., 2003, vol. 1, pp. 424-429.
22. U. Kartoun, H. Stern, and Y. Edan, "Bag classification using support vector machines," in Applied Soft Computing Technologies: The Challenge of Complexity Series: Advances in Soft Computing. Heidelberg, Germany: Springer Berlin, 2006, pp. 665-674.
23. U. Kartoun, "Human-Robot Collaborative Learning Methods," Ph.D. dissertation, Dept. of Ind. Eng. Manage., Ben-Gurion Univ. of the Negev, Beer-Sheva, Israel, 2007.