Policy gradient based reinforcement learning for real autonomous underwater cable tracking

2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

Volumn , Issue , 2008, Pages 3635-3640

  El Fakdi, Andres ^a   Carreras, Marc ^a  

^a UNIVERSITY OF GIRONA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; AUTONOMOUS ROBOT; CONVERGENCE TIME; DIRECT POLICY SEARCH; FIELD APPLICATION; LEARNING PHASE; LEARNING PROCESS; POLICY GRADIENT; REAL ROBOT; SIMULATED ENVIRONMENT; SPEED-UPS; UNDERWATER CABLES; UNDERWATER ROBOTS;

AUTONOMOUS UNDERWATER VEHICLES; CABLES; CONVERGENCE OF NUMERICAL METHODS; EDUCATION; INTELLIGENT ROBOTS; REINFORCEMENT; REINFORCEMENT LEARNING;

ROBOTICS;

EID: 69549136968     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2008.4650873     Document Type: Conference Paper

References (23)

1. R. Sutton and A. Barto, Reinforcement Learning, an introduction. MIT Press, 1998.
2. R. Sutton, D. McAllester, S. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," Advances in Neural Information Processing Systems, vol.12, pp. 1057-1063, 2000.
3. C. Anderson, "Approximating a policy can be easier than approximating a value function," University of Colorado State," Computer Science Technical Report, 2000.
4. D. A. Aberdeen, "Policy-gradient algorithms for partially observable markov decision processes," Ph.D. dissertation, Australian National University, April 2003.
5. J. Bagnell and J. Schneider, "Autonomous helicopter control using reinforcement learning policy search methods," in Proceedings of the IEEE International Conference on Robotics and Automation, Korea, 2001.
6. M. Rosenstein and A. Barto, "Robot weightlifting by direct policy search," in Proceedings of the International Joint Conference on Artificial Intelligence, 2001.
7. N. Kohl and P. Stone, "Policy gradient reinforcement learning for fast quadrupedal locomotion," in IEEE International Conference on Robotics and Automation (ICRA), 2004.
8. P. Marbach and J. N. Tsitsiklis, "Gradient-based optimization of Markov reward processes: Practical variants," Center for Communications Systems Research, University of Cambridge, Tech. Rep., March 2000.
9. V. Konda and J. Tsitsiklis, "On actor-critic algorithms," SIAM Journal on Control and Optimization, vol.42, number 4, pp. 1143-1166, 2003.
10. N. Meuleau, L. Peshkin, and K. Kim, "Exploration in gradient based reinforcement learning," Massachusetts Institute of Technology, AI Memo 2001-2003, Tech. Rep., April 2001.
11. R. Tedrake, T. W. Zhang, and H. S. Seung, "Stochastic policy gradient reinforcement learning on a simple 3D biped," in IEEE/RSJ International Conference on Intelligent Robots and Systems IROS'04, Sendai, Japan, September 28 - October 2 2004.
12. T. Matsubara, J. Morimoto, J. Nakanishi, M. Sato, and K. Doya, "Learning sensory feedback to CPG with policy gradient for biped locomotion," in Proceedings of the International Conference on Robotics and Automation ICRA, Barcelona, Spain, April 2005.
13. L. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching." Machine Learning, vol.8(3/4), pp. 293-321, 1992.
14. W. Smart, "Making reinforcement learning work on real robots," Ph.D. dissertation, Department of Computer Science at Brown University, Rhode Island, May 2002.
15. C. Atkenson, A. Moore, and S. Schaal, "Locally weighted learning," Artificial Intelligence Review, vol.11, pp. 11-73, 1997.
16. B. Hammer, S. Singh, and S. Scherer, "Learning obstacle avoidance parameters from operator behavior," Journal of Field Robotics, Special Issue on Machine Learning Based Robotics in Unstructured Environments, vol.23 (11/12), December 2006.
17. J. Baxter and P. Bartlett, "Direct gradient-based reinforcement learning: I. gradient estimation algorithms," Australian National University, Tech. Rep., 1999.
18. A. El-Fakdi, M. Carreras, and P. Ridao, "Towards direct policy search reinforcement learning for robot control," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006.
19. S. Haykin, Neural Networks, a comprehensive foundation, 2nd ed. Prentice Hall, 1999.
20. D. Ribas, N. Palomeras, P. Ridao, M. Carreras, and E. Hernandez, "Ictineu auv wins the first sauc-e competition," in IEEE International Conference on Robotics and Automation, 2007.
21. P. Ridao, A. Tiano, A. El-Fakdi, M. Carreras, and A. Zirilli, "On the identification of non-linear models of unmanned underwater vehicles," Control Engineering Practice, vol.12, pp. 1483-1499, 2004. (Pubitemid 38994782)
22. A. Ortiz, M. Simo, and G. Oliver, "A vision system for an underwater cable tracker," International Journal of Machine Vision and Applications, vol.13 (3), pp. 129-140, 2002. (Pubitemid 41200797)
23. J. Antich and A. Ortiz, "Underwater cable tracking by visual feedback," in First Iberian Conference on Pattern recognition and Image Analysis (IbPRIA, LNCS 2652), Port d'Andratx, Spain, 2003.