Two steps natural actor critic learning for underwater cable tracking

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2010, Pages 2267-2272

  El Fakdi, Andres ^a   Carreras, Marc ^a   Galceran, Enric ^a  

^a UNIVERSITY OF GIRONA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; ACTOR CRITIC; ACTOR-CRITIC LEARNING; AUTONOMOUS ROBOT; CONVERGENCE PROCESS; FAST CONVERGENCE; FIELD APPLICATION; FUNCTION APPROXIMATION; HYDRODYNAMIC MODEL; LEARNING PROCEDURES; LEARNING PROCESS; PARTIAL OBSERVABILITY; POLICY GRADIENT; REAL ENVIRONMENTS; SIMULATED RESULTS; UNDERWATER CABLES; UNDERWATER VEHICLES; VALUE FUNCTIONS;

CABLES; COMPUTER SIMULATION; OBSERVABILITY; ROBOTICS; ROBOTS; SUBMERSIBLES; WATER CRAFT;

CONVERGENCE OF NUMERICAL METHODS;

EID: 77955825214     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2010.5509751     Document Type: Conference Paper

References (19)

1. R. Sutton and A. Barto, Reinforcement Learning, an introduction. MIT Press, 1998.
2. J. Peters and S. Schaal, "Policy gradient methods for robotics," in IEEE/RSJ International Conference on Intelligent Robots and Systems IROS'06, Beijing, China, October 9-15 2006.
3. V. Konda and J. Tsitsiklis, "On actor-critic algorithms," SIAM Journal on Control and Optimization, vol. 42, number 4, pp. 1143-1166, 2003.
4. R. Sutton, D. McAllester, S. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," Advances in Neural Information Processing Systems, vol. 12, pp. 1057-1063, 2000.
5. R. Tedrake, T. W. Zhang, and H. S. Seung, "Stochastic policy gradient reinforcement learning on a simple 3D biped," in IEEE/RSJ International Conference on Intelligent Robots and Systems IROS'04, Sendai, Japan, September 28 - October 2 2004.
6. T. Matsubara, J. Morimoto, J. Nakanishi, M. Sato, and K. Doya, "Learning sensory feedback to CPG with policy gradient for biped locomotion," in Proceedings of the International Conference on Robotics and Automation ICRA, Barcelona, Spain, April 2005.
7. J. Peters, "Machine learning of motor skills for robotics," Ph.D. dissertation, Department of Computer Science, University of Southern California., 2007.
8. S. Amari, "Natural gradient works efficiently in learning," Neural Computation, vol. 10, pp. 251-276, 1998.
9. S. Richter, D. Aberdeen, and J. Yu, "Natural actor-critic for road traffic optimisation," in Neural Information Processing Systems, NIPS'06, 2006, pp. 1169-1176.
10. T. Ueno, Y. Nakamura, T. Shibata, K. Hosoda, and S. Ishii, "Stable learning of quasi-passive dynamic walking by an unstable biped robot based on off-policy natural actor-critic," in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2006.
11. W. Smart, "Making reinforcement learning work on real robots," Ph.D. dissertation, Department of Computer Science at Brown University, Rhode Island, May 2002.
12. B. Hammer, S. Singh, and S. Scherer, "Learning obstacle avoidance parameters from operator behavior," Journal of Field Robotics, Special Issue on Machine Learning Based Robotics in Unstructured Environments, vol. 23 (11/12), December 2006.
13. J. Peters, S. Vijayakumar, and S. Schaal, "Natural actor-critic," in ECML, 2005, pp. 280-291.
14. L. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching." Machine Learning, vol. 8(3/4), pp. 293-321, 1992.
15. A. El-Fakdi and M. Carreras, "Policy gradient based reinforcement learning for real autonomous underwater cable tracking," in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2008.
16. T. I. Fossen, Guidance and Control of Ocean Vehicles. John Wiley and Sons, 1995.
17. D. Ribas, N. Palomeras, P. Ridao, M. Carreras, and E. Hernandez, "Ictineu auv wins the first sauc-e competition," in IEEE International Conference on Robotics and Automation, 2007.
18. P. Ridao, A. Tiano, A. El-Fakdi, M. Carreras, and A. Zirilli, "On the identification of non-linear models of unmanned underwater vehicles," Control Engineering Practice, vol. 12, pp. 1483-1499, 2004.
19. J. Antich and A. Ortiz, "Underwater cable tracking by visual feedback," in First Iberian Conference on Pattern recognition and Image Analysis (IbPRIA, LNCS 2652), Port d'Andratx, Spain, 2003.