Method for applying reinforcement learning to motion planning and control of under-actuated underwater vehicle in unknown non-uniform sea flow

2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

Volumn , Issue , 2005, Pages 996-1002

  Kawano, Hiroshi ^a  

^a NTT Communication Science Laboratories   (Japan)

Author keywords

Artificial neural network; Markov decision process; Motion digitizing method; Nonholonomic underwater robot; Q learning

Indexed keywords

COMPUTER AIDED INSTRUCTION; INTELLIGENT ROBOTS; LEARNING ALGORITHMS; MACHINE LEARNING; MARKOV PROCESSES; MOTION PLANNING; NEURAL NETWORKS; ROBOT PROGRAMMING; STOCHASTIC SYSTEMS; VEHICLES;

DYNAMICAL CHARACTERISTICS; FLOW AROUND OBSTACLES; MARKOV DECISION PROCESSES; MOTION DIGITIZING METHOD; Q-LEARNING; REINFORCEMENT LEARNING METHOD; STOCHASTIC ENVIRONMENT; UNDERWATER ROBOTS;

REINFORCEMENT LEARNING;

EID: 34250624220     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2005.1544973     Document Type: Conference Paper

References (12)

1. J.P. Laumond, P.Jacobs, M. Taix, R. Murray, "A motion planner for nonholonomic mobile robots", IEEE Transactions on Robotics and Automation, vol.10, n.5, pp.577-593, 1994.
2. M. Aicardi, G. Casalino, G. Indiveri "New techniques for the guidance of underactuated marine vehicles", Proceedings of the IARP Workshop, pp88-98, October, 2001.
3. M. Venditteli, J.P. Laumond "Obstacle Distance for Car-like Robots", IEEE Transactions on Robotics and Automation, Vol. 15, No. 4, pp.678- 691, 1999.
4. Sven Koenig, Maxim Likhachev: "Improved Fast Replanning for Robot Navigation in Unknown Terrain", Proceedings of the 2002 IEEE International Conference on Robotics and Automation, pp968-975, May, 2002. (Pubitemid 34916717)
5. K., Matsuoka, "Sustained Oscillations Generated by Mutually Inhibiting Neurons with Adaptations", Biological Cybernetics, Vol.52, pp367-376, 1985. (Pubitemid 15244296)
6. K. Matsuoka, "Mechanism of Frequency and Pattern Control in the Neural Rhythm Generators", Biological Cybernetics, Vol.56, pp345-353, 1987.
7. H., Kawano, T., Ura. "Motion Planning Algorithm for Non-Holonomic Autonomous Underwater Vehicle in Disturbance using Reinforcement Learning and Teaching Method", Proceedings of IEEE/ASME International Conference on Robotics and Automation, pp 4032 -4038, May 2002. (Pubitemid 34916168)
8. H., Kawano, T., Ura. "Fast Reinforcement Learning Algorithm for Motion Planning of Non-Holonomic Autonomous Underwater Vehicle in Disturbance", Proceedings of 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.903-908, October 2002. (Pubitemid 35437924)
9. H. Kimura, S. Kobayashi. "Efficient Non-Linear Control by Combining Q-learning with Local Linear Controllers", Proceedings of 16th International Conference on Machine Learning, pp210-219, June, 1999.
10. G., Taga, "A model of the neuro-musculo-skeletal system for human locomotion -II. Real-time adaptability under various constraints-", Biological Cybernetics, Vol. 73, pp.113-121, 1995.
11. Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto, MIT Press, 1998.
12. K., Kim, T., Ura:"Fuel-Optimal Guidance and Tracking Control of AUV under Current Interaction", Proceedings of ISOPE 2003, pp.191-196, May, 2003.