Mobile robot navigation control based on hierarchical reinforcement learning

Nanjing Hangkong Hangtian Daxue Xuebao/Journal of Nanjing University of Aeronautics and Astronautics

Volumn 38, Issue 1, 2006, Pages 70-75

  Chen, Chunlin ^a   Chen, Zonghai ^a   Zhuo, Rui ^a   Zhou, Guangming ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Grid topological map; Hierarchical reinforcement learning; Mobile robot; Navigation control

Indexed keywords

ADAPTIVE SYSTEMS; DYNAMICS; HIERARCHICAL SYSTEMS; LEARNING SYSTEMS; MAPS; NAVIGATION; OPTIMIZATION; TOPOLOGY;

GRID TOPOLOGICAL MAP; HIERARCHICAL REINFORCEMENT LEARNING; NAVIGATION CONTROL; STATE ACTION SPACE;

MOBILE ROBOTS;

EID: 33646154212     PISSN: 10052615     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (14)

1. Althaus P, Christensen H I. Smooth task switching through behaviour competition[J]. Robotics and Autonomous Systems, 2003, 44(3/4): 241-249.
2. Beom H R, Cho H S. A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning[J]. IEEE Trans on Systems, Man and Cybernetics, 1995, 25(3): 464-477.
3. Ranganathan P, Hayet J B, Devy M, et al. Topological navigation and qualitative localization for indoor environment using multi-sensory perception[J]. Robotics and Autonomous Systems, 2002, 41: 137-144.
4. Sutton R S, Barto A G. Reinforcement learning: an introduction[M]. Cambridge, MA: MIT Press, 1998: 3-9.
5. Ye C, Yung N H C, Wang D W. A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance[J]. IEEE Transactions on Systems, Man and Cybernetics, 2003, 33(1): 17-27.
6. Kondo T, Ito K. A reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots control[J]. Robotics and Autonomous Systems, 2004, 46(2): 111-124.
7. Barto A G, Mahanevan S. Recent advances in hierarchical reinforcement learning[J]. Discrete Event Dynamic Systems: Theory and Applications, 2003, 13(4): 41-77.
8. Sutton R, Precup D, Singh S. Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning[J]. Artificial Intelligence, 1999, 112(1/2): 181-211.
9. Dietterich T G. Hierarchical reinforcement learning with the MAXQ value function decomposition[J]. Journal of Artificial Intelligence Research, 2000, 13(1): 227-303.
10. Thrun S. Learning metric-topological maps for indoor mobile robot navigation[J]. Artificial Intelligence, 1998, 99(1): 21-71.
11. Elfes A. Sonar based real world mapping and navigation[J]. IEEE Journal of Robotics and Automation, 1987, RA-3(3): 249-265.
12. Remolina E, Kuipers B. Towards a general theory of topological maps[J]. Artificial Intelligence, 2004, 152(2): 47-104.
13. Watkins C, Dayan P. Q-learning[J]. Machine Learning, 1992, 8(3): 279-292.