Connect-based subgoal discovery for options in hierarchical reinforcement learning

Proceedings - Third International Conference on Natural Computation, ICNC 2007

Volumn 4, Issue , 2007, Pages 698-702

  Chen, Fei ^a   Chen, Shifu ^a   Gao, Yang ^a   Ma, Zhenduo ^b  

^a NANJING UNIVERSITY   (China)

^b Nanjing Nanda Dragontec Software Co LTD   (China)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMIC PROGRAMMING; HIERARCHICAL SYSTEMS; KNOWLEDGE ENGINEERING; ROBUST CONTROL;

CONNECT-BASED SUBGOAL DISCOVERY; HIERARCHICAL REINFORCEMENT LEARNING; SUBGOALS;

LEARNING ALGORITHMS;

EID: 38049022559     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICNC.2007.312     Document Type: Conference Paper

References (12)

1. B. Bakker and J. Schmidhuber. Hierarchical reinforcement learning based on subgoal discovery and subpolicy specialization. In Proceedings of the Eighth Conference on Intelligent Autonomous Systems, pages 438-445, 2004.
2. B. Bakker, Z. Zivkovic, and B. Krose. Hierarchical dynamic programming for robot path planning. In Proceedings of 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2756-2761, 2005.
3. A. G. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Systems, Special Issue on Reinforcement Learning, 13(7):341-379, January 2003.
4. O. Şimşek, A. Wolfe, and A. Barto. Identifying useful subgoals in reinforcement learning by local graph partitioning. In Proceedings of the Twenty-Second International Conference on Machine Learning, pages 816-823, 2005.
5. P. Dayan and C. Watkins. Q-learning. Machine Learning, 8:279-292, 1992.
6. B. Digney. Learning hierarchical control structure for multiple tasks and changing environments. In Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior on from Animals to Animals 5, pages 321-330, 1998.
7. S. Goel and M. Huber. Subgoal discovery for hierarchical reinforcement learning using learned policies. In Proceedings of the Sixteenth International FLAIRS Conference, pages 346-350, 2003.
8. K. Jong and P. Stone. State abstraction discovery from irrelevant state variables. In Proceedings of the Ninteenth International Joint Conference on Artificial Intelligence, pages 752-757, 2005.
9. A. McGovern and A. G. Barto. Automatic discovery of subgoals in reinforcement learning using diverse density. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 361-368, 2001.
10. I. Menache, S. Mannor, and N. Shimkin. Q-cut: Dynamic discovery of subgoals in reinforcement learning. In Proceedings of the Thirteenth European Conference on Machine Learning, pages 295-306, 2002.
11. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
12. R. S. Sutton, D. Precup, and S. Singh. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211, 1999.