Automatic option generation in hierarchical reinforcement learning via immune clustering

1st International Symposium on Systems and Control in Aerospace and Astronautics

Volumn 2006, Issue , 2006, Pages 497-500

  Jing, Shen ^a   Guochang, Gu ^a   Haibo, Liu ^a  

^a HARBIN ENGINEERING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; IMMUNOLOGY; INTELLIGENT AGENTS; ONLINE SYSTEMS; PROBLEM SOLVING;

AUTOMATIC CONSTRUCTION; IMMUNE CLUSTERING; LEARNING AGENTS; STATE TRANSITIONS;

LEARNING SYSTEMS;

EID: 33750954561     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. A. G. Barto, S. Mahadevan, "Recent advances in hierarchical reinforcement learning," Discrete Event Dynamic Systems: Theory and Applications, vol.13, pp.41-77, Apr. 2003.
2. R.S. Sutton, D. Precup, S.P. Singh, "Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning," Artificial Intelligence, vol.112, pp.181-211, Jan. 1999.
3. R. Parr, "Hierarchical control and learning for Markov decision processes," Ph.D. Thesis, University of California, Berkeley, 1998.
4. T.G. Dietterich, "Hierarchical reinforcement learning with the MAXQ value function decomposition," Journal of Artificial Intelligence Research, vol.13, pp.227-303, 2000.
5. B.L. Digney, "Learning hierarchical control structures for multiple tasks and changing environments," in Proc. of the 15th International Conference on Simulation of Adaptive Behavior, Zurich, Switzerland, 1998. pp.321-330.
6. A. McGovern, A. Barto, "Autonomous discovery of subgoals in reinforcement learning using deverse density," in Proc. of the 8th International Conference on Machine Learning, San Fransisco: Morgan Kaufmann, 2001. pp.361-368.
7. I. Menache, S. Mannor, N. Shimkin, "Q-cut: dynamic discovery ofsub-goals in reinforcement learning," in Volume 2430 of Lecture Notes in Computer Science, Springer, 2002. pp.295-306.
8. S. Mannor, et al, "Dynamic abstraction in reinforcement learning via clustering," in Proc. of the 21st International Conference on Machine Learning, Banff, Canada, 2004. pp.560-567.
9. N. K. Jerne, "Towards a network theory of the immune system," Annual Immunology, vol. 125C, pp.373-389, Jan. 1974.
10. L.N. de Castro, F. N. Von Zuben, "An evolutionary immune network for data clustering," in Proc. of the IEEE Brazilian Symposium on Artificial Neural Networks, vol.1, Rio de Janeiro, 2000. pp.84-89.
11. C. Watkins, P. Dayan, "Q-learning," Machine Learning, vol. 8, pp.279-292, Mar. 1992.
12. L. G. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching," Machine Learning, vol. 8, pp.293-321, Apr. 1992.