Optimal policy switching algorithms for reinforcement learning

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 2, Issue , 2010, Pages 709-714

  Comanici, Gheorghe ^a   Precup, Doina ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Markov Decision Processes; Policy gradient; Reinforcement learning; Temporal abstraction

Indexed keywords

GRADIENT METHODS; LEARNING ALGORITHMS; MARKOV PROCESSES; MULTI AGENT SYSTEMS; OPTIMIZATION; REINFORCEMENT LEARNING;

GRADIENT BASED ALGORITHM; LONG-TERM RETURNS; MARKOV DECISION PROCESSES; POLICY GRADIENT; SEQUENTIAL DECISION MAKING; SWITCHING ALGORITHMS; TEMPORAL ABSTRACTION; TERMINATION CONDITION;

AUTONOMOUS AGENTS;

EID: 80053022338     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. A. G. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems, 13(4):341-379, 2003.
2. Ö. Şimşek, A. P. Wolfe, and A. G. Barto. Identifying useful subgoals in reinforcement learning by local graph partitioning. In ICML, pages 816-823, 2005.
3. T. G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13:227-303, 1999.
4. B. Hengst. Discovering hierarchy in reinforcement learning with HEXQ. In ICML, pages 243-250, 2002.
5. A. Jonsson and A. Barto. Causal graph based decomposition of factored mdps. Journal of Machine Learning Research, 7:2259-2301,2006.
6. A. Mcgovern and A. G. Barto. Automatic discovery of subgoals in reinforcement learning using diverse density. In ICML, pages 361-368, 2001.
7. N. Mehta, S. Ray, P. Tadepalli, and T. G. Dietterich. Automatic discovery and transfer of MAXQ hierarchies. In ICML, pages 648-655, 2008.
8. I. Menache, S. Mannor, and N. Shimkin. Q-cut - dynamic discovery of sub-goals in reinforcement learning. In ECML, pages 295-306, 2002.
9. R. Parr and S. Russell. Reinforcement learning with hierarchies of machines. In NIPS, 1998.
10. D. Precup. Temporal abstraction in reinforcement learning. PhD thesis, University of Massachusetts, Amherst, 2000.
11. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, 1994.
12. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence, 112:181-211, 1999.
13. R.S. Sutton and A.G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
14. R.S. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation. In NIPS, pages 1057-1063, 2000.