Efficient skill learning using abstraction selection

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2009, Pages 1107-1112

  Konidaris, George ^a   Barto, Andrew ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING;

SAMPLE DATA; SKILL LEARNING;

REINFORCEMENT LEARNING;

EID: 78751681641     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. A.G. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Systems, 13:41-77, 2003. Special Issue on Reinforcement Learning.
2. C.M. Bishop. Pattern Recognition and Machine Learning. Springer, New York NY, 2006.
3. J.A. Boyan. Least squares temporal difference learning. In Proceedings of the 16th International Conference on Machine Learning, pages 49-56, 1999.
4. T.G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13:227-303, 2000.
5. B. Hengst. Discovering hierarchy in reinforcement learning with HEXQ. In Proceedings of the Nineteenth International Conference on Machine Learning, pages 243-250, 2002.
6. A. Jonsson and A.G. Barto. Automated state abstraction for options using the U-Tree algorithm. In Advances in Neural Information Processing Systems 13, pages 1054-1060, 2001.
7. G.D. Konidaris and A.G. Barto. Skill discovery in continuous reinforcement learning domains. Technical Report UM-CS-2008-24, Department of Computer Science, University of Massachusetts Amherst, July 2008.
8. G.D. Konidaris and S. Osentoski. Value function approximation in reinforcement learning using the Fourier basis. Technical Report UM-CS-2008-19, Department of Computer Science, University of Massachusetts, Amherst, June 2008.
9. L. Li, T.J. Walsh, and M.L. Littman. Towards a unified theory of state abstraction for MDPs. In Proceedings of the Ninth International Symposium on Artificial Intelligence and Mathematics, 2006.
10. A. McCallum. Learning to use selective attention and short-term memory in sequential tasks. In From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior, 1996.
11. G. Schwarz. Estimating the dimension of a model. Annals of Statistics, 6:461-464, 1978.
12. Ö. Şimşek, A.P.Wolfe, and A.G. Barto. Identifying useful subgoals in reinforcement learning by local graph partitioning. In Proceedings of the Twenty-Second International Conference on Machine Learning, 2005.
13. S. Singh, A.G. Barto, and N. Chentanez. Intrinsically motivated reinforcement learning. In Proceedings of the 18th Annual Conference on Neural Information Processing Systems, 2004.
14. R.S. Sutton and A.G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
15. R.S. Sutton, D. Precup, and S.P. Singh. Intra-option learning about temporally abstract actions. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 556-564, 1998.
16. R.S. Sutton, D. Precup, and S.P. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1-2):181-211, 1999.
17. H.H. van Seijen, B. Bakker, and L.J.H.M. Kester. Reinforcement learning with multiple, qualitatively different state representations. In Proceedings of NIPS 2007 Workshop on Hierarchical Organization of Behavior, 2007.