Autonomously learning an action hierarchy using a learned qualitative state representation

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2009, Pages 1175-1180

  Mugan, Jonathan ^a   Kuipers, Benjamin ^b  

^a University of Texas at Austin   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; MARKOV PROCESSES;

CONTINUOUS DOMAIN; DEVELOPMENTAL ROBOTICS; DYNAMIC BAYESIAN NETWORKS; EXTRINSIC REWARDS; HIERARCHICAL REINFORCEMENT LEARNING; MARKOV DECISION PROCESSES; QUALITATIVE REPRESENTATION; REALISTIC PHYSICS;

REINFORCEMENT LEARNING;

EID: 78751697580     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. A.G. Barto, S. Singh, and N. Chentanez. Intrinsically motivated learning of hierarchical collections of skills. ICDL, 2004.
2. C. Boutilier, R. Dearden, and M. Goldszmidt. Exploiting structure in policy construction. In IJCAI, pages 1104-1113, 1995.
3. T. Degris, O. Sigaud, and P.H. Wuillemin. Learning the structure of factored Markov decision processes in reinforcement learning problems. In ICML, pages 257-264, 2006.
4. T.G. Dietterich. The MAXQ method for hierarchical reinforcement learning. ICML, 1998.
5. Gary L. Drescher. Made-Up Minds: A Constructivist Approach to Artificial Intelligence. Cambridge, MA, 1991.
6. A. Jonsson and A. Barto. Causal graph based decomposition of factored MDPs. The Journal of Machine Learning Research, 7:2259-2301, 2006.
7. Jon Klein. Breve: a 3d environment for the simulation of decentralized systems and artificial life. In Proc. of the Int. Conf. on Artificial Life, 2003.
8. Benjamin Kuipers. Qualitative Reasoning. The MIT Press, Cambridge, Massachusetts, 1994.
9. Amy McGovern and Andrew G. Barto. Automatic discovery of subgoals in reinforcement learning using diverse density. In ICML, pages 361-368, 2001.
10. J. Mugan and B. Kuipers. Learning to predict the effects of actions: Synergy between rules and landmarks. In ICDL, 2007.
11. J. Mugan and B. Kuipers. Towards the application of reinforcement learning to undirected developmental learning. In Proc. of the Int. Conf. on Epigenetic Robotics, 2008.
12. H.M. Pasula, L.S. Zettlemoyer, and L.P. Kaelbling. Learning symbolic models of stochastic domains. JAIR, 29:309-352, 2007.
13. J. Provost. sourceforge.net, 2008.
14. O. Simsek, A. Wolfe, and A. Barto. Identifying useful subgoals in reinforcement learning by local graph partitioning. ICML, pages 816-823, 2005.
15. A.L. Strehl, C. Diuk, and M.L. Littman. Efficient structure learning in factored-state MDPs. In AAAI, volume 22, page 645, 2007.
16. R. S. Sutton and A. G. Barto. Reinforcement Learning. MIT Press, Cambridge MA, 1998.
17. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1-2):181-211, 1999.