Logical Markov decision programs and the convergence of logical TD(λ)

Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)

Volumn 3194, Issue , 2004, Pages 180-197

  Kersting, Kristian ^a   De Raedt, Luc ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY; LOGIC PROGRAMMING; MARKOV PROCESSES; PROBABILISTIC LOGICS; REGRESSION ANALYSIS; TREES (MATHEMATICS); REINFORCEMENT LEARNING;

LOGICAL MARKOV DECISION PROGRAMS (LOMDP); MARKOV DECISION PROCESS (MDP); RELATIONAL LEARNING; RELATIONAL REINFORCEMENT LEARNING (RRL); LOGIC PROGRAMS; LOGICAL MARKOV DECISION PROGRAMS; MARKOV DECISION PROCESSES; RELATIONAL REINFORCEMENT LEARNING; REPRESENTATION FORMALISMS;

LEARNING SYSTEMS; INDUCTIVE LOGIC PROGRAMMING (ILP);

EID: 22944490192     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-3-540-30109-7_16     Document Type: Conference Paper

References (35)

1. D. Andre and S. Russell. Programmable reinforcement learning agents. In Advances in Neural Information Processing Systems 13, pages 1019-1025. MIT Press, 2001.
2. E. B. Baum. Towards a Model of Intelligence as an Economy of Agents. Machine Learning, 35(2):155-185, 1999.
3. C. Boutilier, T. Deam, and S. Hanks. Decision-Theoretic Planning: Structural Assumptions and Computational Leverage. JAIR, 11:1-94, 1999.
4. C. Boutilier, R. Reiter, and B. Price. Symbolic Dynamic Programming for First-order MDPs. In Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01), pages 690-700, Seattle, USA, 2001.
5. J. A. Boyan and A. W. Moore. Generalization in reinforcement learning: safely approximating the value function. In Advances in Neural Information Processing Systems, volume 7, 1995.
6. L. De Raedt and K. Kersting. Probabilistic Logic Learning. ACM-SIGKDD Explorations: Special issue on Multi-Relational Data Mining, 5(1):31-48, 2003.
7. R. Dearden and C. Boutilier. Abstraction and approximate decision theoretic planning. Artificial Intelligence, 89(1):219-283, 1997.
8. Thomas G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13:227-303, 2000.
9. K. Driessens and J. Ramon. Relational Instance Based Regression for Relational Reinforcement Learning. In Proceedings of the Twelfth International Conference on Machine Learning, pages 123-130, Washington DC, USA, 2003.
10. S. Džeroski, L. De Raedt, and K. Driessens. Relational reinforcement learning. Machine Learning, 43(1/2):7-52, 2001.
11. S. Džeroski and N. Lavrač. Relational Data Mining. Springer-Verlag, 2001.
12. A. Fern, S. Yoon, and R. Givan. Approximate policy iteration with a policy language bias. In Proceedings of the Neural Information Processing Conference (NIPS), 2003.
13. S. Finney, N. H. Gardiol, L. P. Kaelbling, and T. Oates. The thing that we tried didn't work very well: Deictic representation in reinforcement learning. In Proceedings of the Eighteenth International Conference on Uncertainty in Artificial Intelligence (UAI-02), 2002.
14. P. Flach. Simply logical: intelligent reasoning by example. John Wiley and Sons Ltd., 1994.
15. N. Friedman, L. Getoor, D. Koller, and A. Pfeffer. Learning probabilistic relational models. In Proceedings of the Sixteenth International Joint Conferences on Artificial Intelligence (IJCAI-99), pages 1300-1309, Stockholm, Sweden, 1999. Morgan Kaufmann.
16. R. Givan, T. Dean, and M. Greig. Equivalence notions and model minimization in Markov decision processes. Artificial Intelligence, 147:163-224, 2003.
17. G. J. Gordon. Stable fitted reinforcement learning. In Advances in Neural Information Processing, pages 1052-1058. MIT Press, 1996.
18. C. Guestrin, D. Koller, C. Gearhart, and N. Kanodia. Generalizing Plans to New Environments in Relational MDPs. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-03), Acapulco, Mexico, 2003.
19. L. P. Kaelbling, T. Oates, N. H. Gardiol, and S. Finney. Learning in worlds with objects. In Working Notes of the AAAI Stanford Spring Symposium on Learning Grounded Representations, 2001.
20. K. Kersting and L. De Raedt. Logical markov decision programs. In Working Notes of the IJCAI-2003 Workshop on Learning Statistical Models from Relational Data (SRL-03), pages pp. 63-70, 2003.
21. K. Kersting, M. Van Otterlo, and L. De Raedt. Bellman goes Relational. In Proceedings of the Twenty-First International Conference on Machine Learning (ICML-04), Banff, Alberta, Canada, July 4-8 2004. (to appear).
22. K.-E. Kim and T. Dean. Solving factored mdps using non-homogeneous partitions. Artificial Intelligence, 147:225-251, 2003.
23. A. K. McCallum. Reinforcement Learning with Selective Perception and Hidden States. PhD thesis, Department of Computer Science, University of Rochester, 1995.
24. S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19(20):629-679, 1994.
25. R. Munos and A. Moore. Influence and Variance of a Markov Chain: Application to Adaptive Discretization in Optimal Control. In Proceedings of the IEEE Conference on Decision and Control, 1999.
26. D. Poole. The independent choice logic for modelling multiple agents under uncertainty. Artificial Intelligence, 94(1-2):7-56, 1997.
27. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley &: Sons, 1994.
28. S. P. Singh, T. Jaakkola, and M. I. Jordan. Reinforcement learning with soft state aggregation. In Advances in Neural Information Processing 7, pages 361-268. MIT Press, 1994.
29. J. Slaney and S. Thiébaux. Blocks World revisited. Artificial Intelligence, 125:119-153, 2001.
30. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. The MIT Press, 1998.
31. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211, 1999.
32. J. N. Tsitsiklis and B. Van Roy. An analysis of temporal-difference learning with function approximation. IEEE Transactions of Automatic Control, 42:674-690, 1997.
33. M. Van Otterlo. Reinforcement Learning for Relational MDPs. In Proceedings of the Annual Machine Learning Conference of Belgium and the Netherlands, 2004.
34. S. D. Whitehead and D. H. Ballard. Learning to perceive and act by trial and error. Machine Learning, 7(1):45-83, 1991.
35. S. Yoon, A. Fern, and R. Givan. Inductive policy selection for first-order MDPs. In Proceedings of the International Conference on Uncertainty in Artificial Intelligence (UAI), 2002.