Agent learning in relational domains based on logical MDPs with negation

Journal of Computers

Volumn 3, Issue 9, 2008, Pages 29-38

  Song, Zhiwei ^a   Chen, Xiaoping ^a   Cong, Shuang ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Logical MDPs with negation; Relational reineforcement learning; State refinement; ( ) Learning

Indexed keywords

GROUND STATE; MARKOV PROCESSES; REINFORCEMENT LEARNING;

FORMAL DEFINITION; GENERATING METHODS; LOGICAL MDPS WITH NEGATION; MARKOV DECISION PROCESSES; RELATIONAL FORMS; RELATIONAL REINEFORCEMENT LEARNING; RELATIONAL REINFORCEMENT LEARNING; STATE REFINEMENT;

LEARNING ALGORITHMS;

EID: 72949090743     PISSN: 1796203X     EISSN: None     Source Type: Journal    
DOI: 10.4304/jcp.3.9.29-38     Document Type: Article

References (36)

1. L. Kaelbling, M. Littman, and A. Moore, "Reinforcement learning: A survey," Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, 1996.
2. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. The MIT Press, 1998.
3. P.-Y. Yin, B. Bhanu, K.-C. Chang, and A. Dong, "Integrating relevance feedback techniques for image retrieval using reinforcement learning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1536-1551, 2005.
4. S. Fakih and T. Das, "LEAD: a methodology for learning efficient approaches to medical diagnosis," IEEE Transactions on Information Technology in Biomedicine, vol. 10, no. 2, pp. 220-228, 2006.
5. S. Misra and B. Oommen, "An efficient dynamic algorithm for maintaining all-pairs shortest paths in stochastic networks," IEEE Transactions on Computers, vol. 55, no. 6, pp. 686-702, 2006.
6. S. Džeroski, L. De Raedt, and K. Driessens, "Relational reinforcement learning," Machine Learning, vol. 43, pp. 7-52, 2001.
7. M. Van Otterlo, "A survey of reinforcement learning in relational domains," CTIT Technical Report Series ISSN 1381-3625, July 2005.
8. P. Tadepalli, R. Givan, and K. Driessens, "Relational reinforcement learning: An overview," in ICML'04 Workshop on Relational Reinforcement Learning, 2004.
9. S. Yoon, A. Fern, and R. Givan, "Inductive policy selection for first-order MDPs," in UAI'02, 2002.
10. J. Cole, K. Lloyd, and K. Ng, "Symbolic learning for adaptive agents," in The Annual Partner Conference, Smart Internet Technology Cooperative Research Centre, 2003.
11. C. Guestrin, D. Koller, C. Gearhart, and N. Kanodia, "Generalizing plans to new environments in relational MDPs," in IJCAI'03, 2003.
12. K. Kersting and L. De Raedt, "Logical markov decision programs," in IJCAI'03 Workshop on Learning Statistical Models of Relational Data, 2003.
13. E. Morales, "Scaling up reinforcement learning with a relational representation," in Proceedings of the Workshop on Adaptability in Multi-agent Systems at AORC'03, Sydney, 2003.
14. K. Kersting, M. Van Otterlo, and L. De Raedt, "Bellman goes relational," in ICML'04, 2004.
15. M. Van Otterlo, "Reinforcement learning for relational MDPs," in Machine Learning Conference of Belgium and the Netherlands, 2004.
16. K. Driessens and S. Džeroski, "Combining model-based and instance-based learning for first order regression," in Proceedings of the 22nd International Conference on Machine Learning, 2005, pp. 193-200.
17. J. Ramon, "Convergence of reinforcement learning using a decision tree learner," in Proceedings of the ICML'05 Workshop on Rich Representations for Reinforcement Learning, Bonn Germany, 2005.
18. A. Karwath and K. Kersting, "Relational sequence alignements," in Proceedings of The 4th International Workshop on Mining and Learning with Graphs (MLG '06), T. Gärtner, G. C. Garriga, and T. Meinl, Eds., September 2006.
19. C. Wang, S. Joshi, and R. Khardon, "First order decision diagrams for relational mdps," in IJCAI 2007, 2007.
20. S.-H. Neinhuys-Cheng and R. de Wolf, Foundations of Inductive Logic Programming, vol. 1228 of Lecture Notes in Artifical Intelligence. Springer-Verlag, 1997.
21. K. Clark, "Negation as failure." in Logic and Data Bases, 1977, pp. 293-322.
22. M. Van Otterlo and K. Kersting, "Challenges for relational reinforcement learning," in ICML'04 Workshop on Relational Reinforcement Learning, 2004.
23. N. Kushmerick, S. Hanks, and D. Weld, "An algorithm for probabilistic planning," Artificial Intelligence, vol. 76, pp. 239-286, 1995.
24. K. Kersting and L. De Raedt, "Logical markov decision programs and the convergence of logical TD(λ)," in Fourteenth International Conference on Inductive Logic Programming, 2004, pp. 180-197.
25. J. Slaney and S. Thiébaux, "Blocks world revisited," Artificial Intelligence, vol. 125, pp. 119-153, 2001.
26. F. Bacchus, J. Y. Halpern, and H. J. Levesque, "Reasoning about noisy sensors and effectors in the situation calculus," Artificial Intelligence, vol. 111, no. 1-2, pp. 171-208, 1999.
27. P. Mateus, A. Pacheco, and J. Pinto, "Observations and the probabilistic situation calculus," in Proceedings of the 8th KR, 2002, pp. 327-340.
28. C. Boutilier, T. Dean, and S. Hanks, "Decision-theoretic planning: Structural assumptions and computational leverage," Journal of Artificial Intelligence Research (JAIR), vol. 11, pp. 1-94, 1999.
29. D. Poole, "The independent choice logic for modelling multiple agents under uncertainty," Artificial Intelligence, vol. 94, no. 1-2, pp. 7-56, 1997.
30. C. Boutilier, R. Reiter, and B. Price, "Symbolic dynamic programming for first-order MDPs," in Proceedings of the 17th IJCAI, 2001, pp. 690-700.
31. C. Boutilier, R. Reiter, M. Soutchanski, and S. Thrun, "Decisino-theoretic, high-level agent programming in the situatino calculus," in Proceedings of the 17th AAAI/12th IAAI, 2000, pp. 355-362.
32. M. Gelfoun and V. Lifschitz, "Representing action and change by logic programs," Journal of Logical Programming, vol. 17, no. 2-4, pp. 301-321, 1993.
33. C. Baral, N. Tran, and L.-C. Tuan, "Reasoning about actions in a probabilistic setting," in Proceedings of the 18th AAAI/14th IAAI, 2002, pp. 507-512.
34. D. Chapman and L. Kaelbling, "Input generalization in delayed reinforcement learning: An algorithm and performance comparisions," in Proccedings of the 12th International Joint Conference on Artificial Intelligence, 1991, pp. 726-731.
35. A. McCallum, Reinforcement Learning with Selective Perception and Hidden State. PhD thesis, Computer Science Department, University of Rochester, 1995.
36. A. Moore, "The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces," Machine Learning, vol. 21, no. 3, pp. 199-233, 1995.