Toward a topological theory of relational reinforcement learning for navigation tasks

Proceedings of the Eighteenth International Florida Artificial Intelligence Research Society Conference, FLAIRS 2005 - Recent Advances in Artifical Intelligence

Volumn , Issue , 2005, Pages 461-466

  Lane, Terrain ^a   Wilson, Andrew ^b  

^a MSC01 1070   (United States)

^b SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOSED-FORM ENVELOPE; MARKOV DECISION PROCESS (MDP); RELATIONAL REINFORCEMENT LEARNING;

DECISION THEORY; MARKOV PROCESSES; NAVIGATION;

LEARNING SYSTEMS;

EID: 32844454618     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Anderson, C. R.; Domingos, P.; and Weld, D. S. 2002. Relational Markov models and their application to adaptive web navigation. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002). Edmonton, Alberta, Canada: ACM SIGKDD.
2. Boutilier, C.; Dearden, R.; and Goldszmidt, M. 2000. Stochastic dynamic programming with factored representations. Artificial Intelligence 121(1-2):49-107.
3. Dean, T., and Givan, R. 1997. Model minimization in Markov decision processes. In Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI-97), 106-111. Providence, RI: AAAI Press/MIT Press.
4. Dean, T.; Kaelbling, L. P.; Kirman, J.; and Nicholson, A. 1995. Planning under time constraints in stochastic domains. Artificial Intelligence 76.
5. Dietterich, T. G. 2000. An overview of MAXQ hierarchical reinforcement learning. In Choueiry, B. Y., and Walsh, T., eds., Proceedings of the Symposium on Abstraction, Reformulation and Approximation (SARA 2000), Lecture Notes in Artificial Intelligence. New York: Springer Verlag.
6. Finney, S.; Gardiol, N. H.; Kaelbling, L. P.; and Oates, T. 2002. The thing that we tried didn't work very well: Deictic representation in reinforcement learning. In Proceedings of the Eighteenth International Conference on Uncertainty in Artificial Intelligence (UAI-2002).
7. Getoor, L.; Friedman, N.; Koller, D.; and Pfeffer, A. 2001. Learning Probabilistic Relational Models. In Dzeroski, S. and Lavrac, N., eds., Relational Data Mining. Springer-Verlag.
8. Hauskrecht, M.; Meuleau, N.; Boutilier, C.; Kaelbling, L. P.; and Dean, T. 1998. Hierarchical solution of Markov decision processes using macro-actions. In Cooper, G. F., and Moral, S., eds., Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI-98). Morgan Kaufmann.
9. Lane, T., and Kaelbling, L. P. 2002. Nearly deterministic abstractions of Markov decision processes. In Proceedings of the Eighteenth National Conference on Artificial Intelligence (AAAI-02), 260-266. Edmonton, Canada: AAAI Press.
10. Parr, R. 1998a. Flexible decomposition algorithms for weakly coupled Markov decision problems. In Cooper, G. F., and Moral, S., eds., Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI-98). Morgan Kaufmann.
11. Parr, R. E. 1998b. Hierarchical Control and Learning for Markov Decision Processes. Ph.D. Dissertation, University of California at Berkeley.
12. Precup, D. 2000. Temporal Abstraction in Reinforcement Learning. Ph.D. Dissertation, Department of Computer Science, University of Massachusetts, Amherst, MA.
13. Puterman, M. L. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: John Wiley & Sons.
14. Ravindran, B., and Barto, A. G. 2002. Model minimization in hierarchical reinforcement learning. In Holte, R., ed., Proceedings of the 2002 Symposium on Abstraction, Reformulation, and Approximation (SARA-200229.
15. Ravindran, B., and Barto, A. G. 2003. Relativized options: Choosing the right transformation. In Fawcett, T., and Mishra, N., eds., Proceedings of the Twentieth International Conference on Machine Learning, 608-615. Washington, DC: AAAI Press.
16. Ravindran, B. 2004. An Algebraic Approach to Abstraction in Reinforcement Learning. Ph.D. Dissertation, Department of Computer Science, University of Massachusetts, Amherst, MA.
17. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.