Multi-time models for temporally abstract planning

Advances in Neural Information Processing Systems

Volumn , Issue , 1998, Pages 1050-1056

  Precup, Doina ^a   Sutton, Richard S ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES; REINFORCEMENT LEARNING;

ABSTRACT MODELING; ABSTRACT MODELS; BELLMAN EQUATIONS; MARKOV DECISION PROCESSES; MATHEMATICAL FRAMEWORKS; MULTIPLE LEVELS; TEMPORAL ABSTRACTION; THEORETICAL FRAMEWORK;

ARTIFICIAL INTELLIGENCE;

EID: 84899003140     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Dayan, P. (1993). Improving generalization for temporal difference learning: The successor representation. Neural Computation, 5, 613-624.
2. Dayan, P. & Hinton, G. E. (1993). Feudal reinforcement learning. In Advances in Neural Information Processing Systems, volume 5, (pp. 271-278)., San Mateo, CA. Morgan Kaufmann.
3. Kaelbling, L. P. (1993). Hierarchical learning in stochastic domains: Preliminary results. In Pro-ceedings of the Tenth International Conference on Machine Learning ICML'93, (pp. 167-173)., San Mateo, CA. Morgan Kaufmann.
4. Korf, R. E. (1985). Learning to Solve Problems by Searching for Macro-Operators. London: Pitman Publishing Ltd.
5. Laird, J. E., Rosenbloom, P. S., & Newell, A. (1986). Chunking in SOAR: The anatomy of a general learning mechanism. Machine Learning, 1, 11-46.
6. Moore, A. W. & Atkeson, C. G. (1993). Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13, 103-130.
7. Peng, J. & Williams, J. (1993). Efficient learning and planning within the Dyna framework. Adaptive Behavior, 4, 323-334.
8. Precup, D. & Sutton, R. S. (1997). Multi-Time models for reinforcement learning. In ICML'97 Workshop: The Role of Models in Reinforcement Learning.
9. Sacerdoti, E. D. (1977). A Structure for Plans and Behavior. North-Holland, NY: Elsevier.
10. Singh, S. P. (1992). Scaling reinforcement learning by learning variable temporal resolution models. In Proceedings of the Ninth International Conference on Machine Learning ICML'92, (pp. 202207)., San Mateo, CA. Morgan Kaufmann.
11. Sutton, R. S. (1995). TD models: Modeling the world as a mixture of time scales. In Proceedings of the Twelfth International Conference on Machine Learning ICML'95, (pp. 531-539)., San Mateo, CA. Morgan Kaufmann.
12. Sutton, R. S. & Barto, A. G. (1998). Reinforcement Learning. An Introduction. Cambridge, MA: MIT Press.
13. Sutton, R. S. & Pinette, B. (1985). The learning of world models by connectionist networks. In Proceedings of the Seventh Annual Conference of the Cognitive Science Society, (pp. 54-64).
14. Watkins, C. J. C. H. (1989). Learning with Delayed Rewards. PhD thesis, Cambridge University.