State abstraction in MAXQ hierarchical reinforcement learning

Advances in Neural Information Processing Systems

Volumn , Issue , 2000, Pages 994-1000

  Dietterich, Thomas G ^a  

^a Oregon State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

REINFORCEMENT LEARNING;

HIERARCHICAL REINFORCEMENT LEARNING; PRIMITIVE ACTIONS; STATE ABSTRACTION; TEMPORAL ABSTRACTION; VALUE FUNCTION DECOMPOSITION;

ABSTRACTING;

EID: 0003506152     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. D. Precup and R. S. Sutton, "Multi-time models for temporally abstract planning," in NIPS 10, The MIT Press, 1998.
2. R. S. Sutton, D. Precup, and S. Singh, "Between MDPs and Semi-MDPs: Learning, planning, and representing knowledge at multiple temporal scales," tech. rep., Univ. Mass., Dept. Comp. Inf. Sci., Amherst, MA, 1998.
3. R. Parr and S. Russell, "Reinforcement learning with hierarchies of machines," in NIPS-10, The MIT Press, 1998.
4. S. P. Singh, "Transfer of learning by composing solutions of elemental sequential tasks," Machine Learning, vol. 8, p. 323, 1992.
5. L. P. Kaelbling, "Hierarchical reinforcement learning: Preliminary results," in Proceedings ICML-10, pp. 167-173, Morgan Kaufmann, 1993.
6. M. Hauskrecht, N. Meuleau, C. Boutilier, L. Kaelbling, and T. Dean, "Hierarchical solution of Markov decision processes using macro-actions," tech. rep., Brown Univ., Dept. Comp. Sci., Providence, RI, 1998.
7. P. Dayan and G. Hinton, "Feudal reinforcement learning," in NIPS-5, pp. 271-278, San Francisco, CA: Morgan Kaufmann, 1993.
8. T. G. Dietterich, "The MAXQ method for hierarchical reinforcement learning," in ICML-15, Morgan Kaufmann, 1998.
9. S. Singh, T. Jaakkola, M. L. Littman, and C. Szpesvari, "Convergence results for single-step on-policy reinforcement-learning algorithms," tech. rep., Univ. Col, Dept. Comp. Sci., Boulder, CO, 1998.
10. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
11. T. Jaakkola, M. I. Jordan, and S. P. Singh, "On the convergence of stochastic iterative dynamic programming algorithms," Neur. Comp., vol. 6, no. 6, pp. 1185-1201, 1994.
12. C. Boutilier, R. Dearden, and M. Goldszmidt, "Exploiting structure in policy construction," in Proceedings IJCAI-95, pp. 1104-1111, 1995.