Multi-value-functions: Efficient automatic action hierarchies for multiple goal MDPs

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2, Issue , 1999, Pages 1318-1321

  Moore, Andrew W ^a   Baird, Leemon C ^a   Kaelbling, Leslie ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION HIERARCHY; DELAYED REWARDS; MARKOV DECISION PROBLEM; MINIMUM COST; VALUE FUNCTIONS;

ARTIFICIAL INTELLIGENCE; AUTOMATA THEORY; COST BENEFIT ANALYSIS;

COSTS;

EID: 84880688141     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. D. P. Bertsekas and J. N Tsitsiklis. Parallel and Distributed Computation. Prentice Hall, 1989.
2. D. Chapman and L. P. Kaelbling. Learning from Delayed Reinforcement In a Complex Domain. In IJCAI91, 1991.
3. P. Dayan and G. E. Hinton. Feudal Reinforcement Learning. In S J. Hanson, J. D Cowan, and C. L. Giles, editors, Advances in Neural Information Processing Systems 5. Morgan Kaufmann, 1993.
4. T. G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. In Jude Shavlik, editor, International Conference on Machine Learning, 1998.
5. L. Kaelbling. Hierarchicial Learning in Stochastic Domains: Preliminary Results In Machine Learning: Proceedings of the Tenth International Workshop. Morgan Kaufmann, June 1993
6. M. Kearns, Y. Mansour, and A. Ng. Sparse Sampling Methods for Planning and Learning in Large and Partially Observable Markov Decision Processes. Draft Report, 1998.
7. A. W Moore and C G. Atkeson. Prioritized Sweeping: Reinforcement Learning with Less Data and Less Real Time. Machine Learning, 13, 1993.
8. A W Moore. The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces. In S J. Hanson, J. D Cowan, and C. L. Giles, editors, Advances in Neural information Processing Systems 6. Morgan Kaufmann, April 1994.
9. R Parr and S, Russell. Reinforcement Learning with Hierarchies of Machines. In Neural Information Processing Systems 10, 1997. Morgan Kaufmann, 1998.
10. D Precup and R. Sutton. Multi-Time Models for Temporally Abstract Planning. In Neural Information Processing Systems 10, 1997 Morgan Kaufmann, 1998.
11. S. P. Singh. Transfer of learning across compositions of sequential tasks. In L. Birnbaum and G. Collins, editors, Machine Learning: Proceedings of the Eighth International Workshop, Morgan Kaufmann, June 1991.