Reinforcement learning with hierarchies of machines

Advances in Neural Information Processing Systems

Volumn , Issue , 1998, Pages 1043-1049

  Parr, Ronald ^a   Russell, Stuart ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR-BASED; CONVERGENT ALGORITHMS; LEARNING PROCESS; NEW APPROACHES; PRIOR KNOWLEDGE; SEARCH SPACES;

REINFORCEMENT LEARNING;

EID: 84898956770     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. S. Benson and N. Nilsson. Reacting, planning and learning in an autonomous agent. In K. Furukawa, D. Michie, and S. Muggleton, editors, Machine Intelligence 14. Oxford University Press, Oxford, 1995.
2. D. C. Bertsekas and J. N. Tsitsiklis. Parallel and Distributed Computation: Numerical Methods. Prentice-Hall, Englewood Cliffs, New Jersey, 1989.
3. S. J. Bradtke and M. O. Duff. Reinforcement learning methods for continuous-time Markov decision problems. In Advances in Neural Information Processing Systems 7: Proc. of the 1994 Conference, Denver, Colorado, December 1995. MIT Press.
4. R. A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2, 1986.
5. K. W. Currie and A. Tate. O-Plan: The Open Planning Architecture. Artificial Intelligence, 52(1), November 1991.
6. P. Dayan and G. E. Hinton. Feudal reinforcement learning. In Stephen Jose Hanson, Jack D. Cowan, and C. Lee Giles, editors, Neural Information Processing Systems 5, San Mateo, California, 1993. Morgan Kaufman.
7. T. Dean, R. Givan, and S. Leach. Model reduction techniques for computing approximately optimal solutions for markov decision processes. In Proc. of the Thirteenth Conference on Un-certainty in Artificial Intelligence, Providence, Rhode Island, August 1997. Morgan Kaufmann.
8. T. Dean and S.-H. Lin. Decomposition techniques for planning in stochastic domains. In Proc. of the Fourteenth Int. Joint Conference on Artificial Intelligence, Montreal, Canada, August 1995. Morgan Kaufmann.
9. Thomas G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. Technical report, Department of Computer Science, Oregon State University, Corvallis, Oregon, 1997.
10. Y.-J. Hsu. Synthesizing efficient agents from partial programs. In Methodologies for Intelligent Systems: 6th Int. Symposium, 1SM1S '91, Proc., Charlotte, North Carolina, October 1991. Springer-Verlag.
11. T. Jaakkola, M.I. Jordan, and S.P. Singh. On the convergence of stochastic iterative dynamic programming algorithms. Neural Computation, 6(6), 1994.
12. L.-J. Lin. Reinforcement Learning for Robots Using Neural Networks. PhD thesis, Computer Science Department, Carnegie-Mellon University, Pittsburgh, Pennsylvania, 1993.
13. Shieu-Hong Lin. Exploiting Structure for Planning and Control. PhD thesis, Computer Science Department, Brown University, Providence, Rhode Island, 1997.
14. A. McGovern, R. S. Sutton, and A. H. Fagg. Roles of macro-actions in accelerating reinforcement learning. In 1997 Grace Hopper Celebration of Women in Computing, 1997.
15. D. Precup and R. S. Sutton. Multi-time models for temporally abstract planning. In This Volume.
16. S. P. Singh. Scaling reinforcement learning algorithms by learning variable temporal resolution models. In Proceedings of the Ninth International Conference on Machine Learning, Aberdeen, July 1992. Morgan Kaufmann.
17. S. P. Singh. Transfer of learning by composing solutions of elemental sequential tasks. Machine Learning, 8(3), May 1992.
18. S. P. Singh, T. Jaakola, and M. I. Jordan. Reinforcement learning with soft state aggregation. In G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Neural Information Processing Systems 7, Cambridge, Massachusetts, 1995. MIT Press.
19. R. S. Sutton. Temporal abstraction in reinforcement learning. In Proc. of the Twelfth Int. Conference on Machine Learning, Tahoe City, CA, July 1995. Morgan Kaufmann.