Improved switching among temporally abstract actions

Advances in Neural Information Processing Systems

Volumn , Issue , 1999, Pages 1066-1072

  Sutton, Richard S ^a   Singh, Satinder ^a   Precup, Doina ^b   Ravindran, Balaraman ^b  

^a AT AND T LABS RESEARCH   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES; ROBOTICS;

ADDITIONAL COSTS; CONTROL APPLICATIONS; EXISTING CONTROLLERS; HIGH LEVEL CONTROLLERS; MARKOV DECISION PROCESSES; RE-PLANNING; SEMI-MARKOV DECISION PROCESS; SUBTASKS;

CONTROLLERS;

EID: 0000672258     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Bradtke, S. J. & Duff, M. O. (1995). Reinforcement learning methods for continuous-time Markov decision problems. In NIPS 7 (393-500). MIT Press.
2. Dayan, P. & Hinton, G. E. (1993). Feudal reinforcement learning. In NIPS 5 (271-278). MIT Press.
3. Dietterich, T. G. (1998). The MAXQ method for hierarchical reinforcement learning. In Proceedings of the Fifteenth International Conference on Machine Learning. Morgan Kaufmann.
4. Kaelbling, L. P. (1993). Hierarchical learning in stochastic domains: Preliminary results. In Proceedings of the Tenth International Conference on Machine Learning (167-173). Morgan Kaufmann.
5. Mahadevan, S., Marchallek, N., Das, T. K. & Gosavi, A. (1997). Self-improving factory simulation using continuous-time average-reward reinforcement learning. In Proceedings of the Fourteenth International Conference on Machine Learning (202-210). Morgan Kaufmann.
6. McGovern, A., and Sutton., R. S., & Fagg, A. H. (1997). Roles of macro-actions in accelerating reinforcement learning. In Grace Hopper Celebration of Women in Computing (13-17).
7. Parr, R. & Russell, S. (1998). Reinforcement learning with hierarchies of machines. In NIPS 10. MIT Press.
8. Puterman, M. L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley.
9. Singh, S. P. (1992). Reinforcement learning with a hierarchy of abstract models. In Proceedings of the Tenth National Conference on Artificial Intelligence (202-207). MIT/AAAI Press.
10. Sutton, R. S. (1995). TD models: Modeling the world as a mixture of time scales. In Proceedings of the Twelfth International Conference on Machine Learning (531-539). Morgan Kaufmann.
11. Sutton, R. S., Precup, D. & Singh, S. (1998). Intra-option learning about temporally abstract actions. In Proceedings of the Fifteenth International Conference on Machine Learning. Morgan Kaufman.
12. Sutton, R. S., Precup, D. & Singh, S. (1998). Between MDPs and Semi-MDPs: learning, planning, and representing knowledge at multiple temporal scales. TR 98-74, Department of Comp. Sci., University of Massachusetts, Amherst.
13. Thrun, S. & Schwartz, A. (1995). Finding structure in reinforcement learning. In NIPS 7 (385-392). MIT Press.