Online resource allocation using decompositional reinforcement learning

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2005, Pages 886-889

  Tesauro, Gerald ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES; ONLINE SYSTEMS; QUEUEING THEORY; RESOURCE ALLOCATION; SERVERS; TIME VARYING SYSTEMS;

NON-MARKOVIAN SYSTEM; REINFORCEMENT LEARNING; SELF-MANAGING COMPUTING SYSTEMS;

LEARNING SYSTEMS;

EID: 29344462255     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Dietterich, T. G. 2000. Hierarchical reinforcement learning with the MAXQ value function decomposition. J. of AI Research 13:227-303.
2. Guestrin, C.; Lagoudakis, M.; and Parr, R. 2002. Coordinated reinforcement learning. In Proceedings of ICML-02,227-234.
3. ICAC. 2004. Proceedings of the First International Conference on Autonomic Computing. IEEE Computer Society.
4. Kearns, M. J., and Koller, D. 1999. Efficient reinforcement learning in factored MDPs. In Proceedings of UCAI-99, 740-747.
5. Kephart, J. O., and Chess, D. M. 2003. The vision of autonomic computing. Computer 36(1):41-52.
6. Meuleau, N.; Hauskrecht, M.; Kim, K.-E.; Peshkin, L.; Kaelbling, L.; Dean, T.; and Boutilier, C. 1998. Solving very large weakly coupled Markov Decision Processes. In Proceedings of AAAI-98, 165-172.
7. Russell, S., and Zimdars, A. L. 2003. Q-decomposition for reinforcement learning agents. In Proceedings of lCML-03, 656-663.
8. Singh, S., and Cohn, D. 1998. How to dynamically merge Markov Decision Processes. In Jordan, M. I.; Kearns, M. J.; and Solla, S. A., eds., Advances in Neural Information Processing Systems, volume 10, 1057-1063. MIT Press.
9. Squillante, M. S.; Yao, D. D.; and Zhang, L. 1999. Internet traffic: Periodicity, tail behavior and performance implications. In Gelenbe, E., ed., System Performance Evaluation: Methodologies and Applications. CRC Press.
10. Trade3. 2004. Websphere benchmark sample. http://www.ibm.com/software/ webservers/appserv/benchmark3.html.
11. Walsh, W. E.; Tesauro, G.; Kephart, J. O.; and Das, R. 2004. Utility functions in autonomic systems. In 1st IEEE International Conference on Autonomic Computing, 70-77.