Workstation capacity tuning using reinforcement learning

Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC'07

Volumn , Issue , 2007, Pages

  Bar Hillel, Aharon ^a   Di Nur, Amir ^b   Ein Dor, Liat ^a   Gilad Bachrach, Ran ^a   Ittach, Yossi ^a  

^a INTEL CORPORATION   (Israel)

^b INTEL CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTO-TUNING; AVERAGE THROUGHPUTS; COMPUTER GRIDS; CORE MACHINES; DYNAMIC POLICIES; DYNAMIC SYSTEMS; GRADUAL TRANSITIONS; MACHINE STATES; REINFORCEMENT LEARNING ALGORITHMS; SERVER CAPACITIES;

COMPUTER WORKSTATIONS; COMPUTERS; LEARNING SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; SERVERS; TUNING;

LEARNING ALGORITHMS;

EID: 56749154668     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1362622.1362666     Document Type: Conference Paper

References (23)

1. S. Albers, L. Favrholdt, and 0, Giel, On paging with locality of reference. In Annual ACM symposium on theory of computing, volume 34, pages 258-267, 2002.
2. L. Chrisman. Reinforcement learning with perceptual aliasing: The perceptual distinctions approach. In National Conference on Artificial Intelligence, pages 183-188, 1992.
3. P. J. Denning. The working set model for program behavior. Communications of the ACM, 11(5):323-333, 1968.
4. D. Ernst, P. Geurts, and L. Wehenkel. iteratively extending time horizon reinforcement learning. In European Conference on Machine Learning (ECML), pages 96-107, 2003.
5. D. Ernst, P. Geurts, and L. Wehenkel. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research (JMLR), 6:503-556, 2005.
6. E. A. Feinberg and A. Shwartz, editors. Handbook of Markov Decision Processes methods and applications. Kluwer, 2002.
7. D. G. Fietelson. The supercomputer industry in light of the top500 data. Comput. in Science and Engineering, 7(1), 2005.
8. I. Foster. What is the grid? a three point checklist. In GRID Today, 2002.
9. A. Galstyan, K. Czajkowski, and K. Lerman. Resource allocation in the grid using reinforcement learning. In International Joint Conference on Autonomous Agents and Multiagent Systems, volume 3, pages 1314 - 1315, 2004.
10. A. Glockner and J. Pasquale. Goadaptive behaviour in a simple distributed job scheduling system. IEEE transactions on Systems, Man and Cybernetics, 23(3):902-907, 1993.
11. A. R. Karlin, S. J. Phillips, and P. Raghavan. Markov paging. Siam J. Compute., 30(3):906-922, 2000.
12. M. Litzkow, M. Livny, and M. Mutka. Condor - a hunter of idle workstations. In Int. Conference of Distributed Computing Systems, June 1988.
13. S. M. Majercik and M. L. Littman. Reinforcement learning for selfish load balancing in a distributed memory environment. In International Conference on Information Sciences, pages 262-265, 1997.
14. R. Mirchandaney, D. Towsley, and J. A. Stankovic. Analysis of the effects of delays on load sharing. IEEE Trans. Comput., 38(11):1513-1525, 1989.
15. S. Pulidas, D. Towsley, and J. Stankovic. Imbedding gradient estimators in load balancing algorithms. In Int. Conference of Distributed Computing Systems, pages 482-489, 1988.
16. A. Schaerf, Y. Shoham, and M. Tennenholtz. Adaptive load balancing: A study in multi-agent learning. pages 475-500, 1995.
17. A. Snavely and J. Kepner. 99% utilization - is 99% utilization of a supercomputer a good thing? In ACM/IEEE conference on Supercomputing, page 37, New York, NY, USA, 2006. ACM Press.
18. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
19. G. Tesauro. Online resource allocation using decompositional reinforcement learning. In AAAI, pages 886-891, 2005.
20. G. Tesauro, N. K. Jong, R. Das, and M. N. Bennani. Improvement of systems management policies using hybrid reinforcement learning. In European Conference on Machine Learning (ECML), pages 783-791, 2006.
21. W. E. Walsh, G. Tesauro, J. O. Kephart, and R. Das. Utility functions in autonomic systems. In Int. Conference of Autonomic Computing, pages 70-77, 2004.
22. L. R.. Welch. Hidden markov models and the baum-welch algorithm. IEEE Information Theory Society Newsletter, 53(4), December 2003.
23. E. Yom-Tov and Y. Aridor. Improving resource matching through estimation of actual job requirements. In IEEE Int. Symposium on High Performance Distributed Computing (HPDC), pages 367-368, 2006.