A reinforcement learning approach to online web systems auto-configuration

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2009, Pages 2-11

  Bu, Xiangping ^a   Rao, Jia ^a   Xu, Cheng Zhong ^a  

^a Wayne State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTO-CONFIGURATION; INTERNET TRAFFIC; LEARNING TIME; MULTI-TIER; ONLINE DECISIONS; OPTIMAL CONFIGURATIONS; PERFORMANCE PARAMETERS; REINFORCEMENT LEARNING APPROACH; SERVICE AVAILABILITY; TPC-W BENCHMARK; VIRTUAL MACHINE CONFIGURATION; VIRTUAL MACHINE ENVIRONMENTS; WEB SYSTEM;

COMPUTER SCIENCE; REINFORCEMENT; REINFORCEMENT LEARNING; TECHNICAL PRESENTATIONS; WEBSITES;

ONLINE SYSTEMS;

EID: 70350217789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2009.76     Document Type: Conference Paper

References (20)

1. A. Bar-Hillel, A. Di-Nur, L. Ein-Dor, R. Gilad-Bachrach, and Y. Ittach. Workstation capacity tuning using reinforcement learning. In SC, 2007.
2. I.-H. Chung and J. K. Hollingsworth. Automated cluster-based web service performance tuning. In HPDC, pages 36-44, 2004.
3. S. Fu and C.-Z. Xu. Service migration in distributed virtual machines for adaptive grid computing. In ICPP, pages 358-365, 2005.
4. E. Ipek, O. Mutlu, J. F. Martinez, and R. Caruana. Self-optimizing memory controllers: A reinforcement learning approach. In ISCA, 2008.
5. X. Liu, L. Sha, Y. Diao, S. Froehlich, J. L. Hellerstein, and S. S. Parekh. Online response time optimization of apache web server. In IWQoS, pages 461-478, 2003.
6. D. L. Oppenheimer, A. Ganapathi, and D. A. Patterson. Why do internet services fail, and what can be done about it? In USENIX Symposium on Internet Technologies and Systems, 2003.
7. T. Osogami and S. Kato. Optimizing system configurations quickly by guessing at the performance. In SIGMETRICS, pages 145-156, 2007.
8. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys, 2007.
9. J. Rao, X. Bu, C.-Z. Xu, L. Wang, and G. Yin. Vconf:a reinforcement learning approach to virtual machine auto-configuration. In ICAC, 2009.
10. Rice University Computer Science Department. http://www.cs.rice.edu/CS/ System/DynaServer.
11. J. S.Graupner and S.Singhal. Making the utility data center a power station for the enterprise grid. In Technical Report HPL-2003-53, Hewlett Packard Laboratories, March 2003, 2003.
12. A. A. Soror, U. F. Minhas, A. Aboulnaga, K. Salem, P. Kokosielis, and S. Kamath. Automatic virtual machine configuration for database workloads. In SIGMOD Conference, 2008.
13. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
14. G. Tesauro. Online resource allocation using decompositional reinforcement learning. In AAAI, 2005.
15. G. Tesauro, R. Das, H. Chan, J. Kephart, D. Levine, F. Rawson, and C. Lefurgy. Managing power consumption and performance of computing systems using reinforcement learning. In Advances in Neural Information Processing Systems 20. 2007.
16. G. Tesauro, N. K. Jong, R. Das, and M. N. Bennani. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing, 2007.
17. J. Wildstrom, P. Stone, and E. Witchel. Carve: A cognitive agent for resource value estimation. In ICAC, 2008.
18. B. Xi, Z. Liu, M. Raghavachari, C. H. Xia, and L. Zhang. A smart hill-climbing algorithm for application server configuration. In WWW, pages 287-296, 2004.
19. Y. Zhang, W. Qu, and A. Liu. Automatic performance tuning for j2ee application server systems. In WISE, pages 520-527, 2005.
20. W. Zheng, R. Bianchini, and T. D. Nguyen. Automatic configuration of internet services. In EuroSys, pages 219-229, 2007.