A model-free learning approach for coordinated configuration of virtual machines and appliances

IEEE International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems - Proceedings

Volumn , Issue , 2011, Pages 12-21

  Bu, Xiangping ^a   Rao, Jia ^a   Xu, Cheng Zhong ^a  

^a Wayne State University   (United States)

Author keywords

Autonomic Configuration; Cloud Computing; Reinforcement Learning

Indexed keywords

AUTONOMIC CONFIGURATION; COORDINATED TUNING; EXPLORATION POLICY; MODEL FREE; MODEL-FREE LEARNING; ON-THE-FLY; OPTIMAL CONFIGURATIONS; RESOURCE CONFIGURATIONS; SYSTEM DYNAMICS; SYSTEM KNOWLEDGE; THROUGHPUT IMPROVEMENT; TUNING STRATEGY; VIRTUAL MACHINES; VIRTUAL SERVERS; VIRTUALIZED ENVIRONMENT;

ALGORITHMS; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; TELECOMMUNICATION SYSTEMS; VIRTUAL REALITY;

CLOUD COMPUTING;

EID: 80052989069     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MASCOTS.2011.44     Document Type: Conference Paper

References (28)

1. http://www.tpc.org/tpcw.
2. http://www.tpc.org/tpcc.
3. M. Avriel. Nonlinear Programming: Analysis and Methods. Dover Publishing, 2003.
4. A. Bar-Hillel, A. Di-Nur, L. Ein-Dor, R. Gilad-Bachrach, and Y. Ittach. Workstation capacity tuning using reinforcement learning. In SC, 2007.
5. X. Bu, J. Rao, and C.-Z. Xu. A reinforcement learning approach to online web systems auto-configuration. In ICDCS, 2009.
6. I.-H. Chung and J. K. Hollingsworth. Automated cluster-based web service performance tuning. In HPDC, pages 36-44, 2004.
7. Y. Diao, J. L. H. andTesauro Sujay S. Parekh, H. Shaikh, and M. Surendra. Controlling quality of service in multi-tier web applications. In ICDCS, page 25, 2006.
8. J. Gong and C.-Z. Xu. A gray-box feedback control approach for system-level peak power management. In ICPP, 2010.
9. J. Gong and C.-Z. Xu. vpnp: Automated coordination of power and performance in virtualized datacenters. In IWQoS, 2010.
10. D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing performance isolation across virtual machines in xen. In Middleware, 2006.
11. E. Ipek, O. Mutlu, J. F. Martinez, and R. Caruana. Self-optimizing memory controllers: A reinforcement learning approach. In ISCA, 2008.
12. E. Kwan, S. Lightstone, K. B. Schiefer, A. J. Storm, and L. Wu. Automatic database configuration for db2 universal database: Compressing years of performance expertise into seconds of execution. In BTW, pages 620-629, 2003.
13. X. Liu, L. Sha, Y. Diao, S. Froehlich, J. L. Hellerstein, and S. S. Parekh. Online response time optimization of apache web server. In IWQoS, pages 461-478, 2003.
14. D. Ongaro, A. L. Cox, and S. Rixner. Scheduling i/o in virtual machine monitors. In VEE, 2008.
15. P. Padala, K.-Y. Hou, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, and A. Merchant. Automated control of multiple virtualized resources. In EuroSys, pages 13-26, 2009.
16. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys, 2007.
17. J. Rao, X. Bu, and C.-Z. Xu. A distributed self-learning approach for elastic provisioning of virtualized cloud resources. In MASCOTS, 2011.
18. J. Rao, X. Bu, C.-Z. Xu, L. Wang, and G. Yin. Vconf:a reinforcement learning approach to virtual machines autoconfiguraiton. In ICAC, 2009.
19. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
20. G. Tesauro. Online resource allocation using decompositional reinforcement learning. In AAAI, 2005.
21. G. Tesauro, R. Das, H. Chan, J. Kephart, D. Levine, F. Rawson, and C. Lefurgy. Managing power consumption and performance of computing systems using reinforcement learning. In Advances in Neural Information Processing Systems 20. 2007.
22. G. Tesauro, N. K. Jong, R. Das, and M. N. Bennani. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing, 2007.
23. Y. Wang, X. Wang, M. Chen, and X. Zhu. Power-efficient response time guarantees for virtualized enterprise servers. In IEEE Real-Time Systems Symposium, pages 303-312, 2008.
24. J. Wei and C.-Z. Xu. eqos: Provisioning of client-perceived end-to-end qos guarantees in web servers. IEEE Trans. Computers, 55(12):1543-1556, 2006.
25. A. Whitaker, R. S. Cox, and S. D. Gribble. Configuration debugging as search: Finding the needle in the haystack. In OSDI, 2004.
26. B. Xi, Z. Liu, M. Raghavachari, C. H. Xia, and L. Zhang. A smart hill-climbing algorithm for application server configuration. In WWW, pages 287-296, 2004.
27. C.-Z. Xu, J. Wei, and F. Liu. Model predictive feedback control for end-to-end qos guarantees in web servers. In IEEE Computer, 2008.
28. W. Zheng, R. Bianchini, and T. D. Nguyen. Automatic configuration of internet services. In EuroSys, 2007.