VCONF: A reinforcement learning approach to virtual machines auto-configuration

Proceedings of the 6th International Conference on Autonomic Computing, ICAC'09

Volumn , Issue , 2009, Pages 137-146

  Rao, Jia ^a   Bu, Xiangping ^a   Xu, Cheng Zhong ^a   Wang, Leyi ^a   Yin, George ^b  

^a Wayne State University   (United States)

^b WAYNE STATE UNIVERSITY   (United States)

Author keywords

Autonomic computing; Cloud computing; Reinforcement learning; Virtual machines

Indexed keywords

AUTO-CONFIGURATION; AUTONOMIC COMPUTING; CLOUD COMPUTING; CONFIGURATION PROCESS; CONTROLLED ENVIRONMENT; MODEL-BASED; ON-LINE DETERMINATION; REINFORCEMENT LEARNING APPROACH; SMALL-SCALE SYSTEMS; SYSTEMS MANAGEMENT; VIRTUAL MACHINE TECHNOLOGY; VIRTUAL MACHINES;

COMPETITION; COMPUTER SCIENCE; EDUCATION; LARGE SCALE SYSTEMS; REINFORCEMENT LEARNING; SCALABILITY;

REINFORCEMENT;

EID: 70049107396     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1555228.1555263     Document Type: Conference Paper

References (33)

1. http://www.research.ibm.com/autonomic.
2. C. G. Atkeson and J. C. Santamar'ia. A comparison of direct and model-based reinforcement learning. In In ICRA, 1997.
3. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. L. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In SOSP, 2003.
4. X. Bu, J. Rao, C.-Z. Xu. A reinforcement learning approach to online web systems auto-configuration. In ICDCS, 2009.
5. G. Candea, E. Kiciman, S. Kawamoto, and A. Fox. Autonomous recovery in componentized internet applications. Cluster Computing, 2006.
6. J. P. Cassaza, M. Greenfield, and K. shi. Redefining server performance characterization for virtualization benchmarking. In Intel technology Journal, 2006.
7. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In NSDI, 2005.
8. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox. Capturing, indexing, clustering, and retrieving system history. In SOSP, 2005.
9. D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing performance isolation across virtual machines in xen. In Middleware, 2006.
10. Hyper-V server. http://www.microsoft.com/servers/hyper-v-server.
11. E. Ipek, O. Mutlu, J. F. Martinez, and R. Caruana. Self-optimizing memory controllers: A reinforcement learning approach. In ISCA, 2008.
12. A. Kamra, V. Misra, and E. M. Nahum. Yaksha: a self-tuning controller for managing the performance of 3-tiered web sites. In IWQoS, 2004.
13. M. Karlsson, C. T. Karamanolis, and X. Zhu. Triage: performance isolation and differentiation for storage systems. In IWQoS, 2004.
14. X. Liu, L. Sha, Y. Diao, S. Froehlich, J. L. Hellerstein, and S. S. Parekh. Online response time optimization of apache web server. In IWQoS, 2003.
15. D. Ongaro, A. L. Cox, and S. Rixner. Scheduling i/o in virtual machine monitors. In VEE, 2008.
16. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys, 2007.
17. J. Rao and C.-Z. Xu. Online measurement the capacity of multi-tier websites using hardware performance counters. In ICDCS, 2008.
18. A. A. Soror, U. F. Minhas, A. Aboulnaga, K. Salem, P. Kokosielis, and S. Kamath. Automatic virtual machine configuration for database workloads. In SIGMOD, 2008.
19. Y.-Y. Su, M. Attariyan, and J. Flinn. Autobash: improving configuration management with operating system causality analysis. In SOSP, 2007.
20. R. S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems. 1996.
21. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
22. G. Tesauro. Online resource allocation using decompositional reinforcement learning. In AAAI, 2005.
23. G. Tesauro, R. Das, H. Chan, J. Kephart, D. Levine, F. Rawson, and C. Lefurgy. Managing power consumption and performance of computing systems using reinforcement learning. In Advances in Neural Information Processing Systems. 2007.
24. G. Tesauro, N. K. Jong, R. Das, and M. N. Bennani. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing, 2007.
25. The SPECweb benchmark. http://www.spec.org/web2005.
26. http://www.tpc.org/tpcw.
27. http://www.tpc.org/tpcc.
28. VMware. http://www.vmware.com.
29. VMware VMmark. http://www.vmware.com/products/vmmark.
30. J. Wei and C.-Z. Xu. A self-tuning fuzzy control approach for end-to-end qos guarantees in web servers. In IWQoS, 2005.
31. A. Whitaker, R. S. Cox, and S. D. Gribble. Configuration debugging as search: Finding the needle in the haystack. In OSDI, 2004.
32. J. Wildstrom, P. Stone, and E. Witchel. Carve: A cognitive agent for resource value estimation. In ICAC, 2008.
33. S. Zhang, I. Cohen, M. Goldszmidt, J. Symons, and A. Fox. Ensembles of models for automated diagnosis of system performance problems. In DSN, 2005.