Modeling virtualized applications using machine learning techniques

ACM SIGPLAN Notices

Volumn 47, Issue 7, 2012, Pages 3-14

  Kundu, Sajib ^a   Rangaswami, Raju ^a   Gulati, Ajay ^b   Zhao, Ming ^a   Dutta, Kaushik ^c  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

^b VMWARE INC   (United States)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Cloud data centers; Machine learning; Performance modeling; Virtualization; VM sizing

Indexed keywords

CLOUD DATA CENTERS; CLOUD SERVICE PROVIDERS; EFFECTIVE APPROACHES; MACHINE LEARNING TECHNIQUES; MULTI-DIMENSIONAL MODELING; PERFORMANCE MODELING; VIRTUALIZATIONS; VM SIZINGS;

LEARNING SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; SUPPORT VECTOR MACHINES;

BENCHMARKING;

EID: 84878473891     PISSN: 15232867     EISSN: None     Source Type: Journal    
DOI: 10.1145/2365864.2151028     Document Type: Conference Paper

References (38)

1. Amazon elastic compute cloud (amazon EC2). http://aws.amazon.com/ec2/.
2. Filebench: a framework for simulating applications on file systems. http://www.solarisinternals.com/wiki/index.php/FileBench.
3. fio: Flexible I/O tester. http://freshmeat.net/projects/fio/.
4. fpc: Flexible procedures for clustering. http://cran.rproject. org/web/packages/fpc/index.html.
5. LIBSVM: A Library for Support Vector Machines. http://www.csie.ntu.edu. tw/cjlin/libsvm/.
6. The R Project for Statistical Computing. http://www.r-project.org/.
7. RUBiS: Rice University Bidding System. http://rubis.ow2.org/.
8. E. Alpaydin. Introduction to machine learning. MIT Press, 2004.
9. M. N. Bennani and D. A. Menascé. Resource allocation for autonomic data centers using analytic performance models. In ICAC, pages 229-240. IEEE Computer Society, 2005. (Pubitemid 43959626)
10. P. Bodik, M. Goldszmidt, A. Fox, D. B. Woodard, and H. Andersen. Fingerprinting the datacenter: Automated classification of performance crises. In Euro Sys '10 Proceedings of the 5th European conference on Computer systems, pages 111-124, 2010.
11. A. T. Clements, I. Ahmad, M. Vilayannur, and J. Li. Decentralized Deduplication in SAN Cluster File Systems. In Proc. of USENIX ATC, June 2009.
12. I. Cohen, M. Goldszmidt, T. Kelly, J. Symons, and J. S. Chase. Correlating instrumentation data to system states: A building block for automated diagnoses and control. In Proc. of the 6th USENIX OSDI), 2004.
13. I. Cohen, S. Zhang, M. Goldszmidt, J. Symons, T. Kelly, and A. Fox. Capturing, indexing, clustering, and retrieving system history. In Proc. of ACM SOSP, 2005.
14. R. P. Doyle, J. S. Chase, O. M. Asad, W. Jin, and A. Vahdat. Modelbased resource provisioning in a web service utility. In USENIX Symposium on Internet Technologies and Systems, 2003.
15. U. Drepper. The Cost of Virtualization. ACM Queue, Feb. 2008.
16. A. Ganapathi, Y. Chen, A. Fox, R. Katz, and D. Patterson. Statisticsdriven workload modeling for the cloud. In SMDB, 2010.
17. A. Gulati, I. Ahmad, and C. Waldspurger. PARDA: Proportionate Allocation of Resources for Distributed Storage Access. In Proc. of USENIX FAST, Feb. 2009.
18. A. Gulati, A. Merchant, and P. Varman. mClock: Handling Throughput Variability for Hypervisor IO Scheduling. In 9th USENIX OSDI, October 2010.
19. S. Haykin. Neural Networks: A Comprehensive Foundation. Prentice Hall, 2nd edition, 1998.
20. J. Katcher. Postmark: A new file system benehmark. Technical report, Network Appliance, 1997.
21. E. Kotsovinos. Virtualization: Blessing or Curse? ACM Queue, Jan. 2011.
22. S. Kundu, R. Rangaswami, K. Dutta, and M. Zhao. Application Performance Modeling in a Virtualized Environment. In Proc. of IEEE HPCA, January 2010.
23. X. Liu, X. Zhu, S. Singhal, and M. F. Arlitt. Adaptive entitlement control of resource containers on shared servers. In IM, pages 163-176. IEEE, 2005. (Pubitemid 43804452)
24. J. C. McCullough, Y. Agarwal, J. Chandrashekar, S. Kuppuswamy, A. C. Snoeren, and R. K. Gupta. Evaluating the effectiveness of model-based power characterization. In Proc. of USENIX Annual Technical Conference, 2011.
25. R. Nathuji, A. Kansal, and A. Ghaffarkhah. Q-clouds: managing performance interference effects for qos-aware clouds. In Euro Sys '10, pages 237-250, 2010.
26. P. Padala, K.-Y. Hou, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. G. Shin. Automated control of multiple virtualized resources. In Proceedings of the 4th ACM European conference on Computer systems/Euro Sys, pages 13-16, 2009.
27. J. Rao, X. Bu, C.-Z. Xu, L. Y. Wang, and G. G. Yin. VCONF: a reinforcement learning approach to virtual machines auto-configuration. In ICAC, pages 137-146. ACM, 2009.
28. C. Stewart, T. Kelly, A. Zhang, and K. Shen. A dollar from 15 cents: Cross-platform management for internet services. In Proceedings of the USENIX Annual Techinal Conference, pages 199-212, 2008.
29. S. Uttamchandani, L. Yin, G. A. Alvarez, J. Palmer, and G. Agha. Chameleon: a self-evolving, fully-adaptive resource arbitrator for storage systems. In Proc. of USENIX Annual Technical Conference, 2005.
30. VMware, Inc. Introduction to VMware Infrastructure. 2010. http://www.vmware.com/support/pubs/.
31. VMware, Inc. vSphere Resource Management Guide: ESX 4.1, ESXi 4.1, vCenter Server 4.1. 2010.
32. W. Vogels. Beyond Server Consolidation. ACM Queue, Feb. 2008.
33. C. A. Waldspurger. Memory resource management in vmware esx server. In Proc. of USENIX OSDI, 2002.
34. Z. Wang, X. Zhu, and S. Singhal. Utilization and slo-based control for dynamic sizing of resource partitions. In Proc. of 16th IFIP/IEEE Distributed Systems: Operations and Management (DSOM), October 2005.
35. J. Wildstrom, P. Stone, and E. Witchel. CARVE: A cognitive agent for resource value estimation. In ICAC, pages 182-191. IEEE Computer Society, 2008.
36. T. Wood, L. Cherkasova, K. Ozonat, and P. Shenoy. Profiling and modeling resource usage of virtualized applications. In Proc. of ACM/IFIP/USENIX Middleware, 2008.
37. J. Xu, M. Zhao, J. A. B. Fortes, R. Carpenter, and M. S. Yousif. Autonomic resource management in virtualized data centers using fuzzy logic-based approaches. Cluster Computing, 11(3):213-227, 2008.
38. W. Zheng, R. Bianchini, G. J. Janakiraman, J. R. Santos, and Y. Turner. JustRunIt: Experiment-Based Management of Virtualized Data Centers. In Proceeding of the USENIX Annual Technical Conference, 2009.