FCMS: A fuzzy controller for CPU and memory consolidation under SLA constraints

Concurrency and Computation: Practice and Experience

Volumn 29, Issue 5, 2017, Pages

  Anglano, Cosimo ^a   Canonico, Massimo ^a   Guazzone, Marco ^a  

^a UNIVERSITY OF EASTERN PIEDMONT   (Italy)

Author keywords

cloud computing, feedback control, fuzzy control, resource management, server consolidation, virtualized cloud applications

Indexed keywords

CONTROLLERS; FUZZY CONTROL; VIRTUAL MACHINE;

ALTERNATIVE SOLUTIONS; DYNAMIC ALLOCATIONS; EXPERIMENTAL EVALUATION; MEMORY CONSOLIDATION; RESOURCE CONTENTION; RESOURCE MANAGEMENT; SERVER CONSOLIDATION; SERVICE LEVEL AGREEMENT (SLAS);

FEEDBACK;

EID: 85006153412     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.3968     Document Type: Article

References (79)

1. Armbrust M, Fox A, Griffith R, et al. A view of cloud computing. Commun ACM. 2010;53(4):50–58.
2. st International Workshop on Energy-Efficient Data Centres (E2DC). Springer-Verlag, Berlin, Heidelberg, Germany; 2012:81–92.
3. th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). IEEE Computer Society, Washington, DC, USA; 2014:618–625.
4. Amazon Web Services, Inc. Amazon Web Services. 2016. Available from: https://aws.amazon.com. Accessed September 12, 2016.
5. Rackspace. Rackspace: The Open Cloud Company. 2016. Available from: http://www.rackspace.com. Accessed September 12, 2016.
6. Vogels W. Beyond server consolidation. Queue. 2008;6(1):20–26.
7. Greenberg A, Hamilton J, Maltz DA, Patel P. The cost of a cloud: research problems in data center networks. Comput Comm Rev. 2009;39(1):68–73.
8. Maltz DA. Challenges in cloud scale data centers. Perform Eval Rev. 2013;41(1):3–4.
9. th IEEE International Symposium on Cluster Computing and the Grid (CCGRID).IEEE Computer Society, Washington, DC, USA; 2008:609–614.
10. Anglano C, Canonico M, Guazzone M. The ShareGrid peer-to-peer desktop grid: infrastructure, applications, and performance evaluation. J Grid Comput. 2010;8(4):543–570.
11. Wu L, Buyya R. Service level agreement (SLA) in utility computing systems. In: Cardellini V, Casalicchio E, Branco KRLJC, Estrella JC, Monaco FJ, eds. Performance and Dependability in Service Computing: Concepts, Techniques and Research Directions. Hershey, PA, USA: IGI Global; 2011: 286–310.
12. Amazon Web Services, Inc. Amazon EC2 Service Level Agreement. 2016. Available from: https://aws.amazon.com/ec2/sla/. Accessed September 12, 2016.
13. th International Conference on Autonomic Computing (ICAC), New York, NY, USA; 2009: 149–158.
14. th International Conference on Autonomic Computing (ICAC), New York, NY, USA; 2010: 21–30.
15. st International Symposium on Quality of Service (IWQOS), Piscataway, NJ, USA; 2013:1–10.
16. Xiao Z, Chen Q, Luo H. Automatic scaling of internet applications for cloud computing services. IEEE Trans Comput. 2014;63(5):1111–1123.
17. Lloyd W, Pallickara S, David O, Lyon J, Arabi M, Rojas K. Performance implications of multi-tier application deployments on infrastructure-as-a-service clouds: towards performance modeling. Future Generat Comput Syst. 2013;29(5):1254–1264.
18. Liu H, Jin H, Liao X, Deng W, He B, z. Xu C. Hotplug or ballooning: a comparative study on dynamic memory management techniques for virtual machines. IEEE Trans Parallel Distr Syst. 2015;26(5):1350–1363.
19. Lama P, Guo Y, Jiang C, Zhou X. Autonomic performance and power control for co-located web applications in virtualized datacenters. IEEE Trans Parallel Distr Syst. 2016;27(5):1289–1302.
20. Wang L, Xu J, Duran-Limon HA, Zhao M. QoS-driven cloud resource management through fuzzy model predictive control. Proc. 2015 IEEE International Conference on the Autonomic Computing (ICAC), Piscataway, NJ, USA; 2015:81–90.
21. Anglano C, Canonico M, Guazzone M. FC2Q: exploiting fuzzy control in server consolidation for cloud applications with SLA constraints. Concurrency Comput Pract Ex. 2015;27(17):4491–4514.
22. Rao J, Wei Y, Gong J, Xu CZ. QoS guarantees and service differentiation for dynamic cloud applications. IEEE Trans Netw Service Manag. 2013;10(1):43–55.
23. rd IEEE International Conference on Cloud Computing Technology and Science (CLOUDCOM).IEEE Computer Society, Washington, DC, USA; 2011:424–431.
24. rd International Cloud and Green Computing Conference (CGC). IEEE Computer Society, Washington, DC, USA; 2013:159–166.
25. Hellerstein JL, Diao Y, Parekh S, Tilbury DM. Feedback control of computing systems. Hoboken, NJ, USA: Wiley-IEEE Press; 2004.
26. Wang LX, Mendel JM. Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans Comput. 1992;3(5):807–814.
27. Kosko B. Fuzzy systems as universal approximators. IEEE Trans Comput. 1994;43(11):1329–1333.
28. Ghosh R, Longo F, Xia R, Naik VK, Trivedi KS. Stochastic model driven capacity planning for an infrastructure-as-a-service cloud. IEEE Trans Service Comput. 2014;7(4):667–680.
29. Ghosh R, Naik VK. Biting off safely more than you can chew: predictive analytics for resource over-commit in IaaS cloud. Proc. of the 5th International Conference on Cloud Computing (CLOUD). IEEE, 2012, Washington, DC, USA; 2012: 25–32.
30. Urgaonkar B, Shenoy P, Chandra A, Goyal P, Wood T. Agile dynamic provisioning of multi-tier Internet applications. ACM Trans Autonom Adapt Syst. 2008;3(1):1–39.
31. st ACM Sigops Symposium on Operating Systems Principles (SOSP), New York, NY, USA; 2007:205–220.
32. Casale G, Mi N, Cherkasova L, Smirni E. Dealing with burstiness in multi-tier applications: models and their parameterization. IEEE Trans Software Eng. 2012;38(5):1040–1053.
33. Chen Y, Alspaugh S, Katz R. Interactive analytical processing in big data systems: a cross-industry study of mapreduce workloads. Proceedings VLDB Endowment. 2012;5(12):1802–1813.
34. Lama P, Zhou X. Coordinated power and performance guarantee with fuzzy MIMO control in virtualized server clusters. IEEE Trans Comput. 2015;64(1):97–111.
35. Amazon Web Services, Inc. Amazon EC2 Pricing. 2016. Available from: https://aws.amazon.com/ec2/pricing/. Accessed September 12, 2016.
36. Google. Google Compute Engine Pricing. 2016. Available from: https://cloud.google.com/compute/pricing. Accessed September 12, 2016.
37. Rackspace. Rackspace Cloud Servers Pricing. 2016. Available from: http://www.rackspace.com/cloud/servers/pricing/. Accessed September 12, 2016.
38. Fedorova A, Seltzer M, Smith MD. A non-work-conserving operating system scheduler for SMT processors. Proc. of the Workshop on the Interaction Between Operating Systems and Computer Architecture (WIOSCA), Washington, DC, USA; 2006: 10–17.
39. Kambadur M, Moseley T, Hank R, Kim MA. Measuring interference between live datacenter applications. Proc. of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC). IEEE Computer Society Press, Los Alamitos, CA, USA; 2012:51:1–51:12.
40. Almeida J, Almeida V, Ardagna D, talo C, Francalanci C, Trubian M. Joint admission control and resource allocation in virtualized servers. J Parallel Distr Comput. 2010;70(4):344–362.
41. Urgaonkar R, Kozat UC, Igarashi K, Neely MJ. Dynamic resource allocation and power management in virtualized data centers. Proc. of the 2010 IEEE Network Operations and Management Symposium (NOMS), Piscataway, NJ, USA; 2010:479–486.
42. Borgetto D, Casanova H, Costa GD, Pierson JM. Energy-aware service allocation. Future Generat Comput Syst. 2012;28(5):769–779.
43. th ACM/IFIP/USENIX International Conference on Middleware (Middleware), New York, NY, USA; 2008:243–264.
44. Beloglazov A, Abawajy J, Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generat Comput Syst. 2012;28(5):755–768.
45. Liu H, He B. Vmbuddies: coordinating live migration of multi-tier applications in cloud environments. IEEE Trans Parallel Distr Syst. 2015;26(4):1192–1205.
46. Zao W, Want Z. Dynamic memory balancing for virtual machines. Proc. of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE 09), ACM, USA; 2009:21–30.
47. Waldspurger CA. Memory resource management in VMware ESX Server. SIGOPS Oper Syst Rev. 2002;36(SI):181–194.
48. th ACM Symposyum on Operating Systems Principles (SOSP). ACM, New York, NY, USA; 2003:164–177.
49. Kivity A, Kamay Y, Laor D, Lublin U, Liguori A. KVM: the linux virtual machine monitor. Proc. of the Linux Symposium, vol. 1; 2007:225–230.
50. Mamdani EH. Application of fuzzy logic to approximate reasoning using linguistic synthesis. IEEE Trans Comput. 1977;26(12):1182–1191.
51. Zadeh LA. Fuzzy sets. Inform Contr. 1965;8(3):338–353.
52. Chen G, Pham TT. Introduction to Fuzzy Sets, Fuzzy Logic, and Fuzzy Control Systems. Boca Raton, FL, USA: CRC Press; 2001.
53. Dunning T, Friedman E. Practical Machine Learning: A New Look at Anomaly Detection. Sebastopol, CA, USA: O'Reilly Media; 2014.
54. Dunning T. t-digest: an algorithm for computing extremely accurate quantiles. 2015. Available from: https://github.com/tdunning/t-digest. Accessed September 12, 2016
55. Anglano C, Canonico M, Guazzone M. Repository for the code used in our experimental evaluation. 2016. Available from: https://github.com/sguazt/fcms2016. Accessed September 12, 2016.
56. Red Hat 2016. Libvirt virtualization API. Available from: http://libvirt.org. Accessed September 12, 2016.
57. th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), New York, NY, USA; 2012:37–48.
58. Apache Software Foundation. The Cassandra project. 2016. Available from: http://cassandra.apache.org. Accessed September 12, 2016.
59. Sobel W, Subramanyam S, Sucharitakul A, et al. Cloudstone: multi-platform, multi-language benchmark and measurement tools for web 2.0. Proc. of the Cloud Computing and its Applications (CCA), vol. 8; 2008.
60. Apache Software Foundation. Olio web 2.0 toolkit. 2011. Available from: https://incubator.apache.org/projects/olio.html. Accessed September 12, 2016.
61. Sanfilippo S. Redis. 2008. Available from: http://redis.io. Accessed September 12, 2016.
62. OW2 Consortium. RUBBoS: Rice University bulletin board system. 2004. Available from: http://jmob.ow2.org/rubbos.html. Accessed September 12, 2016.
63. Amza C, Chanda A, Cox A, et al. Specification and implementation of dynamic web site benchmarks. Proc. of the IEEE International Workshop on Workload Characterization (WWC-5), Piscataway, NJ, USA; 2002:3–13.
64. OW2 Consortium. RUBiS: Rice University bidding system. 2008. Available from: http://rubis.ow2.org/index.html. Accessed September 12, 2016.
65. Beitch A, Liu B, Yung T, Griffith R, Fox A, Patterson DA. RAIN: a workload generation toolkit for cloud computing applications. Technical Report UCB/EECS-2010-14, University of California at Berkeley; 2010.
66. ® 2015a, Natick, MA. Available from: http://www.mathworks.com. Accessed September 12, 2016.
67. Jang JSR, Sun CT, Mizutani E. Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Englewood Cliff, NJ, USA:Prentice Hall; 1997.
68. Ljung L. System Identification: Theory for the User. 2nd ed. Englewood Cliff, NJ, USA: Prentice Hall; 1999.
69. Magenheimer D. Memory overcommit…without the commitment. Xen summit; 2008:1–3. Extended abstract.
70. Magenheimer D, Mason C, McCracken D, Hackel K. Transcendent memory and linux. Proc. of the Linux Symposium; 2009:191–200.
71. Schopp JH, Fraser K, Silbermann MJ. Resizing memory with balloons and hotplug. Proc. of the Linux Symposium, vol. 2; 2006:313–319.
72. Kim J, Fedorov V, Gratz PV, Reddy ALN. Dynamic memory pressure aware ballooning. Proc. of the 2015 International Symposium on Memory Systems (MEMSYS). ACM, New York, NY, USA; 2015:103–112.
73. Zhang WZ, Xie HC, Hsu CH. Automatic memory control of multiple virtual machines on a consolidated server. IEEE Trans Cloud Comput. 2015;PP(99):1–1.
74. Moltó G, Caballer M, de Alfonso C. Automatic memory-based vertical elasticity and oversubscription on cloud platforms. Future Generat Comput Syst. 2016;56:1–10.
75. Heo J, Zhu X, Padala P, Wang Z. Memory overbooking and dynamic control of Xen virtual machines in consolidated environments. Proc. of the IFIP/IEEE International Symposium on Integrated Network Management (IM), Piscataway, NJ, USA; 2009:630–637.
76. Lu L, Zhu X, Griffith R, et al. Application-driven dynamic vertical scaling of virtual machines in resource pools. Proc. of the 2014 IEEE Network Operations and Management Symposium (NOMS), Piscataway, NJ, USA; 2014:1–9.
77. Farokhi S, Lakew EB, Klein C, Brandic I, Elmroth E. Coordinating CPU and memory elasticity controllers to meet service response time constraints. Proc. of the 2015 International Conference on Cloud and Autonomic Computing (ICCAC), Piscataway, NJ, USA; 2015:69–80.
78. th ACM European Conference on Computer Systems (EUROSYS). ACM, New York, NY, USA; 2013:337–350.
79. th International Conference on Cloud Computing (CLOUD), Piscataway, NJ, USA; 2015:277–284.