HCloud : Resource-efficient provisioning in shared cloud systems

ACM SIGPLAN Notices

Volumn 51, Issue 4, 2016, Pages 473-488

  Delimitrou, Christina ^a   Kozyrakis, Christos ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Cloud computing; Datacenter; Hybrid; Latency; Provisioning; QoS; Resource efficiency

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SCIENCE;

CRITICAL APPLICATIONS; HYBRID CONFIGURATIONS; HYBRID PROVISIONING; IMPROVE PERFORMANCE; MULTIDIMENSIONAL PROBLEMS; ON-DEMAND ALLOCATIONS; QUALITY OF SERVICE CONSTRAINTS; RESOURCE-EFFICIENT;

QUALITY OF SERVICE;

EID: 85101474181     PISSN: 15232867     EISSN: None     Source Type: Journal    
DOI: 10.1145/2872362.2872365     Document Type: Article

References (71)

1. Amazon ec2. http://aws.amazon.com/ec2/.
2. K. Annapureddy. Security challenges in hybrid cloud infrastructures. In Aalto University, T-110.5290 Seminar on Network Security. 2010.
3. Autoscale. https://cwiki.apache.org/cloudstack/autoscaling.html.
4. Aws autoscaling. http://aws.amazon.com/autoscaling/.
5. G. Banga, P. Druschel, and J. Mogul. Resource containers: a new facility for resource management in server systems. In Proceeedings of OSDI. New Orleans, 1999.
6. S. K. Barker and P. Shenoy. Empirical evaluation of latencysensitive application performance in the cloud. In Proceedings of the First Annual ACM SIGMM Conference on Multimedia Systems (MMsys). Scottsdale, AR, 2010.
7. L. Barroso.Warehouse-scale computing: Entering the teenage decade. ISCA Keynote, SJ, June 2011.
8. L. Barroso and U. Hoelzle. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. MC Publishers, 2009.
9. O. A. Ben-Yehuda, M. Ben-Yehuda, A. Schuster, and D. Tsafrir. Deconstructing amazon ec2 spot instance pricing. In ACM TEAC, 1(3), September 2013.
10. G. Breiter and V. Naik. A framework for controlling and managing hybrid cloud service integration. In Proceedings of the 2013 IEEE International Conference on Cloud Engineering (IC2E). Redwood City, CA, 2013.
11. M. Carvalho, W. Cirne, F. Brasileiro, and J. Wilkes. Longterm slos for reclaimed cloud computing resources. In Proceedings of ACM Symposium on Cloud Computing (SOCC). Seattle, WA, 2014.
12. J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proceedings of the Symposium on Operating Systems Principles (SOSP). Banff, CA, 2001.
13. Linux containers. http://lxc.sourceforge.net/.
14. J. Dean and L. A. Barroso. The tail at scale. In Communications of the ACM (CACM), Vol. 56 No. 2, Pages 74-80.
15. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the cloud: The montage example. In Proceedings of Supercomputing (SC). Austin, TX, 2008.
16. C. Delimitrou, N. Bambos, and C. Kozyrakis. QoS-Aware Admission Control in Heterogeneous Datacenters. In Proceedings of the International Conference of Autonomic Computing (ICAC). San Jose, CA, USA, 2013.
17. C. Delimitrou and C. Kozyrakis. iBench: Quantifying Interference for Datacenter Workloads. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC). Portland, OR, September 2013.
18. C. Delimitrou and C. Kozyrakis. Paragon: QoS-Aware Scheduling for Heterogeneous Datacenters. In Proceedings of the Eighteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Houston, TX, 2013.
19. C. Delimitrou and C. Kozyrakis. QoS-Aware Scheduling in Heterogeneous Datacenters with Paragon. In ACM Transactions on Computer Systems (TOCS), Vol. 31 Issue 4. December 2013.
20. C. Delimitrou and C. Kozyrakis. Quality-of-Service-Aware Scheduling in Heterogeneous Datacenters with Paragon. In IEEE Micro Special Issue on Top Picks from the Computer Architecture Conferences. May/June 2014.
21. C. Delimitrou and C. Kozyrakis. Quasar: Resource-Efficient and QoS-Aware Cluster Management. In Proceedings of the Nineteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Salt Lake City, UT, USA, 2014.
22. C. Delimitrou, D. Sanchez, and C. Kozyrakis. Tarcil: Reconciling Scheduling Speed and Quality in Large Shared Clusters. In Proceedings of the Sixth ACM Symposium on Cloud Computing (SOCC). Kohala Coast, HI, 2015.
23. B. Farley, A. Juels, V. Varadarajan, T. Ristenpart, K. D. Bowers, and M. M. Swift. More for your money: Exploiting performance heterogeneity in public clouds. In Proceedings of the ACM Symposium on Cloud Computing (SOCC). San Jose, CA, 2012.
24. Google compute engine. https://developers.google. com/compute/.
25. D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper. Workload analysis and demand prediction of enterprise data center applications. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC). Boston, MA, 2007.
26. Z. Gong, X. Gu, and J. Wilkes. Press: Predictive elastic resource scaling for cloud systems. In Proceedings of the International Conference on Network and Service Management (CNSM). Niagara Falls, ON, 2010.
27. G. R. Grimmett and D. R. Stirzaker. Probability and random processes. 2nd Edition. Clarendon Press, Oxford, 1992.
28. M. Guevara, B. Lubin, and B. Lee. Navigating heterogeneous processors with market mechanisms. In Proceedings of the IEEE Symposium on High Performance Computer Architecture (HPCA). Shenzhen, China, 2013.
29. J. Hamilton. Cost of power in large-scale data centers. http://perspectives.mvdirona.com.
30. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: A platform for finegrained resource sharing in the data center. In Proceedings of the USENIX Sumposium on Networked Systems Design and Implementation (NSDI). Boston, MA, 2011.
31. M. Hoseinyfarahabady, H. Samani, L. Leslie, Y. C. Lee, and A. Zomaya. Handling uncertainty: Pareto-efficient bot scheduling on hybrid clouds. In Proceedings of the International Conference for Parallel Processing (ICPP). Lyon, France, 2013.
32. A. Iosup, N. Yigitbasi, and D. Epema. On the performance variability of production cloud services. In Proceedings of IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). Newport Beach, CA, 2011.
33. V. Khadilkar, K. Y. Oktay, B. Hore, M. Kantarcioglu, S. Mehrotra, and B. Thuraisingham. Risk-aware data processing in hybrid clouds. TR-UTDCS-31-11, 2011.
34. Y. E. Khamra, H. Kim, S. Jha, and M. Parashar. Exploring the performance fluctuations of hpc workloads on clouds. In Proceeedings of IEEE International Conference on Cloud Computing Technology and Science (CloudCom). Indianapolis, IN, 2010.
35. L. Kleinrock. Queueing systems volume 1: Theory. pp. 101-103, 404.
36. E. Lau, J. E. Miller, I. Choi, D. Yeung, S. Amarasinghe, and A. Agarwal. Multicore performance optimization using partner cores. In Proceedings of the USENIX Workshop on Hot Topics in Parallelism (HotPar). Berkeley, CA, 2011.
37. J. Laudon. Performance/watt: the new server focus. In ACM SIGARCH Computer Architecture News: dasCMP. Vol. 33 Issue 4, p. 5-13, November 2005.
38. A. Li, X. Yang, S. Kandula, and M. Zhang. Cloudcmp: Comparing public cloud providers. In Proceeedings of Internet Measurement Conference (IMC). Melbourne, Australia, 2010.
39. Host server cpu utilization in amazon ec2 cloud. http://goo.gl/nCfYFX.
40. J. Lorch and A. Smith. Reducing processor power consumption by improving processor time management in a singleuser operating system. In Proceeedings of Annual International Conference on Mobile Computing and Networking (Mobicom). New York, NY, 1996.
41. Mahout. http://mahout.apache.org/.
42. D. Mangot. Ec2 variability: The numbers revealed. http://goo.gl/NAH2lm.
43. J. Mars and L. Tang. Whare-map: heterogeneity in "homogeneous" warehouse-scale computers. In Proceeedings of the International Symposium on Computer Architecture (ISCA). Tel-Aviv, Israel, 2013.
44. J. Mars, L. Tang, R. Hundt, K. Skadron, and M. L. Soffa. Bubble-up: increasing utilization in modern warehouse scale computers via sensible co-locations. In Proceeedings of the IEEE/ACM International Symposium on Microarchitecture (MICRO). Porto Alegre, Brazil, 2011.
45. S. M. Martin, K. Flautner, T. Mudge, and D. Blaauw. Combined dynamic voltage scaling and adaptive body biasing for lower power microprocessors under dynamic workloads. In Proceeedings of International Conference On Computer Aided Design (ICCAD). 2002.
46. R. Nathuji, C. Isci, and E. Gorbatov. Exploiting platform heterogeneity for power efficient data centers. In Proceeedings of the International Conference on Autonomic Computing (ICAC). Jacksonville, FL, 2007.
47. R. Nathuji, A. Kansal, and A. Ghaffarkhah. Q-clouds: Managing performance interference effects for qos-aware clouds. In Proceeedings of EuroSys France, 2010.
48. H. Nguyen, Z. Shen, X. Gu, S. Subbiah, and J.Wilkes. Agile: Elastic distributed resource scaling for infrastructure-as-aservice. In Proceedings of the International Conference on Autonomic Computing (ICAC). 2013.
49. D. Novakovic, N. Vasic, S. Novakovic, D. Kostic, and R. Bianchini. Deepdive: Transparently identifying and managing performance interference in virtualized environments. In Proceeedings of the USENIX Annual Technical Conference (ATC). San Jose, CA, 2013.
50. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema. A performance analysis of ec2 cloud computing services for scientific computing. In Lecture Notes on Cloud Computing. Volume 34, p.115-131, 2010.
51. Z. Ou, H. Zhuang, J. K. Nurminen, A. Yl¨a-J¨äaski, and P. Hui. Exploiting hardware heterogeneity within the same instance type of amazon ec2. In HotCloud. 2012.
52. K. Ousterhout, P. Wendell, M. Zaharia, and I. Stoica. Sparrow: Distributed, low latency scheduling. In Proceeedings of the Symposium on Operating Systems Principles (SOSP). Farminton, PA, 2013.
53. M. Rehman and M. Sakr. Initial findings for provisioning variation in cloud computing. In Proceeedings of CloudCom. Indianapolis, IN, 2010.
54. C. Reiss, A. Tumanov, G. Ganger, R. Katz, and M. Kozych. Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In Proceeedings of ACM Symposium on Cloud Computing (SOCC). 2012.
55. Rightscale. https://aws.amazon.com/solution-providers/isv/rightscale.
56. J. Schad, J. Dittrich, and J.-A. Quiané-Ruiz. Runtime measurements in the cloud: Observing, analyzing, and reducing variance. Proceeedings VLDB Endow., 3(1-2):460-471, Sept. 2010.
57. M. Schwarzkopf, A. Konwinski, M. Abd-El-Malek, and J. Wilkes. Omega: flexible, scalable schedulers for large compute clusters. In Proceeedings of EuroSys. 2013.
58. Z. Shen, S. Subbiah, X. Gu, and J. Wilkes. Cloudscale: elastic resource scaling for multi-tenant cloud systems. In Proceeedings of ACM Symposium on Cloud Computing (SOCC). Cascais, Portugal, 2011.
59. T. Simunic and S. Boyd. Managing power consumption in networks on chips. In Proceeedings of Design Automation Conference (DAC). Paris, France, 2002.
60. S. Swanson, A. Putnam, M. Mercaldi, K. Michelson, A. Petersen, A. Schwerin, M. Oskin, and S. J. Eggers. Areaperformance trade-offs in tiled dataflow architectures. In Proceeedings of ACM SIGARCH Computer Architecture News, v.34 n.2, p.314-326, May 2006.
61. K. Therdsteerasukdi, G. Byun, J. Cong, F. Chang, and G. Reinman. Utilizing rf-i and intelligent scheduling for better throughput/watt in a mobile gpu memory system. In Transactions on Architecture and Code Optimization (TACO) 8(4). 2012.
62. Torque resource manager. http://www.adaptivecomputing. com/products/open-source/torque/.
63. N. Vasíc, D. Novakovíc, S. Miucin, D. Kostíc, and R. Bianchini. Dejavu: accelerating resource allocation in virtualized environments. In Proceedings of the Seventeenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). 2012.
64. G.Wang and T. S. E. Ng. The impact of virtualization on network performance of amazon ec2 data center. In Proceeedings of IEEE International Conference on Computer Communications (INFOCOM). San Diego, CA, 2010.
65. Windows azure. http://www.windowsazure.com/.
66. H. Yang, A. Breslow, J. Mars, and L. Tang. Bubble-flux: precise online qos management for increased utilization in warehouse scale computers. In Proceeedings of the International Symposium on Computer Architecture (ISCA). 2013.
67. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. Mc-Cauley, M. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In Proceedings of the USENIX Sumposium on Networked Systems Design and Implementation (NSDI). San Jose, CA, 2012.
68. S. M. Zahed and B. C. Lee. Ref: Resource elasticity fairness with sharing incentives for multiprocessors. In Proceeedings of the Nineteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Salt Lake City, UT, 2014.
69. J. Y. Zhang, P. Wu, J. Zhu, H. Hu, and F. Bonomi. Privacypreserved mobile sensing through hybrid cloud trust framework. In Proceeedings of IEEE International Conference on Cloud Computing (CLOUD). 2013.
70. X. Zhang, E. Tune, R. Hagmann, R. Jnagal, V. Gokhale, and J. Wilkes. Cpi2: Cpu performance isolation for shared compute clusters. In Proceeedings of EuroSys. Prague, 2013.
71. L. Zhao, R. Iyer, J. Moses, R. Illikkal, S. Makineni, and D. Newell. Exploring large-scale cmp architectures using manysim. In IEEE Micro, vol.27 n.4, July 2007.