Autoscale: Dynamic, robust capacity management for multi-tier data centers

ACM Transactions on Computer Systems

Volumn 30, Issue 4, 2012, Pages

  Gandhi, Anshul ^a   Harchol Balter, Mor ^a   Raghunathan, Ram ^a   Kozuch, Michael A ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Data centers; Power management; Resource provisioning

Indexed keywords

AUTO-SCALE; DATA CENTERS; DYNAMIC CAPACITY; ENERGY COST; FACEBOOK; KEY FEATURE; MULTI-TIER; PEAK POWER; POWER MANAGEMENTS; RESOURCE PROVISIONING; ROBUST CAPACITY; SPARE CAPACITY; TIME VARYING LOADS;

ENERGY MANAGEMENT;

DIGITAL STORAGE;

EID: 84870549803     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2382553.2382556     Document Type: Article

References (46)

1. AMAZON INC. 2008. Amazon Elastic Compute Cloud (Amazon EC2).
2. ARMBRUST, M., FOX, A., GRIFFITH, R., JOSEPH, A. D., KATZ, R. H., KONWINSKI, A., LEE, G., PATTERSON, D. A., RABKIN, A., STOICA, I., and ZAHARIA, M. 2009. Above the clouds: A Berkeley view of cloud computing. Tech. rep. UCB/EECS-2009-28, EECS Department, University of California, Berkeley.
3. BARROSO, L. A. and HÖLZLE, U. 2007. The case for energy-proportional computing. Computer 40, 12, 33-37.
4. BOBROFF, N., KOCHUT, A., and BEATY, K. 2007. Dynamic placement of virtual machines for managing SLA violations. In Proceedings of the 10th IFIP/IEEE International Symposium on Integrated Network Management (IM'07). 119-128. (Pubitemid 47485165)
5. BODÍK, P., GRIFFITH, R., SUTTON, C., FOX, A., JORDAN, M., and PATTERSON, D. 2009. Statistical machine learning makes automatic control practical for internet datacenters. In Proceedings of the 2009 Conference on Hot Topics in Cloud Computing (HotCloud'09).
6. CASTELLANOS, M., CASATI, F., SHAN, M.-C., and DAYAL, U. 2005. iBOM: A platform for intelligent business operation management. In Proceedings of the 21st International Conference on Data Engineering (ICDE'05). 1084-1095. (Pubitemid 41731227)
7. CHASE, J. S., ANDERSON, D. C., THAKAR, P. N., and VAHDAT, A. M. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP'01). 103-116. (Pubitemid 33612608)
8. CHEN, G., HE, W., LIU, J., NATH, S., RIGAS, L., XIAO, L., and ZHAO, F. 2008. Energy-aware server provisioning and load dispatching for connection-intensive internet services. In Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI'08). 337-350.
9. CHEN, Y., DAS, A., QIN, W., SIVASUBRAMANIAM, A., WANG, Q., and GAUTAM, N. 2005. Managing server energy and operational costs in hosting centers. In Proceedings of the ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS'05). 303-314. (Pubitemid 43275430)
10. DECANDIA, G., HASTORUN, D., JAMPANI, M., KAKULAPATI, G., LAKSHMAN, A., PILCHIN, A., SIVASUBRAMANIAN, S., VOSSHALL, P., and VOGELS, W. 2007. Dynamo: Amazon's highly available key-value store. In Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP'07). 205-220. (Pubitemid 351429377)
11. ELNOZAHY, E., KISTLER, M., and RAJAMONY, R. 2002. Energy-efficient server clusters. In Proceedings of the 2nd Workshop on Power-Aware Computing Systems (WPACS'02). 179-196. (Pubitemid 36557071)
12. FACEBOOK. 2011. Personal communication with Facebook.
13. FAN, X., WEBER, W.-D., and BARROSO, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA'07). 13-23. (Pubitemid 47582087)
14. GANDHI, A., CHEN, Y., GMACH, D., ARLITT, M., and MARWAH, M. 2011a. Minimizing data center SLA violations and power consumption via hybrid resource provisioning. In Proceedings of the 2nd International Green Computing Conference (IGCC'11).
15. GANDHI, A., HARCHOL-BALTER, M., and KOZUCH, M. A. 2011b. The case for sleep states in servers. In Proceedings of the 4th Workshop on Power-Aware Computing and Systems (HotPower'11).
16. GANDHI, N., TILBURY, D., DIAO, Y., HELLERSTEIN, J., and PAREKH, S. 2002. MIMO control of an Apache web server: Modeling and controller design. In Proceedings of the 2002 American Control Conference (ACC'02 Series, vol. 6). 4922-4927.
17. GMACH, D., KROMPASS, S., SCHOLZ, A., WIMMER, M., and KEMPER, A. 2008. Adaptive quality of service management for enterprise services. ACM Trans. Web 2, 1, 1-46.
18. GRUNWALD, D., MORREY III, C. B., LEVIS, P., NEUFELD, M., and FARKAS, K. I. 2000. Policies for dynamic clock scheduling. In Proceedings of the 4th Conference on Symposium of Operating System Design and Implementation (OSDI'00).
19. HOFFMANN, H., SIDIROGLOU, S., CARBIN, M., MISAILOVIC, S., AGARWAL, A., and RINARD, M. 2011. Dynamic knobs for responsive power-aware computing. In Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'11). 199-212.
20. HORVATH, T. and SKADRON, K. 2008. Multi-mode energy management for multi-tier server clusters. In Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques (PACT'08). 270-279.
21. iTA. 1998. The Internet Traffic Archives: WorldCup98. http://ita.ee.lbl.gov/html/contrib/WorldCup. html.
22. IYER, S. and DRUSCHEL, P. 2001. Anticipatory scheduling: A disk scheduling framework to overcome deceptive idleness in synchronous I/O. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP'01). 117-130. (Pubitemid 33612609)
23. KIM, J. and ROSING, T. S. 2006. Power-aware resource management techniques for low-power embedded systems. In Handbook of Real-Time and Embedded Systems. Taylor-Francis Group LLC.
24. KIVITY, A. 2007. KVM: The Linux virtual machine monitor. In Proceedings of the 2007 Ottawa Linux Symposium (OLS'07). 225-230.
25. KLEINROCK, L. 1975. Queueing Systems, Volume I: Theory. Wiley-Interscience.
26. KRIOUKOV, A., MOHAN, P., ALSPAUGH, S., KEYS, L., CULLER, D., and KATZ, R. 2010. NapSAC: Design and implementation of a power-proportional web cluster. In Proceedings of the 1st ACM SIGCOMM Workshop on Green Networking (Green Networking'10). 15-22.
27. LEITE, J. C., KUSIC, D. M., and MOSSÉ, D. 2010. Stochastic approximation control of power and tardiness in a three-tier web-hosting cluster. In Proceeding of the 7th International Conference on Autonomic Computing (ICAC'10). 41-50.
28. LI, B. and NAHRSTEDT, K. 1999. A control-based middleware framework for quality of service adaptations. IEEE J. Sel. Areas Commun. 17, 1632-1650. (Pubitemid 129587919)
29. LIM, S.-H., SHARMA, B., TAK, B. C., and DAS, C. R. 2011. A dynamic energy management scheme for multi-tier data centers. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS'11). 257-266.
30. LU, C., LU, Y., ABDELZAHER, T., STANKOVIC, J., and SON, S. 2006. Feedback control architecture and design methodology for service delay guarantees in web servers. IEEE Trans. Paral. Distrib. Syst. 17, 9, 1014-1027. (Pubitemid 44263829)
31. LU, Y.-H., CHUNG, E.-Y., ŠIMUNIĆ, T., BENINI, L., and DE MICHELI, G. 2000. Quantitative comparison of power management algorithms. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE'00). 20-26.
32. MEISNER, D., GOLD, B. T., and WENISCH, T. F. 2009. PowerNap: Eliminating server idle power. In Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'09). 205-216.
33. MEISNER, D., SADLER, C. M., BARROSO, L. A., WEBER, W.-D., and WENISCH, T. F. 2011. Power management of online data-intensive services. In Proceedings of the 38th Annual International Symposium on Computer Architecture (ISCA'11). 319-330.
34. MOSBERGER, D. and JIN, T. 1998. httperf-A tool for measuring web server performance. ACM Sigmetrics: Perf. Eval. Rev. 26, 3, 31-37. (Pubitemid 128605767)
35. NATHUJI, R., KANSAL, A., and GHAFFARKHAH, A. 2010. Q-clouds: Managing performance interference effects for QoS-aware clouds. In Proceedings of the 5th European Conference on Computer Systems, (EuroSys'10). 237-250.
36. NEWMAN, M. E. J. 2005. Power laws, Pareto distributions and Zipf's law. Contemp. Phys. 46, 323-351. (Pubitemid 41335662)
37. nLANR. 1995. National Laboratory for Applied Network Research. Anonymized access logs. ftp://ftp.ircache.net/Traces/.
38. PERING, T., BURD, T., and BRODERSEN, R. 1998. The simulation and evaluation of dynamic voltage scaling algorithms. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED'98). 76-81.
39. QIN, W., and WANG, Q. 2007. Modeling and control design for performance management of web servers via an IPV approach. IEEE Trans. Control Syst. Tech. 15, 2, 259-275. (Pubitemid 46485263)
40. sap. 2011. SAP application trace from anonymous source.
41. SNYDER, B. 2010. Server virtualization has stalled, despite the hype. http://www.infoworld.com/print/146901.
42. URGAONKAR, B. and CHANDRA, A. 2005. Dynamic provisioning of multi-tier internet applications. In Proceedings of the 2nd International Conference on Automatic Computing (ICAC'05). 217-228. (Pubitemid 43959625)
43. URGAONKAR, B., PACIFICI, G., SHENOY, P., SPREITZER, M., and TANTAWI, A. 2005. An analytical model for multi-tier internet services and its applications. In Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS'05). 291-302. (Pubitemid 43275429)
44. VERMA, A., DASGUPTA, G., NAYAK, T. K., DE, P., and KOTHARI, R. 2009. Server workload analysis for power minimization using consolidation. In Proceedings of the 2009 Conference on USENIX Annual Technical Conference (USENIX'09).
45. WANG, X. and CHEN, M. 2008. Cluster-level feedback power control for performance optimization. In Proceeding of the 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA'08). 101-110.
46. WOOD, T., SHENOY, P. J., VENKATARAMANI, A., and YOUSIF, M. S. 2007. Black-box and gray-box strategies for virtual machine migration. In Proceedings of the 4th USENIX Conference on Networked Systems Design and Implementation (NSDI'07). 229-242.