Efficient server provisioning and offloading policies for internet data centers with dynamic load-demand

IEEE Transactions on Computers

Volumn 64, Issue 3, 2015, Pages 682-697

  Xu, Dan ^a   Liu, Xin ^a   Fan, Bin ^b  

^a University of California   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

convex optimization; Data center; dynamic traffic; electricity price diversity; energy efficiency; stochastic multiplexing

Indexed keywords

CONVEX OPTIMIZATION; COST REDUCTION; COSTS; DYNAMIC LOADS; ENERGY UTILIZATION; INTERNET; MULTIPLEXING; PROBABILITY; QUALITY OF SERVICE; STOCHASTIC SYSTEMS;

CAPACITY ALLOCATION; DATA CENTERS; DIFFERENT TIME SCALE; DYNAMIC TRAFFIC; ELECTRICITY PRICES; INTERNET DATA CENTERS; OUTAGE PROBABILITY CONSTRAINTS; REDUCE ENERGY CONSUMPTION;

ENERGY EFFICIENCY;

EID: 84923092480     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/TC.2013.2295797     Document Type: Article

References (54)

1. T. Benson, A. Akella, and D. Maltz, "Network Traffic Characteristics of Data Centers in the Wild" Proc. 10th ACM SIGCOMM Conf. Internet Measurement (IMC), 2010
2. M. Weiser, B. Welch, A. Demers, and S. Shenker, "Scheduling for Reduced CPU Energy" Proc. First USENIX Conf. Operating Systems Design and Implementation (OSDI), 1994
3. F.F. Yao, A. Demers, and S. Shenker, "A Scheduling Model for Reduced CPU Energy" Proc. 36th Ann. Symp. Foundations of Computer Science (FOCS), 1995
4. J.R. Lorch and A.J. Smith, "Improving Dynamic Voltage Scaling Algorithms with PACE" Proc. ACM SIGMETRICS Int'l Conf. Measurement and Modeling of Computer Systems, 2001
5. D. Grunwald, P. Levis, K.I. Farkas, C.B. Morrey III, and M. Neufeld, "Policies for Dynamic Clock Scheduling" Proc. Fourth Conf. Symp. Operating Systems Design and Implementation (OSDI), 2000
6. Y. Zhu and F. Mueller, "Feedback EDF Scheduling of Real-Time Tasks Exploiting Dynamic Voltage Scaling" Real-Time Systems J., vol. 31, no. 1-3, Dec. 2005
7. N. Bansal, K. Pruhs, and C. Steins, "Speed Scaling for Weighted Flow Times" Proc 18th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA), 2007
8. N. Bansal, T. Kimbrel, and K. Pruhs, "Speed Scaling to Manage Energy and Temperature" J. ACM, vol. 54, no. 1, Mar. 2007
9. A. Wierman, L.L.H. Andrew, and A. Tang, "Power-Aware Speed Scaling in Processor Sharing Systems" Proc. IEEE INFOCOM, 2009
10. T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu., "Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control" IEEE Trans. Computers, vol. 56, no. 4, pp. 444-458, Apr. 2007
11. L.L.H. Andrew, M. Lin, and A. Wierman, "Optimality, Fairness, and Robustness in Speed Scaling Designs" Proc. ACM SIGMETRICS Int'l Conf. Measurement and Modeling of Computer Systems, 2010
12. C. Lim and A Tang, "Dynamic Speed Scaling and Load Balancing of Interconnected Queues" Proc. Information Theory and Applications Workshop (ITA), 2011
13. L. Chen, N. Li, and S.H. Low, "On the Interaction between Load Balancing and Speed Scaling" Proc. Information Theory and Applications Workshop (ITA), 2011
14. O.S. Unsal and I. Koren, "System-Level Power Aware Design Techniques in Real-Time System" Proc. IEEE, vol. 91, no. 7, pp. 1055-1069, July 2003
15. J.S. Chase, D.C. Anderson, P.N. Thakar, and A.M. Vahdat, "Managing Energy and Server Resources in Hosting Centers" Proc. 18th ACM Symp. Operating Systems Principles (SOSP), 2001
16. Y.Y. Chen et al., "Managing Server Energy and Operational Costs in Hosting Centers" Proc. ACM SIGMETRICS Int'l Conf. Measurement and Modeling of Computer Systems, 2005
17. G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao, "Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services" Proc. Fifth USENIX Symp. Networked Systems Design and Implementation (NSDI), 2008
18. M. Lin, A. Wierman, L.L.H. Andrew, and E. Thereska, "Dynamic Right-Sizing for Power-Proportional Data Centers" Proc. IEEE INFOCOM, 2011
19. R. Urgaonkar, U.C. Kozat, K. Igarashi, and M.J. Neely, "Dynamic Resource Allocation and Power Management in Virtualized Data Centers" Proc. IEEE Network Operations and Management Symp. (NOMS), 2010
20. R. Urgaonkar, B. Urgaonkar, M.J. Neely, and A. Sivasubramaniam, "Optimal Power Cost Management Using Stored Energy in Data Centers" Proc. ACM SIGMETRICS Joint Int'l Conf. Measurement and Modeling of Computer Systems, 2011
21. C. Lim and A Tang, "Dynamic Speed Scaling and Load Balancing of Interconnected Queues" Proc. Information Theory and Applications Workshop (ITA), 2011
22. H. Lim, A. Kansal, and J. Liu, "Power Budgeting for Virtualized Data Centers" Proc. USENIX Conf. Ann. Technical Conf. (ATC), 2011
23. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wikes, "Hibernator: Helping Disk Arrays Sleep through the Winter" Proc. 20th ACM Symp. Operating Systems Principles (SOSP), 2005
24. J. Torres, D. Carrera, K. Hogan, R.Gavald, V. Beltran, and N. Poggi, "Reducing Wasted Resources to Help Achieve Green Data Centers" Proc. IEEE Int'l Symp. Parallel and Distributed Processing (IPDPS), 2008
25. R. Nathuji and K. Schwan, "VirtualPower: Coordinated Power Management in Virtualized Enterprise Systems" Proc. 21st ACM SIGOPS Symp. Operating Systems Principles (SOSP), 2007
26. S.Srikantaiah, A. Kansal and F. Zhao, "Energy Aware Consolidation for Cloud Computing" Proc. Conf. Power Aware Computing and Systems (HotPower), 2008
27. X. Meng, C. Isci, J. Kephart, L. Zhang, E. Bouillet, and D. Pendarakis, "Efficient Resource Provisioning in Compute Clouds via VM Multiplexing" Proc. Seventh Int'l Conf. Autonomic Computing (ICAC), 2010
28. M. Wang, X. Meng, and L. Zhang, "Consolidating Virtual Machines with Dynamic Bandwidth Demand in Data Centers" Proc. IEEE INFOCOM, 2011
29. A. Qureshi, R. Weber, H. Balakrishnan, J. Guttag, and B. Maggs, "Cutting the Electric Bill for Internet-Scale Systems" Proc. ACM SIGCOMM, 2009
30. L. Rao, X. Liu, L, Xie, and W. Liu., "Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment" Proc. IEEE INFOCOM, 2010
31. L. Rao, X. Liu, M. Ilic, and J. Liu, "MEC-IDC: Joint Load Balancing and Power Control for Distributed Internet Data Centers" Proc. First ACM/IEEE Int'l Conf. Cyber-Physical Systems (ICCPS), 2010
32. A.N. Sankaranarayanan, S. Sharangi, and A. Fedorova, "Global Cost Diversity Aware Dispatch Algorithm for Heterogeneous Data Centers" Proc. Second ACM/SPEC Int'l Conf. Performance Engineering (ICPE), 2011
33. R. Stanojevic and R. Shorten, "Distributed Dynamic Speed Scaling" Proc. IEEE INFOCOM, 2010
34. Z. Liu, M. Lin, A. Wierman, S. Low, and L.L.H. Andrew, "Greening Geographical Load Balancing" Proc. ACM SIGMETRICS Joint Int'l Conf. Measurement and Modeling of Computer Systems, 2011
35. N. Buchbinder, N. Jain, and I. Menache, "Online Job-Migration for Reducing the Electricity Bill in the Cloud" Proc. 10th Int'l IFIP TC 6 Conf. Networking (NETWORKING), 2011
36. K. Le, R. Bianchiniy, M. Martonosiz, and T.D. Nguyeny, "Cost-and Energy-Aware Load Distribution across Data Centers" Proc. USENIX Workshop Power Aware Computing and Systems (HotPower), 2009
37. Z. Liu, M. Lin, A. Wierman, S. Low, and L.L.H. Andrew, "Geographical Load Balancing with Renewables" in ACM GreenMetrics, 2011
38. L. Chiaraviglio and I. Matta, "GreenCoop: Cooperative Green Routing with Energy-Efficient Servers" Proc. First Int'l Conf. Energy-Efficient Computing and Networking (e-Energy), 2010
39. K. Schröder, D. Schlitt, M. Hoyer, and W. Nebel, "Power and Cost Aware Distributed Load Management" Proc. First Int'l Conf. Energy-Efficient Computing and Networking (e-Energy), 2010
40. V. Valancius, N. Laoutaris, L.Massouli, C. Diot, and P. Rodriguez, "Greening the Internet with Nano Data Centers" Proc. Fifth Int'l Conf. Emerging Networking Experiments and Technologies (CoNEXT), 2009
41. L. Lu and P. Varman, "Workload Decomposition for Power Efficient Storage Systems" Proc. USENIX Workshop Power Aware Computing and Systems (HotPower), 2008
42. A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy, "Optimal Power Allocation in Server Farms" Proc. ACM SIGMETRICS Joint Int'l Conf. Measurement and Modeling of Computer Systems, 2009
43. C. Stewart and K. Shen, "Some Joules Are More Precious than Others: Managing Renewable Energy in the Datacenter" Proc. USENIX Workshop Power Aware Computing and Systems (HotPower), 2009
44. X. Fan, W.D. Weber, and L.A. Barroso, "Power Provisioning for a Warehouse-Sized Computer" Proc. 34th Ann. Int'l Symp. Computer Architecture (ISCA), 2007
45. D. Niu, C. Feng, and B. Li, "Pricing Cloud Bandwidth Reservations under Demand Uncertainty" Proc. 12th ACM SIGMETRICS/PERFORMANCE Joint Int'l Conf. Measurement and Modeling of Computer Systems, 2012
46. Windows Azure Platform, http://www.azure.com, 2014
47. J. Liu, F. Zhao, X. Liu, and W. He, "Challenges towards Elastic Power Management in Internet Data Centers" Proc. 29th IEEE Int'l Conf. Distributed Computing Systems Workshops (ICDCSW), 2009
48. J. Hamilton, "Where Does the Power Go in High-Scale Data Centers" http://www.mvdirona.com/jrh/work/, 2014
49. Z. Zhang, M. Zhang, A. Greenberg, Y.C. Hu, R. Mahajan, and B. Christian, "Optimizing Cost and Performance in Online Service Provider Networks" Proc. Seventh USENIX Conf. Networked Systems Design and Implementation (NSDI), 2010
50. S. Pelley, D. Meisner, T.F. Wenisch, and J.W. VanGilder, "Understanding and Abstracting Total Data Center Power" Proc. ISCA Workshop Energy Efficient Design (WEED), 2009
51. N. Rasmussen, "Electrical Efficiency Modeling for Data Centers" White paper No. 113, American Power Conversion, 2006
52. A. Greenberg, J.R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, and Sudipta Sengupta, "VL2: A Scalable and Flexible Data Center Network" Proc. ACM SIGCOMM, 2009
53. S. Boyd and L. Vandenberghe, "Convex Optimization" Cambridge University Press, 2004
54. D. Xu, X. Liu, and B. Fan, "Minimizing Energy Cost for Internet-Scale Datacenters with Dynamic Traffic" Proc. IEEE 19th Int'l Workshop Quality of Service (IWQOS), 2011