Joint Resource Provisioning for Internet Datacenters with Diverse and Dynamic Traffic

IEEE Transactions on Cloud Computing

Volumn 5, Issue 1, 2017, Pages 71-84

  Xu, Dan ^a   Liu, Xin ^b   Niu, Zhisheng ^c  

^a AT AND T LABS RESEARCH   (United States)

^b University of California   (United States)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

convex optimization; cost effectiveness; Datacenters; delay sensitive jobs; delay tolerant jobs; energy efficiency; queue; stochastic optimization; traffic diversity; traffic dynamics

Indexed keywords

CONVEX OPTIMIZATION; COST EFFECTIVENESS; COSTS; DYNAMICS; ELECTRIC LOAD DISPATCHING; GREEN COMPUTING; QUEUEING THEORY;

DATA CENTERS; DELAY TOLERANT; DELAY-SENSITIVE JOBS; QUEUE; STOCHASTIC OPTIMIZATIONS; TRAFFIC DIVERSITIES; TRAFFIC DYNAMICS;

ENERGY EFFICIENCY;

EID: 85027717258     PISSN: None     EISSN: 21687161     Source Type: Journal    
DOI: 10.1109/TCC.2014.2382118     Document Type: Article

References (38)

1. Y. Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam, "Managing server energy and operational costs in hosting centers," in Proc. ACM SIGMETRICS Int. Conf. Meas. Model. Comput. Syst., 2005, pp. 303-314.
2. L. Rao, X. Liu, L. Xie, and W. Liu, "Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricitymarket environment," in Proc. IEEE INFOCOM, 2010, pp. 1-9.
3. G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao, "Energy-aware server provisioning and load dispatching for connection- intensive internet services," in Proc. 5th Usenix Symp. Netw. Syst. Des. Implementation, 2008, pp. 337-350.
4. M. Lin, A. Wierman, L. L. H. Andrew, and E. Thereska, "Dynamic right-sizing for power-proportional data centers," in Proc. IEEE INFOCOM, 2011, pp. 1098-1106.
5. Z. Liu, M. Lin, A. Wierman, S. H. Low, and L. L. H. Andrew, "Greening geographical load balancing," in Proc. ACM SIGMETRICS Joint Int. Conf. Measurement Model. Comput. Syst., 2011, pp. 233-244.
6. T. Lu, M. Chen, and L. L. H. Andrew, "Simple and effective dynamic provisioning for power-proportional data centers," IEEE Trans. Parallel Distrib. Syst., vol. 24, no.06, pp. 1161-1171, Jun. 2013.
7. J. Tu, L. Lu, M. Chen, and R. K. Sitaraman, "Dynamic provisioning in next-generation data centers with on-site power production," in Proc. ACM 4th Int. Conf. Future Energy Syst., 2013, pp. 137-148.
8. H. Qian and D. Medhi, "Server operational cost optimization for cloud computing service providers over a time horizon," in Proc. 11th USENIX Conf. Hot Topics Manage. Internet, Cloud, Enterprise Netw. Services, 2011, p. 4.
9. B. Guenter, N. Jain, and C. Williams, "Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning," in Proc. IEEE INFOCOM, 2011, pp. 1332-1340.
10. D. Xu, X. Liu, and B. Fan, "Minimizing energy cost for internetscale datacenters with dynamic traffic," in Proc. IEEE 19th Int. Workshop Quality Workshop, 2011, pp. 1-2.
11. D. Xu, X. Liu, and B. Fan, "Efficient server provisioning and offloading policies for internet datacenters with dynamic load demand," in IEEE Trans. on Comput., vol. PP, no. 99, p. 1.
12. D. Xu, "Green internet datacenters with dynamic and diverse traffic," Doctoral dissertation, Univ. California, Davis, CA, USA, 2011.
13. D. Xu and X. Liu, "Geographic trough filling for internet datacenters," in Proc. IEEE INFOCOM Mini-Conf., 2012, pp. 2881-2885.
14. Y. Yao, L. Huang, A. Sharma, L. Golubchik, and M. J. Neely, "Data centers power reduction: A two time scale approach for delay tolerant workloads," in Proc. IEEE INFOCOM, 2012, pp. 1431-1439.
15. M. Polverini, A. Cianfrani, S. Ren, and A. V. Vasilakos, "Thermalaware scheduling of batch jobs in geographically distributed data centers," IEEE Trans. Cloud Comput., vol. 2, no. 1, Jan-Mar. 2014.
16. M. A. Rodriguez and R. Buyya, "Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds," IEEE Trans. Cloud Comput., vol. 2, no. 2, pp. 222-235, Apr.-Jun., 2014.
17. R. Urgaonkar, U. C. Kozat, K. Igarashi, and M. J. Neely, "Dynamic resource allocation and power management in virtualized data centers," in Proc. IEEE Netw. Oper. Manage. Symp., 2010, pp. 479- 486.
18. Z. Liu, Y. Chen, C. Bash, A. Wierman, D. Gmach, Z. Wang, M. Marwah, and C. Hyser, "Renewable and cooling aware workload management for sustainable data centers," in Proc. ACM SIGMETRICS/ PERFORMANCE Joint Int. Conf. Measurement Model. Comput. Syst., 2012, pp. 175-186.
19. H. Xu, C. Feng, and B. Li, "Temperature aware workload management in geo-distributed datacenters," in Proc. USENIX Int. Conf. Autonomic Comput., 2013, pp. 303-314.
20. A. Beloglazov and R. Buyya, "Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints," IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 7, pp. 1366-1379, Jul. 2013.
21. A. Qureshi, R. Weber, H. Balakrishnan, J. Guttag, and B. Maggs, "Cutting the electric bill for internet-scale systems," in Proc. ACM SIGCOMM Conf. Data Commun., 2009, pp. 123-134.
22. R. Stanojevic and R. Shorten, "Distributed dynamic speed scaling," in Proc. IEEE INFOCOM, 2010, pp. 426-430.
23. N. Buchbinder, N. Jain, and I. Menache, "Online job-migration for reducing the electricity bill in the cloud," in Proc. 10th Int. IFIP TC 6 Conf. Netw., 2011, pp. 172-185.
24. M. Lin, Z. Liu, A. Wierman, and L. L. H. Andrew, "Online algorithms for geographical load balancing," in Proc. Int. Green Comput. Conf., 2012, pp. 1-10.
25. N. Bansal, K. Pruhs, and C. Steins, "Speed scaling for weighted flow times," in Proc. 18th Annu. ACM-SIAM Symp. Discrete Algorithms, 2007, pp. 805-813.
26. A. Wierman, L. L. H. Andrew, and A. Tang, "Power-aware speed scaling in processor sharing systems," in Proc. IEEE INFOCOM, 2009, pp. 2007-2015.
27. F. Xu, F. Liu, H. Jin, and A. V. Vasilakos, "Managing performance overhead of virtual machines in cloud computing: A survey, state of the art, and future directions," Proc. IEEE, vol. 102, no. 1, pp. 11-31, Jan. 2014.
28. L. Wang, F. Zhang, J. A. Aroca, A. V. Vasilakos, K. Zheng, C. Hou, D. Li, and Z. Liu, "GreenDCN: A general framework for achieving network energy efficiency in data centers," IEEE J. Sel. Areas Commun., vol. 32, no. 1, pp. 4-15, Jan. 2014.
29. L. Wang, F. Zhang, A. V. Vasilakos, C. Hou, and Z. Liu, "Joint virtual machine assignment and traffic engineering for green data center networks," SIGMETRICS Perform. Eval. Rev., vol. 41, no. 3, pp. 107-112, 2013.
30. L. Wang, F. Zhang, K. Zheng, A. V. Vasilakos, S. Ren, and Z. Liu, "Energy-efficient flow scheduling and routing with hard deadlines in data center networks," in Proc. IEEE 34th Int. Conf. Distrib. Comput. Syst., 2014, pp. 248-257.
31. Z. Shao, X. Jin, W. Jiang, M. Chen, and M. Chiang, "Intra-data-center traffic engineering with ensemble routing," in Proc. IEEE INFOCOM 2013, pp. 2148-2156.
32. H. Zhang, B. Li, H. Jiang, F. Liu, A. V. Vasilakos, and J. Liu, "A framework for truthful online auctions in cloud computingwith heterogeneous user demands," in Proc. IEEE INFOCOM, 2013, pp. 1510-1518.
33. L. Mashayekhy, M. Nejad, D. Grocu, and A. V. Vasilakos, "Incentive-compatible online mechanism for resource provisioning and allocation in cloud," in Proc. IEEE 7th Int. Conf. Cloud Comput., 2014, pp. 3112-319.
34. L. Lu and P. Varman, "Workload decomposition for power efficient storage systems," in Proc. Conf. Power Aware Comput. Syst., 2008, p. 13.
35. H. Xu and B. Li, "Cost efficient datacenter selection for cloud services," in Proc. IEEE Int. Conf. Commun. China,, 2012, pp. 51-56.
36. D. Niu, C. Feng, and B. Li, "Pricing cloud bandwidth reservations under demand uncertainty," in Proc. 12th ACM SIGMETRICS/ PERFORMANCE Joint Int. Conf. Meas. Model. Comput. Syst., 2012, pp. 151-162.
37. B. Fortz and M. Thorup, "Internet TE by optimizing OSPF weights," in Proc. IEEE INFOCOM, 2000, pp. 519-528.
38. M. Grant and S. Boyd, CVX: Matlab software for disciplined convex programming. (2015, Jan.). Version 2.1 [Online]. Avaialble: http://cvxr.com/cvx/download/