Data center energy efficient resource scheduling

Cluster Computing

Volumn 17, Issue 4, 2014, Pages 1265-1277

  Shuja, Junaid ^a   Bilal, Kashif ^b   Madani, Sajjad Ahmad ^c   Khan, Samee U ^b  

^a UNIVERSITY OF MALAYA   (Malaysia)

^b North Dakota State University   (United States)

^c Tobe Camp University Road Abbottabad   (Pakistan)

Author keywords

Cloud computing; Data centers; Data intensive workloads; Energy efficiency; Resource scheduling

Indexed keywords

CLOUD COMPUTING; ENERGY EFFICIENCY; ENERGY UTILIZATION; SCHEDULING; STOCHASTIC PROGRAMMING;

BENDERS DECOMPOSITION ALGORITHM; DATA CENTERS; DATA-INTENSIVE WORKLOADS; INFORMATION AND COMMUNICATION TECHNOLOGY SECTORS; MULTI-COMMODITY FLOW; REDUNDANT SERVERS; RESOURCE SCHEDULING FRAMEWORK; RESOURCE-SCHEDULING;

GREEN COMPUTING;

EID: 84911807211     PISSN: 13867857     EISSN: 15737543     Source Type: Journal    
DOI: 10.1007/s10586-014-0365-0     Document Type: Article

References (56)

1. Masanet, E., Brown, R., Shehabi, A., Koomey, J., Nordman, B.: Estimating the energy use and efficiency potential of u.s. data centers. Proc. IEEE 99(8), 1440–1453 (2011)
2. Brown, R.: Report to congress on server and data center energy efficiency public law 109–431. Environ. Prot. 109, 431 (2007)
3. Bolla, R., Davoli, F., Bruschi, R., Christensen, K., Cucchietti, F., Singh, S.: The potential impact of green technologies in next-generation wireline networks: Is there room for energy saving optimization? Commun. Mag. IEEE 49(8), 80–86 (2011)
4. Webb, M.: SMART 2020: Enabling the low carbon economy in the information age. Tech. rep, Climate Group on behalf of the Global eSustainability Initiative (GeSI) (2008)
5. Koomey, J.G.: Worldwide electricity used in data centers. Environ. Res. Lett., IOPscience 3(3), 1–8 (2008).
6. Wang, L., Khan, S.U.: Review of performance metrics for green data centers: a taxonomy study. J. Supercomput. 63(3), 639–656 (2013)
7. Kliazovich, D., Bouvry, P., Audzevich, Y., Khan, S.: Greencloud: A packet-level simulator of energy-aware cloud computing data centers. In: GLOBECOM 2010, 2010 IEEE Global Telecommunications Conference, pp. 1–5 (2010).
8. Despins, C., Labeau, F., Le Ngoc, T., Labelle, R., Cheriet, M., Thibeault, C., Gagnon, F., Leon-Garcia, A., Cherkaoui, O., St Arnaud, B., et al.: Leveraging green communications for carbon emission reductions: Techniques, testbeds, and emerging carbon footprint standards. Communications Magazine, IEEE 49(8), 101–109 (2011).
9. Khan, S.U., Wang, L., Yang, L.T., Xia, F.: Green computing and communications. J. Supercomput. 63(3), 637–638 (2013)
10. Khargharia, B., Hariri, S., Szidarovszky, F., Houri, M., El-Rewini, H., Khan, S., Ahmad, I., Yousif, M.: Autonomic power performance management for large-scale data centers. In: Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE, International, pp. 1–8 (2007).
11. Wang, L., Khan, S.U., Chen, D., Kołodziej, J., Ranjan, R., Xu, Cz, Zomaya, A.: Energy-aware parallel task scheduling in a cluster. Future Gener. Comput. Syst. 29(7), 1661–1670 (2013)
12. Heller, B., Seetharaman, S., Mahadevan, P., Yiakoumis, Y., Sharma, P., Banerjee, S., Mckeown, N.: Elastictree: Saving energy in data center networks. In: IN NSDI (2010).
13. Da Costa, G., Gelas, J.P., Georgiou, Y., Lefevre, L., Orgerie, A.C., Pierson, J.M., Richard, O., Sharma, K.: The green-net framework: Energy efficiency in large scale distributed systems. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).
14. Garg, M., Smith, J.C.: Models and algorithms for the design of survivable multicommodity flow networks with general failure scenarios. Omega 36(6), 1057–1071 (2008)
15. Kliazovich, D., Bouvry, P., Khan, S.: Dens: Data center energy-efficient network-aware scheduling. In: Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int’l Conference on Int’l Conference on Cyber, Physical and Social Computing (CPSCom), pp. 69–75 (2010).
16. Cisco: Cisco data center infrastructure 2.5 design guide. Cisco press (2007).
17. Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., Handley, M.: Improving datacenter performance and robustness with multipath tcp. SIGCOMM Comput. Commun. Rev. 41, 266–277 (2011)
18. Al-Fares, M., Loukissas, A., Vahdat, A.: A scalable, commodity data center network architecture. SIGCOMM Comput. Commun. Rev. 38, 63–74 (2008)
19. Greenberg, A., Hamilton, J.R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D.A., Patel, P., Sengupta, S.: Vl2: a scalable and flexible data center network. Proceedings of the ACM SIGCOMM 2009 conference on Data communication. SIGCOMM ’09, pp. 51–62. ACM, New York, NY, USA (2009)
20. Bilal, K., Khan, S.U., Zhang, L., Li, H., Hayat, K., Madani, S.A., Min-Allah, N., Wang, L., Chen, D., Iqbal, M., et al.: Quantitative comparisons of the state-of-the-art data center architectures. Concurr. Comput.: Pract. Exp. 25(12), 1771–1783 (2013)
21. Al-fares, M., Radhakrishnan, S., Raghavan, B., Huang, N., Vahdat, A.: Hedera: Dynamic flow scheduling for data center networks. In: In Proceedings of Networked Systems Design and Implementation (NSDI) Symposium (2010).
22. Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39, 68–73 (2008)
23. Bilal, K., Malik, S.U.R., Khalid, O., Hameed, A., Alvarez, E., Wijaysekara, V., Irfan, R., Shrestha, S., Dwivedy, D., Ali, M., et al.: A taxonomy and survey on green data center networks. Future Gener. Comput. Syst. (2013).
24. Valentini, G.L., Lassonde, W., Khan, S.U., Min-Allah, N., Madani, S.A., Li, J., Zhang, L., Wang, L., Ghani, N., Kolodziej, J., et al.: An overview of energy efficiency techniques in cluster computing systems. Clust. Comput. 16(1), 3–15 (2013)
25. Liu, J., Zhao, F., Liu, X., He, W.: Challenges towards elastic power management in internet data centers. In: Distributed Computing Systems Workshops, 2009. ICDCS Workshops ’09. 29th IEEE International Conference on, pp. 65–72 (2009).
26. Wang, L., von Laszewski, G., Tao, J., Kunze, M.: Grid virtualization engine: design, implementation, and evaluation. Syst. J. IEEE 3(4), 477–488 (2009)
27. Kołodziej, J., Khan, S.U., Wang, L., Byrski, A., Min-Allah, N., Madani, S.A.: Hierarchical genetic-based grid scheduling with energy optimization. Clust. Comput. 16(3), 591–609 (2013)
28. Horvath, T., Abdelzaher, T., Skadron, K., Liu, X.: Dynamic voltage scaling in multitier web servers with end-to-end delay control. Comput. IEEE Trans. 56(4), 444–458 (2007)
29. Bilal, K., Khan, S., Madani, S., Hayat, K., Khan, M., Min-Allah, N., Kolodziej, J., Wang, L., Zeadally, S., Chen, D.: A survey on green communications using adaptive link rate. Clust. Comput. 16(3), 575–589 (2013)
30. Shuja, J., Madani, S.A., Bilal, K., Hayat, K., Khan, S.U., Sarwar, S.: Energy-efficient data centers. Computing 94(12), 973–994 (2012)
31. Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.Y., Moon, S.: I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. In: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement. IMC ’07, pp. 1–14. ACM, New York, NY, USA (2007)
32. Meisner, D., Sadler, C.M., Barroso, L.A., Weber, W.D., Wenisch, T.F.: Power management of online data-intensive services. In: Computer Architecture (ISCA), 2011 38th Annual International Symposium on, pp. 319–330. IEEE (2011).
33. Wang, L., Tao, J., Ranjan, R., Marten, H., Streit, A., Chen, J., Chen, D.: G-hadoop: Mapreduce across distributed data centers for data-intensive computing. Future Gener. Comput. Syst. 29(3), 739–750 (2013)
34. Wang, L., Tao, J., Marten, H., Streit, A., Khan, S.U., Kolodziej, J., Chen, D.: Mapreduce across distributed clusters for data-intensive applications. In: Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International, pp. 2004–2011. IEEE (2012).
35. Urgaonkar, R., Kozat, U.C., Igarashi, K., Neely, M.J.: Dynamic resource allocation and power management in virtualized data centers. In: NOMS, pp. 479–486 (2010).
36. Beloglazov, A., Buyya, R.: Energy efficient resource management in virtualized cloud data centers. In: Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pp. 826–831 (2010).
37. Wang, L., Khan, S., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)
38. Wang, L., von Laszewski, G., Dayal, J., He, X., Younge, A.J., Furlani, T.R.: Towards thermal aware workload scheduling in a data center. In: Proceedings of the 2009 10th International Symposium on Pervasive Systems. Algorithms, and Networks, ISPAN ’09, pp. 116–122. IEEE Computer Society, Washington, DC, USA (2009)
39. Wang, L., von Laszewski, G., Huang, F., Dayal, J., Frulani, T., Fox, G.: Task scheduling with ann-based temperature prediction in a data center: a simulation-based study. Eng. Comput. 27(4), 381–391 (2011)
40. Meng, X., Pappas, V., Zhang, L.: Improving the scalability of data center networks with traffic-aware virtual machine placement. In: INFOCOM, 2010 Proceedings IEEE, pp. 1–9 (2010).
41. Wang, G., Ng, T.S.E.: The impact of virtualization on network performance of amazon ec2 data center. In: Proceedings of the 29th conference on Information communications. INFOCOM’10, pp. 1163–1171. IEEE Press, Piscataway, NJ, USA (2010)
42. Voorsluys, W., Broberg, J., Venugopal, S., Buyya, R.: Cost of virtual machine live migration in clouds: A performance evaluation. In: Proceedings of the 1st International Conference on Cloud Computing. CloudCom ’09, pp. 254–265. Springer-Verlag, Berlin, Heidelberg (2009)
43. Banerjee, A., Mukherjee, T., Varsamopoulos, G., Gupta, S.: Cooling-aware and thermal-aware workload placement for green hpc data centers. In: Green Computing Conference, 2010 International, pp. 245–256 (2010).
44. Parolini, L., Sinopoli, B., Krogh, B.H., Wang, Z.: A cyber-physical systems approach to data center modeling and control for energy efficiency. Proc. IEEE PP(99), 1–15 (2011).
45. Le, K., Bianchini, R., Martonosi, M., Nguyen, T.: Cost-and energy-aware load distribution across data centers. Proc. HotPower pp. 1–5 (2009).
46. McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: Openflow: enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)
47. Wang, L., Tao, J., von Laszewski, G., Marten, H.: Multicores in cloud computing: research challenges for applications. J. Comput. 5(6), 958–964 (2010)
48. Zink, M., Suh, K., Gu, Y., Kurose, J.: Characteristics of youtube network traffic at a campus network-measurements, models, and implications. Comput. Netw. 53(4), 501–514 (2009)
49. Bilal, K., Manzano, M., Khan, S.U., Calle, E., Li, K., Zomaya, A.Y.: On the characterization of the structural robustness of data center networks. IEEE Transaction on Cloud Computing (2013).
50. Geoffrion, A.M., Graves, G.W.: Multicommodity distribution system design by benders decomposition. Manag. Sci. 20(5), 822–844 (1974)
51. Multicommodity network flow models and algorithms in telecommunications. Handbook of optimization in telecommunications, pp. 163–184. Springer, New York (2006)
52. Wang, L., Anta, A.F., Zhang, F., Hou, C., Liu, Z.: Routing for energy minimization with discrete cost functions. arXiv, preprint arXiv:1302.0234 (2013).
53. Costa, A.M.: A survey on benders decomposition applied to fixed-charge network design problems. Comput. Oper. Res. 32(6), 1429–1450 (2005)
54. Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., Zhao, F.: Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation. NSDI’08, pp. 337–350. USENIX Association, Berkeley, CA, USA (2008)
55. Jiang, N., Parashar, M.: Enabling autonomic power-aware management of instrumented data centers. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).
56. Bianzino, A.P., Chaudet, C., Rossi, D., Rougier, J.L.: A survey of green networking research. CoRR (2010).