Reinforcement learning-based adaptive resource management of differentiated services in geo-distributed data centers

2017 IEEE/ACM 25th International Symposium on Quality of Service, IWQoS 2017

Volumn , Issue , 2017, Pages

  Zhou, Xiaojie ^a   Wang, Kun ^a,b   Jia, Weijia ^a   Guo, Minyi ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b NANJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Differentiated services; Geo distributed data centers; Power consumption; QoS revenue; Reinforcement learning

Indexed keywords

BEHAVIORAL RESEARCH; DECISION MAKING; DIGITAL STORAGE; ELECTRIC POWER UTILIZATION; GREEN COMPUTING; INFORMATION MANAGEMENT; INTERNET SERVICE PROVIDERS; LEARNING ALGORITHMS; NATURAL RESOURCES MANAGEMENT; REINFORCEMENT LEARNING; RESOURCE ALLOCATION; TELECOMMUNICATION SERVICES;

ADAPTIVE RESOURCE MANAGEMENT; DIFFERENTIATED SERVICES; DISTRIBUTED DATA; NETWORK COMMUNICATIONS; RENEWABLE ENERGIES; RESOURCE REQUIREMENTS; SERVICE LEVEL AGREEMENTS; SERVICE PROVISIONS;

QUALITY OF SERVICE;

EID: 85027861481     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IWQoS.2017.7969161     Document Type: Conference Paper

References (16)

1. C. Gu, C. Liu, J. Zhang, H. Huang, and X. Jia, "Green scheduling for cloud data centers using renewable resources, " in INFOCOM WKSHPS, 2015, pp. 354-359.
2. M. Shatnawi and M. Hefeeda, "Real-time failure prediction in online services, " in INFOCOM, 2015, pp. 1391-1399.
3. L. Rao, X. Liu, L. Xie, and W. Liu, "Coordinated energy cost management of distributed internet data centers in smart grid, " IEEE Transactions on Smart Grid, vol. 3, no. 1, pp. 50-58, 2012.
4. L. Yu, T. Jiang, and Y. Cao, "Energy cost minimization for distributed internet data centers in smart microgrids considering power outages, " IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 1, pp. 120-130, 2015.
5. H. Lin, X. Qi, S. Yang, and S. Midkiff, "Workload-driven vm consolidation in cloud data centers, " in IPDPS, 2015, pp. 207-216.
6. F. P. Tso, K. Oikonomou, E. Kavvadia, and D. P. Pezaros, "Scalable traffic-aware virtual machine management for cloud data centers, " in ICDCS, 2014, pp. 238-247.
7. Z. Han, H. Tan, G. Chen, R. Wang, Y. Chen, and F. C. Lau, "Dynamic virtual machine management via approximate markov decision process, " in INFOCOM, 2016, pp. 1-9.
8. F. Farahnakian, P. Liljeberg, and J. Plosila, "Energy-efficient virtual machines consolidation in cloud data centers using reinforcement learning, " in PDP, 2014, pp. 500-507.
9. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. MIT press Cambridge, 1998, vol. 1, no. 1.
10. C. J. Watkins and P. Dayan, "Q-learning, " Machine learning, vol. 8, no. 3-4, pp. 279-292, 1992.
11. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. De Rose, and R. Buyya, "Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms, " Software: Practice and experience, vol. 41, no. 1, pp. 23-50, 2011.
12. C. Fuerst, S. Schmid, L. Suresh, and P. Costa, "Kraken: Online and elastic resource reservations for multi-tenant datacenters, " in INFOCOM, 2016, pp. 1-9.
13. R. Buyya, A. Beloglazov, and J. Abawajy, "Energy-efficient management of data center resources for cloud computing: A vision, architectural elements, and open challenges, " arXiv preprint arXiv:1006.0308, 2010.
14. M. Stone, "Cross-validatory choice and assessment of statistical predictions, " Journal of the royal statistical society. Series B (Methodological), pp. 111-147, 1974.
15. A. Beloglazov and R. Buyya, "Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers, " Concurrency and Computation: Practice and Experience, vol. 24, no. 13, pp. 1397- 1420, 2012.
16. A. Singh, J. Ong, A. Agarwal, G. Anderson, A. Armistead, R. Bannon, S. Boving, G. Desai, B. Felderman, P. Germano, A. Kanagala, J. Provost, J. Simmons, E. Tanda, J. Wanderer, U. Hölzle, S. Stuart, and A. Vahdat, "Jupiter rising: A decade of clos topologies and centralized control in google's datacenter network, " ACM SIGCOMM Computer Communication Review, vol. 45, no. 4, pp. 183-197, 2015.