Dynamic workload management in heterogeneous cloud computing environments

IEEE/IFIP NOMS 2014 - IEEE/IFIP Network Operations and Management Symposium: Management in a Software Defined World

Volumn , Issue , 2014, Pages

  Zhang, Qi ^a   Boutaba, Raouf ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; COMPUTER SYSTEMS; ENERGY UTILIZATION; MANAGEMENT; SCHEDULING;

APPLICATION PERFORMANCE; CLOUD COMPUTING ENVIRONMENTS; DYNAMIC APPLICATIONS; PERFORMANCE CHARACTERISTICS; PERFORMANCE OBJECTIVE; PRODUCTION ENVIRONMENTS; RESOURCE REQUIREMENTS; SERVICE APPLICATIONS;

ENVIRONMENTAL MANAGEMENT;

EID: 84904200836     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NOMS.2014.6838288     Document Type: Conference Paper

References (43)

1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, 2008.
2. A. K. Mishra, J. L. Hellerstein, W. Cirne, and C. R. Das, "Towards characterizing cloud backend workloads: insights from Google compute clusters," SIGMETRICS Perform. Eval. Rev., vol. 37, March 2010.
3. nd ACM Symposium on Cloud Computing (SOCC), 2011.
4. Q. Zhang, J. Hellerstein, and R. Boutaba, "Characterizing task usage shapes in googles compute clusters," in ACM Workshop on Large Scale Distributed Systems and Middleware (LADIS), 2011.
5. C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch, "Towards understanding heterogeneous clouds at scale: Google trace analysis," Tech. Rep. ISTC-CC-TR-12-101, April 2012.
6. G. Lee, B.-G. Chun, and R. H. Katz, "Heterogeneity-aware resource allocation and scheduling in the cloud," in Proceedings of the 3rd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud, vol. 11, 2011.
7. L. Rao, X. Liu, and W. Liu, "Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricity-market environment," in INFOCOM, 2010 Proceedings IEEE. IEEE, 2010, pp. 1-9.
8. G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao, "Energyaware server provisioning and load dispatching for connection-intensive Internet services," in USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2008.
9. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. Cetin, and S. Babu, "Starfish: A self-tuning system for big data analytics," in Proc. of the 5th Biennial Conf. on Innovative Data Systems Research (CIDR11), Asilomar, California, USA, 2011.
10. "Technology research - Gartner Inc," www.gartner.com.
11. A. Beloglazov, R. Buyya, Y. C. Lee, A. Zomaya et al., "A taxonomy and survey of energy-efficient data centers and cloud computing systems," Advances in Computers, vol. 82, no. 2, pp. 47-111, 2011.
12. "Google cluster-usage traces: format + schema," http://googleclusterdata.googlecode.com/files/Google %20cluster- usage%20traces%20-%20format%20%2B %20schema%20%282011.10.27%20external%29.pdf.
13. M. Mao and M. Humphrey, "A performance study on the vm startup time in the cloud," in Cloud Computing (CLOUD), 2012 IEEE 5th International Conference on. IEEE, 2012, pp. 423-430.
14. L. Qiu, V. Padmandabhan, and V. Geoffrey, "On the placement of web server replicas," IEEE INFOCOM, 2001.
15. C. Vicari, C. Petrioli, and F. Presti, "Dynamic replica placement and traffic redirection in content delivery networks," Proc. of MASCOTS, 2007.
16. M. Karlsson and C. Karamanolis, "Choosing replica placement heuristics for wide-area systems," in Distributed Computing Systems, 2004. Proceedings. 24th International Conference on. IEEE, 2004, pp. 350-359.
17. J. Kingman, "The single server queue in heavy traffic," in Mathematical Proceedings of the Cambridge Philosophical Society, vol. 57, no. 04. Cambridge Univ Press, 1961, pp. 902-904.
18. S. Boyd and L. Vandenberghe, Convex optimization. Cambridge Univ Pr, 2004.
19. N. Spring, R. Mahajan, D. Wetherall, and T. Anderson, "Measuring isp topologies with rocketfuel," IEEE/ACM Transactions on Networking (TON), 2009.
20. "World cup 1998 web site requests," http://ita.ee.lbl.gov/html/ contrib/WorldCup.html.
21. C. Reiss, A. Tumanov, G. Ganger, R. Katz, and M. Kozuch, "Heterogeneity and dynamicity of clouds at scale: Google trace analysis," in ACM Symposium on Cloud Comp., 2012.
22. Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam, "Managing server energy and operational costs in hosting centers," in ACM SIGMETRICS Performance Evaluation Review, vol. 33, no. 1. ACM, 2005.
23. Q. Zhang, M. F. Zhani, Q. Zhu, S. Zhang, R. Boutaba, and J. L. Hellerstein, "Dynamic energy-aware capacity provisioning for cloud computing environments," in Proceedings of the IEEE/ACM International Conference on Autonomic Computing (ICAC), 2012.
24. S. Lee, R. Panigrahy, V. Prabhakaran, V. Ramasubrahmanian, K. Talwar, L. Uyeda, and U. Wieder, "Validating heuristics for virtual machines consolidation," Microsoft Research, MSR-TR-2011-9, 2011.
25. "Eucalyptus community," http://open.eucalyptus.com/.
26. "Google workload arrival traces," http://rboutaba.cs.uwaterloo. ca/Clusterstatistics-OneMonth.zip.
27. J. Polo, C. Castillo, D. Carrera, Y. Becerra, I. Whalley, M. Steinder, J. Torres, and E. Ayguadé, "Resource-aware adaptive scheduling for mapreduce clusters," Middleware 2011, pp. 187-207, 2011.
28. "The next generation of apache hadoop mapreduce."
29. A. Verma, L. Cherkasova, and R. H. Campbell, "Aria: automatic resource inference and allocation for mapreduce environments," in Proceedings of the 8th ACM international conference on Autonomic computing. ACM, 2011, pp. 235-244.
30. A. Verma, L. Cherkasova, and R. Campbell, "Resource provisioning framework for mapreduce jobs with performance goals," Middleware 2011, pp. 165-186, 2011.
31. A. Ghodsi, M. Zaharia, B. Hindman, A. Konwinski, S. Shenker, and I. Stoica, "Dominant resource fairness: fair allocation of multiple resource types," in Proceedings of the 8th USENIX conference on Networked systems design and implementation. USENIX Association, 2011, pp. 24-24.
32. PUMA Benchmarks. http://web.ics.purdue.edu/fahmad/benchmarks/datasets. htm.
33. GridMix benchmark for Hadoop clusters. http://hadoop.apache.org/docs/ mapreduce/current/gridmix.html.
34. Q. Zhang, L. Cheng, and R. Boutaba, "Cloud computing: state-of-the-art and research challenges," Journal of Internet Services and Applications, vol. 1, no. 1, pp. 7-18, 2010.
35. L. Cheng, Q. Zhang, and R. Boutaba, "Mitigating the negative impact of preemption on heterogeneous mapreduce workloads," in 7th International Conference on Network and Service Management (CNSM), 2011. IEEE, 2011.
36. Q. Zhang, Q. Zhu, and R. Boutaba, "Dynamic resource allocation for spot markets in cloud computing environments," in IEEE International Conference on Utility and Cloud Computing (UCC), 2011.
37. R. Boutaba, L. Cheng, and Q. Zhang, "On cloud computational models and the heterogeneity challenge," Journal of Internet Services and Applications, 2012.
38. M. Bari, R. Boutaba, R. Esteves, L. Granville, M. Podlesny, M. Rabbani, Q. Zhang, and M. Zhani, "Data center network virtualization: A survey," IEEE Communications Survey and Tutorials, 2012.
39. Q. Zhang, Q. Zhu, M. F. Zhani, and R. Boutaba, "Dynamic service placement in geographically distributed clouds," in Proceedings of International Conference on Distributed Computing Systems (ICDCS), 2012.
40. -, "Dynamic service placement in geographically distributed clouds," IEEE Journal on Selected Areas in Communications (JSAC), 2013.
41. M. F. Zhani, Q. Zhang, G. Simon, and R. Boutaba, "Vdc planner: Dynamic migration-aware virtual data center embedding for clouds," Proceedings of Integrated Network Management (IM), 2013.
42. Q. Zhang, M. F. Zhani, R. Boutaba, and J. L. Hellerstein, "Harmony: Dynamic heterogeneity-aware resource provisioning in the cloud," in IEEE International Conference on Distributed Computing Systems (ICDCS), 2013.
43. -, "Dynamic heterogeneity-aware resource provisioning in the cloud," IEEE Transactions on Cloud Computing (TCC), 2014, to appear.