Statistical characterization of business-critical workloads hosted in cloud datacenters

Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015

Volumn , Issue , 2015, Pages 465-474

  Shen, Siqi ^a   Van Beek, Vincent ^a,b   Iosup, Alexandru ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b Bitbrains IT Services Inc   (Netherlands)

Author keywords

Characterization; Datacenters; Workload

Indexed keywords

CLUSTER COMPUTING; DATA SHARING; GRID COMPUTING; INFRASTRUCTURE AS A SERVICE (IAAS); SEARCH ENGINES;

APPLICATION PERFORMANCE; DATA CENTERS; IN-DEPTH ANALYSIS; RESOURCE MANAGEMENT; RESOURCE-SCHEDULING; STATISTICAL CHARACTERIZATION; SUPERCOMPUTING CENTERS; WORKLOAD;

INFORMATION MANAGEMENT;

EID: 84941215420     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2015.60     Document Type: Conference Paper

References (38)

1. U. Schwiegelshohn, R. M. Badia, M. Bubak, et al., "Perspectives on grid computing," FGCS 2010, vol. 26, no. 8, Oct. 2010.
2. C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch, "Heterogeneity and dynamicity of clouds at scale: Google trace analysis," in SoCC, 2012, p. 7.
3. Y. Chen, A. Ganapathi, R. Griffith, and R. H. Katz, "The case for evaluating MapReduce performance using workload suites," in MASCOTS, 2011.
4. B. Guenter, N. Jain, and C. Williams, "Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning," in INFOCOM, 2011, pp. 1332-1340.
5. D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper, "Workload analysis and demand prediction of enterprise data center applications," in IISWC, 2007.
6. A. K. Mishra, J. L. Hellerstein, W. Cirne, and C. R. Das, "Towards characterizing cloud backend workloads: insights from Google compute clusters," SIGMETRICS Performance Evaluation Review, vol. 37, no. 4, pp. 34-41, 2010.
7. A. Iosup and D. H. J. Epema, "Grid computing workloads," IEEE Internet Computing, vol. 15, no. 2, pp. 19-26, 2011.
8. S. Di, D. Kondo, and W. Cirne, "Characterization and comparison of cloud versus grid workloads," in CLUSTER, 2012, pp. 230-238.
9. K. Deng, J. Song, K. Ren, and A. Iosup, "Exploring portfolio scheduling for long-term execution of scientific workloads in IaaS clouds," in SC, 2013.
10. O. Beaumont, L. Eyraud-Dubois, and H. Larcheveque, "Reliable service allocation in clouds," in IPDPS, 2013, pp. 55-66.
11. L. A. Bautista-Gomez, B. Nicolae, N. Maruyama, F. Cappello, and S. Matsuoka, "Scalable Reed-Solomon-based reliable local storage for HPC applications on IaaS clouds," in Euro-Par, 2012, pp. 313-324.
12. O. Agmon Ben-Yehuda, E. Posener, M. Ben-Yehuda, A. Schuster, and A. Mu'alem, "Ginseng: market-driven memory allocation," in VEE, 2014, pp. 41-52.
13. Y. Chen, S. Alspaugh, and R. H. Katz, "Interactive analytical processing in big data systems: A cross-industry study of MapReduce workloads," PVLDB, vol. 5, no. 12, 2012.
14. Z. Ren, X. Xu, J. Wan, W. Shi, and M. Zhou, "Workload characterization on a production Hadoop cluster: A case study on Taobao," in IISWC. IEEE Computer Society, 2012.
15. R. Birke, L. Y. Chen, and E. Smirni, "Multi-resource characterization and their (in)dependencies in production datacenters," in NOMS, 2014.
16. G. Chen, W. He, J. Liu, S. Nath, L. Rigas, L. Xiao, and F. Zhao, "Energyaware server provisioning and load dispatching for connection-intensive internet services," in NSDI, 2008, pp. 337-350.
17. P. Bod'k, A. Fox, M. J. Franklin, M. I. Jordan, and D. A. Patterson, "Characterizing, modeling, and generating workload spikes for stateful services," in SoCC, 2010, pp. 241-252.
18. A. Iosup, H. Li, M. Jan, S. Anoep, C. Dumitrescu, L. Wolters, and D. H. J. Epema, "The Grid Workloads Archive," FGCS, vol. 24, no. 7, pp. 672-686, Jul. 2008.
19. D. Feitelson, "Parallel Workloads Archive," http://www. cs. huji. Ac. il/labs/ parallel/workload/.
20. S. Shen, V. van Beek, and A. Iosup, "Workload characterization of cloud datacenter of BitBrains," TU Delft, Tech. Rep. PDS-2014-001, Feb. 2014. [Online]. Available: http://www. pds. ewi. tudelft. nl/fileadmin/ pds/reports/2014/PDS-2014-001. pdf
21. D. Feitelson, "Packing schemes for gang scheduling," in JSSPP, 1996.
22. A. Iosup, T. Tannenbaum, M. Farrellee, D. H. J. Epema, and M. Livny, "Inter-operating grids through delegated matchmaking," Scientific Programming, vol. 16, no. 2-3, pp. 233-253, 2008.
23. H. Yanagisawa, T. Osogami, and R. Raymond, "Dependable virtual machine allocation," in INFOCOM, 2013.
24. A. Verma and G. Dasgupta, "Server workload analysis for power minimization using consolidation. " in USENIX ATC, 2009.
25. A. Gandhi, M. Harchol-Balter, R. Raghunathan, and M. A. Kozuch, "Autoscale: Dynamic, robust capacity management for multi-tier data centers," ACM Trans. Comput. Syst., vol. 30, no. 4, 2012.
26. S. Delamare, G. Fedak, D. Kondo, and O. Lodygensky, "SpeQuloS: a QoS service for bot applications using best effort distributed computing infrastructures," in HPDC, 2012.
27. A. Gupta, L. V. Kale, D. Milojicic, P. Faraboschi, and S. M. Balle, "HPC-aware VM placement in infrastructure clouds," in IC2E, 2013.
28. L. Chen and H. Shen, "Consolidating complementary VMs with spatial/temporal-awareness in cloud datacenters," in INFOCOM, 2014.
29. J. Ahn, C. Kim, J. Han, Y. Choi, and J. Huh, "Dynamic virtual machine scheduling in clouds for architectural shared resources," in HotCloud, 2012.
30. U. Deshpande, B. Schlinker, E. Adler, and K. Gopalan, "Gang migration of virtual machines using cluster-wide deduplication," in CCGrid, 2013.
31. N. Yigitbasi, A. Iosup, D. H. J. Epema, and S. Ostermann, "C-meter: A framework for performance analysis of computing clouds," in CCGRID, 2009, pp. 472-477.
32. M. Silva, M. R. Hines, D. S. Gallo, Q. Liu, K. D. Ryu, and D. D. Silva, "CloudBench: Experiment automation for cloud environments," in IC2E, 2013, pp. 302-311.
33. T. Rabl, A. Ghazal, M. Hu, A. Crolotte, F. Raab, M. Poess, and H. Jacobsen, "BigBench specification V0. 1-BigBench: An industry standard benchmark for big data analytics," in WBDB'12, 2012.
34. A. Iosup, A. L. Varbanescu, M. Capota, T. Hegeman, Y. Guo,W. L. Ngai, and M. Verstraaten, "Towards benchmarking IaaS and PaaS clouds for graph analytics," in WBDB'14, 2014.
35. L. Wang, J. Zhan, C. Luo, Y. Zhu, Q. Yang, Y. He, W. Gao, Z. Jia, Y. Shi, S. Zhang, C. Zheng, G. Lu, K. Zhan, X. Li, and B. Qiu, "BigDataBench: A big data benchmark suite from internet services," in HPCA, 2014.
36. D. Kondo, F. Araujo, P. Malecot, P. Domingues, L. M. Silva, G. Fedak, and F. Cappello, "Characterizing result errors in internet desktop grids," in Euro-Par, 2007.
37. Z. Jia, L. Wang, J. Zhan, L. Zhang, and C. Luo, "Characterizing data analysis workloads in data centers," in IISWC, 2013, pp. 66-76.
38. T. Benson, A. Akella, and D. A. Maltz, "Network traffic characteristics of data centers in the wild," in IMC, 2010.