CCRP: Customized cooperative resource provisioning for high resource utilization in clouds

Proceedings - 2016 IEEE International Conference on Big Data, Big Data 2016

Volumn , Issue , 2016, Pages 243-252

  Liu, Jinwei ^a   Shen, Haiying ^b   Narman, Husnu S ^a  

^a AMRL   (United States)

^b University of Virginia   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

RESOURCE ALLOCATION;

CLOUD PROVIDERS; CLOUD SYSTEMS; EFFICIENT RESOURCE ALLOCATION; MULTIPLE RESOURCES; RESOURCE UTILIZATIONS; SERVICE LEVEL OBJECTIVE; SPATIAL SPACES; VIOLATION RATES;

BIG DATA;

EID: 85015204745     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2016.7840610     Document Type: Conference Paper

References (45)

1. M. Carvalho, W. Cirne, F. Brasileiro, and J. Wilkes. Long-term slos for reclaimed cloud computing resources. In Proc. of SoCC, Seattle, 2014.
2. Y. Chen, S. Alspaugh, and R. Katz. Interactive analytical processing in big data systems: Across-industry study of mapreduce workloads. In Proc. of VLDB, 2012.
3. Y. Chen, A. Ganapathi, R. Griffith, and R. Katz. The case for evaluating mapreduce performance using workload suites. In MASCOTS, 2011.
4. P. Delgado, F. Dinu, A.-M. Kermarrec, and W. Zwaenepoel. Hawk: Hybrid datacenter scheduling. In Proc. of ATC, 2015.
5. J. Liu and H. Shen. A popularity-aware cost-effective replication scheme for high data durability in cloud storage. In IEEE Big Data, 2016.
6. C. Delimitrou and C. Kozyrakis. HCloud: Resource-efficient provisioning in shared cloud systems. In Proc. of ASPLOS, 2016.
7. J. Liu, H. Shen, and L. Chen. CORP: Cooperative opportunistic resource provisioning for short-lived jobs in cloud systems. In Proc. of IEEE Cluster, 2016.
8. J. Mace, P. Bodik, R. Fonseca, and M. Musuvathi. Retro: Targeted resource management in multi-tenant distributed systems. In Proc. of NSDI, 2015.
9. A. Bhattacharya, D. Culler, E. Friedman, A. Ghodsi, S. Shenker, and I. Stoica. Hierarchical scheduling for diverse datacenter workloads. In Proc. of SoCC, Santa Clara, 2013.
10. J. Liu and H. Shen. Dependency-aware and resource-efficient scheduling for heterogeneous jobs in clouds. In Proc. of CloudCom, 2016.
11. Z. Li, H. Shen, W. Ligon, and J. Denton. An exploration of designing a hybrid scale-up/out hadoop architecture based on performance measurements. TPDS, PP(99):1-1, 2016.
12. R. Grandl, G. Ananthanarayanan, S. Kandula, S. Rao, and A. Akella. Multi-resource packing for cluster schedulers. In SIGCOMM, 2014.
13. N. J. Yadwadkar, G. Ananthanarayanan, and R. Katz. Wrangler: Predictable and faster jobs using fewer resources. In SoCC, 2014.
14. X. Ren, G. Ananthanarayanan, A. Wierman, and M. Yu. Hopper: Decentralized speculation-aware cluster scheduling at scale. In Proc. of ACM SIGCOMM, London, 2015.
15. M. Chowdhury, Z. Liu, A. Ghodsi, and I. Stoica. HUG: Multi-resource fairness for correlated and elastic demands. In Proc. of NSDI, 2016.
16. D. Arteaga, J. Cabrera, J. Xu, S. Sundararaman, and M. Zhao. Cloudcache: On-demand flash cache management for cloud computing. In Proc. of FAST, 2016.
17. E. J. Friedman, A. Ghodsi, and C.-A. Psomas. Strategyproof allocation of discrete jobs on multiple machines. In Proc. of ACM EC, 2014.
18. I. Pietri, G. Juve, E. Deelman, and R. Sakellariou. A performance model to estimate execution time of scientific workflows on the cloud. In WORKS'14, pages 11-19, 2014.
19. CPLEX linear program solver. http://www-01.ibm.com/software/integra tion/optimization/cplex-optimizer/ [accessed in Aug. 2016].
20. T. Patki, D. K. Lowenthal, A. Sasidharan, M. Maiterth, B. L. Rountree, M. Schulz, and B. R. de Supinski. Practical resource management in power-constrained, high performance computing. In HPDC, 2015.
21. P. Xiong, Y. Chi, S. Zhu, J. Tatemura, C. Pu, and H. Hacigümüs. Activesla: A profit-oriented admission control framework for databaseas-a-service providers. In Proc. of SoCC, Cascais, October 2011.
22. V. N. Vapn. The nature of statistical learning theory. Springer-Verlag, 1995.
23. Y. Liu, J. Bian, and E. Agichtein. Predicting information seeker satisfaction in community question answering. In Proc. of SIGIR, 2008.
24. J. Liu, H. Shen, and L. Yu. Question quality analysis and prediction in community question answering services with coupled mutual reinforcement. TSC, PP(99):1-14, 2015.
25. A. Ganapathi, Y. Chen, A. Fox, R. H. Katz, and D. A. Patterson. Statistics-driven workload modeling for the cloud. In SMDB, 2010.
26. Google trace. https://code.google.com/p/googleclusterdata/.
27. C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In Proc. of SoCC, San Jose, October 2012.
28. A. van den Oord, S. Dieleman, and B. Schrauwen. Deep content-based music recommendation. In Proc. of NIPS, pages 2643-2651, 2013.
29. Z. Shen, S. Subbiah, X. Gu, and J. Wilkes. Cloudscale: Elastic resource scaling for multi-tenant cloud systems. In Proc. of SoCC, Oct. 2011.
30. H. Shen, J. Liu, K. Chen, J. Liu, and S. Moyer. SCPS: A socialaware distributed cyber-physical human-centric search engine. IEEE Transactions on Computers (TC), 64:518-532, 2015.
31. B. Wu, H. Shen, and K. Chen. Exploiting active sub-areas for multi-copy routing in vdtns. In Proc. of ICCCN, 2015.
32. D. Chicco, P. Sadowski, and P. Baldi. Deep autoencoder neural networks for gene ontology annotation predictions. In ACM BCB, 2014.
33. Z. Ghahramani. Probabilistic machine learning and artificial intelligence. Nature, 521:452-459, 2015.
34. Q. V. Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng. On optimization methods for deep learning. In Proc. of ICML, 2011
35. V. Nae, A. Iosup, S. Podlipnig, R. Prodan, D. Epema, and T. Fahringer. Efficient management of data center resources for massively multiplayer online games. In Proc. of SC, 2008.
36. J. Liu, H. Shen, and H. Hu. Load-aware and congestion-free state management in network function virtualization. In Proc. of ICNC, 2017.
37. J. Liu, L. Yu, H. Shen, Y. He, and J. Hallstrom. Characterizing data deliverability of greedy routing in wireless sensor networks. In Proc. of SECON, Seattle, June 2015.
38. G. Shanmuganathan, A. Gulati, and P. Varman. Defragmenting the cloud using demand-based resource allocation. In SIGMETRICS, 2013.
39. J. Liu and H. Shen. A low-cost multi-failure resilient replication scheme for high data availability in cloud storage. In Proc. of HiPC, 2016.
40. Y. Lv, Y. Duan, W. Kang, Z. Li, and F. Wang. Traffic flow prediction with big data: A deep learning approach. ITS, 16(2):865-873, 2015.
41. Palmetto cluster. http://citi.clemson.edu/palmetto/.
42. Amazon EC2. http://aws.amazon.com/ec2 [accessed in Aug. 2016].
43. C. Curino, D. E. Difallah, C. Douglas, S. Krishnan, R. Ramakrishnan, and S. Rao. Reservation-based scheduling: If you're late don't blame us! In Proc. of SoCC, Seattle, November 2014.
44. P. Marshall, K. Keahey, and T. Freeman. Improving utilization of infrastructure clouds. In IEEE/ACM CCGrid, pages 205-214, 2011.
45. Amazon EC2 instance purchasing options. https://aws.amazon.com/ec2 /purchasing-options [accessed in Aug. 2016].