Era: A framework for economic resource allocation for the cloud

26th International World Wide Web Conference 2017, WWW 2017 Companion

Volumn , Issue , 2017, Pages 634-642

  Babaioff, Moshe ^a   Noti, Gali ^a   Menache, Ishai ^a   Mansour, Yishay ^a   Curino, Carlo ^b   Reingold, Omer ^c   Timnat, Erez ^d   Nisan, Noam ^a   Ganapathy, Nar ^b   Tennenholtz, Moshe ^d  

^a MICROSOFT RESEARCH   (United States)

^b MICROSOFT   (United States)

^c STANFORD UNIVERSITY   (United States)

^d TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Cloud Computing; Dynamic Pricing; Economics; Reservations

Indexed keywords

CLOUD COMPUTING; COSTS; ECONOMICS; RESOURCE ALLOCATION; SCHEDULING; SOFTWARE TESTING; WINDOWS OPERATING SYSTEM; WORLD WIDE WEB;

ALGORITHMIC MODULE; CLOUD INFRASTRUCTURES; DYNAMIC PRICING; ECONOMIC PRINCIPLE; HARDWARE RESOURCES; RESERVATIONS; RESOURCE MANAGERS; SUB-OPTIMAL ALLOCATIONS;

COMPUTER ARCHITECTURE;

EID: 85060284766     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3041021.3054186     Document Type: Conference Paper

References (35)

1. Apache Hadoop Project. http://hadoop.apache.org/.
2. V. Abhishek, I. A. Kash, and P. Key. Fixed and market pricing for cloud services. arXiv preprint arXiv:1201.5621, 2012.
3. O. Agmon Ben-Yehuda, M. Ben-Yehuda, A. Schuster, and D. Tsafrir. Deconstructing amazon ec2 spot instance pricing. ACM Transactions on Economics and Computation, 1(3):16, 2013.
4. Amazon. Amazon elastic mapreduce. At http://aws.amazon.com/elasticmapreduce/.
5. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, et al. A view of cloud computing. CACM, 53(4):50-58, 2010.
6. Y. Azar, I. Kalp-Shaltiel, B. Lucier, I. Menache, J. S. Naor, and J. Yaniv. Truthful online scheduling with commitments. In Proceedings of the Sixteenth ACM Conference on Economics and Computation, pages 715-732. ACM, 2015.
7. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In ACM SIGOPS Operating Systems Review, volume 37, pages 164-177. ACM, 2003.
8. E. Boutin, J. Ekanayake, W. Lin, B. Shi, J. Zhou, Z. Qian, M. Wu, and L. Zhou. Apollo: Scalable and coordinated scheduling for cloud-scale computing. In OSDI, pages 285-300, Broomfield, CO, Oct. 2014. USENIX Association.
9. Y. Chen, A. Ganapathi, R. Griffith, and R. Katz. The case for evaluating mapreduce performance using workload suites. In Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems, 2011.
10. C. Curino, D. E. Difallah, C. Douglas, S. Krishnan, R. Ramakrishnan, and S. Rao. Reservation-based scheduling: If you're late don't blame us! In SoCC, 2014.
11. A. D. Ferguson, P. Bodik, S. Kandula, E. Boutin, and R. Fonseca. Jockey: guaranteed job latency in data parallel clusters. In Proceedings of the ACM European Conference on Computer Systems, Eu-roSys, 2012.
12. A. Ghodsi, M. Zaharia, B. Hindman, A. Konwinski, S. Shenker, and I. Stoica. Dominant resource fairness: Fair allocation of multiple resource types. In NSDI, volume 11, pages 24-24, 2011.
13. R. Grandl, G. Ananthanarayanan, S. Kandula, S. Rao, and A. Akella. Multi-resource packing for cluster schedulers. In ACM SIGCOMM Computer Communication Review, volume 44, pages 455-466. ACM, 2014.
14. A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel. The cost of a cloud: research problems in data center networks. ACM SIGCOMM computer communication review, 2008.
15. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: a platform for fine-grained resource sharing in the data center, 2011.
16. N. Jain, I. Menache, J. S. Naor, and J. Yaniv. A truthful mechanism for value-based scheduling in cloud computing. Theory of Computing Systems, 54(3):388-406, 2014.
17. S. A. Jyothi, C. Curino, I. Menache, S. M. Narayanamurthym, A. Tumanov, and et. al. Morpheus: Towards automated slos for enterprise clusters. In OSDI, 2016.
18. K. Karanasos, S. Rao, C. Curino, C. Douglas, K. Chaliparambil, G. M. Fumarola, S. Heddaya, R. Ramakrishnan, and S. Sakalanaga. Mercury: Hybrid centralized and distributed scheduling in large shared clusters. In ATC, 2015.
19. C. Kilcioglu and J. M. Rao. Competition on price and quality in cloud computing. In WWW, 2016.
20. I. Menache, A. Ozdaglar, and N. Shimkin. Socially optimal pricing of cloud computing resources. In ICST Conference on Performance Evaluation Methodologies and Tools, 2011.
21. I. Menache, O. Shamir, and N. Jain. On-demand, spot, or both: Dynamic resource allocation for executing batch jobs in the cloud. In 11th International Conference on Autonomic Computing (ICAC 14), pages 177-187, 2014.
22. P. Menage, P. Jackson, and C. Lameter. Cgroups. Available on-line at: http://www.mjmwired.net/kernel/Documentation/cgroups.txt, 2008.
23. D. Merkel. Docker: lightweight linux containers for consistent development and deployment. Linux Journal, 2014(239):2, 2014.
24. K. Ousterhout, P. Wendell, M. Zaharia, and I. Stoica. Sparrow: Scalable scheduling for sub-second parallel jobs. Technical Report UCB/EECS-2013-29, EECS Department, University of California, Berkeley, Apr 2013.
25. J. Rasley, K. Karanasos, S. Kandula, R. Fonseca, M. Vojnovic, and S. Rao. Efficient queue management for cluster scheduling. In Proceedings of the Eleventh European Conference on Computer Systems, page 36. ACM, 2016.
26. D. Sarkar. Introducing hdinsight. In Pro Microsoft HDInsight, pages 1-12. Springer, 2014.
27. B. Sharma, R. K. Thulasiram, P. Thulasiraman, S. K. Garg, and R. Buyya. Pricing cloud compute commodities: a novel financial economic model. In IEEE-CCGRID, 2012.
28. Y. Song, M. Zafer, and K.-W. Lee. Optimal bidding in spot instance market. In INFOCOM, 2012 Proceedings IEEE, pages 190-198. IEEE, 2012.
29. M. A. team. Azure batch: Cloud-scale job scheduling and compute management. In https://azure.microsoft.com/en-us/services/batch/, 2015.
30. A. Tumanov, T. Zhu, J. W. Park, M. A. Kozuch, M. Harchol-Balter, and G. R. Ganger. Tetrisched: global rescheduling with adaptive plan-ahead in dynamic heterogeneous clusters. In Eurosys, 2016.
31. V. K. Vavilapalli, A. C. Murthy, C. Douglas, S. Agarwal, M. Konar, R. Evans, T. Graves, J. Lowe, H. Shah, S. Seth, et al. Apache hadoop yarn: Yet another resource negotiator. In ACM - SoCC, 2013.
32. A. Velte and T. Velte. Microsoft virtualization with Hyper-V. McGraw-Hill, Inc., 2009.
33. A. Verma, L. Pedrosa, M. Korupolu, D. Oppenheimer, E. Tune, and J. Wilkes. Large-scale cluster management at google with borg. In Eurosys, 2015.
34. C. A. Waldspurger. Memory resource management in vmware esx server. SOSP, 2002.
35. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling. In Eurosys, 2010.