Hawk: Hybrid datacenter scheduling

Proceedings of the 2015 USENIX Annual Technical Conference, USENIX ATC 2015

Volumn , Issue , 2015, Pages 499-510

  Delgado, Pamela ^a   Dinu, Florin ^a   Kermarrec, Anne Marie ^b   Zwaenepoel, Willy ^a  

^a EPFL

^b INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CENTRALIZED SCHEDULERS; DISTRIBUTED SCHEDULERS; DISTRIBUTED SCHEDULING; EFFICIENT SCHEDULING; HETEROGENEOUS WORKLOADS; PROTOTYPE IMPLEMENTATIONS; SCHEDULING DECISIONS; TRACE DRIVEN SIMULATION;

SCHEDULING;

EID: 84992029827     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. J. Wilkes-More Google cluster data. http://googleresearch.blogspot.ch/2011/11/more-google-clusterdata.html.
2. G. Ananthanarayanan, A. Ghodsi, A. Wang, D. Borthakur, S. Kandula, S. Shenker, and I. Stoica. Pacman: Coordinated memory caching for parallel jobs. In Proc. NSDI 2012.
3. E. Boutin, J. Ekanayake, W. Lin, B. Shi, J. Zhou, Z. Qian, M. Wu, and L. Zhou. Apollo: Scalable and coordinated scheduling for cloud-scale computing. In Proc. OSDI 2014.
4. Y. Chen, S. Alspaugh, and R. Katz. Interactive analytical processing in big data systems: A cross-industry study of mapreduce workloads. In Proc. VLDB 2012.
5. Y. Chen, A. Ganapathi, R. Griffith, and R. Katz. The case for evaluating mapreduce performance using workload suites. In Proc. MASCOTS 2011.
6. C. Delimitrou and C. Kozyrakis. Paragon: QoS-aware scheduling for heterogeneous datacenters. In Proc. ASPLOS 2013.
7. C. Delimitrou and C. Kozyrakis. Quasar: Resource-efficient and QoS-aware cluster management. In Proc. ASPLOS 2014.
8. F. R. Dogar, T. Karagiannis, H. Ballani, and A. Rowstron. Decentralized task-aware scheduling for data center networks. In Proc. SIGCOMM 2014.
9. A. D. Ferguson, P. Bodik, S. Kandula, E. Boutin, and R. Fonseca. Jockey: Guaranteed job latency in data parallel clusters. In Proc. EuroSys 2012.
10. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. In Proc. NSDI 2011.
11. K. Karanasos, S. Rao, C. Curino, C. Douglas, K. Chaliparambil, G. Fumarola, S. Heddaya, R. Ramakrishnan, and S. Sakalanaga. Mercury: Hybrid centralized and distributed scheduling in large shared clusters. In Proc. Usenix ATC 2015.
12. C. Kozyrakis. Resource efficient computing for warehouse-scale datacenters. In Proc. DATE 2013.
13. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia. A study of skew in mapreduce applications. In Proc. OpenCirrus Summit 2011.
14. K. Ousterhout, P. Wendell, M. Zaharia, and I. Stoica. Sparrow: Distributed, low latency scheduling. In Proc. SOSP 2013.
15. C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In Proc. SoCC 2012.
16. K. Ren, Y. Kwon, M. Balazinska, and B. Howe. Hadoop's adolescence: An analysis of hadoop usage in scientific workloads. In Proc. VLDB 2013.
17. M. Schwarzkopf, A. Konwinski, M. Abd-El-Malek, and J. Wilkes. Omega: Flexible, scalable schedulers for large compute clusters. In Proc. EuroSys 2013.
18. G. Staples. Torque resource manager. In Proc. SuperComputing 2006.
19. E. Thereska, H. Ballani, G. O'Shea, T. Karagiannis, A. Rowstron, T. Talpey, R. Black, and T. Zhu. IOFlow: A softwaredefined storage architecture. In Proc. SOSP 2013.
20. V. K. Vavilapalli, A. C. Murthy, C. Douglas, S. Agarwal, M. Konar, R. Evans, T. Graves, J. Lowe, H. Shah, S. Seth, B. Saha, C. Curino, O. O'Malley, S. Radia, B. Reed, and E. Baldeschwieler. Apache Hadoop YARN: Yet Another Resource Negotiator. In Proc. SOCC 2013.
21. A. Verma, L. Pedrosa, M. Korupolu, D. Oppenheimer, E. Tune, and J. Wilkes. Large-scale cluster management at Google with Borg. In Proc. EuroSys 2015.
22. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling. In Proc. EuroSys 2010.
23. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. Mc-Cauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proc. NSDI 2012.