MIMP: Deadline and interference aware scheduling of hadoop virtual machines

Proceedings - 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2014

Volumn , Issue , 2014, Pages 394-403

  Zhang, Wei ^a,b   Rajasekaran, Sundaresan ^a   Wood, Timothy ^a   Zhu, Mingfa ^b  

^a GEORGE WASHINGTON UNIVERSITY   (United States)

^b BEIHANG UNIVERSITY   (China)

Author keywords

deadlines; interference; Map Reduce; scheduling; virtualization

Indexed keywords

BATCH DATA PROCESSING; BIG DATA; GRID COMPUTING; INTERFERENCE SUPPRESSION; VIRTUAL REALITY; WAVE INTERFERENCE;

BIG DATA APPLICATIONS; DEADLINE-AWARE SCHEDULING; DEADLINES; INTERACTIVE SERVICES; MAP-REDUCE; VIRTUALIZATION LAYERS; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT;

SCHEDULING;

EID: 84904551304     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2014.101     Document Type: Conference Paper

References (26)

1. X. Bu, J. Rao, and C.-z. Xu. Interference and Locality-aware Task Scheduling for MapReduce Applications in Virtual Clusters. In Proc. of HPDC, 2013.
2. L. Cheng and C.-L. Wang. vBalance: using interrupt load balance to improve I/O performance for SMP virtual machines. In Proc. of SOCC, 2012.
3. T. Chia-Ying and L. Kang-Yuan. A Modified Priority Based CPU Scheduling Scheme for Virtualized Environment. International Journal of Hybrid Information Technology, 6(2), 2013.
4. N. Chohan, C. Castillo, M. Spreitzer, M. Steinder, A. Tantawi, and C. Krintz. See spot run: using spot instances for mapreduce workflows. In Proc. of HotCloud, 2010.
5. R. B. Clay, Z. Shen, and X. Ma. Accelerating Batch Analytics with Residual Resources from Interactive Clouds. In Proc. of MASCOTS, 2013.
6. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM, 51, 2008.
7. C. Delimitrou and C. Kozyrakis. Paragon: QoS-aware Scheduling for Heterogeneous Datacenters. In Proc. of ASPLOS, 2013.
8. A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel. The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev., 39(1), Dec. 2008.
9. H. Herodotou, F. Dong, and S. Babu. No one (cluster) size fits all: automatic cluster sizing for data-intensive analytics. In Proc. of SOCC, 2011.
10. M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg. Quincy: fair scheduling for distributed computing clusters. In Proc.of SOSP, 2009.
11. E. Keller, J. Szefer, J. Rexford, and R. B. Lee. NoHype: virtualized cloud infrastructure without the virtualization. In Proc. of ISCA, 2010.
12. G. Lee, B.-G. Chun, and H. Katz. Heterogeneity-aware resource allocation and scheduling in the cloud. In Proc. of HotCloud, 2011.
13. B. Lin and P. A. Dinda. Vsched: Mixing batch and interactive virtual machines using periodic real-time scheduling. In Proc. of Super Computing, 2005.
14. H. Lin, X. Ma, J. Archuleta, W.-c. Feng, M. Gardner, and Z. Zhang. MOON: MapReduce On Opportunistic eNvironments. In Proc. of HPDC, 2010.
15. K. Morton, A. Friesen, M. Balazinska, and D. Grossman. Estimating the progress of MapReduce pipelines. In Proc. of ICDE, 2010.
16. J. Polo, C. Castillo, D. Carrera, Y. Becerra, I. Whalley, M. Steinder, J. Torres, and E. Ayguadé. Resource-aware adaptive scheduling for mapreduce clusters. In Proc. of Middleware, 2011.
17. T. Sandholm and K. Lai. Dynamic proportional share scheduling in Hadoop. In Proc. of JSSPP, 2010.
18. B. Sharma, T. Wood, and C. R. Das. HybridMR: A Hierarchical MapReduce Scheduler for Hybrid Data Centers. In Proc. of ICDCS, 2013.
19. A. Verma, L. Cherkasova, V. Kumar, and R. Campbell. Deadline-based workload management for MapReduce environments: Pieces of the performance puzzle. In Proc. of NOMS, 2012.
20. C. A. Waldspurger. Memory resource management in VMware ESX server. Proc. of OSDI, 36(SI), Dec. 2002.
21. S. Xi, J. Wilson, C. Lu, and C. Gill. RT-Xen: towards realtime hypervisor scheduling in xen. In Proc. of EMSOFT, 2011.
22. C. Xu, S. Gamage, H. Lu, R. Kompella, and D. Xu. vTurbo: accelerating virtual machine I/O processing using designated turbo-sliced core. In Proc. of Usenix ATC, 2013.
23. Y. Xu, Z. Musgrave, B. Noble, and M. Bailey. Bobtail: Avoiding Long Tails in the Cloud. In Proc. of NSDI, 2013.
24. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling. In Proc. of EuroSys, 2010.
25. W. Zhang, S. Rajasekaran, and T. Wood. Big Data in the Background: Maximizing Productivity while Minimizing Virtual Machine Interference. In Proc. of Workshop on Architectures and Systems for Big Data, 2013.
26. Z. Zhang, L. Cherkasova, A. Verma, and B. T. Loo. Performance Modeling and Optimization of Deadline-Driven Pig Programs. ACM TAAS, 8, 2013.