Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds

IEEE International Workshop on Quality of Service, IWQoS

Volumn , Issue , 2013, Pages 213-218

  Qiu, Xuanjia ^a   Yeow, Wai Leong ^b   Wu, Chuan ^a   Lau, Francis C M ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD PLATFORMS; EFFICIENT SCHEDULING; HYBRID CLOUDS; ON-LINE ALGORITHMS; PRE-EMPTIVE SCHEDULING; PRIVATE CLOUDS; PROGRAMMING MODELS; TASK COMPLETION TIME;

ALGORITHMS; OUTSOURCING; QUALITY OF SERVICE; SCHEDULING;

COSTS;

EID: 84881354193     PISSN: 1548615X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IWQoS.2013.6550284     Document Type: Conference Paper

References (15)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," in Proc. of OSDI, Dec. 2004.
2. Hadoop, http://hadoop.apache.org/.
3. Fair Scheduler, http://hadoop.apache.org/mapreduce/docs/r0.21.0/fair scheduler.html.
4. Capacity Scheduler, http://hadoop.apache.org/mapreduce/docs/r0.21.0/ capacity scheduler.html.
5. H. Zhang, G. Jiang, K. Yoshihira, H. Chen, and A. Saxena, "Intelligent Workload Factoring for a Hybrid Cloud Computing Model," in Proc. of the International Workshop on Cloud Services (IWCS), Jun. 2009.
6. M. Hajjat, X. Sun, Y. E. Sung, D. Maltz, and S. Rao, "Cloudward Bound: Planning for Beneficial Migration of Enterprise Applications to the Cloud," in Proc. of IEEE SIGCOMM, Aug. 2010.
7. L. Cheng, Q. Zhang, and R. Boutaba, "Mitigating the Negative Impact of Preemption on Heterogeneous MapReduce Workloads," in Proc. of 7th International Conference on Network and Service Management (CNSM), Oct. 2011.
8. S. Kavulya, J. Tan, R. Gandhi, and P. Narasimhan, "An Analysis of Traces from a Production MapReduce Cluster," in Proc. of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid), May 2010.
9. T. White, Hadoop: The Definitive Guide. Yahoo Press, 2010.
10. T. Sandholm and K. Lai, "Dynamic Proportional Share Scheduling in Hadoop," in Proc. of the 15th International Conference on Job Scheduling Strategies for Parallel Processing (JSSPP), 2010.
11. S. T. Maguluri, R. Srikant, and L. Ying, "Stochastic Models of Load Balancing and Scheduling in Cloud Computing Clusters," in Proc. of IEEE INFOCOM, Mar. 2012.
12. S. Babu, "Towards automatic optimization of MapReduce programs," in Proc. of the 1st ACM symposium on Cloud computing (SoCC), Jun. 2010.
13. M. J. Neely, Stochastic Network Optimization with Application to Communication and Queueing Systems. Morgan & Claypool, 2010.
14. -, "Opportunistic Scheduling with Worst Case Delay Guarantees in Single and Multi-Hop Networks," in Proc. of IEEE INFOCOM, Apr. 2011.
15. X. Qiu, W. L. Yeow, C. Wu, and F. C. M. Lau, "Cost-Minimizing Preemptive Scheduling of MapReduce Workloads on Hybrid Clouds," http://www.cs.hku.hk/-xjqiu/xjqiu-mrsch.pdf, The University of Hong Kong, Tech. Rep., Apr. 2013.