Scheduling mixed real-time and non-real-time applications in MapReduce environment

Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

Volumn , Issue , 2011, Pages 9-16

  Dong, Xicheng ^a   Wang, Ying ^a   Liao, Huaming ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Deadline scheduler; Hadoop; MapReduce; Non real time; Real time; Two level scheduler

Indexed keywords

DEADLINE SCHEDULER; HADOOP; MAP-REDUCE; NON-REAL-TIME; REAL-TIME; TWO-LEVEL SCHEDULER;

COMPUTER SYSTEMS; CONCURRENCY CONTROL; QUALITY OF SERVICE;

SCHEDULING;

EID: 84863053144     PISSN: 15219097     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPADS.2011.115     Document Type: Conference Paper

References (12)

1. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters, " in Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6. Berkeley, CA, USA: USENIX Association, 2004, pp. 107-113. [Online]. Available: http://portal.acm. org/citation.cfm?id=1251254.1251264.
2. M. Zaharia, D. Borthakur, J. S. Sarma, K. Elmeleegy, S. Shenker, and I. Stoica, "Job scheduling for multi-user mapreduce clusters, " EECS Department, University of California, Berkeley, Tech. Rep., Apr 2009.
3. K. Kc and K. Anyanwu, "Scheduling hadoop jobs to meet deadlines, " in 2nd IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 2010, pp. 388 -392.
4. J. Polo, D. Carrera, Y. Becerra, J. Torres, E. Ayguade and, M. Steinder, and I. Whalley, "Performance-driven task co-scheduling for mapreduce environments, " in Network Operations and Management Symposium (NOMS), 2010 IEEE, 2010, pp. 373 -380.
5. C. Tian, H. Zhou, Y. He, and L. Zha, "A dynamic mapreduce scheduler for heterogeneous workloads, " in Proceedings of the 2009 Eighth International Conference on Grid and Cooperative Computing, ser. GCC'09 Washington, DC, USA: IEEE Computer Society, 2009, pp. 218-224. [Online]. Available: http://dx.doi.org/10.1109/GCC.2009.19.
6. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica, "Improving mapreduce performance in heterogeneous environments, " in Proceedings of the 8th USENIX conference on Operating systems design and implementation, ser. OSDI'08. Berkeley, CA, USA: USENIX Association, 2008, pp. 29-42. [Online]. Available: http://portal.acm.org/citation.cfm?id=1855741. 1855744.
7. T. Sandholm and K. Lai, "Mapreduce optimization using regulated dynamic prioritization, " in Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems, ser. SIGMETRICS'09. New York, NY, USA: ACM, 2009, pp. 299-310. [Online]. Available: http://doi.acm.org/10.1145/1555349.1555384.
8. M. Dertouzos and A. Mok, "Multiprocessor online scheduling of hardreal- time tasks, " Software Engineering, IEEE Transactions on, vol. 15, no. 12, pp. 1497 -1506, Dec. 1989. (Pubitemid 20653698)
9. X. Lin, Y. Lu, J. Deogun, and S. Goddard, "Real-time divisible load scheduling for cluster computing, " in Real Time and Embedded Technology and Applications Symposium, 2007. RTAS'07. 13th IEEE, 2007, pp. 303 -314. [Online]. Available: http://hadoop.apache.org/.
10. H. Xiaoshan, X. he Sun, and G. Laszewski, "Qos guided min-min heuristic for grid task scheduling, " Jouranal of Computer Science & Technology, pp. 442-451, 2003.
11. K. Morton, M. Balazinska, and D. Grossman, "Paratimer: a progress indicator for mapreduce dags, " in Proceedings of the 2010 international conference on Management of data, ser. SIGMOD'10. New York, NY, USA: ACM, 2010, pp. 507-518. [Online]. Available: http://doi.acm.org/10.1145/1807167.1807223.
12. P. Linh T.X, Z. Zhang, B. T. Loo, and I. Lee, "Real-time mapreduce scheduling, " University of Pennsylvania Department of Computer and Information Science, Tech. Rep., Jan 2010.