A scheduling method based on deadlines in MapReduce

Lecture Notes in Electrical Engineering

Volumn 138 LNEE, Issue , 2012, Pages 1585-1592

  Xiaohong, Zhang ^a   Shui, Ju ^a   Zhibin, Jiao ^a  

^a HENAN POLYTECHNIC UNIVERSITY   (China)

Author keywords

MapReduce; Prefetching technique; Scheduling

Indexed keywords

INPUT DATAS; MAP TASK; MAP-REDUCE; PREFETCHING; PREFETCHING TECHNIQUES; REMOTE DATA ACCESS; SCHEDULING METHODS;

INPUT OUTPUT PROGRAMS;

SCHEDULING;

EID: 84859177809     PISSN: 18761100     EISSN: 18761119     Source Type: Book Series    
DOI: 10.1007/978-1-4471-2467-2_189     Document Type: Conference Paper

References (15)

1. Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters. In: Proceedings of 6th Symposium on Operating System Design and Implementation (OSDI), pp 137-150. USENIX
2. http://hadoop.apache.org, 2010
3. Huang X (2009) Research. Development and practice of cloud computing in China mobile. http://labs.chinamobile.com/mblog/47-40345
4. Leo S, Santoni F, Zanetti G (2009) Biodoop: bioinformatics on hadoop. In: Proceedings of International Conference on Parallel Processing Workshops.Vienna, pp.415-422. IEEE
5. Liu X, Han J, He J et al (2009) An approach to parallel processing of spatial data on clusters. Chinese High Technol Lett 19(10):991-997
6. Wegener D, Mock M, Adranale D et al. (2009) Toolkit-based high-performance data mining of large data on mapreduce clusters. In: Proceedings of the IEEE International Conference on Data Mining Workshops, pp 296-301. IEEE
7. Zhang S, Han J, Liu Z et al. (2009) Spatial queries evaluation with mapreduce. In: Proceedings of the Eighth International Conference on Grid and Cooperative Computing (GCC), pp 287-292. IEEE
8. Zhang X, Feng S, Fan J et al. (2012) Improving mapreduce performance by prefetching before scheduling. J High Technol Lett, vol 2
9. Zaharia M, Borthakur D, Sarma JS et al. (2009) Job scheduling for multi-user mapreduce clusters, Technical Report No.UCB/EECS-2009-55[R]. University of California at Berkeley
10. Zhang, Zhong Z, Feng S et al. (2011) Improving data locality of mapreduce by scheduling in homogeneous computing environments. In: Proceedings of IEEE 9th International Symposium on Parallel and Distributed Processing with Applications (ISPA), pp 120-126. IEEE
11. Tian C, Zhou H, He Y, Zha L (2009) A dynamic mapreduce scheduler for heterogeneous workloads. In: Proceedings of the Eighth International Conference on Grid and Cooperative Computing(GCC), pp 218-224. IEEE
12. Isard M, Prabhakaran V, Currey J, Wieder U, Talwar K, Goldberg A (2009) Quincy: fair scheduling for distributed computing clusters. In: Proceedings of the ACM SIGOPS symposium on Operating systems principles(SOSP), pp 261-276. ACM
13. Sandholm T, Lai K (2010) Dynamic proportional share scheduling in hadoop. In: Proceedings of Proceedings of the 15th international conference on Job scheduling strategies for parallel processing, pp 110-131. Springer
14. Polo J, Carrera D, Becerra Y, Steinder M, Whalley I (2010) Performance driven ask co-scheduling for mapreduce environments. In: Proceedings of IEEE/IFIP Network Operations and Management Symposium(NOMS), pp 373-380. IEEE
15. Dhok J, Varma V (2010) Using pattern classification for task assignment in mapreduce. http://researchweb.iiit.ac.in/~jaideep/