Job aware scheduling algorithm for MapReduce framework

Proceedings - 2011 3rd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2011

Volumn , Issue , 2011, Pages 724-729

  Nanduri, Radheshyam ^a   Maheshwari, Nitesh ^a   Reddyraja, A ^a   Varma, Vasudeva ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Cloud computing; Job scheduling; Machine learning; MapReduce

Indexed keywords

JOB SCHEDULING; LARGE-SCALE COMPUTING; MACHINE-LEARNING; MAP-REDUCE; RESEARCH COMMUNITIES; RUNTIMES;

CLOUD COMPUTING; LEARNING SYSTEMS;

SCHEDULING;

EID: 84857147047     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2011.112     Document Type: Conference Paper

References (15)

1. Rajkumar Buyya, Chee Shin Yeo, Srikumar Venugopal, James Broberg, and Ivona Brandic. Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems, 25(6):599-616, 2009.
2. Nitesh Maheshwari, Radheshyam Nanduri, and Vasudeva Varma. Dynamic energy efficient data placement and cluster reconfiguration algorithm for mapreduce framework. Future Generation Computer Systems, 28(1):119 - 127, 2012.
3. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, 2008.
4. Jaideep Dhok, Nitesh Maheshwari, and Vasudeva Varma. Learning based opportunistic admission control algorithm for mapreduce as a service. In ISEC '10: Proceedings of the 3rd India software engineering conference, pages 153-160. ACM, 2010.
5. JobTracker Architecture. http://hadoop.apache.org/common/docs/current/ mapred tutorial.html.
6. Richard O. Duda, Peter E. Hart, and David G. Stork. Pattern Classification (2nd Edition). Wiley-Interscience, 2 edition, November 2000.
7. Geoffrey Holmes Bernhard Pfahringer Peter Reutemann Ian H. Witten Mark Hall, Eibe Frank. The weka data mining software. SIGKDD Explorations, 11(1), 2009.
8. 'Atop' utility. http://www.atoptool.nl/.
9. Hadoop Distributed File System. http://hadoop.apache.org/common/docs/ current/hdfs-design.html.
10. Fair Scheduler. http://hadoop.apache.org/common/docs/r0.20.2/fair- scheduler.html.
11. Capacity Scheduler. http://hadoop.apache.org/common/docs/r0.20.2/ capacity-scheduler.html.
12. Quan Chen, Daqiang Zhang, Minyi Guo, Qianni Deng, and Song Guo. Samr: A self-adaptive mapreduce scheduling algorithm in heterogeneous environment. In Computer and Information Technology (CIT), 2010 IEEE 10th International Conference on, 29 2010.
13. J. Polo, D. Carrera, Y. Becerra, V. Beltran, J. Torres, and E. Ayguade and. Performance management of accelerated mapreduce workloads in heterogeneous clusters. In Parallel Processing (ICPP), 2010 39th International Conference on, pages 653 -662, 2010.
14. Aameek Singh, Madhukar Korupolu, and Dushmanta Mohapatra. Server-storage virtualization: integration and load balancing in data centers. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC '08, pages 53:1-53:12, Piscataway, NJ, USA, 2008. IEEE Press.
15. Karthik Kambatla, Abhinav Pathak, and Himabindu Pucha. Towards optimizing hadoop provisioning in the cloud. In Proceedings of the 2009 conference on Hot topics in cloud computing, HotCloud'09, pages 22-22, Berkeley, CA, USA, 2009. USENIX Association.