Learning based opportunistic admission control algorithm for MapReduce as a service

ISEC'10 - Proceedings of the 2010 India Software Engineering Conference

Volumn , Issue , 2010, Pages 153-160

  Dhok, Jaideep ^a   Maheshwari, Nitesh ^a   Varma, Vasudeva ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Admission control; Cloud computing; MapReduce; Software as a service

Indexed keywords

ADMISSION CONTROL; ADMISSION CONTROL ALGORITHMS; CLOUD COMPUTING; NAIVE BAYES CLASSIFIERS; ON-DEMAND SERVICES; SERVICE PROVIDER; SOFTWARE AS A SERVICE; USER SERVICES;

CLASSIFIERS; COMPUTER SOFTWARE; GRID COMPUTING; LEARNING ALGORITHMS; LOCOMOTIVES; RAILROAD CARS;

CLUSTERING ALGORITHMS;

EID: 77951434450     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1730874.1730903     Document Type: Conference Paper

References (17)

1. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2/.
2. Amazon Elastic MapReduce. http://aws.amazon.com/elasticmapreduce/.
3. Amazon Simple Storage Service. http://aws.amazon.com/s3/.
4. Apache Hadoop. http://hadoop.apache.org.
5. Capacity Scheduler for Hadoop. http://hadoop.apache.org/common/docs/ current/capacity-scheduler.html.
6. Dynamic Priority Scheduler for Hadoop. http://issues.apache.org/jira/ browse/HADOOP-4768.
7. Hadoop PoweredBy. http://wiki.apache.org/hadoop/PoweredBy.
8. Scaling Hadoop to 4000 nodes at Yahoo! http://developer.yahoo.net/blogs/ hadoop/2008/09/scaling-hadoop-to-4000-nodes-a.html.
9. A. AuYoung, L. Rit, S. Wiener, and J. Wilkes. Service contracts and aggregate utility functions. In High Performance Distributed Computing, 2006 15th IEEE International Symposium on, pages 119-131, 0-0 2006.
10. M. Bichler and T. Setzer. Admission control for media on demand services. Service Oriented Computing and Applications, 1(1):65-73, 2007.
11. J. Broberg, S. Venugopal, and R. Buyya. Market-oriented grids and utility computing: The state-of-the-art and future directions. Journal of Grid Computing, 6(3):255-276, 2008.
12. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic. Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems, 25(6):599-616, 2009.
13. B. N. Chun and D. E. Culler. User-centric performance analysis of market-based cluster batch schedulers. In CCGRID '02: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, page 30, Washington, DC, USA, 2002. IEEE Computer Society.
14. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation, pages 137-150, 2004.
15. D. E. Irwin, L. E. Grit, and J. S. Chase. Balancing risk and reward in a market-based task service. In HPDC '04: Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing, pages 160-169, Washington, DC, USA, 2004. IEEE Computer Society.
16. F. I. Popovici and J. Wilkes. Profitable services in an uncertain world. In SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing, page 36, Washington, DC, USA, 2005. IEEE Computer Society.
17. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Job Scheduling for Multi-User MapReduce Clusters. Technical Report UCB/EECS-2009-2055, EECS Department, University of California, Berkeley, Apr 2009.