Evaluating MapReduce on virtual machines: The Hadoop case

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5931 LNCS, Issue , 2009, Pages 519-528

  Ibrahim, Shadi ^a   Jin, Hai ^a   Lu, Lu ^a   Qi, Li ^b   Wu, Song ^a   Shi, Xuanhua ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b Center of Operations   (China)

Author keywords

Cloud computing; Data intensive; Distributed file system; Hadoop; MapReduce; Virtual machine

Indexed keywords

CLOUD COMPUTING; COMPUTING UNITS; DATA CENTERS; DATA INTENSIVE; DATA-INTENSIVE APPLICATION; DISTRIBUTED FILE SYSTEMS; HEAVY LOADS; OPEN SOURCE IMPLEMENTATION; PARALLEL APPLICATION; POOR PERFORMANCE; PROGRAMMING MODELS; SYSTEM RESOURCES; VIRTUAL MACHINES;

COMPUTER SCIENCE;

EID: 71749088619     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-10665-1_47     Document Type: Conference Paper

References (22)

1. Szalay, A., Bunn, A., Gray, J., Foster, I., Raicu, I.: The Importance of Data Locality in Distributed Computing Applications. In: Proceedings of the NSF Workflow Workshop (2006)
2. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: Proceedings of 19th ACM Symposium on Operating Systems Principles, pp. 29-43. ACM Press, New York (2003)
3. Dean, J., Ghemawat, S.: Mapreduce: simplified data processing on large clusters. In: Proceedings of 6th Conference on Operating Systems Design & Implementation (2004)
4. Hadoop, http://lucene.apache.org/hadoop
5. Ranger, C., Raghuraman, R., Penmetsa, A., Bradski, G., Kozyrakis, C.: Evaluating MapReduce for Multi-core and Multiprocessor Systems. In: Proceedings of 13th International Symposium on High Performance Computer Architecture, pp. 13-24. ACM Press, New York (2007)
6. Bryant, R.E.: Data-Intensive Supercomputing: The Case for DISC. CMU-CS-07-128, Technical Report, Department of Computer Science, Carnegie Mellon University (May 2007)
7. Chen, S., Schlosser, S.W.: Map-Reduce Meets Wider Varieties of Applications, IRP-TR-08-05, Technical Report, Intel. Research Pittsburgh (May 2008)
8. CNET news, http://news.cnet.com/8301-13505-3-10196871-16.html (accessed September 2009)
9. Amazon Elastic Cloud Computing, http://aws.amazon.com/ec2/
10. GoGrid Cloud Hosting, http://www.gogrid.com/
11. Figueiredo, R., Dinda, P., Fortes, J.: A Case for Grid Computing on Virtual Machines. In: Proceedings of 23rd International Conference on Distributed Computing Systems, pp. 550-559. IEEE CS Press, Los Alamitos (2003)
12. Mergen, M.F., Uhlig, V., Krieger, O., Xenidis, J.: Virtualization for High Performance Computing. ACM SIGOPS Oper. Syst. Rev. 40(2), 8-11 (2006)
13. Huang, W., Liu, J., Abali, B., Panda, D.K.: A Case for High Performance Computing with Virtual Machines. In: Proceedings of 20th ACM International Conference on Supercomputing, pp. 125-134. ACM Press, New York (2006)
14. Nagarajan, A.B., Mueller, F., Engelmann, C., Scott, S.L.: Proactive Fault Tolerance for HPC with Xen Virtualization. In: Proceedings of 21st ACM International Conference on Supercomputing, pp. 23-32. ACM Press, New York (2007)
15. Amazon Elastic MapReduce, http://aws.amazon.com/elasticmapreduce/
16. Amazon Simple Storage Service, http://aws.amazon.com/s3/
17. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live Migration of Virtual Machines. In: Proceedings of USENIX Symposium on Networked Systems Design and Implementation (2005)
18. Zhao, M., Figueiredo, R.J.: Experimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources. In: Proceedings of 2nd International Workshop on Virtualization Technology in Distributed Computing (2007)
19. XenSource (2008), http://www.xensource.com/
20. Hadoop Wiki (2008), http://wiki.apache.org/hadoop/
21. Zaharia, M., Konwinski, A., Joseph, A.D., Katz, R., Stoica, I.: Improving mapreduce performance in heterogeneous environments. In: Proceedings of 8th USENIX Symposium on Operating Systems Design and Implementation (2008)
22. Ibrahim, S., Jin, H., Cheng, B., Cao, H., Wu, S., Qi, L.: Cloudlet: Towards MapReduce implementation on Virtual machines. In: Proceedings of 18th ACM International Symposium on High Performance Distributed Computing, pp. 65-66. ACM Press, New York (2009)