More convenient more overhead: The performance evaluation of Hadoop streaming

Proceedings of the 2011 ACM Research in Applied Computation Symposium, RACS 2011

Volumn , Issue , 2011, Pages 307-313

  Ding, Mengwei ^a   Zheng, Long ^b   Lu, Yanchao ^a   Li, Li ^a   Guo, Song ^b   Guo, Minyi ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF AIZU   (Japan)

Author keywords

Hadoop; Hadoop streaming; Linux kernel; MapReduce

Indexed keywords

DATA INTENSIVE; DISTRIBUTED SYSTEMS; HADOOP; JAVA LANGUAGE; LINUX KERNEL; MAP-REDUCE; PERFORMANCE EVALUATION; PERFORMANCE PENALTIES; PROGRAMMING MODELS;

BENCHMARKING; COMPUTER PROGRAMMING; EXPERIMENTS;

JAVA PROGRAMMING LANGUAGE;

EID: 84863177111     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2103380.2103444     Document Type: Conference Paper

References (12)

1. Apache hadoop. http://hadoop.apache.org.
2. Hadoop streaming. http://hadoop.apache.org/ common/docs/stable/\\ streaming.html.
3. R. Barga, D. Gannon, and D. Reed. The client and the cloud: Democratizing research computing. Internet Computing, IEEE, 15(1):72-75, jan.-feb. 2011.
4. D. Bovet, M. Cesati, and A. Oram. Understanding the Linux kernel. O'Reilly & Associates, Inc., 2002.
5. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic. Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst., 25:599-616, June 2009.
6. M. de Kruijf and K. Sankaralingam. Mapreduce for the cell broadband engine architecture. IBM Journal of Research and Development, 53(5):10:1-10:12, 2009.
7. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51:107-113, January 2008.
8. J. Ekanayake, T. Gunarathne, and J. Qiu. Cloud technologies for bioinformatics applications. IEEE Transactions on Parallel and Distributed Systems, 22(6):998-1011, june 2011.
9. B. He, W. Fang, Q. Luo, N. K. Govindaraju, and T. Wang. Mars: a mapreduce framework on graphics processors. In the 17th international conference on Parallel architectures and compilation techniques, pages 260-269, New York, NY, USA, 2008. ACM.
10. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. SIGOPS Oper. Syst. Rev., 41:59-72, March 2007. (Pubitemid 47281575)
11. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis. Evaluating mapreduce for multi-core and multiprocessor systems. In IEEE 13th International Symposium on High Performance Computer Architecture, pages 13 -24, feb. 2007.
12. J. A. Stuart, C.-K. Chen, K.-L. Ma, and J. D. Owens. Multi-gpu volume rendering using mapreduce. In the 19th ACM International Symposium on High Performance Distributed Computing, pages 841-848, New York, NY, USA, 2010. ACM.