Improving mapreduce performance through complexity and performance based data placement in heterogeneous hadoop clusters

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7753 LNCS, Issue , 2013, Pages 115-125

  Arasanal, Rajashekhar M ^a   Rumani, Daanish U ^a  

^a NONE

Author keywords

Data processing; Hadoop; Heterogeneous cluster; MapReduce

Indexed keywords

CLUSTER COMPUTING; DATA PROCESSING; OPEN SOURCE SOFTWARE; OPEN SYSTEMS;

COMPUTING CAPACITY; DATA PLACEMENT ALGORITHMS; HADOOP; HETEROGENEOUS CLUSTERS; MAP-REDUCE; OPEN SOURCE IMPLEMENTATION; PERFORMANCE BASED; PROGRAMMING MODELS;

CLUSTERING ALGORITHMS;

EID: 84872780523     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-36071-8_8     Document Type: Conference Paper

References (11)

1. Mustafa Rafique, M., Rose, B., Butt, A.R., Nikolopoulos, D.S.: Supporting MapReduce on Large-Scale Asymmetric Multi-Core Clusters
2. Babu, S.: Towards automatic optimization of MapReduce programs. In: Proc. SoCC, pp. 137-142 (2010)
3. Isard, M., Prabhakaran, V., Currey, J., Wieder, U., Talwar, K., Goldberg, A.: Quincy: Fair Scheduling for Distributed Computing Clusters
4. Xie, J., Yin, S., Ruan, X., Ding, Z., Tian, Y., Majors, J., Manzanares, A., Qin, X.: Improving MapReduce performance through data placement in heterogeneous Hadoop clusters. In: Proc. IPDPS Workshops, pp. 1-9 (2010)
5. Gufler, B., Augsten, N., Reiser, A., Kemper, A.: Handling Data Skew in MapReduce. In: Proc. CLOSER, pp. 574-583 (2011)
6. Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. In: OSDI 2004: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA (December 2004)
7. Hadoop, http://hadoop.apache.org/
8. Hadoop Single Node Setup, http://hadoop.apache.org/common/docs/r1.0.1/ single-node-setup.html
9. Hadoop Cluster Setup, http://hadoop.apache.org/common/docs/r1.0.1/ cluster-setup.html
10. Configuring Eclipse for Hadoop Development (a screencast), http://www.cloudera.com/blog/2009/04/configuring-eclipsefor- hadoop-development-a-screencast/
11. Amazon AWS, https://console.aws.amazon.com/console/home