Benchmarking approach for designing a MapReduce performance model

ICPE 2013 - Proceedings of the 2013 ACM/SPEC International Conference on Performance Engineering

Volumn , Issue , 2013, Pages 253-258

  Zhang, Zhuoyao ^a   Cherkasova, Ludmila ^b   Loo, Boon Thau ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

benchmarking; job profiling; mapreduce; performance modeling

Indexed keywords

EVALUATION STUDY; JOB PROFILING; MAP-REDUCE; MICRO-BENCHMARKS; PERFORMANCE EVALUATION FRAMEWORKS; PERFORMANCE MODEL; PERFORMANCE MODELING; PROGRAM COMPLETION;

DATA PROCESSING;

BENCHMARKING;

EID: 84878182443     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2479871.2479906     Document Type: Conference Paper

References (10)

1. BTrace: A Dynamic Instrumentation Tool for Java. http://kenai.com/ projects/btrace.
2. F. Ahmad, S. Chakradhar, A. Raghunathan, and T. Vijaykumar. Tarazu: Optimizing MapReduce on heterogeneous clusters. In Proc. of ASPLOS, 2012.
3. Apache. Hadoop: TeraGen Class. http://hadoop.apache.org/common/docs/r0. 20.2/api/org/apache/hadoop/examples/terasort/TeraGen.html.
4. J. Dean, and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Communications of the ACM,51(1), 2008.
5. H. Herodotou, F. Dong, and S. Babu. No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics. In Proc. of ACM Symposium on Cloud Computing, 2011.
6. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. Cetin, and S. Babu. Starfish: A Self-tuning System for Big Data Analytics. In Proc. of 5th Conf. on Innovative Data Systems Research (CIDR), 2011.
7. P. Holland and R. Welsch. Robust regression using iteratively reweighted least-squares. Communications in Statistics-Theory and Methods, 6(9):813-827, 1977.
8. F. Tian and K. Chen. Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds. In Proc. of IEEE Conference on Cloud Computing (CLOUD 2011).
9. A. Verma, L. Cherkasova, and R. H. Campbell. ARIA: Automatic Resource Inference and Allocation for MapReduce Environments. Proc. of the 8th ACM International Conference on Autonomic Computing (ICAC), 2011.
10. A. Verma, L. Cherkasova, and R. H. Campbell. Resource Provisioning Framework for MapReduce Jobs with Performance Goals. Proc. of the 12th ACM/IFIP/USENIX Middleware Conference, 2011.