Modeling the performance of the hadoop online prototype

Proceedings - Symposium on Computer Architecture and High Performance Computing

Volumn , Issue , 2011, Pages 152-159

  Vianna, Emanuel ^a   Comarela, Giovanni ^a   Pontes, Tatiana ^a   Almeida, Jussara ^a   Almeida, Virgilio ^a   Wilkinson, Kevin ^b   Kuno, Harumi ^b   Dayal, Umeshwar ^b  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

analytical model; hadoop online prototype; pipeline parallelism; queuing network; simulation; task graph

Indexed keywords

ANALYTICAL MODEL; HADOOP ONLINE PROTOTYPE; QUEUING NETWORK; SIMULATION; TASK GRAPH;

COMPUTER ARCHITECTURE; COMPUTER SOFTWARE SELECTION AND EVALUATION; HIERARCHICAL SYSTEMS; MATHEMATICAL MODELS; QUEUEING NETWORKS; QUEUEING THEORY;

NETWORK ARCHITECTURE;

EID: 84855598584     PISSN: 15506533     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SBAC-PAD.2011.24     Document Type: Conference Paper

References (14)

1. T. Condie, N. Conway, P. Alvaro, J. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In USENIX, 2010.
2. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In Op. Systems Design & Implementation, 2004.
3. Apache Software Foundation. Powered by hadoop. http://wiki.apache.org/ hadoop/PoweredBy.
4. Apache Software Foundation. Official apache hadoop website. http://hadoop.apache.org/, Jun, 2011.
5. A. Ganapathi. Predicting and Optimizing System Utilization and Performance via Statistical Machine Learning. PhD thesis, University of California, 2009.
6. D.R. Jiang, B. Ooi B., L. Shi, and S.Wu. The performance of mapreduce: an in-depth study. VLDB, 3:472, 2010.
7. H. Jonkers. Queueing models of parallel applications: the Glamis methodology. In Comp. Perf. Eval., pages 123-138. Springer, 1994.
8. D. Liang and S. Tripathi. On performance prediction of parallel computations with precedent constraints. IEEE Trans. Parallel Distrib. Syst., 11:491-508, 2000.
9. V. W. Mak and S. F. Lundstrom. Predicting performance of parallel computations. IEEE Trans. Parallel Distrib. Syst., 1(3):257, 1990.
10. D. Menasce, W. Dowdy, and V. Almeida. Performance by Design: Computer Capacity Planning By Example. Prentice Hall PTR, 2004.
11. A. Pavlo., E. Paulson, A. Rasin, D. Abadi, D. DeWitt, S. Madden, and M. Stonebraker. A comparison of approaches to large-scale data analysis. In SIGMOD, 2009.
12. A. Thomasian and P. F. Bay. Analytic Queueing Network Models for Parallel Processing of Task Systems. IEEE Trans. Comput., 35(12):1045-1054, 1986. (Pubitemid 17484057)
13. E. Varki. Mean value technique for closed fork-join networks. SIGMETRICS Perform. Eval. Rev., 27:103-112, May 1999.
14. G.Wang, A. Butt, P. Pandey, and K. Gupta. Using realistic simulation for performance analysis of MapReduce setups. LSAP. ACM, 2009.