MRTuner: A toolkit to enable holistic optimization for MapReduce jobs

Proceedings of the VLDB Endowment

Volumn 7, Issue 13, 2014, Pages 1319-1330

  Shi, Juwei ^a   Zou, Jia ^a   Lu, Jiaheng ^b   Cao, Zhao ^a   Li, Shiqiang ^a   Wang, Chen ^b  

^a IBM CHINA RESEARCH LAB   (China)

^b RENMIN UNIVERSITY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

DATA-INTENSIVE COMPUTING; EXPERIMENTAL EVALUATION; HOLISTIC OPTIMIZATIONS; JOB OPTIMIZATIONS; ON-THE-JOB PERFORMANCE; ORDERS OF MAGNITUDE; PARALLEL EXECUTIONS; PRODUCTION SYSTEM;

EID: 84905856702     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2733004.2733005     Document Type: Conference Paper

References (17)

1. S. Chaudhuri. An overview of query optimization in relational systems. In PODS, pages 34-43, 1998.
2. S. Chaudhuri. What next?: a half-dozen data management research goals for big data and the cloud. In PODS, pages 1-4, 2012.
3. D. Culler, R. Karp, D. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian, and T. von Eicken. Logp: Towards a realistic model of parallel computation. SIGPLAN Not., 28(7):1-12, 1993.
4. A. J. Elmore, S. Das, A. Pucher, D. Agrawal, A. El Abbadi, and X. Yan. Characterizing tenant behavior for placement and crisis mitigation in multitenant dbmss. In SIGMOD, pages 517-528, 2013.
5. L. Grit, D. Irwin, A. Yumerefendi, and J. Chase. Virtual machine hosting for networked clusters: Building the foundations for "autonomic" orchestration. In VTDC, page 7, 2006.
6. H. Herodotou and S. Babu. Profiling, what-if analysis, and cost-based optimization of mapreduce programs. PVLDB, 4(11):1111-1122, 2011.
7. H. Herodotou, H. Lim, G. Luo, N. Borisov, L. Dong, F. B. Cetin, and S. Babu. Starfish: A self-tuning system for big data analytics. In CIDR, pages 261-272, 2011.
8. S. Huang, J. Huang, J. Dai, T. Xie, and B. Huang. The hibench benchmark suite: Characterization of the mapreduce-based data analysis. In ICDEW, pages 41-51, 2010.
9. Y. Kwon, M. Balazinska, B. Howe, and J. Rolia. Skewtune: Mitigating skew in mapreduce applications. In SIGMOD, pages 25-36, 2012.
10. J. K. Laurila, D. Gatica-Perez, I. Aad, O. Bornet, T.-M.-T. Do, O. Dousse, J. Eberle, and M. Miettinen. The mobile data challenge: Big data for mobile computing research. In Proc. of Nokia Mobile Data Challenge Workshop, 2012.
11. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy. A platform for scalable one-pass analytics using mapreduce. In SIGMOD, pages 985-996, 2011.
12. O. O'Malley and A. C. Murthy. Winning a 60 second dash with a yellow elephant. Sort Benchmark, 2009.
13. N. Park, I. Ahmad, and D. J. Lilja. Romano: autonomous storage management using performance prediction in multi-tenant datacenters. In SoCC, pages 1-14, 2012.
14. L. G. Valiant. A bridging model for parallel computation. Commun. ACM, 33(8):103-111, 1990.
15. G. Wang, A. R. Butt, P. Pandey, and K. Gupta. A simulation approach to evaluating design decisions in mapreduce setups. In MASCOTS, pages 1-11, 2009.
16. T. White. Hadoop: The Definitive Guide. O'Reilly, 2012.
17. W. Xue, J. Shi, and B. Yang. X-rime: cloud-based large scale social network analysis. In SCC, pages 506-513, 2010.