Starfish: A self-tuning system for big data analytics

CIDR 2011 - 5th Biennial Conference on Innovative Data Systems Research, Conference Proceedings

Volumn , Issue , 2011, Pages 261-272

  Herodotou, Herodotos ^a   Lim, Harold ^a   Luo, Gang ^a   Borisov, Nedyalko ^a   Dong, Liang ^a   Cetin, Fatma Bilgen ^a   Babu, Shivnath ^a  

^a Duke University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL SCIENTISTS; DATA ANALYTICS; DISTRIBUTED STORAGE; ENGINEERING DISCIPLINES; EXECUTION ENGINE; MAP-REDUCE; PAY-AS-YOU-GO; SELF-TUNING SYSTEMS; SELFTUNING; SYSTEM ARCHITECTURES; SYSTEM WORKLOADS; USER NEED;

DATABASE SYSTEMS; INNOVATION; VIRTUAL STORAGE;

RESEARCH;

EID: 80053500227     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. A. Abouzeid, K. Bajda-Pawlikowski, D. J. Abadi, A. Rasin, and A. Silberschatz. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. PVLDB, 2(1), 2009.
2. BTrace: A Dynamic Instrumentation Tool for Java. http://kenai.com/ projects/btrace.
3. M. J. Cafarella and C. Ré. Manimal: Relational Optimization for Data-Intensive Programs. In WebDB, 2010.
4. B. M. Cantrill, M. W. Shapiro, and A. H. Leventhal. Dynamic Instrumentation of Production Systems. In USENIX Annual Technical Conference, 2004.
5. Cloudera: 7 tips for Improving MapReduce Performance. http://www.cloudera.com/blog/2009/12/7-tips-for-improving-mapreduce-performance.
6. J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton. MAD Skills: New Analysis Practices for Big Data. PVLDB, 2(2), 2009.
7. J. Dittrich, J.-A. Quiané-Ruiz, A. Jindal, Y. Kargin, V. Setty, and J. Schad. Hadoop++: Making a Yellow Elephant Run Like a Cheetah. PVLDB, 3(1), 2010.
8. P. K. Gunda, L. Ravindranath, C. A. Thekkath, Y. Yu, and L. Zhuang. Nectar: Automatic Management of Data and Computation in Datacenters. In OSDI, 2010.
9. Pluggable Block Placement Policies in HDFS. issues.apache.org/jira/ browse/HDFS-385.
10. D. Jiang, B. C. Ooi, L. Shi, and S. Wu. The Performance of MapReduce: An In-depth Study. PVLDB, 3(1), 2010.
11. S. Y. Ko, I. Hoque, B. Cho, and I. Gupta. Making Cloud Intermediate Data Fault-tolerant. In SoCC, 2010.
12. TeraByte-scale Data Cycle at LinkedIn. http://tinyurl.com/lukod6.
13. Hadoop MapReduce Tutorial. http://hadoop.apache.org/common/docs/r0.20.2/ mapred-tutorial.html.
14. T. Nykiel, M. Potamias, C. Mishra, G. Kollios, and N. Koudas. MRShare: Sharing Across Multiple Queries in MapReduce. PVLDB, 3(1), 2010.
15. C. Olston, B. Reed, A. Silberstein, and U. Srivastava. Automatic Optimization of Parallel Dataflow Programs. In USENIX Annual Technical Conference, 2008.
16. A. Qureshi, R. Weber, H. Balakrishnan, J. V. Guttag, and B. V. Maggs. Cutting the Electric Bill for Internet-scale Systems. In SIGCOMM, 2009.
17. Agile Enterprise Analytics. Keynote by Oliver Ratzesberger at the Self-Managing Database Systems Workshop 2010.
18. J. Zhou, P.-Å. Larson, and R. Chaiken. Incorporating Partitioning and Parallel Plans into the SCOPE Optimizer. In ICDE, 2010.