Understanding insights into the basic structure and essential issues of table placement methods in clusters

Proceedings of the VLDB Endowment

Volumn 6, Issue 14, 2013, Pages 1750-1761

  Huai, Yin ^a   Ma, Siyuan ^a   Lee, Rubao ^a   O'Malley, Owen ^b   Zhang, Xiaodong ^a  

^a The Ohio State University   (United States)

^b Hortonworks Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADVANCED ANALYTICS; BENCHMARKING; BIG DATA; DATA ANALYTICS; DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED DATABASE SYSTEMS;

BENCHMARKING TOOLS; COMPUTING ENVIRONMENTS; CRITICAL COMPONENT; DISTRIBUTED SYSTEMS; LARGE SCALE EXPERIMENTS; PROCESSING INFRASTRUCTURES; PRODUCTION WORKLOADS; READING PERFORMANCE;

DATA HANDLING;

EID: 84891051134     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2556549.2556559     Document Type: Article

References (27)

1. https://hive.apache.org/.
2. https://pig.apache.org/.
3. https://github.com/cloudera/impala.
4. https://issues.apache.org/jira/browse/HIVE-3874.
5. https://github.com/Parquet/parquet-format.
6. http://avro.apache.org/docs/current/trevni/spec.html.
7. http://avro.apache.org/.
8. http://docs.hortonworks.com/HDPDocuments/HDP2/ HDP-2.0.0.2/ds Hive/orcfile.html.
9. http://docs.hortonworks.com/HDPDocuments/HDP1/ HDP-1.3.0/bk cluster-planning-guide/content/ hardware-for-slave.html.
10. http://www.tpc.org/tpch/.
11. http://www.slideshare.net/hortonworks/ virtualize-hadoop050113webinar.
12. http://aws.amazon.com/elasticmapreduce/.
13. https://issues.apache.org/jira/browse/HIVE-600.
14. https://issues.apache.org/jira/browse/HIVE-4246.
15. https://issues.apache.org/jira/browse/HIVE-4868.
16. http://www.slideshare.net/oom65/ orc-andvectorizationhadoopsummit.
17. SS-DB: A Standard Science DBMS Benchmark. http:// www-conf.slac.stanford.edu/xldb10/docs/ssdb benchmark. pdf.
18. Star Schema Benchmark. http://www.cs.umb.edu/~poneil/ StarSchemaB.PDF.
19. S. Chen. Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce. In VLDB, 2010.
20. A. Floratou, J. M. Patel, E. J. Shekita, and S. Tata. Column-Oriented Storage Techniques for MapReduce. In VLDB, 2011.
21. S. Guo, J. Xiong, W. Wang, and R. Lee. Mastiff: A Mapreduce-based System for Time-Based Big Data Analytics. In CLUSTER, 2012.
22. Y. He, R. Lee, Y. Huai, Z. Shao, N. Jain, X. Zhang, and Z. Xu. RCFile: A Fast and Space-efficient Data Placement Structure in MapReduce-based Warehouse Systems. In ICDE, 2011.
23. A. Jindal, J.-A. Quiańe-Ruiz, and J. Dittrich. Trojan Data Layouts: Right Shoes for a Running Elephant. In SOCC, 2011.
24. R. Lee, T. Luo, Y. Huai, F. Wang, Y. He, and X. Zhang. YSmart: Yet Another SQL-to-MapReduce Translator. In ICDCS, 2011.
25. Y. Lin, D. Agrawal, C. Chen, B. C. Ooi, and S.Wu. Llama: Leveraging Columnar Storage for Scalable Join Processing in the Mapreduce Framework. In SIGMOD, 2011.
26. F. Wu, H. Xi, and C. Xu. On the Design of a New Linux Readahead Framework. SIGOPS Oper. Syst. Rev., 42(5):75-84, July 2008.
27. R. S. Xin, J. Rosen, M. Zaharia, M. J. Franklin, S. Shenker, and I. Stoica. Shark: SQL and Rich Analytics at Scale. In SIGMOD, 2013.