Join optimization in the mapreduce environment for column-wise data store

Proceedings - 6th International Conference on Semantics, Knowledge and Grid, SKG 2010

Volumn , Issue , 2010, Pages 97-104

  Zhou, Minqi ^a   Zhang, Rong ^b   Zeng, Dadan ^a   Qian, Weining ^a   Zhou, Aoying ^a  

^a EAST CHINA NORMAL UNIVERSITY   (China)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CENTRALIZED DATA-BASE; COMMUNICATION COST; DISTRIBUTED FILE SYSTEMS; EFFECTIVENESS AND EFFICIENCIES; GOOGLE FILE SYSTEMS; INTERMEDIATE RESULTS; JOIN PROCESSING; PERFORMANCE STUDY;

SEMANTICS; TREES (MATHEMATICS);

FILE ORGANIZATION;

EID: 84863149565     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SKG.2010.18     Document Type: Conference Paper

References (22)

1. M. Armbrust, A. Fox, R. Griffith, A. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, et al., "Above the clouds: A berkeley view of cloud computing," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-28, 2009.
2. N. Carr, "The end of corporate computing," MIT Sloan Management Review, vol. 46, no. 3, pp. 67-73, 2005.
3. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in OSDI, 2004, pp. 137-150.
4. S. Ghemawat, H. Gobioff, and S. Leung, "The Google file system," in OSDI, 2003, pp. 29-43.
5. R. L. V. and L. Da, "Storage Adoption and Opportunities in Telecommunications, 2008," in IDC Reoprt, 2008.
6. M. Stonebraker, D. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, et al., "C-store: a columnoriented DBMS," in VLDB, 2005, pp. 564-576.
7. F. Afrati and J. Ullman, "Optimizing Joins in a Map-Reduce Environment," in EDBT, 2010.
8. Yahoo!, "Hadoop Distribted File System Architecture," http://hadoop.apache.org/common/docs/current/hdfs design.html, 2008.
9. C. French, "One size fits all" database architectures do not work for DSS," in SIGMOD, 1995, pp. 449-450.
10. Sybase, "Sybase IQ," http://www.sybase.com/products/ databaseservers/sybaseiq, 2009.
11. Addamark, "Addamark," http://www.addamark.com/products/sls. html, 2009.
12. Kx, "KDB+," http://kx.com/Products/kdb+.php, 2009.
13. M. StoneBraker and etc, "VERTICA," http://www.vertica.com/, 2009.
14. D. Abadi, S. Madden, and N. Hachem, "Column-Stores vs. Row-Stores: How different are they really?" in SIGMOD, 2008, pp. 967-980.
15. T. Corp, "DBC/1012 Data Base Computer Concepts & Facilities, Teradata Corp," Document No.C02-0001-00, 1983.
16. D. DeWitt, R. Katz, F. Olken, L. Shapiro, M. Stonebraker, and D. Wood, "Implementation techniques for main memory database systems," in SIGMOD, 1984, pp. 1-8.
17. M. Kitsuregawa, H. Tanaka, and T. Moto-Oka, "Application of hash to data base machine and its architecture," New Generation Computing, vol. 1, no. 1, pp. 63-74, 1983.
18. H. Yang, A. Dasdan, R. Hsiao, and D. Parker, "Map-reduce-merge: simplified relational data processing on large clusters," in SIGMOD, 2007, pp. 1040-1052.
19. F. Afrati and J. Ullman, "A New Computation Model for Cluster Computing," in PODS, 2009.
20. Yahoo!, "Hadoop," http://hadoop.apache.org, 2008.
21. Yahoo!, "Hadoop MapReduce," http://hadoop.apache.org/common/ docs/current/mapred tutorial.html, 2008.
22. TPC-H, "TPC-H," http://www.tpc.org/tpch/, 2009.