Cache conscious star-join in MapReduce environments

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages

  Zhou, Guoliang ^a   Zhu, Yongli ^a   Wang, Guilan ^a  

^a NORTH CHINA ELECTRIC POWER UNIVERSITY   (China)

Author keywords

Cache conscious; Column store Copyright 2013 ACM; MapReduce; Star join

Indexed keywords

CACHE OPTIMIZATION; CACHE UTILIZATION; CACHE-CONSCIOUS; CLUSTER ENVIRONMENTS; COLUMN-STORE; DATA WAREHOUSE SYSTEMS; MAP-REDUCE; STAR JOIN;

DATA WAREHOUSES; DIGITAL STORAGE; FACSIMILE;

CLUSTERING ALGORITHMS;

EID: 84890544555     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2501928.2501929     Document Type: Conference Paper

References (21)

1. J. Dean and S. Ghemawat, MapReduce: Simplified data processing on large clusters, in OSDI, 2004, pp. 137-150.
2. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, etc. Bigtable: A Distributed Storage System for Structured Data. OSDI '06 pp. 205-218
3. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy, Hive - a warehousing solution over a Map-Reduce framework, PVLDB, Vol. 2, no. 2, pp. 1626-1629, 2009.
4. A. Gates, O. Natkovich, S. Chopra, P. Kamath, S. Narayanam, C. Olston, B. Reed, S. Srinivasan, and U. Srivastava, Building a high level dataflow system on top of MapReduce: The Pig experience, PVLDB, Vol. 2, no. 2, pp. 1414-1425, 2009.
5. M. Stonebraker, D. J. Abadi, A. Batkin, etc., C-store: A column-oriented DBMS, VLDB 2005, pp. 553-564.
6. D. J. Abadi, S. Madden, and N. Hachem, Column-stores vs.row-stores:how different are they really? SIGMOD 2008, pp. 967-980.
7. A. Ailamaki, D. J. DeWitt, M. D. Hill, and M. Skounakis, Weaving relations for cache performance, VLDB 2001, pp. 169-180.
8. Rubao Lee, Yin Huai, Zheng Shao, etc. RCFile: A fast and space-efficient data place-ment structure in MapReduce-based warehouse systems. ICDE 2011, pp. 1199-1208
9. Avrilia Floratou, Jignesh M. Patel, Eugene J. Shekita, and Sandeep Tata. 2011. Column-oriented storage techniques for MapReduce. Proc. VLDB Endow. 4, 7 (April 2011), 419-429.
10. Yuting Lin, Divyakant Agrawal, Chun Chen, Beng Chin Ooi, Sai Wu: Llama: leveraging columnar storage for scalable join processing in the MapReduce framework. SIGMOD 2011, pp. 961-972
11. S. Blanas, J. M. Patel, V. Ercegovac, J. Rao, E. J. Shekita, and Y. Tian. A comparison of join algorithms for log processing in mapreduce. SIGMOD 2010, pp. 975-986
12. Hyuck Han, Hyungsoo Jung, Hyeonsang Eom, Heon Young Yeom: Scatter-Gather-Merge: An efficient star-join query processing algorithm for data-parallel frameworks. Cluster Computing 14(2): 183-197 (2011)
13. Jun Rao and Kenneth A. Ross. Cache Conscious Indexing for Decision-Support in Main Memory. VLDB 1999, pp. 78-89.
14. Brewer EA. Towards robust distributed systems (abstract). PODC 2000, pp. 7.
15. Shubin Zhang, Jizhong Han, Zhiyong Liu, Kai Wang, and Shengzhong Feng, Accelerating MapReduce with Distributed Memory Cache, ICPADS 2009, December 8-11, 2009, Shenzhen, China
16. P. E. O'Neil, E. J. O'Neil, and X. Chen. The Star Schema Benchmark (SSB). http://www.cs.umb.edu/poneil/StarSchemaB.PDF.
17. Apache Hadoop. http://hadoop.apache.org/, 2012
18. Wang Lam, Lu Liu, Sts Prasad, Anand Rajaraman, Zoheb Vacheri, and AnHai Doan. 2012. Muppet: MapReduce-style processing of fast data. Proc. VLDB Endow. 5, 12 (August 2012), 1814-1825.
19. Avraham Shinnar, David Cunningham, Vijay Saraswat, and Benjamin Herta. 2012. M3R: increased performance for in-memory Hadoop jobs. Proc. VLDB Endow. 5, 12 (August 2012), 1736-1747.
20. Rubao Lee, Tian Luo, Yin Huai, Fusheng Wang, Yongqiang He, and Xiaodong Zhang. YSmart: Yet another SQL-to-MapReduce Translator. ICDCS 2011, Minneapolis, Minnesota, June 20-24, 2011.
21. Yin Huai, Rubao Lee, Simon Zhang, Cathy H. Xia, and Xiaodong Zhang. DOT: a matrix model for analyzing, optimizing and deploying software for big data analytics in distributed systems. SOCC 2011, Cascais, Portugal, October 27-28, 2011.