Efficient many-core query execution in main memory column-stores

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2013, Pages 350-361

  Dees, Jonathan ^a,b   Sanders, Peter ^b  

^a SAP RESEARCH   (Germany)

^b KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATION ALGORITHMS; AUTOMATIC GENERATION; BETTER PERFORMANCE; DECISION SUPPORT QUERY; EFFICIENT IMPLEMENTATION; INVERTED INDICES; ORDERS OF MAGNITUDE; TPC-H BENCHMARKS;

DECISION SUPPORT SYSTEMS;

BENCHMARKING;

EID: 84881351478     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2013.6544838     Document Type: Conference Paper

References (38)

1. G. Graefe and W. McKenna, "The volcano optimizer generator: Extensibility and efficient search," in Proc. of ICDE. IEEE, 1993, pp. 209-218.
2. S. Padmanabhan, T. Malkemus, R. Agarwal, and A. Jhingran, "Block oriented processing of relational database operations in modern computer architectures," in ICCCN. IEEE, 2001, p. 567.
3. P. Boncz, M. Zukowski, and N. Nes, "MonetDB/X100: Hyper-pipelining query execution," in Proc. of CIDR, vol. 5, 2005.
4. P. Boncz and M. Kersten, "MIL primitives for querying a fragmented world," The VLDB Journal, vol. 8, no. 2, pp. 101-119, 1999.
5. C. Lattner, "LLVM and Clang: Next generation compiler technology," in The BSD Conference, 2008.
6. (2012) TPC Benchmark H v2.14.4. [Online]. Available: http://www.tpc.org/ tpch
7. D. Abadi, S. Madden, and N. Hachem, "Column-Stores vs. Row-Stores: How different are they really?" in Proc. of SIGMOD. ACM, 2008, pp. 967-980.
8. M. Stonebraker, D. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, and Others, "C-store: a column-oriented DBMS," in Proc. of VLDB, 2005, pp. 553-564.
9. (2012). [Online]. Available: http://www.vertica.com/
10. (2012). [Online]. Available: www.ingres.com/products/vectorwise
11. R. MacNicol and B. French, "Sybase iq multiplex-designed for analytics," in Proc. of VLDB, 2004, pp. 1227-1230.
12. K. Krikellas, S. Viglas, and M. Cintra, "Generating code for holistic query evaluation," in Proc. of ICDE. IEEE, 2010, pp. 613-624.
13. T. Neumann, "Efficiently compiling efficient query plans for modern hardware," Proc. of VLDB, vol. 4, no. 9, pp. 539-550, 2011.
14. A. Kemper and T. Neumann, "HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots," in Proc. of ICDE. IEEE, 2011, pp. 195-206.
15. O. Kennedy, Y. Ahmad, and C. Koch, "Dbtoaster: Agile views for a dynamic data management system," in Proc. of CIDR. Proc. of CIDR, 2011.
16. C. Koch, "Incremental query evaluation in a ring of databases," in Proc. of PODS. ACM, 2010, pp. 87-98.
17. D. DeWitt and J. Gray, "Parallel database systems: the future of high performance database systems," Commun. ACM, vol. 35, pp. 85-98, 1992. (Pubitemid 23642225)
18. C. K. Baru, G. Fecteau, A. Goyal, H.-I. Hsiao, A. Jhingran, S. Padmanabhan, G. P. Copeland, and W. G. Wilson, "Db2 parallel edition," IBM Systems Journal, vol. 34, no. 2, pp. 292-322, 1995.
19. F. Akal, K. Böhm, and H.-J. Schek, "OLAP query evaluation in a database cluster: A performance study on intra-query parallelism," in Advances in Databases and Information Systems, ser. LNCS, vol. 2435, 2002, pp. 181-184.
20. M. Levene and G. Loizou, "Why is the snowflake schema a good data warehouse design?" Inf. Syst., vol. 28, pp. 225-240, 2003.
21. R. W. Taylor and R. L. Frank, "Codasyl data-base management systems," ACM Comput. Surv., vol. 8, no. 1, pp. 67-103, Mar. 1976. [Online]. Available: http://doi.acm.org/10.1145/356662.356666
22. S. Golomb, "Run-length encodings (corresp.)," Transactions on Information Theory, vol. 12, no. 3, pp. 399-401, 2002.
23. M. Zukowski, S. Heman, N. Nes, and P. Boncz, "Super-scalar RAMCPU cache compression," in Proc. of ICDE. IEEE, 2006, p. 59.
24. A. Kleen, "A NUMA API for Linux," Novel Inc, 2005, http://halobates.de/numaapi3.pdf.
25. V. N. Anh and A. Moffat, "Inverted index compression using word-aligned binary codes," Information Retrieval, vol. 8, pp. 151-166, 2005. (Pubitemid 40965682)
26. -, "Index compression using 64-bit words," Software: Practice and Experience, vol. 40, no. 2, pp. 131-147, 2010.
27. G. Graefe, "Fast loads and fast queries," Data Warehousing and Knowledge Discovery, pp. 111-124, 2009.
28. (2012). [Online]. Available: http://www.threadingbuildingblocks.org
29. J. Seidel, "Job-scheduling in main-memory based parallel database systems," Master's thesis, Karlsruhe Institute of Technology, 2011.
30. J. Sompolski, M. Zukowski, and P. Boncz, "Vectorization vs. compilation in query execution," in Proc. of DaMoN, ser. DaMoN '11. New York, NY, USA: ACM, 2011, pp. 33-40.
31. J. Cieslewicz and K. A. Ross, "Adaptive aggregation on chip multiprocessors," in Proc. of VLDB, ser. VLDB '07. VLDB Endowment, 2007, pp. 339-350.
32. S. Manegold, P. Boncz, and M. Kersten, "Optimizing main-memory join on modern hardware," IEEE Trans. on Knowl. and Data Eng., vol. 14, pp. 709-730, 2002.
33. P. Sanders and F. Transier, "Fast intersection in randomized inverted indices," in Workshop on Algorithm Engineering and Experiments (ALENEX), 2007.
34. R. Boyer and J. Moore, "A fast string searching algorithm," Commun. ACM, vol. 20, no. 10, pp. 762-772, 1977.
35. A. Apostolico and R. Giancarlo, "The Boyer-Moore-Galil string searching strategies revisited," SIAM J. Comput., vol. 15, no. 1, pp. 98-105, 1986. (Pubitemid 16477183)
36. J. McCalpin, "A survey of memory bandwidth and machine balance in current high performance computers," IEEE TCCA Newsletter, pp. 19-25, 1995.
37. S. Héman, M. Zukowski, N. Nes, L. Sidirourgos, and P. Boncz, "Positional update handling in column stores," in Proc. of SIGMOD. ACM, 2010, pp. 543-554.
38. J. Krueger, C. Kim, M. Grund, N. Satish, D. Schwalb, J. Chhugani, H. Plattner, P. Dubey, and A. Zeier, "Fast updates on read-optimized databases using multi-core cpus," Proc. of VLDB, vol. 5, no. 1, pp. 61-72, 2011.