MCJoin: A memory-constrained join for column-store main-memory databases

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 121-132

  Begley, Steven Keith ^a   He, Zhen ^a   Chen, Yi Ping Phoebe ^a  

^a LA TROBE UNIVERSITY   (Australia)

Author keywords

column store; hash join; main memory

Indexed keywords

APPLICATION SCENARIO; COLUMN-STORE; EXISTING SYSTEMS; HASH JOIN; JOIN ALGORITHM; JOIN OPERATION; MAIN MEMORY; MAIN-MEMORY DATABASE; MEMORY BOTTLENECK; MEMORY CONSTRAINTS;

HASH FUNCTIONS;

DATABASE SYSTEMS;

EID: 84862666576     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213851     Document Type: Conference Paper

References (18)

1. D. Abadi, S. Madden, and M. Ferreira. Integrating compression and execution in column-oriented database systems. In Proceedings of the 2006 ACM SIGMOD international conference on Management of data, SIGMOD '06, pages 671-682, New York, NY, USA, 2006. ACM.
2. D. J. Abadi, S. R. Madden, and N. Hachem. Column-stores vs. row-stores: how different are they really? In SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data, pages 967-980, New York, NY, USA, 2008. ACM.
3. D. J. Abadi, D. S. Myers, D. J. DeWitt, and S. Madden. Materialization strategies in a column-oriented dbms. In Proceedings of ICDE, pages 466-475, 2007.
4. A. Ailamaki, D. J. DeWitt, M. D. Hill, and D. A. Wood. DBMSs on a Modern Processor: Where Does Time Go? In VLDB '99: Proceedings of the 25th International Conference on Very Large Data Bases, pages 266-277, San Francisco, CA, USA, 1999. Morgan Kaufmann Publishers Inc.
5. P. A. Boncz, M. L. Kersten, and S. Manegold. Breaking the memory wall in MonetDB. Commun. ACM, 51(12):77-85, 2008.
6. P. A. Boncz, S. Manegold, and M. L. Kersten. Database Architecture Optimized for the New Bottleneck: Memory Access. In VLDB '99: Proceedings of the 25th International Conference on Very Large Data Bases, pages 54-65, San Francisco, CA, USA, 1999. Morgan Kaufmann Publishers Inc.
7. boost.org. Boost c++ libraries. http://www.boost.org/, 2010.
8. E. F. Codd. A relational model of data for large shared data banks. Commun. ACM, 13(6):377-387, 1970.
9. G. P. Copeland and S. N. Khoshafian. A decomposition storage model. In SIGMOD '85: Proceedings of the 1985 ACM SIGMOD international conference on Management of data, pages 268-279, New York, NY, USA, 1985. ACM.
10. B. He, M. Lu, K. Yang, R. Fang, N. K. Govindaraju, Q. Luo, and P. V. Sander. Relational query coprocessing on graphics processors. ACM Trans. Database Syst., 34(4):1-39, 2009.
11. A. L. Holloway and D. J. DeWitt. Read-optimized databases, in depth. Proc. VLDB Endow., 1:502-513, 2008.
12. S. N. Khoshafian, G. P. Copeland, T. Jagodis, H. Boral, and P. Valduriez. A Query Processing Strategy for the Decomposed Storage Model. In Proceedings of the Third International Conference on Data Engineering, pages 636-643, Washington, DC, USA, 1987. IEEE Computer Society.
13. C. Kim, T. Kaldewey, V. W. Lee, E. Sedlar, A. D. Nguyen, N. Satish, J. Chhugani, A. Di Blas, and P. Dubey. Sort vs. hash revisited: fast join implementation on modern multi-core cpus. Proc. VLDB Endow., 2(2):1378-1389, 2009.
14. M. Zukowski, P. A. Boncz, N. Nes, and S. Heman. MonetDB/X100 - A DBMS In The CPU Cache. IEEE Data Engineering Bulletin, 28(2):17-22, 2005.
15. Manegold, S.; Boncz, P.; Kersten, M.;. Optimizing main-memory join on modern hardware. Knowledge and Data Engineering, IEEE Transactions on, 14:709-730, 2002.
16. M. Matsumoto and T. Nishimura. Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. Simul., 8(1):3-30, 1998.
17. A. Shatdal, C. Kant, and J. F. Naughton. Cache conscious algorithms for relational query processing. In VLDB '94: Proceedings of the 20th International Conference on Very Large Data Bases, pages 510-521, San Francisco, CA, USA, 1994. Morgan Kaufmann Publishers Inc.
18. M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, P. O'Neil, A. Rasin, N. Tran, and S. Zdonik. C-store: a column-oriented DBMS. In VLDB '05: Proceedings of the 31st international conference on Very large data bases, pages 553-564. VLDB Endowment, 2005.