An architecture for recycling intermediates in a column-store

ACM Transactions on Database Systems

Volumn 35, Issue 4, 2010, Pages

  Ivanova, Milena G ^a   Kersten, Martin L ^a   Nes, Niels J ^a   Gonçalves, Romulo A P ^a  

^a CWI   (Netherlands)

Author keywords

Caching; Column stores; Database kernels

Indexed keywords

CACHE TUNING; CACHING; COLUMN-STORE; COLUMN-STORES; DATABASE KERNELS; DECISION SUPPORTS; EXECUTION PARADIGM; EXPERIMENTAL ANALYSIS; FURTHER DEVELOPMENT; GRAND CHALLENGE; INTERMEDIATE RESULTS; MATERIALIZED VIEW; OPEN SOURCE SYSTEM; PERFORMANCE GAIN; QUERY RESPONSE TIME; REAL-WORLD APPLICATION; RESOURCE CONTENTION; RESOURCE LIMITATIONS; SELF-ORGANIZING BEHAVIOR; TIME PROCESSING;

ARCHITECTURE; BENCHMARKING; BYPRODUCTS; DATABASE SYSTEMS; DECISION SUPPORT SYSTEMS; LAKES;

RECYCLING;

EID: 78650660986     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/1862919.1862921     Document Type: Conference Paper

References (33)

1. AGRAWAL, S., CHAUDHURI, S., AND NARASAYYA, V. R. 2000. Automated selection of materialized views and indexes in SQL databases. In Proceedings of the International Conference on Very Large Databases (VLDB). 496-505.
2. BLAKELEY, J. A., LARSON, P.-Å., AND TOMPA, F. W. 1986. Efficiently updating materialized views. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 61-71.
3. BONCZ, P. A., KERSTEN, M. L., AND MANEGOLD, S. 2008. Breaking the memory wall in MonetDB. Comm. ACM 51, 12.
4. BORNHÖVD, C., ALTINEL, M., MOHAN, C., PIRAHESH, H., AND REINWALD, B. 2004. Adaptive database caching with DBCache. IEEE Data Eng. Bull. 27, 2, 11-18.
5. BRUNO, N. AND CHAUDHURI, S. 2007. Physical design refinement: The 'merge-reduce' approach. ACM Trans. Datab. Syst. 32, 4.
6. CHEN, C.-M. AND ROUSSOPOULOS, N. 1994. The implementation and performance evaluation of the ADMS query optimizer: Integrating query result caching and matching. In Proceedings of the International Conference on Extending Database Technology (EDBT). 323-336.
7. CHOI, C.-H., YU, J. X., AND LU, H. 2003. Dynamic materialized view management based on predicates. In Proceedings of Asia-Pacific Web Conference (APWeb). 583-594.
8. CORNACCHIA, R., HÉMAN, S., ZUKOWSKI, M., DE VRIES, A. P., AND BONCZ, P. A. 2008. Flexible and efficient IR using array databases. VLDB J. 17, 1, 151-168.
9. GOLDSTEIN, J. AND LARSON, P.-Å. 2001. Optimizing queries using materialized views: A practical, scalable solution. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 331-342.
10. GRAEFE, G. 1994. Volcano - An extensible and parallel query evaluation system. IEEE Trans. Knowl. Data Eng. 6, 1, 120-135.
11. GRIFFIN, T. AND LIBKIN, L. 1995. Incremental maintenance of views with duplicates. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 328-339.
12. IVANOVA, M., KERSTEN, M. L., AND NES, N. 2008. Self-organizing strategies for a column-store database. In Proceedings of the International Conference on Extending Database Technology (EDBT). 157-168.
13. IVANOVA, M., KERSTEN, M. L., NES, N. J., AND GONÇALVES, R. 2009. An architecture for recycling intermediates in a column-store. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 309-320.
14. IVANOVA, M., NES, N., GONÇALVES, R., AND KERSTEN, M. L. 2007. MonetDB/SQL meets SkyServer: the challenges of a scientific database. In Proceedings of the International Conference on Scientific and Statistical Database Management (SSDBM).
15. KOTIDIS, Y. AND ROUSSOPOULOS,N. 2001. A case for dynamic viewmanagement. ACMTrans.Datab. Syst. 26, 4, 388-423.
16. LARSON, P.-Å., GOLDSTEIN, J., AND ZHOU, J. 2004. MTCache: Transparentmid-tier database caching in SQL server. In Proceedings of the International Conference on Data Engineering (ICDE). 177-189.
17. LUO, G. 2007. Partial materialized views. In Proceedings of the International Conference on Data Engineering (ICDE). 756-765.
18. LUO, G. AND YU, P. S. 2008. Content-based filtering for efficient online materialized view maintenance. In Proceedings of the International Conference on Information and Knowledge Management (CIKM). 163-172.
19. MARTELLO, S. AND TOTH, P. 1990. Knapsack Problems: Algorithms and Computer Implementations. John Wiley & Sons, England.
20. MISTRY, H., ROY, P., SUDARSHAN, S., AND RAMAMRITHAM, K. 2001. Materialized view selection and maintenance using multi-query optimization. In Proceedings of the ACM (SIGMOD) Conference on the Management of Data. 307-318.
21. MonetDB 2010. http://monetdb.cwi.nl/.
22. PHAN, T. AND LI, W.-S. 2008. Dynamic materialization of query views for data warehouse workloads. In Proceedings of the International Conference on Data Engineering (ICDE). 436-445.
23. RAO, J. AND ROSS, K. A. 1998. Reusing invariants: a new strategy for correlated queries. Proceedings of the ACM SIGMOD Conference on the Management of Data, 37-48.
24. ROSS, K. A., SRIVASTAVA, D., AND SUDARSHAN, S. 1996. Materialized view maintenance and integrity constraint checking: trading space for time. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 447-458.
25. ROY, P., SESHADRI, S., SUDARSHAN, S., AND BHOBE, S. 2000. Efficient and extensible algorithms for multi query optimization. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 249-260.
26. SCHEUERMANN, P., SHIM, J., AND VINGRALEK, R. 1996. WATCHMAN: A data warehouse intelligent cachemanager. In Proceedings of the International Conference on Very Large Data Bases (VLDB). 51-62.
27. SkyServer 2008. Sloan Digital Sky Survey / SkyServer, http://cas.sdss.org/.
28. SZALAY, A. S., GRAY, J., ET AL. 2002. The SDSS SkyServer: Public access to the sloan digital sky server data. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 570-581.
29. TAN, K.-L., GOH, S.-T., AND OOI, B. C. 2001. Cache-on-demand: Recycling with certainty. In Proceedings of the International Conference on Data Engineering (ICDE). 633-640.
30. TRANSACTION PROCESSING PERFORMANCE COUNCIL. 2008. TPC Benchmark H, Revision 2.6.2. VectorWise 2010. http://www.vectorwise.com/.
31. ZHOU, J., LARSON, P.-Å., GOLDSTEIN, J., AND DING, L. 2007a. Dynamic Materialized Views. In Proceedings of the International Conference on Data Engineering (ICDE). 526-535.
32. ZHOU, J., LARSON, P.-Å., FREYTAG, J.-C., AND LEHNER, W. 2007b. Efficient Exploitation of Similar Subexpressions for Query Processing. In Proceedings of the ACM SIGMOD Conference on the Management of Data. 533-544.
33. ZUKOWSKI, M., HÉMAN, S., NES, N., AND BONCZ, P. 2006. Super-Scalar RAM-CPU Cache Compression. In Proceedings of the International Conference on Data Engineering (ICDE).