Predictable performance and high query concurrency for data analytics

VLDB Journal

Volumn 20, Issue 2, 2011, Pages 227-248

  Candea, George ^a   Polyzotis, Neoklis ^b   Vingralek, Radek ^c  

^a EPFL   (Switzerland)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c GOOGLE INC   (United States)

Author keywords

Concurrency; Join; Sharing; Warehouse

Indexed keywords

COMMERCIAL SYSTEMS; COMPLEX DATA; COMPLEX QUERIES; COMPUTATION RESOURCES; CONCURRENCY; DATA ANALYTICS; EXECUTION TIME; JOIN; LARGE DATASETS; NEW DESIGN; NON-BLOCKING; ON THE FLIES; ORDER OF MAGNITUDE; POSTGRESQL; SHARING; TIME MODEL;

DATA PROCESSING; DATA REDUCTION; DATA WAREHOUSES;

SEARCH ENGINES;

EID: 79952763569     PISSN: 10668888     EISSN: 0949877X     Source Type: Journal    
DOI: 10.1007/s00778-011-0221-2     Document Type: Article

References (31)

1. Abadi, D., Madden, S., Ferreira, M.: Integrating compression and execution in column-oriented database systems. Proceedings of ACM SIGMOD International Conference on Management of Data (2006).
2. Abadi, D. J., Myers, D. S., Dewitt, D. J., Madden, S. R.: Materialization strategies in a column-oriented DBMS. Proceedings of International Confernce on Data Engineering (2007).
3. Agrawal, J., Diao, Y., Gyllstrom, D., Immerman, N.: Efficient pattern matching over event streams. Proceedings of International Conference on Data Engineering (2008).
4. Arumugam, S., Dobra, A., Jermaine, C. M., Pansare, N., Perez, L.: The DataPath system: a data-centric analytic processing engine for large data warehouses. Proceedings of ACM SIGMOD International Conference on Management of Data (2010).
5. Aster Data Systems: Personal communication between George Candea and multiple Aster Data customers (2009).
6. Babu, S., Motwani, R., Munagala, K., Nishizawa, I., Widom, J.: Adaptive ordering of pipelined stream filters. Proceedings of ACM SIGMOD International Conference on Management of Data (2004).
7. Baumann, A., Barham, P., Dagand, P. E., Harris, T., Isaacs, R., Peter, S., Roscoe, T., Schüpbach, A., Singhania, A.: The Multikernel: a new OS architecture for scalable multicore systems. Proceedings of ACM Symposium on Operating Systems Principles (2009).
8. Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S. R., Reiss, F., Shah, M. A.: TelegraphCQ: continuous dataflow processing. Proceedings of ACM SIGMOD International Conference on Management of Data (2003).
9. Chen J., DeWitt D. J., Tian F., Wang Y.: NiagaraCQ: a scalable continuous query system for internet databases. SIGMOD Record 29(2), 379-390 (2000).
10. Cieslewicz, J., Ross Kenneth, A.: Adaptive aggregation on chip multiprocessors. Proceedings of International Conference on Very Large Data Bases (2007).
11. Fernandez, P. M.: Red Brick warehouse: A read-mostly RDBMS for open SMP platforms. Proceedings of ACM SIGMOD International Conference on Management of Data (1994).
12. Goncalves, R., Kersten, M.: The data cyclotron query processing scheme. Proceedings of ACM International Conference on Extending Database Technology (2010).
13. Hanani M. Z.: An optimal evaluation of boolean expressions in an online query system. Commun. ACM 20(5), 344-347 (1977).
14. Harinarayan, V., Rajaraman, A., Ullman, J. D.: Implementing data cubes efficiently. Proceedings of ACM SIGMOD International Conference on Management of Data (1996).
15. Harizopoulos S., Ailamaki A.: StagedDB: Designing database servers for modern hardware. IEEE Data Eng. Bull. 28(2), 11-16 (2005).
16. Harizopoulos, S., Shkapenyuk, V., Ailamaki, A.: Qpipe: a simultaneously pipelined relational query engine. Proceedings of ACM SIGMOD International Conference on Management of Data (2005).
17. Ivanova, M. G., Kersten, M. L., Nes, N. J., Goncalves, R. A.: An architecture for recycling intermediates in a Column-store. Proceedings of ACM SIGMOD International Conference on Management of Data (2009).
18. Liu, Z., Parthasarathy, S., Ranganathan, A., Yang, H.: A generic flow algorithm for shared filter ordering problems. In: Proceedings of Symposium on Principles of Database Systems. New York (2008).
19. Liu, Z., Parthasarathy, S., Ranganathan, A., Yang, H.: Near-optimal algorithms for shared filter evaluation in data stream systems. Proceedings of ACM SIGMOD International Conference on Management of Data (2008).
20. Madden, S., Shah, M., Hellerstein Joseph, M., Raman, V.: Continuously adaptive continuous queries over streams. Proceedings of ACM SIGMOD International Conference on Management of Data (2002).
21. Majumder, A., Rastogi, R., Vanama, S.: Scalable regular expression matching on data streams. Proceedings of International Conference on Data Engineering (2008).
22. Munagala, K., Babu, S., Motwani, R., Widom, J.: The pipelined set cover problem. Proceedings of International Conference on Database Theory (2005).
23. Patrick O'Neil, E. B. O., Chen, X.: The Star Schema Benchmark. (2007). http://www.cs.umb.edu/~poneil/StarSchemaB.PDF.
24. Qiao, L., Raman, V., Reiss, F., Haas, P., Lohman, G.: Main-memory scan sharing for multi-core CPUs. Proceedings of International Conference on Very Large Data Bases (2008).
25. Raman, V., Swart, G., Qiao, L., Reiss, F., Dialani, V., Kossmann, D., Narang, I., Sidle, R.: Constant-time query processing. Proceedings of International Conference on Data Engineering (2008).
26. Roussopoulos, N., Chen, C. M., Kelley, S., Delis, A., Papakonstantinou, Y.: The ADMS project: views R Us. IEEE Data Eng. Bull. 18(2) (1995).
27. Sellis T. K.: Multiple-query optimization. ACM Trans. Database Syst. 13(1), 23-52 (1988).
28. Stonebraker, M., Madden, S., Abadi, D. J., Harizopoulos, S., Hachem, N., Helland, P.: The end of an architectural era (it's time for a complete rewrite). Proceedings of International Conference on Very Large Data Bases (2007).
29. TPC benchmark DS (decision support), draft specification, revision 32. http://www.tpc.org/tpcds/spec/tpcds32.pdf.
30. Unterbrunner P., Giannikis G., Alonso G., Fauser D., Kossmann D.: Predictable performance for unpredictable workloads. Proc. VLDB Endow. 2(1), 706-717 (2009).
31. Zukowski, M., Héman, S., Nes, N., Boncz, P.: Cooperative scans: dynamic bandwidth sharing in a DBMS. In: Proceedings of International Conference on Very Large Data Bases (2007).