Dremel: Interactive analysis of web-scale datasets

Communications of the ACM

Volumn 54, Issue 6, 2011, Pages 114-123

  Melnik, Sergey ^a   Gubarev, Andrey ^a   Long, Jing Jing ^a   Romer, Geoffrey ^a   Shivakumar, Shiva ^a   Tolton, Matt ^a   Vassilakis, Theo ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AD-HOC QUERIES; AGGREGATION QUERIES; DATA LAYOUTS; DATA SETS; INTERACTIVE ANALYSIS; NESTED DATA; PETABYTES;

PROGRAM PROCESSORS; TREES (MATHEMATICS); USER INTERFACES;

SEARCH ENGINES;

EID: 79959994168     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/1953122.1953148     Document Type: Article

References (24)

1. Abadi, D.J., Boncz, P.A., Harizopoulos, S. Column-oriented database systems. VLDB 2, 2 (2009).
2. Abiteboul, S., Hull, R., and Vianu, V. Foundations of Databases. Addison Wesley, Reading, PA, 1995.
3. Abouzeid, A., Bajda-Pawlikowski, K., Abadi, D.J., Rasin, A., Silberschatz, A. HadoopDB: An architectural hybrid of MapReduce and DBMS technologies for analytical workloads. VLDB 2, 1 (2009).
4. Bar-Yossef, Z., Jayram, T.S., Kumar, R., Sivakumar, D., Trevisan, L. Counting distinct elements in a data stream. In RANDOM, 2002, 1-10.
5. Barroso, L.A., Holzle, U. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan & Claypool Publishers, 2009.
6. BigQuery. http://code.google.com/ apis/bigquery.
7. Chaiken, R., Jenkins, B., Larson, P.-A., Ramsey, B., Shakib, D., Weaver, S., Zhou, J. SCOPE: Easy and efficient parallel processing of massive data sets. VLDB 1, 2 (2008).
8. Chambers, C., Raniwala, A., Perry, F., Adams, S., Henry, R., Bradshaw, R., Weizenbaum, N. FlumeJava: Easy, efficient data-parallel pipelines. In PLDI, 2010.
9. Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R. Bigtable: A distributed storage system for structured data. In OSDI, 2006.
10. Colby, L.S. A recursive algebra and query optimization for nested relations. In SIGMOD, 1989.
11. Dean. J., Challenges in building large-scale information retrieval systems: Invited talk. In WSDM,2009.
12. Dean, J., Ghemawat, S. MapReduce: Simplified data processing on large clusters. In OSDI, 2004.
13. Dean, J., Ghemawat, S. MapReduce: A Flexible data processing tool. Commun. ACM 53, 1 (2010).
14. Ghemawat, S., Gobioff, H., Leung, S.-T. The Google File System. In SOSP, 2003.
15. Hadoop Apache Project. http://hadoop. apache.org.
16. Hive. http://wiki.apache.org/hadoop/Hive, 2009.
17. Liefke, H., Suciu, D. XMill: An efficient compressor for XML data. In SIGMOD, 2000.
18. Melnik, S., Gubarev, A., Long, J.J., Romer, G., Shivakumar, S., Tolton, M., Vassilakis, T. Dremel: Interactive analysis of web-scale datasets. PVLDB 3, 1 (2010).
19. Olston, C., Reed, B., Srivastava, U., Kumar, R., Tomkins, A. Pig Latin: A not-so-foreign language for data processing. In SIGMOD, 2008.
20. O'Neil, P.E., O'Neil, E.J., Pal, S., Cseri, I., Schaller, G., Westbury, N. ORDPATH s: Insert-friendly XML node labels. In SIGMOD, 2004.
21. Pike, R., Dorward, S., Griesemer, R., Quinlan, S. Interpreting the data: Parallel analysis with Sawzall. Sci. Program. 13, 4 (2005).
22. Protocol Buffers: Developer Guide. Available at http://code.google.com/ apis/protocolbuffers/docs/overview. html.
23. Stonebraker, M., Abadi, D., DeWitt, D.J., Madden, S., Paulson, E., Pavlo, A., Rasin, A., MapReduce and parallel DBMSs: Friends or foes? Commun. ACM 53, 1 (2010).
24. Yu, Y., Isard, M., Fetterly, D., Budiu, M., Erlingsson, U., Gunda, P.K., Currey, J. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In OSDI, 2008.