Mesa: Georeplicated, near realtime, scalable data warehousing

Proceedings of the VLDB Endowment

Volumn 7, Issue 12, 2014, Pages 1259-1270

  Gupta, Ashish ^a   Yang, Fan ^a   Govig, Jason ^a   Kirsch, Adam ^a   Chan, Kelvin ^a   Lai, Kevin ^a   Wu, Shuo ^a   Dhoot, Sandeep Govind ^a   Kumar, Abhilash Rajesh ^a   Agiwal, Ankur ^a   Bhansali, Sanjay ^a   Hong, Mingsheng ^a   Cameron, Jamie ^a   Siddiqi, Masood ^a   Jones, David ^a   Shute, Jeff ^a   Gubarev, Andrey ^a   Venkataraman, Shivakumar ^a   Agrawal, Divyakant ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA WAREHOUSES; FAULT TOLERANCE; REAL TIME SYSTEMS; WAREHOUSES;

CRITICAL MEASUREMENTS; DATA CENTERS; DATA WAREHOUSING SYSTEMS; HIGH AVAILABILITY; INTERNET ADVERTISING; LOW LATENCY; NEAR REAL-TIME DATUM; SYSTEMS REQUIREMENTS;

SEARCH ENGINES;

EID: 84905096068     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2732977.2732999     Document Type: Conference Paper

References (53)

1. HBase. http://hbase.apache.org/.
2. LevelDB. http://en.wikipedia.org/wiki/LevelDB.
3. MySQL. http:www.mysql.com.
4. Project Voldemart: A Distributed Database. http://www.project-voldemort.com/voldemort/.
5. SAP HANA. http://www.saphana.com/welcome.
6. A. Abouzeid, K. Bajda-Pawlikowski, et al. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. PVLDB, 2(1):922-933, 2009.
7. D. Agrawal, A. El Abbadi, et al. Efficient View Maintenance at Data Warehouses. In SIGMOD, pages 417-427, 1997.
8. P. Agrawal, A. Silberstein, et al. Asynchronous View Maintenance for VLSD Databases. In SIGMOD, pages 179-192, 2009.
9. M. O. Akinde, M. H. Bohlen, et al. Efficient OLAP Query Processing in Distributed Data Warehouses. Information Systems, 28(1-2):111-135, 2003.
10. M. Athanassoulis, S. Chen, et al. MaSM: Efficient Online Updates in Data Warehouses. In SIGMOD, pages 865-876, 2011.
11. J. Baker, C. Bond, et al. Megastore: Providing Scalable, Highly Available Storage for Interactive Services. In CIDR, pages 223-234, 2011.
12. F. Chang, J. Dean, et al. Bigtable: A Distributed Storage System for Structured Data. In OSDI, pages 205-218, 2006.
13. B. Chattopadhyay, L. Lin, et al. Tenzing A SQL Implementation on the MapReduce Framework. PVLDB, 4(12):1318-1327, 2011.
14. S. Chaudhuri and U. Dayal. An Overview of Data Warehousing and OLAP Technology. SIGMOD Rec., 26(1):65-74, 1997.
15. S. Chen, B. Liu, et al. Multiversion-Based View Maintenance Over Distributed Data Sources. ACM TODS, 29(4):675-709, 2004.
16. J. Cohen, J. Eshleman, et al. Online Expansion of Largescale Data Warehouses. PVLDB, 4(12):1249-1259, 2011.
17. B. F. Cooper, R. Ramakrishnan, et al. PNUTS: Yahoo!'s Hosted Data Serving Platform. PVLDB, 1(2):1277-1288, 2008.
18. J. C. Corbett, J. Dean, et al. Spanner: Google's Globally-Distributed Database. In OSDI, pages 251-264, 2012.
19. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM, 51(1):107-113, 2008.
20. G. DeCandia, D. Hastorun, et al. Dynamo: Amazon's Highly Available Key-value Store. In SOSP, pages 205-220, 2007.
21. P. Deshpande, K. Ramasamy, et al. Caching Multidimensional Queries Using Chunks. In SIGMOD, pages 259-270, 1998.
22. A. Fikes. Storage Architecture and Challenges. http://goo.gl/pF6kmz, 2010.
23. S. Ghemawat, H. Gobioff, et al. The Google File System. In SOSP, pages 29-43, 2003.
24. L. Glendenning, I. Beschastnikh, et al. Scalable Consistency in Scatter. In SOSP, pages 15-28, 2011.
25. J. Gray, A. Bosworth, et al. Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tabs and Sub-Totals. In IEEE ICDE, pages 152-159, 1996.
26. H. Gupta and I. S. Mumick. Selection of Views to Materialize Under a Maintenance Cost Constraint. In ICDT, 1999.
27. V. Harinarayan, A. Rajaraman, et al. Implementing Data Cubes Efficiently. In SIGMOD, pages 205-216, 1996.
28. S. Héman, M. Zukowski, et al. Positional Update Handling in Column Stores. In SIGMOD, pages 543-554, 2010.
29. H. V. Jagadish, L. V. S. Lakshmanan, and D. Srivastava. Snakes and Sandwiches: Optimal Clustering Strategies for a Data Warehouse. In SIGMOD, pages 37-48, 1999.
30. H. V. Jagadish, I. S. Mumick, et al. View Maintenance Issues for the Chronicle Data Model. In PODS, pages 113-124, 1995.
31. A. Koeller and E. A. Rundensteiner. Incremental Maintenance of Schema-Restructuring Views in SchemaSQL. IEEE TKDE, 16(9):1096-1111, 2004.
32. L. V. S. Lakshmanan, J. Pei, et al. Quotient cube: How to Summarize the Semantics of a Data Cube. In VLDB, pages 778-789, 2002.
33. L. V. S. Lakshmanan, J. Pei, et al. QC-Trees: An Efficient Summary Structure for Semantic OLAP. In SIGMOD, pages 64-75, 2003.
34. A. Lamb, M. Fuller, et al. The Vertica Analytic Database: C-Store 7 Years Later. PVLDB, 5(12):1790-1801, 2012.
35. L. Lamport. The Part-Time Parliament. ACM Trans. Comput. Syst., 16(2):133-169, 1998.
36. G. Lee, J. Lin, et al. The Unified Logging Infrastructure for Data Analytics at Twitter. PVLDB, 5(12):1771-1780, 2012.
37. S. Melnik, A. Gubarev, et al. Dremel: Interactive Analysis of Web-Scale Datasets. PVLDB, 3(1-2):330-339, 2010.
38. N. Roussopoulos, Y. Kotidis, et al. Cubetree: Organization of and Bulk Incremental Updates on the Data Cube. In SIGMOD, pages 89-99, 1997.
39. K. Salem, K. Beyer, et al. How To Roll a Join: Asynchronous Incremental View Maintenance. In SIGMOD, pages 129-140, 2000.
40. D. Severance and G. Lohman. Differential Files: Their Application to the Maintenance of Large Databases. ACM Trans. Database Syst., 1(3):256-267, 1976.
41. J. Shute, R. Vingralek, et al. F1: A Distributed SQL Database That Scales. PVLDB, 6(11):1068-1079, 2013.
42. Y. Sismanis, A. Deligiannakis, et al. Dwarf: Shrinking the PetaCube. In SIGMOD, pages 464-475, 2002.
43. D. Srivastava, S. Dar, et al. Answering Queries with Aggregation Using Views. In VLDB, pages 318-329, 1996.
44. M. Stonebraker, D. J. Abadi, et al. C-Store: A Column-oriented DBMS. In VLDB, pages 553-564, 2005.
45. A. Thusoo, J. Sarma, et al. Hive: A Warehousing Solution Over a Map-Reduce Framework. PVLDB, 2(2):1626-1629, 2009.
46. A. Thusoo, J. Sarma, et al. Hive - A Petabyte Scale Data Warehouse Using Hadoop. In IEEE ICDE, pages 996-1005, 2010.
47. A. Thusoo, Z. Shao, et al. Data Warehousing and Analytics Infrastructure at Facebook. In SIGMOD, pages 1013-1020, 2010.
48. R. Weiss. A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server. Oracle White Paper. Oracle Corporation, Redwood Shores, 2012.
49. P. Wong, Z. He, et al. Parallel Analytics as a Service. In SIGMOD, pages 25-36, 2013.
50. L. Wu, R. Sumbaly, et al. Avatara: OLAP for Web-Scale Analytics Products. PVLDB, 5(12):1874-1877, 2012.
51. R. S. Xin, J. Rosen, et al. Shark: SQL and Rich Analytics at Scale. In SIGMOD, pages 13-24, 2013.
52. J. Yang, K. Karlapalem, et al. Algorithms for Materialized View Design in Data Warehousing Environment. In VLDB, pages 136-145, 1997.
53. Y. Zhuge, H. Garcia-Molina, et al. The Strobe Algorithms for Multi-Source Warehouse Consistency. In PDIS, pages 146-157, 1996.