Scuba: Diving into data at facebook

Proceedings of the VLDB Endowment

Volumn 6, Issue 11, 2013, Pages 1057-1067

  Abraham, Lior ^a   Borkar, Vinayak ^a   Merl, Daniel ^a   Subramanian, Subbu ^a   Allen, John ^a   Chopra, Bhuwan ^a   Metzler, Josh ^a   Wiener, Janet L ^a   Barykin, Oleksandr ^a   Gerea, Ciprian ^a   Reiss, David ^a   Zed, Okay ^a  

^a FACEBOOK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); DISTRIBUTED DATABASE SYSTEMS; PROGRAM DEBUGGING; QUERY PROCESSING; RANDOM ACCESS STORAGE; REGRESSION ANALYSIS; SOCIAL NETWORKING (ONLINE);

CLIENT REQUEST; DATA MANAGEMENT SYSTEM; MEMORY DATABASE; NETWORK TRAFFIC; PERFORMANCE DEBUGGING; PERFORMANCE ISSUES; PERFORMANCE MONITORING; REAL TIME ANALYSIS;

INFORMATION MANAGEMENT;

EID: 84891106149     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2536222.2536231     Document Type: Article

References (22)

1. Cloudera Impala: Real-time queries in Apache Hadoop, for real. http://blog.cloudera.com/blog/2012/10/clouderaimpala-real-time-queries-in-apache-hadoop-for-real/.
2. Druid. https://github.com/metamx/druid/wiki.
3. MRTG: Multi-router traffic grapher. http://oss.oetiker.ch/mrtg/.
4. RRDTool. http://oss.oetiker.ch/rrdtool/.
5. Scribe. https://github.com/facebook/scribe.
6. Splunk. http://www.splunk.com.
7. Aditya Agarwal, Mark Slee, and Marc Kwiatkowski. Thrift: Scalable cross-language services implementation. Technical report, Facebook, 2007. http://thrift.apache.org/static/files/thrift-20070401.pdf.
8. Peter A. Boncz, Martin L. Kersten, and Stefan Manegold. Breaking the memory wall in monetdb. Communications of the ACM, 51(12):77-85, 2008.
9. Cliff Engle, Antonio Lupher, Reynold Xin, Matei Zaharia, Michael J. Franklin, Scott Shenker, and Ion Stoica. Shark: fast data analysis using coarse-grained distributed memory. In SIGMOD, pages 689-692, 2012.
10. Alexander Hall, Olaf Bachmann, Robert B̈ussow, Silviu Ǧ anceanu, and Marc Nunkesser. Processing a trillion cells per mouse click. PVLDB, 5(11):1436-1446, July 2012.
11. A. Kemper and T. Neumann. Hyper: A hybrid OLTP-OLAP main memory database system based on virtual memory snapshots. In ICDE, pages 195-206, 2011.
12. Sergey Melnik, Andrey Gubarev, Jing Jing Long, Geoffrey Romer, Shiva Shivakumar, Matt Tolton, and Theo Vassilakis. Dremel: Interactive analysis of web-scale datasets. PVLDB, 3(1):330-339, 2010.
13. Raghotham Murthy and Rajat Goel. Peregrine: Low-latency queries on hive warehouse data. XRDS, 19(1):40-43, September 2012.
14. Joshua Rosen, Neoklis Polyzotis, Vinayak Borkar, Yingyi Bu, Michael J. Carey, Markus Weimer, Tyson Condie, and Raghu Ramakrishnan. Iterative MapReduce for Large Scale Machine Learning. Technical report, 03 2013. http://arxiv.org/abs/1303.3517.
15. Vishal Sikka, Franz F̈arber, Wolfgang Lehner, Sang Kyun Cha, Thomas Peh, and Christof Bornḧovd. Efficient transaction processing in sap hana database: the end of a column store myth. In SIGMOD, pages 731-742, 2012.
16. Richard Snodgrass. The temporal query language TQuel. ACM Transactions on Database Systems, 12(2):247-298, June 1987.
17. Richard Snodgrass. A relational approach to monitoring complex systems. ACM Transactions on Computing Systems, 6(2):157-195, May 1988.
18. Mike Stonebraker, Daniel J. Abadi, Adam Batkin, Xuedong Chen, Mitch Cherniack, Miguel Ferreira, Edmond Lau, Amerson Lin, Sam Madden, Elizabeth O'Neil, Pat O'Neil, Alex Rasin, Nga Tran, and Stan Zdonik. C-Store: A Column-Oriented DBMS. In VLDB, pages 553-564, 2005.
19. Jason Taylor. Disaggregation and next-generation systems design, 2013. http://www.opencompute.org/ocp-summit-ivagenda/# keynote.
20. Ashish Thusoo, Joydeep Sen Sarma, Namit Jain, Zheng Shao, Prasad Chakka, Suresh Anthony, Hao Liu, Pete Wyckoff, and Raghotham Murthy. Hive: a warehousing solution over a map-reduce framework. PVLDB
21. Till Westmann, Donald Kossmann, Sven Helmer, and Guido Moerkotte. The implementation and performance of compressed databases. SIGMOD Record, 29(3):55-67, September 2000.
22. Reynold Xin, Josh Rosen, Matei Zaharia, Michael J. Franklin, Scott Shenker, and Ion Stoica. Shark: Sql and rich analytics at scale. Technical report, UC Berkeley, 2012. http://shark.cs.berkeley.edu/presentations/2012-11-26-sharktech-report.pdf.