On brewing fresh espresso: LinkedIn's distributed data serving platform

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2013, Pages 1135-1146

  Qiao, Lin ^a   Surlaker, Kapil ^a   Das, Shirshanka ^a   Quiggle, Tom ^a   Schulman, Bob ^a   Ghosh, Bhaskar ^a   Curtis, Antony ^a   Seeliger, Oliver ^a   Zhang, Zhen ^a   Auradkar, Aditya ^a   Beavers, Chris ^a   Brandt, Gregory ^a   Gandhi, Mihir ^a   Gopalakrishna, Kishore ^a   Ip, Wai ^a   Jagadish, Swaroop ^a   Lu, Shi ^a   Pachev, Alexander ^a   Ramesh, Aditya ^a   Sebastian, Abraham ^a   Shanbhag, Rupa ^a   Subramaniam, Subbu ^a   Sun, Yun ^a   Topiwala, Sajid ^a   Tran, Cuong ^a   Westerman, Jemiah ^a   Zhang, David ^a   more..

^a LINKEDIN CORPORATION   (United States)

Author keywords

Change Data Capture; Cluster Management; Large Databases; MySQL; Secondary Indexing; Transactions

Indexed keywords

CLUSTER MANAGEMENT; CONSISTENCY MODEL; DESIGN PRINCIPLES; DISTRIBUTED CLUSTERS; HIERARCHICAL DOCUMENT; LARGE DATABASE; MYSQL; TRANSACTIONS;

SOCIAL NETWORKING (ONLINE);

INDEXING (OF INFORMATION);

EID: 84880545584     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463676.2465298     Document Type: Conference Paper

References (18)

1. Apache HBase. http://hbase.apache.org/.
2. Couchbase. http://www.couchbase.com/.
3. Facebook inc. http://www.facebook.com.
4. Google inc. http://www.google.com.
5. MongoDB. http://www.mongodb.org/.
6. Project Voldemort. http://project-voldemort.com/.
7. Twitter. http://www.twitter.com.
8. A. Auradkar, C. Botev, S. Das, D. De Maagd, A. Feinberg, P. Ganti, L. Gao, B. Ghosh, K. Gopalakrishna, B. Harris, et al. Data infrastructure at linkedin. In 2012 IEEE 28th International Conference on Data Engineering, pages 1370-1381. IEEE, 2012.
9. J. Baker, C. Bond, J. C. Corbett, J. Furman, A. Khorlin, J. Larson, J.-M. Leon, Y. Li, A. Lloyd, and V. Yushprakh. Megastore: Providing scalable, highly available storage for interactive services. In Proceedings of the Conference on Innovative Data system Research (CIDR), pages 223-234, 2011.
10. E. Brewer. Towards robust distributed systems. In Proceedings of the 19th Anniversary of the ACM Symposium on Principles of Distributed Computing (PODC 00), pages 7-10, 2000.
11. F. Chang et al. Bigtable: A distributed storage system for structured data. In OSDI, 2006.
12. B. F. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. Pnuts: Yahoo!'s hosted data serving platform. Proc. VLDB Endow., 1(2):1277-1288, Aug. 2008.
13. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's globally-distributed database. In Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation, OSDI'12, pages 251-264, Berkeley, CA, USA, 2012. USENIX Association.
14. S. Das, C. Botev, K. Surlaker, et al All aboard the Databus! LinkedIn's scalable consistent change data capture platform. In Proceedings of the 3rd A CM Symposium on Cloud Computing (SoCC 2012). ACM, 2012.
15. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: amazon's highly available key-value store. In Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, SOSP '07, pages 205-220, New York, NY, USA, 2007. ACM.
16. K. Gopalakrishna, S. Lu, Z. Zhang, K. Surlaker, et al Untangling cluster management with Helix. In Proceedings of the 3rd ACM Symposium on Cloud Computing (SoCC 2012). ACM, 2012.
17. A. Lakshman, P. Malik, and K. Ranganathan. Cassandra: A structured storage system on a P2P network. In SIGMOD, 2008.
18. J. Shute, M. Oancea, S. Ellner, B. Handy, E. Rollins, B. Samwel, R. Vingralek, C. Whipkey, X. Chen, B. Jegerlehner, K. Littleïňa̧ eld, and P. Tong. F1 - the fault-tolerant distributed rdbms supporting google's ad business. In SIGMOD, 2012. Talk given at SIGMOD 2012.