bLSM: A general purpose log structured merge tree

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 217-228

  Sears, Russell ^a   Ramakrishnan, Raghu ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

log structured merge tree; merge scheduling; read amplification; read fanout; write amplification

Indexed keywords

B TREES; BLOOM FILTERS; FAN-OUT; GENERAL PURPOSE; LOG STRUCTURED; LOOKUPS; PERFORMANCE METRICES; READ PERFORMANCE;

AMPLIFICATION; ASYMPTOTIC ANALYSIS; INFORMATION MANAGEMENT; SCHEDULING; THROUGHPUT;

FORESTRY;

FORESTRY; INFORMATION RETRIEVAL; MANAGEMENT; SCHEDULING; THROUGHPUT;

EID: 84862669866     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213862     Document Type: Conference Paper

References (35)

1. http://hbase.apache.org/.
2. https://launchpad.net/pbxt.
3. http://wiki.basho.com/.
4. M. Bender, M. Farach-Colton, R. Johnson, B. Kuszmaul, D. Medjedovic, P. Montes, P. Shetty, R. Spillane, and E. Zadok. Don't thrash: How to cache your hash on flash. In HotStorage, 2011.
5. M. A. Bender, M. Farach-Colton, J. T. Fineman, Y. R. Fogel, B. C. Kuszmaul, and J. Nelson. Cache-oblivious streaming B-trees. In SPAA, 2007.
6. D. Borthakur, J. Gray, J. Sarma, K. Muthukkaruppan, N. Spiegelberg, H. Kuang, K. Ranganathan, D. Molkov, A. Menon, S. Rash, et al. Apache Hadoop goes realtime at FaceBook. In Sigmod, 2011.
7. M. Callaghan. Read amplification factor. High Availability MySQL, August 2011.
8. F. Chang et al. Bigtable: A distributed storage system for structured data. In OSDI, 2006.
9. J. Chen, C. Douglas, M. Mutsuzaki, P. Quaid, R. Ramakrishnan, S. Rao, and R. Sears. Walnut: A unified cloud object store. In Sigmod, 2012.
10. B. F. Cooper et al. PNUTS: Yahoo!'s hosted data serving platform. Proc. VLDB Endow., 1(2), 2008.
11. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. SoCC '10, 2010.
12. J. Dean and S. Ghemawat. LevelDB. Google, http://leveldb.googlecode.com.
13. J. Ellis. The present and future of Apache Cassandra. In HPTS, 2011.
14. S. Ghemawat, H. Gobioff, and S. T. Leung. The Google file system. In SOSP, 2003.
15. J. Gray and G. Graefe. The five-minute rule ten years later, and other computer storage rules of thumb. SIGMOD Record, 26(4), 1997.
16. C. Jermaine, E. Omiecinski, and W. G. Yee. The partitioned exponential file for database storage management. The VLDB Journal, 16(4), 2007.
17. Kirsch and Mitzenmacher. Less hashing, same performance: Building a better bloom filter. In ESA, 2006.
18. B. C. Kuszmaul. How TokuDB fractal trees indexes work. Technical report, TokuTek, 2010.
19. A. Lakshman and P. Malik. Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev., 44(2), April 2010.
20. Y. Li, B. He, J. Y. 0001, Q. Luo, and K. Yi. Tree indexing on solid state drives. PVLDB, 3(1):1195-1206, 2010.
21. H. Lim, B. Fan, D. Andersen, and M. Kaminsky. Silt: a memory-efficient, high-performance key-value store. In SOSP, 2011.
22. M. Moshayedi and P. Wilkison. Enterprise SSDs. ACM Queue, 6, July 2008.
23. P. Muth, P. O'Neil, A. Pick, and G. Weikum. The LHAM Log-structured history data access method. In VLDB Journal, 2000.
24. S. Nath and A. Kansal. FlashDB: Dynamic self-tuning database for NAND flash. In IPSN, 2007.
25. P. O'Neil, E. Cheng, D. Gawlick, and E. O'Neil. The log-structured merge-tree (LSM-tree). Acta Informatica, 33(4):351-385, 1996.
26. Oracle. Berkeley DB Java Edition.
27. C. Rev, D. Hitz, J. Lau, and M. Malcolm. File system design for an NFS file server appliance, 1995.
28. M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. In SOSP, 1992.
29. R. Sears and E. Brewer. Stasis: Flexible transactional storage. In OSDI, 2006.
30. R. Sears and E. Brewer. Segment-based recovery: Write-ahead logging revisited. In VLDB, 2009.
31. R. Sears, M. Callaghan, and E. Brewer. Rose: Compressed, log-structured replication. VLDB, 2008.
32. M. Seltzer, K. A. Smith, H. Balakrishnan, J. Chang, S. McMains, and V. Padmanabhan. File system logging versus clustering: A performance comparison. In Usenix Annual Technical Conference, 1995.
33. J. Sheehy and D. Smith. Bitcask, a log-structured hash table for fast key/value data. Technical report, Basho, 2010.
34. R. Spillane, P. Shetty, E. Zadok, S. Archak, and S. Dixit. An efficient multi-tier tablet server storage architecture. In SoCC, 2011.
35. D. Zeinalipour-Yazti, S. Lin, V. Kalogeraki, D. Gunopulos, and W. Najjar. MicroHash: An efficient index structure for fash-based sensor devices. In FAST, 2005.