An efficient design and implementation of LSM-tree based key-value store on open-channel SSD

Proceedings of the 9th European Conference on Computer Systems, EuroSys 2014

Volumn , Issue , 2014, Pages

  Wang, Peng ^a   Sun, Guangyu ^a   Jiang, Song ^a   Ouyang, Jian ^b   Lin, Shiding ^b   Zhang, Chen ^a   Cong, Jason ^a,c  

^a PEKING UNIVERSITY   (China)

^b BAIDU INC   (China)

^c PKU UCLA Joint Research Institute in Science and Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION MANAGEMENT; MEMORY ARCHITECTURE; RELATIONAL DATABASE SYSTEMS;

EFFICIENT DESIGNS; HIGHER EFFICIENCY; INTERNET SERVICES; KEY-VALUE STORES; LOG STRUCTURED MERGE TREES; MULTIPLE CHANNELS; READ PERFORMANCE; SOLID STATE DISKS;

FLASH-BASED SSDS;

EID: 84900453434     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2592798.2592804     Document Type: Conference Paper

References (38)

1. Apache CouchDB. http://couchdb.apache.org/.
2. HyperLevelDB. http://hyperdex.org/performance/leveldb/.
3. NVM Express explained. http://nvmexpress.org/wp-content/uploads/2013/04/ NVM-whitepaper.pdf.
4. Redis. http://redis.io/.
5. Riak. http://basho.com/leveldb-in-riak-1-2/.
6. Tair. http://code.taobao.org/p/tair/src/.
7. TokuDB: MySQL performance, MariaDB performance. http://www.tokutek.com/ products/tokudb-for-mysql/.
8. Tokyo Cabinet: A modern implementation of DBM. http://fallabs.com/ tokyocabinet/.
9. Apache HBase. http://hbase.apache.org/.
10. LevelDB - A fast and lightweight key/value database library by Google. http://code.google.com/p/leveldb/.
11. A. Awasthi, A. Nandini, A. Bhattacharya, and P. Sehgal. Hybrid HBase: Leveraging flash SSDs to improve cost per throughput of HBase. In Proceedings of the 18th International Conference on Management of Data (COMAD), pages 68-79, 2012.
12. M. A. Bender, M. Farach-Colton, J. T. Fineman, Y. R. Fogel, B. C. Kuszmaul, and J. Nelson. Cache-oblivious streaming Btrees. In Proceedings of the 19th ACM Symposium on Parallel Algorithms and Architectures, SPAA '07, pages 81-92, 2007.
13. M. Bjorling, J. Axboe, D. Nellans, and P. Bonnet. Linux block IO: Introducing multi-queue SSD access on multi-core systems. In Proceedings of the 6th International Systems and Storage Conference, SYSTOR '13, pages 22:1-22:10, 2013.
14. B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Commun. ACM, 13(7):422-426, July 1970.
15. R. Cattell. Scalable SQL and NoSQL data stores. SIGMOD Rec., 39(4):12-27, May 2011.
16. A. M. Caulfield, A. De, J. Coburn, T. I. Mollow, R. K. Gupta, and S. Swanson. Moneta: A high-performance storage array architecture for next-generation, non-volatile memories. In Proceedings of the 43rd Annual IEEE/ACM International Symposium on Microarchitecture, MICRO '43, pages 385- 395, 2010.
17. A. M. Caulfield, T. I. Mollov, L. A. Eisner, A. De, J. Coburn, and S. Swanson. Providing safe, user space access to fast, solid state disks. In Proceedings of the 17th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS XVII, pages 387- 400, 2012.
18. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst., 26(2):4:1-4:26, June 2008.
19. F. Chen, R. Lee, and X. Zhang. Essential roles of exploiting internal parallelism of flash memory based solid state drives in high-speed data processing. In High Performance Computer Architecture (HPCA), 2011 IEEE 17th International Symposium on, pages 266-277, 2011.
20. B. Debnath, S. Sengupta, and J. Li. FlashStore: High throughput persistent key-value store. Proc. VLDB Endow., 3(1-2): 1414-1425, Sept. 2010.
21. B. Debnath, S. Sengupta, and J. Li. SkimpyStash: RAM space skimpy key-value store on flash-based storage. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, SIGMOD '11, pages 25-36, 2011.
22. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available keyvalue store. In Proceedings of the 21st ACM Symposium on Operating Systems Principles, SOSP '07, pages 205-220, 2007.
23. R. Escriva, B. Wong, and E. G. Sirer. HyperDex: A distributed, searchable key-value store. SIGCOMM Comput. Commun. Rev., 42(4):25-36, Aug. 2012.
24. J. Esmet, M. A. Bender, M. Farach-Colton, and B. C. Kuszmaul. The TokuFS streaming file system. In Proceedings of the 4th USENIX Workshop on Hot Topics in Storage and File Systems, HotStorage '12, pages 14:1-14:5, 2012.
25. S. Hahn, S. Lee, and J. Kim. SOS: Software-based outof- order scheduling for high-performance NAND flash-based SSDs. In Mass Storage Systems and Technologies (MSST), 2013 IEEE 29th Symposium on, pages 13:1-13:5, 2013.
26. Y. Hu, H. Jiang, D. Feng, L. Tian, H. Luo, and C. Ren. Exploring and exploiting the multilevel parallelism inside SSDs for improved performance and endurance. Computers, IEEE Transactions on, 62(6):1141-1155, 2013.
27. W. K. Josephson, L. A. Bongo, D. Flynn, and K. Li. DFS: A file system for virtualized flash storage. In Proceedings of the 8th USENIX Conference on File and Storage Technologies, FAST '10, pages 85-100, 2010.
28. A. Lakshman and P. Malik. Cassandra: A decentralized structured storage system. SIGOPS Oper. Syst. Rev., 44(2):35-40, Apr. 2010.
29. N. Leavitt. Will NoSQL databases live up to their promise? Computer, 43(2):12-14, 2010.
30. H. Lim, B. Fan, D. G. Andersen, and M. Kaminsky. SILT: A memory-efficient, high-performance key-value store. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles, SOSP '11, pages 1-13, 2011.
31. C. Min, K. Kim, H. Cho, S.-W. Lee, and Y. I. Eom. SFS: Random write considered harmful in solid state drives. In Proceedings of the 10th USENIX Conference on File and Storage Technologies, FAST '12, pages 139-154, 2012.
32. P. O'Neil, E. Cheng, D. Gawlick, and E. O'Neil. The logstructured merge-tree (LSM-tree). Acta Inf., 33(4):351-385, June 1996.
33. J. Ouyang, S. Lin, S. Jiang, Z. Hou, Y. Wang, and Y. Wang. SDF: Software-defined flash for web-scale internet storage systems. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS '14, pages 471-484, 2014.
34. K. Ren and G. Gibson. TABLEFS: Enhancing metadata efficiency in the local file system. In Proceedings of the 2013 USENIX Annual Technical Conference, USENIX ATC '13, pages 145-156, 2013.
35. M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst., 10(1):26-52, Feb. 1992.
36. P. Shetty, R. Spillane, R. Malpani, B. Andrews, J. Seyster, and E. Zadok. Building workload-independent storage with VT-trees. In Proccedings of the 11th Conference on File and Storage Technologies, FAST '13, pages 17-30, 2013.
37. M. Stonebraker. SQL databases v. NoSQL databases. Commun. ACM, 53(4):10-11, Apr. 2010.
38. H. Wang, P. Huang, S. He, K. Zhou, C. Li, and X. He. A novel I/O scheduler for SSD with improved performance and lifetime. In Mass Storage Systems and Technologies (MSST), 2013 IEEE 29th Symposium on, pages 6:1-6:5, 2013.