Rethinking HBase: Design and implementation of an elastic key-value store over log-structured local volumes

Proceedings - IEEE 14th International Symposium on Parallel and Distributed Computing, ISPDC 2015

Volumn , Issue , 2015, Pages 225-234

  Saloustros, Giorgos ^a   Magoutis, Kostas ^a  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

Author keywords

elasticity; HBase; key value stores; NoSQL

Indexed keywords

DIGITAL STORAGE; FILE ORGANIZATION;

DESIGN AND IMPLEMENTATIONS; DISTRIBUTED FILE SYSTEMS; HBASE; KEY-VALUE STORES; NOSQL; ONLINE TRANSACTION PROCESSING; PERFORMANCE BOTTLENECKS; WRITE-INTENSIVE WORKLOADS;

ELASTICITY;

EID: 84946089265     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISPDC.2015.33     Document Type: Conference Paper

References (25)

1. J. H. Saltzer, D. P. Reed, and D. D. Clark, "End-to-end arguments in system design," ACM Transactions on Computer Systems (TOCS), vol. 2, no. 4, pp. 277-288, 1984.
2. M. Welsh and D. Culler, "Virtualization considered harmful: OS design directions for well-conditioned services," in Proceedings of the 8th Workshop on Hot Topics in Operating Systems, 2001, pp. 139-144.
3. Apache HBase, http://www.hbase.org.
4. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber, "Bigtable: A distributed storage system for structured data," ACM Transactions on Computer Systems (TOCS), vol. 26, no. 2, p. 4, 2008.
5. E. K. Lee and C. A. Thekkath, "Petal: Distributed virtual disks," in ACM SIGPLAN Notices, vol. 31, no. 9, 1996, pp. 84-92.
6. C. A. Thekkath, T. Mann, and E. K. Lee, "Frangipani: A scalable distributed file system," in Proceedings of the 16th ACM Symposium on Operating Systems Principles, 1997, pp. 224-237.
7. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The Hadoop distributed file system," in Proceedings of 26th IEEE Symposium on Mass Storage Systems and Technologies (MSST), 2010, pp. 1-10.
8. T. Harter, D. Borthakur, S. Dong, A. S. Aiyer, L. Tang, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, "Analysis of HDFS under HBase: a Facebook messages case study," in Proceedings of USENIX Conference on File and Storage Technologies, 2014, pp. 199-212.
9. A. S. Aiyer, M. Bautin, G. J. Chen, P. Damania, P. Khemani, K. Muthukkaruppan, K. Ranganathan, N. Spiegelberg, L. Tang, and M. Vaidya, "Storage infrastructure behind Facebook messages: Using HBase at scale," IEEE Data Eng. Bull., vol. 35, no. 2, pp. 4-13, 2012.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google file system," in ACM SIGOPS operating systems review, vol. 37, no. 5, 2003, pp. 29-43.
11. M. A. Olson, K. Bostic, and M. I. Seltzer, "Berkeley DB," in USENIX Annual Technical Conference, FREENIX Track, 1999, pp. 183-191.
12. M. Rosenblum and J. K. Ousterhout, "The design and implementation of a log-structured file system," ACM Transactions on Computer Systems (TOCS), vol. 10, no. 1, pp. 26-52, 1992.
13. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed, "ZooKeeper: Waitfree coordination for internet-scale systems." in USENIX Annual Technical Conference, vol. 8, 2010, p. 9.
14. P. ONeil, E. Cheng, D. Gawlick, and E. ONeil, "The log-structured merge-tree (LSM-tree)," Acta Informatica, vol. 33, no. 4, pp. 351-385, 1996.
15. M. Stonebraker, The design of the Postgres storage system. Morgan Kaufmann Publishers, 1987.
16. D. Ongaro, S. M. Rumble, R. Stutsman, J. Ousterhout, and M. Rosenblum, "Fast crash recovery in RAMCloud," in Proceedings of the 23rd ACM Symposium on Operating Systems Principles, 2011, pp. 29-41.
17. M. Balakrishnan, D. Malkhi, V. Prabhakaran, T. Wobber, M. Wei, and J. D. Davis, "Corfu: A shared log design for flash clusters." in Proceedings of USENIX Conference on Networked Systems Design and Implementation, 2012, pp. 1-14.
18. M. Vrable, S. Savage, and G. M. Voelker, "BlueSky: a cloud-backed file system for the enterprise," in FAST, 2012, p. 19.
19. D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan, "Fawn: A fast array of wimpy nodes," in Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, 2009, pp. 1-14.
20. P. Shetty, R. P. Spillane, R. Malpani, B. Andrews, J. Seyster, and E. Zadok, "Building workload-independent storage with VT-trees." in Proceedings of USENIX Conference on File and Storage Technologies, 2013, pp. 17-30.
21. H. T. Vo, S. Wang, D. Agrawal, G. Chen, and B. C. Ooi, "LogBase: a scalable log-structured database system in the cloud," Proceedings of the VLDB Endowment, vol. 5, no. 10, pp. 1004-1015, 2012.
22. R. Sears and R. Ramakrishnan, "bLSM: a general purpose log structured merge tree," in Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, 2012, pp. 217- 228.
23. O. Rodeh, J. Bacik, and C. Mason, "BTRFS: The Linux B-tree filesystem," ACM Transactions on Storage, vol. 9, no. 3, p. 9, 2013.
24. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with YCSB," in Proceedings of the 1st ACM symposium on Cloud computing, 2010, pp. 143-154.
25. R. Vilaça, F. Cruz, J. Pereira, and R. Oliveira, "An effective scalable SQL engine for NoSQL databases," in Distributed Applications and Interoperable Systems. Springer, 2013, pp. 155-168.