BetRFS: A right-optimized write-optimized file system

Proceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015

Volumn , Issue , 2015, Pages 301-315

  Jannen, William ^a   Yuan, Jun ^a   Zhan, Yang ^a   Akshintala, Amogh ^a   Esmet, John ^b   Jiao, Yizheng ^a   Mittal, Ankur ^a   Pandey, Prashant ^a   Reddy, Phaneendra ^a   Walsh, Leif ^b   Bender, Michael ^a   Farach Colton, Martin ^c   Johnson, Rob ^a   Kuszmaul, Bradley C ^d   Porter, Donald E ^a  

^a STONY BROOK UNIVERSITY   (United States)

^b Tokutek Inc

^c Rutgers University   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DIGITAL STORAGE; LINUX;

ADDITIONAL DATUM; BUILDING BLOCKES; FILE SYSTEMS; IMPLEMENTATION TECHNIQUES; LINUX KERNEL; SMALL FILES; STORAGE SYSTEMS; STRUCTURE TUNING;

FILE ORGANIZATION;

EID: 84954356422     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. ANDERSEN, D. G., FRANKLIN, J., KAMINSKY, M., PHANISHAYEE, A., TAN, L., AND VASUDEVAN, V. Fawn: A fast array of wimpy nodes. In Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles (2009), pp. 1–14.
2. APACHE. Accumulo. http://accumulo.apache.org.
3. APACHE. HBase. http://hbase.apache.org.
4. BENDER, M. A., FARACH-COLTON, M., FINEMAN, J. T., FOGEL, Y. R., KUSZMAUL, B. C., AND NELSON, J. Cache-oblivious streaming B-trees. In Proceedings of the 19th Annual ACM Symposium on Parallel Algorithms and Architectures (SPAA) (2007), pp. 81–92.
5. BENT, J., GIBSON, G. A., GRIDER, G., MCCLELLAND, B., NOWOCZYNSKI, P., NUNEZ, J., POLTE, M., AND WINGATE, M. PLFS: A checkpoint filesystem for parallel applications. In Proceedings of the ACM/IEEE Conference on High Performance Computing (SC) (2009).
6. BLOOM, B. H. Space/time trade-offs in hash coding with allowable errors. Commun. ACM 13, 7 (1970), 422–426.
7. BONWICK, J. ZFS: the last word in file systems. https://blogs.oracle.com/video/entry/ zfs_the_last_word_in, Sept. 14 2004.
8. BRODAL, G. S., DEMAINE, E. D., FINEMAN, J. T., IACONO, J., LANGERMAN, S., AND MUNRO, J. I. Cache-oblivious dynamic dictionaries with update/query tradeoffs. In Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms (SODA) (2010), pp. 1448–1456.
9. BRODAL, G. S., AND FAGERBERG, R. Lower bounds for external memory dictionaries. In Proceedings of the 14th Annual ACM-SIAM symposium on Discrete Algorithms (ACM) (2003), pp. 546–554.
10. BUCHSBAUM, A. L., GOLDWASSER, M., VENKATASUBRAMANIAN, S., AND WESTBROOK, J. R. On external memory graph traversal. In Proceedings of the 11th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA) (2000), pp. 859–860.
11. CARD, R., TSO, T., AND TWEEDIE, S. Design and implementation of the Second Extended Filesystem. In Proceedings of the First Dutch International Symposium on Linux (1994), pp. 1–6.
12. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W. C., WALLACH, D. A., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. E. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems (TOCS) 26, 2 (2008), 4.
13. CHAZELLE, B., AND GUIBAS, L. J. Fractional cascading: I. A data structuring technique. Algorithmica 1, 1-4 (1986), 133–162.
14. DOUTHITT, D. Instant 10-20% boost in disk performance: the “noatime” option. http://administratosphere.wordpress.com/2011/07/29/instant-10-20-boost-in-disk-performance-the-noatime-option/, July 2011.
15. ESMET, J., BENDER, M. A., FARACH-COLTON, M., AND KUSZMAUL, B. C. The TokuFS streaming file system. In Proceedings of the 4th USENIX Workshop on Hot Topics in Storage (HotStorage) (June 2012).
16. File system in userspace. http://fuse.sourceforge.net/.
17. GOOGLE, INC. LevelDB: A fast and lightweight key/value database library by Google. http://code.google.com/p/leveldb/.
18. GRAY, J., AND REUTER, A. Transaction Processing: Concepts and Techniques. Morgan Kaufmann, 1993.
19. HITZ, D., LAU, J., AND MALCOLM, M. File system design for an NFS file server appliance. Tech. rep., NetApp, 1994.
20. LAKSHMAN, A., AND MALIK, P. Cassandra: a decentralized structured storage system. ACM SIGOPS Operating Systems Review 44, 2 (2010), 35–40.
21. LEE, C., SIM, D., HWANG, J., AND CHO, S. F2FS: A new file system for flash storage. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST) (2015).
22. LIM, H., FAN, B., ANDERSEN, D. G., AND KAMINSKY, M. Silt: A memory-efficient, high-performance key-value store. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles (2011), pp. 1–13.
23. O’NEIL, P., CHENG, E., GAWLIC, D., AND O’NEIL, E. The log-structured merge-tree (LSM-tree). Acta Informatica 33, 4 (1996), 351–385.
24. QUICKLZ. Fast compression library for c, c#, and java. http://www.quicklz.com/.
25. REN, K., AND GIBSON, G. A. TABLEFS: Enhancing metadata efficiency in the local file system. In USENIX Annual Technical Conference (2013), pp. 145–156.
26. ROSENBLUM, M., AND OUSTERHOUT, J. K. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (Feb. 1992), 26–52.
27. SEARS, R., CALLAGHAN, M., AND BREWER, E. A. Rose: compressed, log-structured replication. Proceedings of the VLDB Endowment 1, 1 (2008), 526–537.
28. SEARS, R., AND RAMAKRISHNAN, R. bLSM: a general purpose log structured merge tree. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data (2012), ACM, pp. 217–228.
29. SELTZER, M., BOSTIC, K., MCKUSICK, M. K., AND STAELIN, C. An implementation of a log-structured file system for UNIX. In Proceedings of the USENIX Winter 1993 Conference Proceedings (San Diego, CA, Jan. 1993), p. 3.
30. SELTZER, M., SMITH, K. A., BALAKRISHNAN, H., CHANG, J., MCMAINS, S., AND PADMANABHAN, V. File system logging versus clustering: A performance comparison. In Proceedings of the USENIX 1995 Technical Conference Proceedings (New Orleans, LA, Jan. 1995), p. 21.
31. SHETTY, P., SPILLANE, R. P., MALPANI, R., ANDREWS, B., SEYSTER, J., AND ZADOK, E. Building workload-independent storage with VT-trees. In FAST (2013), pp. 17–30.
32. SWEENY, A., DOUCETTE, D., HU, W., ANDERSON, C., NISHIMOTO, M., AND PECK, G. Scalability in the XFS file system. In Proceedings of the 1996 USENIX Technical Conference (San Diego, CA, Jan. 1996), pp. 1–14.
33. TOKUTEK, INC. TokuDB: MySQL Performance, MariaDB Performance. http://www.tokutek.com/products/tokudb-for-mysql/.
34. TOKUTEK, INC. TokuMX—MongoDB Performance Engine. http://www.tokutek.com/products/tokumx-for-mongodb/.
35. WANG, P., SUN, G., JIANG, S., OUYANG, J., LIN, S., ZHANG, C., AND CONG, J. An efficient design and implementation of LSM-tree based key-value store on open-channel SSD. In Proceedings of the Ninth European Conference on Computer Systems (2014), EuroSys’14, pp. 16:1–16:14.