Tablefs: Enhancing metadata efficiency in the local file system

Proceedings of the 2013 USENIX Annual Technical Conference, USENIX ATC 2013

Volumn , Issue , 2019, Pages 145-156

  Ren, Kai ^a   Gibson, Garth ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FILE ORGANIZATION; METADATA; TREES (MATHEMATICS);

DATA INTENSIVE; FILE SYSTEMS; LOCAL FILE SYSTEMS; LOG STRUCTURED; MAGNETIC DISK; OBJECT STORE; RANDOM ACCESS; SEQUENTIAL ALLOCATIONS;

INFORMATION MANAGEMENT;

EID: 85077196166     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (51)

1. FUSE. http://fuse.sourceforge.net/.
2. Memcached. http://memcached.org/.
3. ZFS. http://www.opensolaris.org/os/community/zfs.
4. AGRAWAL, N., ARPACI-DUSSEAU, A. C., AND ARPACI-DUSSEAU, R. H. Generating realistic impressions for file-system benchmarking. In Proccedings of the 7th conference on file and storage technologies (2009).
5. BENDER, M. A., FARACH-COLTON, M., FINEMAN, J. T., FO-GEL, Y. R., KUSZMAUL, B. C., AND NELSON, J. Cache-oblivious streaming B-trees. In Proceedings of annual ACM symposium on parallel algorithms and architectures (2007).
6. BENT, J., GIBSON, G., GRIDER, G., MCCLELLAND, B., NOWOCZYNSKI, P., NUNEZ, J., POLTE, M., AND WINGATE, M. PLFS: a checkpoint filesystem for parallel applications. In Proceedings of the ACM/IEEE conference on Supercomputing (2009).
7. BLOOM, B. Space/time trade-offs in hash coding with allowable errors. Communication of ACM 13, 7 (1970).
8. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W. C., WALLACH, D. A., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. E. Bigtable: a distributed storage system for structured data. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation (2006).
9. CUSTER, H. Inside the windows NT file system. Microsoft Press (1994).
10. DAYAL, S. Characterizing HEC storage systems at rest. In Carnegie Mellon University, CMU-PDL-08-109 (2008).
11. ESMET, J., BENDER, M., FARACH-COLTON, M., AND KUSZMAUL, B. The TokuFS streaming file system. Proceedings of the USENIX conference on Hot Topics in Storage and File Systems (2012).
12. GANGER, G. R., AND KAASHOEK, M. F. Embedded inodes and explicit grouping: Exploiting disk bandwidth for small files. In Proceedings of the annual conference on USENIX Annual Technical Conference (1997).
13. GHEMAWAT, S., GOBIOFF, H., AND LEUNG, S.-T. The Google file system. In Proceedings of the 19th ACM symposium on Operating systems principles (2003).
14. HALCROW, M. A. eCryptfs: An Enterprise-class Encrypted Filesystem for Linux. Proc. of the Linux Symposium, Ottawa, Canada (2005).
15. HARTER, T., DRAGGA, C., VAUGHN, M., ARPACI-DUSSEAU, A. C., AND ARPACI-DUSSEAU, R. H. A file is not a file: understanding the I/O behavior of Apple desktop applications. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles (2011).
16. HASKIN, R., MALACHI, Y., SAWDON, W., AND CHAN, G. Recovery management in quicksilver. In Proceedings of the Eleventh ACM Symposium on Operating System Principles (1987).
17. HDFS. Hadoop file system. http://hadoop.apache.org/.
18. HITZ, D., LAU, J., AND MALCOLM, M. File system design for an NFS file server appliance. In USENIX Winter Technical Conference (1994).
19. KASHYAP, A. File system extensibility and reliability using an in-kernel database. Master Thesis, Computer Science Department, Stony Brook University (2004).
20. KATCHER, J. Postmark: A new file system benchmark. In NetApp Technical Report TR3022 (1997).
21. KIM, H., AGRAWAL, N., AND UNGUREANU, C. Revisiting storage for smartphones. In Proceedings of the 10th USENIX conference on File and Storage Technologies (2012).
22. KRA, J. Ext4, BTRFS, and the others. In Proceeding of Linux-Kongress and OpenSolaris Developer Conference (2009).
23. LEVELDB. A fast and lightweight key/value database library. http://code.google.com/p/leveldb/.
24. LIM, H., FAN, B., ANDERSEN, D. G., AND KAMINSKY, M. SILT: a memory-efficient, high-performance key-value store. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles (2011).
25. LUSTRE. Lustre file system. http://www.lustre.org/.
26. MATHUR, A., CAO, M., AND BHATTACHARYA, S. The new Ext4 lesystem: current status and future plans. In Ottawa Linux Symposium (2007).
27. MCKUSICK, M. K., AND GANGER, G. R. Soft updates: A technique for eliminating most synchronous writes in the fast filesystem. Proceedings of the annual conference on USENIX Annual Technical Conference, FREENIX Track (1999).
28. MEYER, D. T., AND BOLOSKY, W. J. A study of practical deduplication. In Proceedings of the 9th USENIX conference on File and Storage Technologies (2011).
29. MULLENDER, S. J., AND TANENBAUM, A. S. Immediate files. SoftwarePractice and Experience (1984).
30. NIGHTINGALE, E. B., VEERARAGHAVAN, K., CHEN, P. M., AND FLINN, J. Rethink the sync. ACM Transactions on Computer Systems, Vol.26, No.3 Article 6 (2008).
31. OLSON, M. A. The design and implementation of the Inversion file system. In USENIX Winter Technical Conference (1993).
32. O'NEIL, P., CHENG, E., GAWLICK, D., AND O'NEIL, E. The log-structured merge-tree (LSM-tree). Acta Informatica (1996).
33. ONGARO, D., RUMBLE, S. M., STUTSMAN, R., OUSTERHOUT, J., AND ROSENBLUM, M. Fast crash recovery in RAM-Cloud. In Proceedings of the 23rd ACM symposium on Operating systems principles (2011).
34. PATIL, S., AND GIBSON, G. Scale and concurrency of GIGA+: File system directories with millions of files. In Proceedings of USENIX Conference on File and Storage Technologies (2011).
35. RODEH, O. B-trees, shadowing, and clones. Transactions on Storage (2008).
36. RODEH, O., BACIK, J., AND MASON, C. BRTFS: The Linux B-tree Filesystem. IBM Research Report RJ10501 (ALM1207-004) (2012).
37. ROSENBLUM, M., AND OUSTERHOUT, J. K. The design and implementation of a log-structured file system. In Proceedings of the thirteenth ACM symposium on Operating systems principles (1991).
38. ROSS, R., AND LATHAM, R. PVFS: a parallel file system. In Proceedings of the ACM/IEEE conference on Supercomputing (2006).
39. SCHMUCK, F. B., AND HASKIN, R. L. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the 1st USENIX conference on file and storage technologies (2002).
40. SEARS, R., AND BREWER, E. A. Stasis: Flexible transactional storage. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (2006).
41. SEARS, R., INGEN, C. V., AND GRAY, J. To BLOB or Not To BLOB: Large Object Storage in a Database or a Filesystem? Microsoft Technical Report (2007).
42. SEARS, R., AND RAMAKRISHNAN, R. bLSM: a general purpose log structured merge tree. Proceedings of the ACM SIGMOD International Conference on Management of Data (2012).
43. SELTZER, M., GANGER, G., MCKUSICK, K., SMITH, K., SOULES, C., AND STEIN, C. Journaling versus soft updates: Asynchronous meta-data protection in file systems. Proceedings of the annual conference on USENIX Annual Technical Conference (2000).
44. SELTZER, M. I., BOSTIC, K., MCKUSICK, M. K., AND STAELIN, C. An implementation of a log-structured file system for UNIX. USENIX Winter Technical Conference (1993).
45. SHETTY, P., SPILLANE, R., MALPANI, R., ANDREWS, B., SEYSTER, J., AND ZADOK, E. Building workload-independent storage with VT-Trees. In Proccedings of the 11th conference on file and storage technologies (2013).
46. STONEBRAKER, M. Operating System Support for Database Management. Commun. ACM (1981).
47. SWEENEY, A. Scalability in the XFS file system. In Proceedings of the 1996 USENIX Annual Technical Conference (1996).
48. WELCH, B., UNANGST, M., ABBASI, Z., GIBSON, G., MUELLER, B., SMALL, J., ZELENKA, J., AND ZHOU, B. Scalable performance of the panasas parallel file system. In Proceedings of the 6th USENIX conference on File and Storage Technologies (2008).
49. WHEELER, R. One billion files: pushing scalability limits of linux filesystem. In Linux Foudation Events (2010).
50. WRIGHT, C. P., SPILLANE, R., SIVATHANU, G., AND ZADOK, E. Extending ACID Semantics to the File System. ACM Transactions on Storage (2007).
51. ZHANG, Z., AND GHOSE, K. hFS: A hybrid file system prototype for improving small file and metadata performance. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems (2007).