Optimizing a hybrid SSD/HDD HPC storage system based on file size distributions

IEEE Symposium on Mass Storage Systems and Technologies

Volumn , Issue , 2013, Pages

  Welch, Brent ^a   Noer, Geoffrey ^a  

^a Panasas Inc   (United States)

Author keywords

file systems; HPC; OSD; parallel file system; SSD

Indexed keywords

FILE SYSTEMS; HPC; OSD; PARALLEL FILE SYSTEM; SSD;

COMPUTER ARCHITECTURE; FILE ORGANIZATION; METADATA; SIZE DISTRIBUTION;

HARD DISK STORAGE;

EID: 84883068846     PISSN: 21601968     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MSST.2013.6558449     Document Type: Conference Paper

References (11)

1. Agrawal, N., Bolosky, W. J., Douceur, J. R., & Lorch, J. R. (2007). A five-year study of file-system metadata. ACM Transactions on Storage (TOS), 3(3), 9
2. Baker, M. G., Hartman, J. H., Kupfer, M. D., Shirriff, K. W., & Ousterhout, J. K. (1991, September). Measurements of a distributed file system. In ACM SIGOPS Operating Systems Review (Vol. 25, No. 5, pp. 198-212). ACM.
3. Dayal, S. (2008). Characterizing HEC storage systems at rest. Parallel Data Lab, Carnegie Mellon University, Pittsburgh, PA, USA. CMU-PDL-08-109
4. Downey, A. B. (2001). The structural cause of file size distributions. InModeling, Analysis and Simulation of Computer and Telecommunication Systems, 2001. Proceedings. Ninth International Symposium on (pp. 361-370). IEEE.
5. Evans, K. M., & Kuenning, G. H. (2002, July). A study of irregularities in file-size distributions. In Proceedings of the 2002 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS).
6. fsstats, http://www.pdsi-scidac.org/fsstats/
7. Mullender, S. J., & Tanenbaum, A. S. (1984). Immediate files. Software: Practice and Experience, 14(4), 365-368
8. Ousterhout, J. K., Da Costa, H., Harrison, D., Kunze, J. A., Kupfer, M., & Thompson, J. G. (1985). A trace-driven analysis of the UNIX 4.2 BSD file system (Vol. 19, No. 5, pp. 15-24). ACM.
9. SFS2008. www.spec.org/sfs2008/
10. Tanenbaum, A. S., Herder, J. N., & Bos, H. (2006). File size distribution on unix systems-then and now. Operating systems review, 40(1), 100
11. Welch, B., Unangst, M., Abbasi, Z., Gibson, G., Mueller, B., Small, J., .. & Zhou, B. (2008, February). Scalable performance of the Panasas parallel file system. In FAST (Vol. 8, pp. 1-17).