Analyzing long-term access locality to find ways to improve distributed storage systems

Proceedings - 20th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2012

Volumn , Issue , 2012, Pages 544-553

  Miranda, Alberto ^a   Cortes, Toni ^a,b  

^a BARCELONA SUPERCOMPUTING CENTER   (Spain)

^b UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS LOCALITY; ACCESS PATTERNS; CACHING POLICY; DATA PLACEMENT; DISTRIBUTED FILE-SYSTEM; DISTRIBUTED STORAGE SYSTEM; EFFICIENT DESIGNS; HUMAN BEHAVIORS; LONG LIFETIME; STORAGE SYSTEMS; USER BEHAVIORS; WORKING SET;

BEHAVIORAL RESEARCH; MULTIPROCESSING SYSTEMS;

TIME SHARING SYSTEMS;

EID: 84862118418     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PDP.2012.15     Document Type: Conference Paper

References (23)

1. N. Agrawal, W. Bolosky, J. Douceur, and J. Lorch. A fiveyear study of file-system metadata. ACM Transactions on Storage (TOS), 3(3):9, 2007.
2. E. Anderson, M. Arlitt, C. Morrey III, and A. Veitch. DataSeries: an efficient, flexible data format for structured serial data. ACM SIGOPS Operating Systems Review, 43(1):70-75, 2009.
3. E. Anderson, S. Spence, R. Swaminathan, M. Kallahalla, and Q. Wang. Quickly finding near-optimal storage designs. ACM Transactions on Computer Systems (TOCS), 23(4):337-374, 2005.
4. M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout. Measurements of a distributed file system. In Proceedings of the thirteenth ACM symposium on Operating systems principles, pages 198-212. ACM, 1991.
5. J. Douceur and W. Bolosky. A large-scale study of filesystem contents. In Proceedings of the 1999 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pages 59-70. ACM, 1999.
6. A. Downey. The structural cause of file size distributions. In Modeling, Analysis and Simulation of Computer and Telecommunication Systems, 2001. Proceedings. Ninth International Symposium on, pages 361-370. IEEE, 2002.
7. D. Ellard, J. Ledlie, P. Malkani, and M. Seltzer. Passive NFS tracing of email and research workloads. In Proceedings of the 2nd USENIX Conference on File and Storage Technologies, pages 203-216. USENIX Association, 2003.
8. T. Gibson and E. Miller. Long-term file activity and interreference patterns. Computer Measurement Group (CMG 98) Proceedings, 1998.
9. S. Kavalanekar, B. Worthington, Q. Zhang, and V. Sharda. Characterization of storage workload traces from production Windows servers. In Workload Characterization, 2008. IISWC 2008. IEEE International Symposium on, pages 119-128. IEEE, 2008.
10. S. Lee and H. Bahn. Data allocation in MEMS-based mobile storage devices. Consumer Electronics, IEEE Transactions on, 52(2):472-476, 2006.
11. A. Leung, S. Pasupathy, G. Goodson, and E. Miller. Measurement and analysis of large-scale network file system workloads. In USENIX 2008 Annual Technical Conference on Annual Technical Conference, pages 213-226. USENIX Association, 2008.
12. D. Muntz, P. Honeyman, and C. Antonelli. Evaluating delayed write in a multilevel caching file system. In Distributed Platforms: Client/Server and Beyond: DCE, CORBA, ODP and Advanced Distributed Applications, Proceedings of the IFIP/IEEE International Conference on, pages 415-429. IEEE, 2002.
13. D. Narayanan, A. Donnelly, E. Thereska, S. Elnikety, and A. Rowstron. Everest: Scaling down peak loads through I/O off-loading. In Proceedings of the 8th USENIX conference on Operating systems design and implementation, pages 15-28. USENIX Association, 2008.
14. J. Ousterhout, H. Da Costa, D. Harrison, J. Kunze, M. Kupfer, and J. Thompson. A trace-driven analysis of the UNIX 4.2 BSD file system. In Proceedings of the tenth ACM symposium on Operating systems principles, page 24. ACM, 1985.
15. J. Park, H. Chun, H. Bahn, and K. Koh. G-MST: A dynamic group-based scheduling algorithm for MEMS-based mobile storage devices. Consumer Electronics, IEEE Transactions on, 55(2):570-575, 2009.
16. K. Ramakrishnan, P. Biswas, and R. Karedla. Analysis of file I/O traces in commercial computing environments. In Proceedings of the 1992 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, pages 78-90. ACM, 1992.
17. D. Roselli, J. Lorch, and T. Anderson. A comparison of file system workloads. In Proceedings of the annual conference on USENIX Annual Technical Conference, page 4. USENIX Association, 2000.
18. A. Smith. Analysis of Long Term File Reference Patterns for Application to File Migration Algorithms. IEEE Transactions on Software Engineering, 7(4):403-417, 1981.
19. A. Traeger, E. Zadok, N. Joukov, and C. Wright. A nine year study of file system and storage benchmarking. ACM Transactions on Storage (TOS), 4(2):1-56, 2008.
20. W. Vogels. File system usage in Windows NT 4.0. In Proceedings of the seventeenth ACM symposium on Operating systems principles, pages 93-109. ACM, 1999.
21. J. Wilkes. Traveling to Rome: QoS specifications for automated storage system management. Quality of ServiceIWQoS 2001, pages 75-91, 2001.
22. T. Wong, G. Ganger, J. Wilkes, and C.-M. U. P. P. S. O. C. SCIENCE. My Cache Or Yours?: Making Storage More Exclusive. School of Computer Science, Carnegie Mellon University, 2000.
23. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. Hibernator: helping disk arrays sleep through the winter. In Proceedings of the twentieth ACM symposium on Operating systems principles, pages 177-190. ACM, 2005.