Understanding data characteristics and access patterns in a cloud storage system

Proceedings - 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013

Volumn , Issue , 2013, Pages 327-334

  Liu, Songbin ^a,b   Huang, Xiaomeng ^a   Fu, Haohuan ^a   Yang, Guangwen ^a,b  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

Access pattern; Cloud storage; Data characteristic; File system

Indexed keywords

ACCESS PATTERNS; CLOUD STORAGES; DATA CHARACTERISTICS; DESIGN AND OPTIMIZATION; FILE SYSTEM SNAPSHOTS; FILE SYSTEMS; SYSTEM CHARACTERISTICS; TRACE DRIVEN SIMULATION;

FILE ORGANIZATION; GRID COMPUTING;

DIGITAL STORAGE;

EID: 84881266153     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2013.9     Document Type: Conference Paper

References (23)

1. J. R. Douceur and W. J. Bolosky, "A large-scale study of filesystem contents, " in Proceedings of the ACM SIGMETRICS international conference on Measurement and modeling of computer systems. New York, NY, USA: ACM, 1999, pp. 59-70.
2. N. Agrawal, W. J. Bolosky, J. R. Douceur, and J. R. Lorch, "A five-year study of file-system metadata, " ACM Transaction on Storage, vol. 3, no. 3, p. 9, 2007.
3. A. S. Tanenbaum, J. N. Herder, and H. Bos, "File size distribution on unix systems: then and now, " ACM SIGOPS Operating Systems Review, vol. 40, pp. 100-104, 2006.
4. T. Harter, C. Dragga, M. Vaughn, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, "A file is not a file: understanding the i/o behavior of apple desktop applications, " in Proceedings of the 23rd ACM Symposium on Operating Systems Principles. New York, NY, USA: ACM, 2011, pp. 71-83.
5. M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, and J. K. Ousterhout, "Measurements of a distributed file system, " in Proceedings of the thirteenth ACM Symposium on Operating Systems Principles. New York, NY, USA: ACM, 1991, pp. 198-212.
6. D. Ellard, J. Ledlie, P. Malkani, and M. Seltzer, "Passive nfs tracing of email and research workloads, " in Proceedings of the 2nd USENIX Conference on File and Storage Technologies, ser. FAST '03, Mar 2003.
7. A. Leung, S. Pasupathy, G. Goodson, and E. Miller, "Measurement and analysis of large-scale network file system workloads, " in Proceedings of the 2008 USENIX Annual Technical Conference, 2008, pp. 213-226.
8. S. Dayal, "Characterizing hec storage system at rest, " Carnegie Mellon University, Tech. Rep. CMU-PDL-08-109, Jul. 2008.
9. A. Iamnitchi, S. Doraimani, and G. Garzoglio, "Filecules in high-energy physics: Characteristics and impact on resource management, " in 15th IEEE International Symposium on High Performance Distributed Computing, 2006, pp. 69-79.
10. P. Carns, R. Latham, R. Ross, K. Iskra, S. Lang, and K. Riley, "24/7 characterization of petascale i/o workloads, " in IEEE International Conference on Cluster Computing and Workshops. IEEE, 2009, pp. 1-10.
11. M. N. Nelson, B. B. Welch, and J. K. Ousterhout, "Caching in the sprite network file system, " ACM Transactions on Computer Systems, vol. 6, pp. 134-154, February 1988.
12. M. Rosenblum and J. K. Ousterhout, "The design and implementation of a log-structured file system, " in Proceedings of the 13th ACM symposium on Operating systems principles. New York, NY, USA: ACM, 1991, pp. 1-15.
13. E. Vairavanathan and et al., "A workflow-aware storage system: An opportunity study, " in Proceedings of the 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, ser. CCGRID '12. Washington, DC, USA: IEEE Computer Society, 2012, pp. 326-334.
14. M. Mesnier, F. Chen, T. Luo, and J. B. Akers, "Differentiated storage services, " in Proceedings of the 23rd ACM Symposium on Operating Systems Principles. New York, NY, USA: ACM, 2011, pp. 57-70.
15. P. Xu and et al., "Enabling cloud storage to support traditional applications, " in Proceddings of the 5th Annual ChinaGrid Conference. IEEE, 2010, pp. 167-172.
16. G. Irlam. (1994) Unix file size survey. [Online], Available: http://www.base.com/gordoni/ufs93.html.
17. K. M. Evans and G. H. Kuenning, "A study of irregularities in file-size distributions, " in International Symposium on Performance Evaluation of Computer and Telecommunication Systems, ser. SPECTS, 2002.
18. K. P. Gummadi and et al., "Measurement, modeling, and analysis of a peer-to-peer file-sharing workload, " in Proceedings of the 19th ACM Symposium on Operating Systems Principles. New York, NY, USA: ACM, 2003, pp. 314-329.
19. D. Roselli, J. Lorch, and T. Anderson, "A comparison of file system workloads, " in Proceedings of the 2000 USENIX Annual Technical Conference, San Diego, CA. Berkeley, CA, USA: USENIX Association, 2000, p. 58.
20. W. Hsu and A. Smith, "Characteristics of i/o traffic in personal computer and server workloads, " IBM Systems Journal, vol. 42, no. 2, pp. 347-372, 2003.
21. I. Drago and et. al, "Inside dropbox: Understanding personal cloud storage services, " in Proceedings of the Internet Measurement Conference, Boston, MA, USA, 2012.
22. J. K. Ousterhout, H. Da Costa, D. Harrison, J. A. Kunze, M. Kupfer, and J. G. Thompson, "A trace-driven analysis of the unix 4.2 bsd file system, " in Proceedings of the tenth ACM symposium on Operating systems principles. New York, NY, USA: ACM, 1985, pp. 15-24.
23. Z. Zhang and K. Ghose, "hfs: a hybrid file system prototype for improving small file and metadata performance, " in Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, ser. EuroSys '07. New York, NY, USA: ACM, 2007, pp. 175-187.