Characteristics of backup workloads in production systems

Proceedings of FAST 2012: 10th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2012, Pages 33-48

  Wallace, Grant ^a   Douglis, Fred ^a   Qian, Hangwei ^a,b   Shilane, Philip ^a   Smaldone, Stephen ^a   Chamness, Mark ^a   Hsu, Windsor ^a  

^a Root cause Analysis Network Management Design and Development

^b CASE WESTERN RESERVE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA PRIVACY; METADATA; REDUNDANCY;

BACK-UP SYSTEMS; CAPACITY REQUIREMENT; DATA REDUNDANCY; DE DUPLICATIONS; DISK-BASED SYSTEMS; LONG-TERM RETENTION; PRIMARY STORAGES; PRODUCTION SYSTEM;

DIGITAL STORAGE;

EID: 85077122692     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. N. Agrawal, W. Bolosky, J. Douceur, and J. Lorch. A five-year study of file-system metadata. In FAST'07: Proceedings of 5th Conference on File and Storage Technologies, pages 31-45, February 2007.
2. M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, and J. K. Ousterhout. Measurements of a distributed file system. In Proceedings of the Thirteenth Symposium on Operating Systems Principles, Oct. 1991.
3. J. Bennett, M. Bauer, and D. Kinchlea. Characteristics of files in NFS environments. In SIGSMALL'91: Proceedings of 1991 Symposium on Small Systems, June 1991.
4. D. R. Bobbarjung, S. Jagannathan, and C. Dubnicki. Improving duplicate elimination in storage systems. Transactions on Storage, 2:424-448, November 2006.
5. W. J. Bolosky, S. Corbin, D. Goebel, and J. R. Douceur. Single instance storage in Windows 2000. In Proceedings of the 4th conference on USENIX Windows Systems Symposium - Volume 4, pages 2-2, Berkeley, CA, USA, 2000. USENIX Association.
6. M. Chamness. Capacity forecasting in a backup storage environment. In LISA'11: Proceedings of the 25th Large Installation System Administration Conference, Dec. 2011.
7. A. Chervenak, V. Vellanki, and Z. Kurmas. Protecting file systems: A survey of backup techniques. In Joint NASA and IEEE Mass Storage Conference, 1998.
8. W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. Tradeoffs in scalable data routing for deduplication clusters. In FAST'11: Proceedings of 9th Conference on File and Storage Technologies, Feb. 2011.
9. J. Douceur and W. Bolosky. A large scale study of file-system contents. In SIGMETRICS'99: Proceedings of 1999 Conference on Measurement and Modeling of Computer Systems, May 1999.
10. C. Dubnicki, G. Leszek, H. Lukasz, M. Kaczmarczyk, W. Kilian, P. Strzelczak, J. Szczepkowski, C. Ungureanu, and M. Welnicki. HYDRAstor: a scalable secondary storage. In FAST'09: Proceedings of the 7th conference on File and Storage Technologies, pages 197-210, February 2009.
11. EMC Corporation. Data Domain Boost Software, 2010. http://www.datadomain.com/products/dd-boost.html.
12. EMC Corporation. Data Domain products. http://www.datadomain.com/products/, 2011.
13. J. Gantz and D. Reinsel. Extracting value from chaos. IDC Iview, available at http://www.emc.com/collateral/analyst-reports/ idc-extracting-value-from-chaos-ar. pdf, June 2011.
14. F. Guo and P. Efstathopoulos. Building a high-performance deduplication system. In Proceedings of the 2011 USENIX conference on USENIX Annual Technical Conference, 2011.
15. W. Hsu and A. J. Smith. Characteristics of I/O traffic in personal computer and server workloads. IBM Systems Journal, 42:347-372, April 2003.
16. IDC. Worldwide purpose-built backup appliance 2011-2015 forecast and 2010 vendor shares, 2011.
17. E. Kruus, C. Ungureanu, and C. Dubnicki. Bimodal content defined chunking for backup streams. In FAST'10: Proceedings of the 8th Conference on File and Storage Technologies, February 2010.
18. P. Kulkarni, F. Douglis, J. LaVoie, and J. M. Tracey. Redundancy elimination within large collections of files. In Proceedings of the USENIX Annual Technical Conference, pages 59-72, 2004.
19. D. A. Lelewer and D. S. Hirschberg. Data compression. ACM Computing Surveys, 19:261-296, 1987.
20. A. Leung, S. Pasupathy, G. Goodson, and E. L. Miller. Measurement and analysis of large-scale network file system workloads. In Proceedings of the 2008 USENIX Technical Conference, June 2008.
21. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise, and P. Camble. Sparse indexing: large scale, inline deduplication using sampling and locality. In FAST'09: Proceedings of the 7th Conference on File and Storage Technologies, pages 111-123, 2009.
22. D. Meyer and W. Bolosky. A study of practical deduplication. In FAST'11: Proceedings of 9th Conference on File and Storage Technologies, February 2011.
23. C. Min, K. Kim, H. Cho, S.-W. Lee, and Y. I. Eom. SFS: Random write considered harmful in solid state drives. In FAST'12: Proceedings of the 10th Conference on File and Storage Technologies, 2012.
24. A. Muthitacharoen, B. Chen, and D. Mazières. A low-bandwidth network file system. In SOSP'01: Proceedings of the 18th ACM Symposium on Operating Systems Principles, pages 174-187, 2001.
25. Y. Nam, G. Lu, N. Park, W. Xiao, and D. H. C. Du. Chunk fragmentation level: An effective indicator for read performance degradation in deduplication storage. In Proceedings of the 2011 IEEE International Conference on High Performance Computing and Communications, HPCC'11, pages 581-586, Washington, DC, USA, 2011. IEEE Computer Society.
26. J. Ousterhout, H. DaCosta, D. Harrison, J. Kuntze, M. Kupfer, and J. G. Thompson. A trace driven analysis of the unix 4.2 BSD file system. Proceedings of the Tenth Symposium on Operating Systems Principles, Oct. 1985.
27. N. Park and D. J. Lilja. Characterizing datasets for data deduplication in backup applications. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC'10), 2010.
28. C. Policroniades and I. Pratt. Alternatives for detecting redundancy in storage systems data. In Proceedings of the USENIX Annual Technical Conference, pages 73-86, 2004.
29. S. Quinlan and S. Dorward. Venti: a new approach to archival storage. In FAST'02: Proceedings of the 1st USENIX conference on File and Storage Technologies, 2002.
30. D. Roselli, J. Lorch, and T. Anderson. A comparision of file system workloads. In Proceedings of 2000 USENIX Annual Technical Conference, June 2000.
31. M. Satyanarayanan. A study of file sizes and functional life-times. In SOSP'81: Proceedings of 8th ACM Symposium on Operating Systems Principles, December 1981.
32. P. Shilane, M. Huang, G. Wallace, and W. Hsu. WAN optimized replication of backup datasets using stream-informed delta compression. In FAST'12: Proceedings of the 10th Conference on File and Storage Technologies, 2012.
33. Y. Tan, D. Feng, F. Huang, and Z. Yan. SORT: A similarity-ownership based routing scheme to improve data read performance for deduplication clusters. IJACT, 3(9):270-277, 2011.
34. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the Data Domain deduplication file system. In FAST'08: Proceedings of the 6th Conference on File and Storage Technologies, pages 269-282, February 2008.