Accelerating restore and garbage collection in deduplication-based backup systems via exploiting historical information

Proceedings of the 2014 USENIX Annual Technical Conference, USENIX ATC 2014

Volumn , Issue , 2014, Pages 181-192

  Fu, Min ^a   Feng, Dan ^a   Hua, Yu ^a   He, Xubin ^c   Chen, Zuoning ^d   Xia, Wen ^a   Huang, Fangting ^a   Liu, Qing ^b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

^d National Parallel Computing Engineering Research Center   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COST REDUCTION; MERGING; METADATA; REFUSE COLLECTION; RESTORATION;

BACKUP SYSTEMS; DEDUPLICATION; GARBAGE COLLECTION; HISTORICAL INFORMATION; PERFORMANCE; REAL-WORLD DATASETS; REWRITING ALGORITHM;

CONTAINERS;

EID: 85077436231     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Linux kernel. http://www.kernel.org/, 2013.
2. BELADY, L. A. A study of replacement algorithms for a virtual-storage computer. IBM systems journal 5, 2 (1966), 78-101.
3. BHAGWAT, D., ESHGHI, K., LONG, D. D., AND LILLIBRIDGE, M. Extreme binning: Scalable, parallel deduplication for chunk-based file backup. In Proc. IEEE MASCTOS, 2009.
4. BOTELHO, F. C., SHILANE, P., GARG, N., AND HSU, W. Memory efficient sanitization of a deduplicated storage system. In Proc. USENIX FAST, 2013.
5. DEBNATH, B., SENGUPTA, S., AND LI, J. ChunkStash: speeding up inline storage deduplication using flash memory. In Proc. USENIX FAST, 2010.
6. DUBNICKI, C., GRYZ, L., HELDT, L., KACZMARCZYK, M., KILIAN, W., STRZELCZAK, P., SZCZEPKOWSKI, J., UNGUREANU, C., AND WELNICKI, M. HYDRAstor: A scalable secondary storage. In Proc. USENIX FAST, 2009.
7. GUO, F., AND EFSTATHOPOULOS, P. Building a highperformance deduplication system. In Proc. USENIX ATC, 2011.
8. KACZMARCZYK, M., BARCZYNSKI, M., KILIAN, W., AND DUBNICKI, C. Reducing impact of data fragmentation caused by in-line deduplication. In Proc. ACM SYSTOR, 2012.
9. LILLIBRIDGE, M., ESHGHI, K., AND BHAGWAT, D. Improving restore speed for backup systems that use inline chunk-based deduplication. In Proc. USENIX FAST, 2013.
10. LILLIBRIDGE, M., ESHGHI, K., BHAGWAT, D., DEOLALIKAR, V., TREZISE, G., AND CAMBLE, P. Sparse indexing: large scale, inline deduplication using sampling and locality. In Proc. USENIX FAST, 2009.
11. MEISTER, D., AND BRINKMANN, A. dedupv1: Improving deduplication throughput using solid state drives (SSD). In Proc. IEEE MSST, 2010.
12. MEISTER, D., BRINKMANN, A., AND SÜSS, T. File recipe compression in data deduplication systems. In Proc. USENIX FAST, 2013.
13. MUTHITACHAROEN, A., CHEN, B., AND MAZIÈRES, D. A low-bandwidth network file system. In Proc. ACM SOSP, 2001.
14. NAM, Y., LU, G., PARK, N., XIAO, W., AND DU, D. H. Chunk fragmentation level: An effective indicator for read performance degradation in deduplication storage. In Proc. IEEE HPCC, 2011.
15. NAM, Y. J., PARK, D., AND DU, D. H. Assuring demanded read performance of data deduplication storage with backup datasets. In Proc. IEEE MASCOTS, 2012.
16. POSEY, B. Deduplication and data lifecycle management. http://searchdatabackup.techtarget.com/tip/Deduplication- and-data-lifecycle-management, 2013.
17. PRESTON, W. C. Backup & Recovery. O'Reilly Media, Inc., 2006.
18. PRESTON, W. C. Restoring deduped data in deduplication systems. http://searchdatabackup.techtarget.com/feature/Restoring-deduped-data-in-deduplication-systems, 2010.
19. QUINLAN, S., AND DORWARD, S. Venti: a new approach to archival storage. In Proc. USENIX FAST, 2002.
20. SHILANE, P., HUANG, M., WALLACE, G., AND HSU, W. WAN-optimized replication of backup datasets using stream-informed delta compression. ACM Transactions on Storage (TOS) 8, 4 (2012), 13.
21. SRINIVASAN, K., BISSON, T., GOODSON, G., AND VORUGANTI, K. iDedup: Latency-aware, inline data deduplication for primary storage. In Proc. USENIX FAST, 2012.
22. SYMANTEC. How to force a garbage collection of the deduplication folder. http://www.symantec.com/business/support/index?page=content&id=TECH129151, 2010.
23. TARASOV, V., MUDRANKIT, A., BUIK, W., SHILANE, P., KUENNING, G., AND ZADOK, E. Generating realistic datasets for deduplication analysis. In Proc. USENIX ATC, 2012.
24. WEI, J., JIANG, H., ZHOU, K., AND FENG, D. MAD2: A scalable high-throughput exact deduplication approach for network backup services. In Proc. IEEE MSST, 2010.
25. XIA, W., JIANG, H., FENG, D., AND HUA, Y. SiLo: a similarity-locality based near-exact deduplication scheme with low ram overhead and high throughput. In Proc. USENIX ATC, 2011.
26. ZHU, B., LI, K., AND PATTERSON, H. Avoiding the disk bottleneck in the data domain deduplication file system. In Proc. USENIX FAST, 2008.