POD: Performance oriented I/O deduplication for primary storage systems in the cloud

Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS

Volumn , Issue , 2014, Pages 767-776

  Mao, Bo ^a   Jiang, Hong ^b   Wu, Suzhen ^a   Tian, Lei ^b  

^a XIAMEN UNIVERSITY   (China)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Data Redundancy; I O Deduplication; I O Performance; Primary Storage; Storage Capacity

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; REDUNDANCY;

DATA DE DUPLICATIONS; DATA REDUNDANCY; DE DUPLICATIONS; PERFORMANCE MEASURE; PERFORMANCE-ORIENTED; PRIMARY STORAGES; PROTOTYPE IMPLEMENTATIONS; STORAGE CAPACITY;

DIGITAL STORAGE;

EID: 84906681614     PISSN: 15302075     EISSN: 23321237     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2014.84     Document Type: Conference Paper

References (37)

1. N. Agrawal, William J. Bolosky, John R. Douceur, and Jacob R. Lorch. A Five-Year Study of File-System metadata. In FAST'07, Feb. 2007.
2. A. Batsakis, R. Burns, A. Kanevsky, J. Lentini, and T. Talpey. AWOL: An Adaptive Write Optimizations Layer. In FAST'08, Feb. 2008.
3. P. Carns, K. Harms, W. Allcock, C. Bacon, S. Lang, R. Latham, and R. Ross. Understanding and improving computational science storage access through continuous characterization. ACM Transactions on Storage, 7(3):1-26, 2011.
4. F. Chen, T. Luo, and X. Zhang. CAFTL: A Content-Aware Flash Translation Layer Enhancing the Lifespan of Flash Memory based Solid State Drives. In FAST'11, Feb. 2011.
5. A. T. Clements, I. Ahmad, M. Vilayannur, and J. Li. Decentralized Deduplication in SAN Cluster File Systems. In USENIX ATC'09, Jun. 2009.
6. W. Dong, F. Douglis, K. Li, H. Patterson, S. Reddy, and P. Shilane. Tradeoffs in Scalable Data Routing for Deduplication Clusters. In FAST'11, Feb. 2011.
7. A. El-Shimi, R. Kalach, A. Kumar, A. Oltean, J. Li, and S. Sengupta. Primary Data Deduplication - Large Scale Study and System Design. In USENIX ATC'12, Jun. 2012.
8. D. Frey, A. Kermarrec, and K. Kloudas. Probabilistic Deduplication for Cluster-Based Storage Systems. In SOCC'12, Nov. 2012.
9. A. Gupta, R. Pisolkar, B. Urgaonkar, and A. Sivasubramaniam. Leveraging Value Locality in Optimizing NAND Flashbased SSDs. In FAST'11, Feb. 2011.
10. K. Jinand and E. L. Miller. The Effectiveness of Deduplication on Virtual Machine Disk Images. In SYSTOR'09, May 2009.
11. Stephanie Jones. Online De-duplication in a Log-Structured File System for Primary Storage. Technical Report UCSCSSRC- 11-03, University of California Santa Cruz. May 2011.
12. S. Kiswany, M. Ripeanu, S. S. Vazhkudai, and A. Gharaibeh. STDCHK: A Checkpoint Storage System for Desktop Grid Computing. In ICDCS'08, Jun. 2008.
13. R. Koller and R. Rangaswami. I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance. In FAST'10, Feb. 2010.
14. M. Lillibridge, K. Eshghi, and D. Bhagwat. Improving Restore Speed for Backup Systems that Use Inline Chunk- Based Deduplication. In FAST'13, Feb. 2013.
15. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise, and P. Camble. Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality. In FAST'09, Feb. 2009.
16. J. Lofstead, M. Polte, G. Gibson, S. Klasky, K. Schwan, R. Oldfield, M. Wolf, and Q. Liu. Six Degrees of Scientific Data: Reading Patterns for Extreme Scale Science IO. In HPDC'11, Jun. 2011.
17. B. Mao, H. Jiang, D. Feng, S. Wu, J. Chen, L. Zeng, and L. Tian. HPDA: A Hybrid Parity-based Disk Array for Enhanced Performance and Reliability. In IPDPS'10, Apr. 2010.
18. B. Mao, H. Jiang, S. Wu, Y. Fu, and L. Tian. SAR: SSD Assisted Restore Optimization for Deduplication-based Storage Systems in the Cloud. In NAS'12, Jun. 2012.
19. N. Megiddo and D. Modha. Arc: A self-tuning, low overhead replacement cache. In FAST'03, Mar. 2003.
20. D. Meister, J. Kaiser, A. Brinkmann, T. Cortes, M. Kuhn, and J. Kunkel. A Study on Data Deduplication in HPC Storage Systems. In SC'12, Nov. 2012.
21. D. T. Meyer and W. J. Bolosky. A Study of Practical Deduplication. In FAST'11, Feb. 2011.
22. C. Ng, M. Ma, T. Wong, Patrick P. C. Lee, and John C. S. Lui. Live Deduplication Storage of Virtual Machine Images in an Open-Source Cloud. In Middleware'11, Dec. 2011.
23. Y. Oh, J. Choi, D. Lee, and Sam H. Noh. Caching less for better performance: Balancing cache size and update cost of flash memory cache in hybrid storage systems. In FAST'12, Feb. 2012.
24. R. Patterson, G. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. In SOSP'95, Dec. 1995.
25. S. Quinlan and D. Sean. Venti: A New Approach to Archival Data Storage. In FAST'02, Jan. 2002.
26. A. Riska and E. Riedel. Disk Drive Level Workload Characterization. In USENIX'06, Jun. 2006.
27. P. C. Roth. Characterizing the I/O Behavior of Scientific Applications on the Cray XT. In PDSW'07, Nov. 2007.
28. K. Srinivasan, T. Bisson, G. Goodson, and K. Voruganti. iDedup: Latency-aware, Inline Data Deduplication for Primary Storage. In FAST'12, Feb. 2012.
29. J. Tucci. Cloud + Big Data = Massive Change, Massive Opportunity, Keynote Address at UW CSE 2011-12 Annual Industrial Affiliates Meeting. Oct 2010.
30. V. Vasudevan, M. Kaminsky, and David G. Andersen. Using Vector Interfaces to Deliver Millions of IOPS from a Networked Key-value Storage Server. In SOCC'12, Oct. 2012.
31. R. Villars, C. Olofson, and M. Eastwood. Big Data: What It Is and Why You Should Care, White Paper, IDC. 2011.
32. S. Wu, H. Jiang, and B. Mao. IDO: Intelligent Data Outsourcing with Improved RAID Reconstruction Performance in Large-Scale Data Centers. In LISA'12, Dec. 2012.
33. W. Xia, H. Jiang, D. Feng, and Y. Hua. SiLo: A Similarity- Locality based Near-Exact Deduplication Scheme with Low RAM Overhead and High Throughput. In USENIX ATC'11, Jun. 2011.
34. Y. Yue, H. Jiang, L. Tian, F. Wang, D. Fang, and Q. Zhang. RoLo: A Rotated Logging Storage Architecture for Enterprise Data Centers. In ICDCS'10, Jun. 2010.
35. X. Zhang, Z. Huo, J. Ma, and D. Meng. Exploiting Data Deduplication to Accelerate Live Virtual Machine Migration. In Cluster'10, Sep. 2010.
36. B. Zhu, K. Li, and H. Patterson. Avoiding the Disk Bottleneck in the Data Domain Deduplication File System. In FAST'08, Feb. 2008.
37. P. Zikopoulos, C. Eaton, D. Deroos, T. Deutsch, and G. Lapis. Understanding Big Data. 2010.