HANDS: A heuristically arranged non-backup in-line deduplication system

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2013, Pages 446-457

  Wildani, Avani ^a   Miller, Ethan L ^a   Rodeh, Ohad ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS PATTERNS; BOTTLENECK PROBLEM; MEMORY-RESIDENT; PERFORMANCE PENALTIES; PRIMARY STORAGES; SPATIO-TEMPORAL DATA; STATISTICAL TECHNIQUES; STORAGE SYSTEMS;

CACHE MEMORY; COST EFFECTIVENESS;

RANDOM ACCESS STORAGE;

EID: 84881352107     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2013.6544846     Document Type: Conference Paper

References (30)

1. J. Gantz, C. Chute, A. Manfrediz, S. Minton, D. Reinsel, W. Schlichting, et al., "The Diverse and Exploding Digital Universe," IDC White Paper, vol. 2, 2008.
2. T. Economist, "Data, data everywhere," The Economist Newspaper Limited, February 2010. [Online]. Available: http://www.economist.com/node/ 15557443?story-id=15557443
3. K. Lawrence, "Re-thinking the lamp stack: Part 2," PINGV, December 2010. [Online]. Available: http://pingv.com/blog/rethinking-the-lamp- stack-disruptive-technology
4. C. Constantinescu, J. Glider, and D. Chambliss, "Mixing deduplication and compression on active data sets," in 2011 Data Compression Conference. IEEE, 2011, pp. 393-402.
5. S. Jones, "Online de-duplication in a log-structured file system for primary storage," University of California, Santa Cruz, Tech. Rep. UCSC-SSRC-11-03, May 2011.
6. K. Srinivasan, T. Bisson, G. Goodson, and K. Voruganti, "iDedup: Latency-aware, inline data deduplication for primary storage," in Proccedings of the 10th conference on File and storage technologies. USENIX Association, 2012.
7. Y. Tsuchiya and T. Watanabe, "Dblk: Deduplication for primary block storage," in Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on. IEEE, 2011, pp. 1-5.
8. D. Bhagwat, K. Eshghi, D. Long, and M. Lillibridge, "Extreme binning: Scalable, parallel deduplication for chunk-based file backup," in Modeling, Analysis & Simulation of Computer and Telecommunication Systems, 2009. MASCOTS'09. IEEE International Symposium on. IEEE, 2009, pp. 1-9.
9. D. Meyer and W. Bolosky, "A study of practical deduplication," in Proceedings of the 9th USENIX conference on File and stroage technologies. USENIX Association, 2011, pp. 1-1.
10. K. Jin and E. L. Miller, "The effectiveness of deduplication on virtual machine disk images," May 2009.
11. I. Adams, E. L. Miller, and M. W. Storer, "Analysis of workload behavior in scientific and historical long-term data repositories," University of California, Santa Cruz, Tech. Rep. UCSC-SSRC-11-01, Mar. 2011.
12. P. Efstathopoulos and F. Guo, "Rethinking deduplication scalability," in HotStorage10, 2nd Workshop on Hot Topics in Storage and File Systems, 2010.
13. M. Storer, K. Greenan, D. Long, and E. Miller, "Secure data deduplication," in Proceedings of the 4th ACM international workshop on Storage security and survivability. ACM, 2008, pp. 1-10.
14. A. El-Shimi, R. Kalach, A. Kumar, A. Oltean, J. Li, and S. Sengupta, "Primary data deduplication - large scale study and system design," 2012.
15. N. Mandagere, P. Zhou, M. Smith, and S. Uttamchandani, "Demystifying data deduplication," in Proceedings of the ACM/IFIP/USENIX Middleware'08 Conference Companion. ACM, 2008, pp. 12-17.
16. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise, and P. Camble, "Sparse indexing: large scale, inline deduplication using sampling and locality," in Proceedings of the 7th conference on File and storage technologies. USENIX Association, 2009, pp. 111-123.
17. B. Zhu, K. Li, and H. Patterson, "Avoiding the disk bottleneck in the data domain deduplication file system," in Proceedings of the 6th USENIX Conference on File and Storage Technologies. USENIX Association, 2008, p. 18.
18. T. Yang, H. Jiang, D. Feng, Z. Niu, K. Zhou, and Y. Wan, "Debar: A scalable high-performance de-duplication storage system for backup and archiving," in Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on. IEEE, 2010, pp. 1-12.
19. A. Arpaci-Dusseau, R. Arpaci-Dusseau, L. Bairavasundaram, T. Denehy, F. Popovici, V. Prabhakaran, and M. Sivathanu, "Semantically-smart disk systems: past, present, and future," ACM SIGMETRICS Performance Evaluation Review, vol. 33, no. 4, p. 35, 2006.
20. A. Wildani and E. Miller, "Semantic data placement for power management in archival storage," in Petascale Data Storage Workshop (PDSW), 2010 5th. IEEE, 2010, pp. 1-5.
21. A. Wildani, E. Miller, and L. Ward, "Efficiently identifying working sets in block i/o streams," in Proceedings of the 4th Annual International Conference on Systems and Storage, 2011, p. 5.
22. Z. Li, Z. Chen, S. Srinivasan, and Y. Zhou, "C-miner: Mining block correlations in storage systems," in Proceedings of the 3rd USENIX Conference on File and Storage Technologies. USENIX Association, 2004, pp. 173-186.
23. S. Doraimani and A. Iamnitchi, "File grouping for scientific data management: lessons from experimenting with real traces," in Proceedings of the 17th international symposium on High performance distributed computing. ACM, 2008, pp. 153-164.
24. J.-F. Pâris, A. Amer, and D. D. E. Long, "A stochastic approach to file access prediction," in The International Workshop on Storage Network Architecture and Parall I/Os (SNAPI '03), sep 2003.
25. G. A. S. Whittle, J.-F. Pâris, A. Amer, D. D. E. Long, and R. Burns, "Using multiple predictors to improve the accuracy of file access predictions," in Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, Apr. 2003, pp. 230-240.
26. A. Amer, D. D. E. Long, J.-F. Pâris, and R. C. Burns, "File access prediction with adjustable accuracy," in Proceedings of 21st International Performance, Computing, and Communications Conference (IPCCC 2002). Phoenix, Arizona: IEEE, 2002.
27. A. Riska and E. Riedel, "Disk drive level workload characterization," in Proceedings of the USENIX Annual Technical Conference, 2006, pp. 97-103.
28. W. Dai, "Crypto++ 5.6.0 benchmarks," 2009. [Online]. Available: http://www.cryptopp.com/benchmarks.html
29. R. Koller and R. Rangaswami, "I/o deduplication: utilizing content similarity to improve i/o performance," ACM Transactions on Storage (TOS), vol. 6, no. 3, pp. 1-26, 2010.
30. A. Rigo and S. Pedroni, "Pypy's approach to virtual machine construction," in Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications. ACM, 2006, pp. 944-953.