AA-Dedupe: An application-aware source deduplication approach for cloud backup services in the personal computing environment

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2011, Pages 112-120

  Fu, Yinjin ^a,b   Jiang, Hong ^b   Xiao, Nong ^a   Tian, Lei ^b   Liu, Fang ^a  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

application aware index; Cloud backup; deduplication efficiency; intelligent data chunking; source deduplication

Indexed keywords

APPLICATION-AWARE INDEX; BACK-UP SERVERS; BACKUP SERVICE; CLIENT SITES; COMPUTATIONAL OVERHEADS; COMPUTING ENVIRONMENTS; CORPORATE DATA; DATA REDUNDANCY; DEDUPLICATION; EXPERIMENTAL EVALUATION; INDEX STRUCTURE; INTELLIGENT DATA CHUNKING; NETWORK BANDWIDTH; PC-BASED; POWER-EFFICIENCY; PROTOTYPE IMPLEMENTATIONS; REDUCED COST; SMART PHONES; STORAGE SPACES; SYSTEM RESOURCES; TRANSFER EFFICIENCY;

CLUSTER COMPUTING; COST REDUCTION; DATA TRANSFER; EFFICIENCY; LAPTOP COMPUTERS; PERSONAL COMPUTING;

CLOUD COMPUTING;

EID: 80955123470     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2011.20     Document Type: Conference Paper

References (26)

1. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica and M. Zaharia, "Above the Clouds: A Berkeley View of Cloud Computing," UC Berkeley Reliable Adaptive Distributed Systems Laboratory. Tech. rep. Feb. 2009.
2. "IDC: Digital Data to Double Every 18 Months," Information Management Journal, Sep. 2009, vol. 43/5 Docstoc page 20.
3. L. Ponemon, "The Cost of a Lost Laptop," Intel Corporation, Apr. 22, 2009.
4. "Cloud Storage for Cloud Computing," SNIA: Advancing storage & information technology, Sep. 2009. www.snia.org/ cloud/ CloudStorageForCloudComputing.pdf
5. B. Agarwal, A. Akella, A. Anand, A. Balachandran, P. Chitnis, C. Muthukrishnan, R. Ramjee and G. Varghese. "EndRE: An End-System Redundancy Elimination Service for Enterprises," in Proceedings of the Second Symposium on Networked Systems Design and Implementation (NSDI '10), 2010, pp. 419-432.
6. L. D. Bois and R. Amatruda, "Backup and Recovery: Accelerating Efficiency and Driving Down IT Costs Using Data Deduplication,"EMC Corporation, Feb. 2010.
7. D. T. Meyer and W. J. Bolosky, "A Study of Practical Deduplication,"in Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST'11), 2011, pp. 1-14.
8. D. Meister and A. Brinkmann, "Multi-level comparison of data deduplication in a backup scenario," in Proceedings of the 2nd Annual International Systems and Storage Conference (SYSTOR'09), Haifa, Israel: ACM, 2009.
9. N. Agrawal, W. J. Bolosky, J. R. Douceur, and J. R. Lorch, "A Five- Year Study of File-System Metadata," in Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST'07), Feb. 2007, pp. 31-45.
10. C. Dubnicki, K. Lichota, E. Kruus and C. Ungureanu, "Methods and systems for data management using multiple selection criteria," United States Patent 7844581, Nov. 30, 2010.
11. Y. Tan, H. Jiang, D. Feng, L. Tian, Z. Yan and G. Zhou, "SAM: A Semantic-Aware Multi-tiered Source De-duplication Framework for Cloud Backup," in Proceedings of the 39th International Conference on Parallel Processing (ICPP'10), 2010, pp. 614 - 623.
12. M. Vrable, S. Savage and G. M. Voelker, "Cumulus: Filesystem Backup to the Cloud," in Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST'09), Feb. 2009, pp. 225-238.
13. D. Bhagwat, K. Eshghi, D. D. Long and M. Lillibridge, "Extreme Binning: Scalable, Parallel Deduplication for Chunkbased File Backup," HP Laboratories, Tech. Rep. HPL-2009-10R2, Sep. 2009.
14. K. Eshghi, "A framework for analyzing and improving content based chunking algorithms," Tech. Rep. HPL-2005-30 (R.1), Hewlett Packard Laboratories, Palo Alto, 2005.
15. B. Zhu, K. Li, and H. Patterson, "Avoiding the disk bottleneck in the Data Domain deduplication file system," in Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST'08), Feb. 2008, pp. 269-282.
16. P. Kulkarni, F. Douglis, J. Lavoie, and J. M. Tracey, "Redundancy elimination within large collections of files," in Proceedings of the annual conference on USENIX Annual Technical Conference (ATC'04), 2004, pp. 59-72.
17. C. Liu, Y. Lu, C. Shi, G. Lu, D. Du, and D.-S. Wang, "ADMAD: Application-driven metadata aware de-deduplication archival storage systems," in Proceedings of the 5th IEEE International Workshop on Storage Network Architecture and Parallel I/Os (SNAPI'08), 2008, pp.29-35.
18. N. Xiao, Z. Chen, F. Liu, M. Lai, L. An, "P3Stor: A parallel, durable flash-based SSD for enterprise-scale storage systems," Science China Information Sciences, vol. 54, No. 6, Jun. 2011, pp.1129-1141. DOI: 10.1007/s11432-011-4266-z.
19. H. Falaki, D. Lymberopoulos, R. Mahajan, S. Kandula and D. Estrin, "A First Look at Traffic on Smartphones," in Proceedings of the 10th annual conference on Internet measurement (IMC'10), Nov.2010, pp. 281-287.
20. M. Lillibridge, K. Eshghi, D. Bhagwat, V. Deolalikar, G. Trezise and P. Camble, "Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality," in Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST'09), 2009, pp. 111-123.
21. P. Anderson and L. Zhang, "Fast and Secure Laptop Backups with Encrypted De-duplication," in Proceedings of the 24th international conference on Large Installation System Administration (LISA'10), 2010, pp. 29-40.
22. VMware Inc. "Virtual disk format." http://www.vmware.com/ interfaces/vmdk.html, Nov. 2007.
23. "Data Loss Statistics," http://www.bostoncomputing.net/consul tation/databackup/statistics/
24. EMC Avamar. http://www.emc.com/avamar.
25. Jungle disk. http://www.jungledisk.com/.
26. BackupPC. http://backuppc.sourceforge.net/.