CDStore: Toward reliable, secure, and cost-efficient cloud storage via convergent dispersal

Proceedings of the 2015 USENIX Annual Technical Conference, USENIX ATC 2015

Volumn , Issue , 2015, Pages 111-124

  Li, Mingqiang ^a,b   Qin, Chuan ^a   Lee, Patrick P C ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b Ecosystem and Cloud Service Group   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE;

CLOUD STORAGES; COST-EFFICIENCY; COST-EFFICIENT; DE DUPLICATIONS; MONETARY COSTS; SECRET SHARING SCHEMES; STATE OF THE ART; STORAGE SOLUTIONS;

COST BENEFIT ANALYSIS;

EID: 85077119766     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (62)

1. Amazon EC2. http://aws.amazon.com/ec2/2014.
2. Amazon S3. http://aws.amazon.com/s3/2014.
3. FSL traces and snapshots public archive. http://tracer.filesystems.org/2014.
4. OpenSSL Project. http://www.openssl.org, 2014.
5. H. Abu-Libdeh, L. Princehouse, and H. Weatherspoon. RACS: A case for cloud storage diversity. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC '10), pages 229-240, Indianapolis, IN, June 2010.
6. A. Adya, W. J. Bolosky, M. Castro, G. Cermak, R. Chaiken, J. R. Douceur, J. Howell, J. R. Lorch, M. Theimer, and R. P. Wattenhofer. FARSITE: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI '02), pages 1-14, Boston, MA, Dec. 2002.
7. P. Anderson and L. Zhang. Fast and secure laptop backups with encrypted de-duplication. In Proceedings of the 24th Large Installation System Administration Conference (LISA '10), pages 1-12, San Jose, CA, Nov. 2010.
8. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaha. A view of cloud computing. Communications of the ACM, 53(4):50-58, Apr. 2010.
9. M. Bellare, S. Keelveedhi, and T. Ristenpart. DupLESS: Server-aided encryption for deduplicated storage. In Proceedings of the 22nd USENIX Security Symposium (Security '13), pages 179-194, Washington, DC, Aug. 2013.
10. M. Bellare, S. Keelveedhi, and T. Ristenpart. Message-locked encryption and secure deduplication. In Proceedings of the 32nd Annual International Conference on the Theory and Applications of Cryptographic Techniques (EUROCRYPT '13), pages 296-312, Athens, Greece, May 2013.
11. M. Bellare and P. Rogaway. Optimal asymmetric encryption. In Proceedings of the 1994 Workshop on the Theory and Application of Cryptographic Techniques (EUROCRYPT '94), pages 92-111, Perugia, Italy, May 1994.
12. D. Bermbach, M. Klems, S. Tai, and M. Menzel. MetaStorage: A federated cloud storage system to manage consistency-latency tradeoffs. In Proceedings of the 2011 IEEE 4th International Conference on Cloud Computing (CLOUD '11), pages 452-459, Washington, DC, July 2011.
13. A. Bessani, M. Correia, B. Quaresma, F. André, and P. Sousa. DepSky: Dependable and secure storage in a cloud-of-clouds. ACM Transactions on Storage, 9(4):1-33, Nov. 2013.
14. A. Bessani, R. Mendes, T. Oliveira, N. Neves, M. Correia, M. Pasin, and P. Verissimo. SCFS: A shared cloud-backed file system. In Proceedings of the 2014 USENIX Annual Technical Conference (ATC '14), pages 169-180, Philadelphia, PA, June 2014.
15. J. Black. Compare-by-hash: A reasoned analysis. In Proceedings of the 2006 USENIX Annual Technical Conference (ATC'06), pages 85-90, Boston, MA, June 2006.
16. G. R. Blakley and C. Meadows. Security of ramp schemes. In Proceedings of CRYPTO '84 on Advances in Cryptology, pages 242-268, Santa Barbara, CA, Aug 1984.
17. J. Blomer, M. Kalfane, R. Karp, M. Karpinski, M. Luby, and D. Zuckerman. An XOR-based erasure-resilient coding scheme. Technical Report TR-95-048, International Computer Science Institute, UC Berkeley, Aug. 1995.
18. B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Communications of the ACM, 13 (7):422-426, July 1970.
19. K. D. Bowers, A. Juels, and A. Oprea. HAIL: A high-availability and integrity layer for cloud storage. In Proceedings of 16th ACM Conference on Computer and Communications Security (CCS '09), pages 187-198, Chicago, IL, Nov. 2009.
20. V. Boyko. On the security properties of OAEP as an all-or-nothing transform. In Proceedings of the 19th Annual International Cryptology Conference (CRYPTO '99), pages 503-518, Santa Barbara, CA, Aug. 1999.
21. C. Cachin, R. Haas, and M. Vukolíc. Dependable storage in the intercloud. IBM Research Report RZ 3783, May 2010.
22. L. P. Cox, C. D. Murray, and B. D. Noble. Pastiche: Making backup cheap and easy. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI '02), pages 1-14, Boston, MA, Dec. 2002.
23. D. Dobre, P. Viotti, and M. Vukolíc. Hybris: Robust hybrid cloud storage. In Proceedings of the 2014 ACM Symposium on Cloud Computing (SoCC'14), pages 1-14, Seattle, WA, Nov. 2014.
24. J. R. Douceur, A. Adya, W. J. Bolosky, D. Simon, and M. Theimer. Reclaiming space from duplicate files in a serverless distributed file system. In Proceedings of the 22nd International Conference on Distributed Computing Systems (ICDCS'02), pages 617-624, Vienna, Austria, July 2002.
25. M. Fu, D. Feng, Y. Hua, X. He, Z. Chen, W. Xia, F. Huang, and Q. Liu. Accelerating restore and garbage collection in deduplication-based backup systems via exploiting historical information. In Proceedings of the 2014 USENIX Annual Technical Conference (ATC '14), pages 181-192, Philadelphia, PA, June 2014.
26. S. Ghemawat and J. Dean. LevelDB: A fast and lightweight key/value database library by Google. http://code.google.com/p/leveldb/2014.
27. S. Halevi, D. Harnik, B. Pinkas, and A. Shulman-Peleg. Proofs of ownership in remote storage systems. In Proceedings of the 18th ACM Conference on Computer and Communications Security (CCS '11), pages 491-500, Chicago, IL, Oct. 2011.
28. D. Harnik, B. Pinkas, and A. Shulman-Peleg. Side channels in cloud services: Deduplication in cloud storage. IEEE Security & Privacy, 8(6):40-47, Nov-Dec 2010.
29. Y. Hu, H. C. H. Chen, P. P. C. Lee, and Y. Tang. NCCloud: Applying network coding for the storage repair in a cloud-of-clouds. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST '12), pages 265-272, San Jose, CA, Feb. 2012.
30. R. Jellinek, Y. Zhai, T. Ristenpart, and M. Swift. A day late and a dollar short: The case for research on cloud billing systems. In Proceedings of the 6th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud '14), pages 1-6, Philadelphia, PA, June 2014.
31. K. Jin and E. L. Miller. The effectiveness of deduplication on virtual machine disk images. In Proceedings of the 2009 Israeli Experimental Systems Conference (SYSTOR '09), pages 1-12, Haifa, Israel, May 2009.
32. M. Kaczmarczyk, M. Barczynski, W. Kilian, and C. Dubnicki. Reducing impact of data fragmentation caused by in-line deduplication. In Proceedings of the 5th Annual International Systems and Storage Conference (SYSTOR '12), pages 1-12, Haifa, Israel, June 2012.
33. R. Kotla, L. Alvisi, and M. Dahlin. SafeStore: A durable and practical storage system. In Proceedings of the 2007 USENIX Annual Technical Conference (ATC '07), pages 129-142, Santa Clara, CA, June 2007.
34. H. Krawczyk. Secret sharing made short. In Proceedings of the 13th Annual International Cryptology Conference on Advances in Cryptology (CRYPTO '93), pages 136-146, Santa Barbara, CA, Aug. 1993.
35. S. Lelii. Nirvanix prepares to close, tells customers to stop using its cloud. http://itknowledgeexchange.techtarget.com/storage-soup/nirvanix-tocustomers-stop-sending-data-toour-cloud/Sept. 2013.
36. J. Li, X. Chen, M. Li, J. Li, P. P. C. Lee, and W. Lou. Secure deduplication with efficient and reliable convergent key management. IEEE Transactions on Parallel and Distributed Systems, 25(6):1615-1625, June 2014.
37. M. Li, C. Qin, P. P. C. Lee, and J. Li. Convergent dispersal: Toward storage-efficient security in a cloud-of-clouds. In Proceedings of the 6th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage '14), pages 1-5, Philadelphia, PA, June 2014.
38. M. Lillibridge, K. Eshghi, and D. Bhagwat. Improving restore speed for backup systems that use inline chunk-based deduplication. In Proceedings of the 11th USENIX Conference on File and Storage Technologies (FAST '13), pages 183-197, San Jose, CA, Feb. 2013.
39. D. Malkhi and M. Reiter. Byzantine quorum systems. In Proceedings of the 29th Annual ACM Symposium on the Theory of Computing (STOC '97), pages 569-578, El Paso, TX, May 1997.
40. C. McLellan. Storage in 2014: An overview. http://www.zdnet.com/storage-in-2014-an-overview-7000024712/, Jan. 2014.
41. D. Meister, A. Brinkmann, and T. Süß. File recipe compression in data deduplication systems. In Proceedings of the 11th USENIX conference on File and Storage Technologies (FAST '13), pages 175-182, San Jose, CA, Feb. 2013.
42. D. T. Meyer and W. J. Bolosky. A study of practical deduplication. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST '11), pages 1-14, San Jose, CA, Feb. 2011.
43. M. Mulazzani, S. Schrittwieser, M. Leithner, M. Huber, and E. Weippl. Dark clouds on the horizon: Using cloud storage as attack vector and online slack space. In Proceedings of the 20th USENIX Security Symposium (Security '11), pages 65-76, San Francisco, CA, Aug. 2011.
44. P. O'Neil, E. Cheng, D. Gawlick, and E. O'Neil. The log-structured merge-tree (LSM-tree). Acta Informatica, 33(4):351-385, June 1996.
45. T. G. Papaioannou, N. Bonvin, and K. Aberer. Scalia: An adaptive scheme for efficient multicloud storage. In Proceedings of the 2012 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '12), pages 1-10, Salt Lake City, UT, Nov. 2012.
46. J. S. Plank. A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems. Software-Practice & Experience, 27(9):995-1012, Sept. 1997.
47. J. S. Plank and Y. Ding. Note: Correction to the 1997 tutorial on Reed-Solomon coding. Software-Practice & Experience, 35(2):189-194, Feb. 2005.
48. J. S. Plank, K. M. Greenan, and E. L. Miller. Screaming fast Galois Field arithmetic using Intel SIMD instructions. In Proceedings of the 11th USENIX conference on File and Storage Technologies (FAST '13), pages 299-306, San Jose, CA, Feb. 2013.
49. M. Rabin. Fingerprint by random polynomials. Technical report, Technical Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
50. M. Rabin. Efficient dispersal of information for security, load balancing, and fault tolerance. Journal of the ACM, 36(2):335-348, Apr. 1989.
51. I. S. Reed and G. Solomon. Polynomial codes over certain finite fields. Journal of the Society for Industrial and Applied Mathematics, 8(2):300-304, June 1960.
52. J. K. Resch and J. S. Plank. AONT-RS: Blending security and performance in dispersed storage systems. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST '11), pages 191-202, San Jose, CA, Feb. 2011.
53. R. L. Rivest. All-or-nothing encryption and the package transform. In Proceedings of the 4th International Workshop on Fast Software Encryption (FSE '97), pages 210-218, Haifa, Israel, Jan. 1997.
54. A. Shamir. How to share a secret. Communications of the ACM, 22(11):612-613, Nov. 1979.
55. M.W. Storer, K. Greenan, D. D. E. Long, and E. L. Miller. Secure data deduplication. In Proceedings of the 4th ACM International Workshop on Storage Security and Survivability (StorageSS '08), pages 1-10, Fairfax, VA, Oct. 2008.
56. M. W. Storer, K. M. Greenan, E. L. Miller, and K. Voruganti. POTSHARDS- A secure, recoverable, long-term archival storage system. ACM Transactions on Storage, 5(2):1-35, June 2009.
57. V. Tarasov, A. Mudrankit, W. Buik, P. Shilane, G. Kuenning, and E. Zadok. Generating realistic datasets for deduplication analysis. In Proceedings of the 2012 USENIX Annual Technical Conference (ATC '12), pages 261-272, Boston, MA, June 2012.
58. G. Wallace, F. Douglis, H. Qian, P. Shilane, S. Smaldone, M. Chamness, and W. Hsu. Characteristics of backup workloads in production systems. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST '12), pages 33-48, San Jose, CA, Feb. 2012.
59. Z. Wilcox-O'Hearn and B. Warner. Tahoe-the least-authority filesystem. In Proceedings of the 4th ACM International Workshop on Storage Security and Survivability (StorageSS '08), pages 21-26, Fairfax, VA, Oct. 2008.
60. Z.Wu, M. Butkiewicz, D. Perkins, E. Katz-Bassett, and H. V. Madhyastha. SPANStore: Cost-effective geo-replicated storage spanning multiple cloud services. In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP '13), pages 292-308, Farmington, PA, Nov. 2013.
61. W. Zhang, H. Tang, H. Jiang, T. Yang, X. Li, and Y. Zeng. Multi-level selective deduplication for VM snapshots in cloud storage. In Proceedings of the 2012 IEEE 5th International Conference on Cloud Computing (CLOUD '12), pages 550-557, Honolulu, HI, June 2012.
62. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the data domain deduplication file system. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST '08), pages 269-282, San Jose, CA, Feb. 2008.