Survey of secure data deduplication schemes for cloud storage systems

ACM Computing Surveys

Volumn 49, Issue 4, 2017, Pages

  Shin, Youngjoo ^a   Koo, Dongyoung ^b   Hur, Junbeom ^b  

^a National Security Research Institute (NSRI)   (South Korea)

^b Korea University   (South Korea)

Author keywords

Deterministic information dispersal; Message dependent encryption; Proof of ownership; Traffic obfuscation

Indexed keywords

CRYPTOGRAPHY; DATA PRIVACY; ECONOMIC AND SOCIAL EFFECTS; RISK PERCEPTION;

CLOUD SERVICE PROVIDERS; CLOUD STORAGE SYSTEMS; INFORMATION DISPERSAL; PROOF OF OWNERSHIP; SECURE DATA DEDUPLICATION; SECURITY AND PRIVACY; SECURITY AND PRIVACY ISSUES; TRAFFIC OBFUSCATIONS;

DIGITAL STORAGE;

EID: 85011418894     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/3017428     Document Type: Article

References (88)

1. Martín Abadi, Dan Boneh, Ilya Mironov, Ananth Raghunathan, and Gil Segev. 2013. Message-locked encryption for lock-dependent messages. In Advances in Cryptology-CRYPTO 2013. Lecture Notes in Computer Science, Vol. 8042. Springer, 374-391.
2. Hussam Abu-Libdeh, Lonnie Princehouse, and Hakim Weatherspoon. 2010. RACS: A case for cloud storage diversity. In Proceedings of the 1st ACM Symposium on Cloud Computing. 229-240.
3. Amazon. 2016a. Amazon S3. Retrieved December 7, 2016, from https://aws.amazon.com/s3.
4. Amazon. 2016b. Protecting Data Using Server-Side Encryption. Retrieved December 7, 2016, from http://docs.aws.amazon.com/AmazonS3/latest/dev/serv-side-encryption.html.
5. Giuseppe Ateniese, Randal Burns, Reza Curtmola, Joseph Herring, Lea Kissner, Zachary Peterson, and Dawn Song. 2007. Provable data possession at untrusted stores. In Proceedings of the 14th ACM Conference on Computer and Communications Security (CCS'07). 598-609. DOI:http://dx.doi.org/10.1145/1315245.1315318.
6. Mihir Bellare and Sriram Keelveedhi. 2015. Interactivemessage-locked encryption and secure deduplication. In Advances in Cryptology-EUROCRYPT 2013. Lecture Notes in Computer Science, Vol. 9020. Springer, 516-538.
7. Mihir Bellare, Sriram Keelveedhi, and Thomas Ristenpart. 2013a. Message-locked encryption and secure deduplication. In Advances in Cryptology-EUROCRYPT 2013. Lecture Notes in Computer Science, Vol. 7881. Springer, 296-312.
8. Mihir Bellare, Sriram Keelveedhi, and Thomas Ristenpart. 2013b. DupLESS: Server-Aided encryption for deduplicated storage. In Proceedings of USENIX Security Symposium 2013. 179-194.
9. Mihir Bellare, Sriram Keelveedhi, and Thomas Ristenpart. 2013c. Source code of Dup LESS. Retrieved December 7, 2016, from http://cseweb.ucsd.edu/∼skeelvee/dupless/.
10. Bitcasa. 2016. Home Page. Retrieved December 7, 2016, from https://www.bitcasa.com.
11. G. R. Blakley and C. Meadows. 1985. Security of ramp schemes. In Advances in Cryptology-CRYPTO 1984. Lecture Notes in Computer Science, Vol. 196. 242-268. DOI:http://dx.doi.org/10.1007/3-540-39568-7-20.
12. J. Blasco, R. Di Pietro, A. Orfila, and A. Sorniotti. 2014. A tunable proof of ownership scheme for deduplication using Bloom filters. In Proceedings of the 2014 IEEE Conference on Communications and Network Security (CNS'14). 481-489.
13. Deepak R. Bobbarjung, Suresh Jagannathan, and Cezary Dubnicki. 2006. Improving duplicate elimination in storage systems. ACM Transactions on Storage 2, 4, 424-448.
14. Andrei Z. Broder. 2000. Identifying and filtering near-duplicate documents. In Combinatorial Pattern Matching. Lecture Notes in Computer Science, Vol. 1848. Springer, 1-10. DOI: http://dx.doi.org/10.1007/3-540-45123-4-1.
15. Cisco. 2015. CISCO Global Cloud Index (2012-2017). Available at http://www.cisco.com/c/en/us/solutions/service-provider/global-cloud-index-gci/index.html.
16. Cloud Berry. 2016. Home Page. Retrieved December 7, 2016, from http://www.cloudberrylab.com.
17. Cloud Flare. 2014. The Relative Cost of Bandwidth Around the World. Retrieved December 7, 2016, from https://blog.cloudflare.com/the-relative-cost-of-bandwidth-Around-The-world/.
18. Roberto Di Pietro and Alessandro Sorniotti. 2012. Boosting efficiency and security in proof of ownership for deduplication. In Proceedings of the 7th ACM Symposium on Information, Computer, and Communications Security (ASIACCS'12). 81-91.
19. John R. Douceur, Atul Adya, William J. Bolosky, Dan Simon, and Marvin Theimer. 2002. Reclaiming space from duplicate files in a serverless distributed file system. In Proceedings of the 2002 22nd International Conference on Distributed Computing Systems. IEEE, Los Alamitos, CA, 617-624.
20. Dropbox. 2016a. Home Page. Retrieved December 7, 2016, from http://www.dropbox.com.
21. Dropbox. 2016b. Dropbox Business Security: A Dropbox Whitepaper. Retrieved December 7, 2016, from https://www.dropbox.com/static/business/resources/Security-Whitepaper.pdf.
22. Yitao Duan. 2014. Distributed key generation for encrypted deduplication. In Proceedings of the 6th Edition of the ACM Cloud Computing Security Workshop (CCSW'14). 57-68.
23. Duplicati. 2016. Home Page. Retrieved December 7, 2016, from http://www.duplicati.com.
24. Cynthia Dwork. 2008. Differential privacy: A survey of results. In Theory and Applications of Models of Computation. Lecture Notes in Computer Science, Vol. 4978. Springer, 1-19. DOI:http://dx.doi.org/10.1007/978-3-540-79228-4-1.
25. Stefan Dziembowski. 2006. Intrusion-resilience via the bounded-storage model. In Theory of Cryptography-TCC 2006. Lecture Notes in Computer Science, Vol. 3876. Springer, 207-224. DOI:http://dx.doi.org/10.1007/11681878-11.
26. Taher Elgamal. 1985. A public key cryptosystem and a signature scheme based on discrete logarithms. IEEE Transactions on Information Theory 31, 4, 469-472. DOI:http://dx.doi.org/10.1109/TIT.1985.1057074.
27. Sascha Fahl, Marian Harbach, Thomas Muders, Matthew Smith, Lars Baumgartner, and Bernd Freisleben. 2012. Why Eve and Mallory love Android: An analysis of Android SSL (In)Security. In Proceedings of the 19th ACM Conference on Computer and Communications Security (CCS'12). 50-61.
28. Fingolfin. 2016. SSH Implementation Comparison. Retrieved December 7, 2016, from http://sshcomparison.quendi.de/.
29. Min Fu, Dan Feng, Yu Hua, Xubin He, Zuoning Chen, Wen Xia, Yucheng Zhang, and Yujuan Tan. 2015. Design tradeoffs for data deduplication performance in backup workloads. In Proceedings of the 13th USENIX Conference on File and Storage Technologies (FAST'15). 331-344.
30. Lorena González-Manzano and Agustín Orfila. 2015. An efficient confidentiality-preserving proof of ownership for deduplication. Journal of Network and Computer Applications 50, 49-59.
31. Google Drive. 2016. Home Page. Retrieved December 7, 2016, from https://www.google.com/drive/.
32. Shai Halevi, Danny Harnik, Benny Pinkas, and Alexandra Shulman-Peleg. 2011. Proofs of ownership in remote storage systems. In Proceedings of the 18th ACM Conference on Computer and Communications Security (CCS'11). 491-500.
33. Danny Harnik, Oded Margalit, Dalit Naor, Dmitry Sotnikov, and Gil Vernik. 2012. Estimation of deduplication ratios in large data sets. In Proceedings of the 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST'12). 1-11.
34. Danny Harnik, Benny Pinkas, and Alexandra Shulman-Peleg. 2010. Side channels in cloud services: Deduplication in cloud storage. IEEE Security and Privacy Magazine 8, 6, 40-47.
35. O. Heen, C. Neumann, L. Montalvo, and S. Defrance. 2012. Improving the resistance to side-channel attacks on cloud storage services. In Proceedings of the 2012 5th International Conference on New Technologies, Mobility, and Security (NTMS'12). 1-5.
36. Intel. 2010. Breakthrough AES Performance with Intel AES New Instructions. White Paper. Retrieved December 7, 2016, from http://www.intel.it/content/dam/www/public/us/en/documents/white-papers/aesbreakthrough-performance-paper.pdf.
37. Keren Jin and Ethan L. Miller. 2009. The effectiveness of deduplication on virtual machine disk images. In Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference. 7.
38. Christine Jost, Ha Lam, Alexander Maximov, and Ben J.M. Smeets. 2015. Encryption Performance Improvements of the Paillier Cryptosystem. Retrieved December 7, 2016, from https://eprint.iacr.org/2015/864.
39. Ari Juels and Burton S. Kaliski Jr. 2007. Pors: Proofs of retrievability for large files. In Proceedings of the 14th ACM Conference on Computer and Communications Security (CCS'07). 584-597. DOI:http://dx.doi.org/10.1145/1315245.1315317.
40. Nesrine Kaaniche and Maryline Laurent. 2014. A secure client side deduplication scheme in cloud storage environments. In Proceedings of the 2014 6th International Conference on New Technologies, Mobility, and Security (NTMS'14). 1-7. DOI:http://dx.doi.org/10.1109/NTMS.2014.6814002.
41. Michal Kaczmarczyk, Marcin Barczynski, Wojciech Kilian, and Cezary Dubnicki. 2012. Reducing impact of data fragmentation caused by in-line deduplication. In Proceedings of the 5th Annual International Systems and Storage Conference. 15.
42. Dongyoung Koo, Junbeom Hur, and Hyunsoo Yoon. 2014. Secure and efficient deduplication over encrypted data with dynamic updates in cloud storage. In Proceedings of the International Symposium on Frontier and Innovation in Future Computing and Communications (FCC'14). 229-235. DOI:http://dx.doi.org/10.1007/978-94-017-8798-7-28.
43. Seungkwang Lee and Dooho Choi. 2012. Privacy-preserving cross-user source-based data deduplication in cloud storage. In Proceedings of the 2012 International Conference on ICT Convergence (ICTC'12). 329-330.
44. J. Li, X. Chen, X. Huang, S. Tang, Y. Xiang, M. Hassan, and A. Alelaiwi. 2015. Secure distributed deduplication systems with improved reliability. IEEE Transactions on Computers 64, 12, 3569-3579. DOI:http://dx.doi.org/0.1109/TC.2015.2401017.
45. J. Li, X. Chen, M. Li, P. P. C. Lee, and W. Lou. 2014a. Secure deduplication with efficient and reliable convergent key management. IEEE Transactions on Parallel and Distributed Systems 25, 6, 1615-1625.
46. J. Li, Y. K. Li, X. Chen, P. P. C. Lee, and W. Lou. 2015a. A hybrid cloud approach for secure authorized deduplication. IEEE Transactions on Parallel and Distributed Systems 26, 5, 1206-1216.
47. Mingqiang Li, Chuan Qin, and Patrick P. C. Lee. 2015b. CDStore: Toward reliable, secure, and cost-efficient cloud storage via convergent dispersal. In Proceedings of the 2015 USENIX Annual Technical Conference (ATC'15). 1-20.
48. Mingqiang Li, Chuan Qin, and Patrick P. C. Lee. 2015c. Source Code of CD Store. Retrieved December 7, 2016, from https://github.com/chintran27/CDStore.
49. Mingqiang Li, Chuan Qin, Patrick P. C. Lee, and Jin Li. 2014b. Convergent dispersal: Toward storage-efficient security in a coud-of-clouds. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage'14).
50. Chih Wei Ling and Anwitaman Datta. 2014. Inter Cloud RAIDer: A do-it-yourself multi-cloud private data backup system. In Distributed Computing and Networking. Lecture Notes in Computer Science, Vol. 8314. Springer, 453-468. DOI:http://dx.doi.org/10.1007/978-3-642-45249-9-30.
51. Chuanyi Liu, Yancheng Wang, and Jie Lin. 2014. A policy-based de-duplication mechanism for encrypted cloud storage. Journal of Computational Information Systems 10, 6, 2297-2304.
52. J. Liu, N. Asokan, and B. Pinkas. 2015. Secure deduplication of encrypted data without additional independent servers. In Proceedings of the 22th ACM Conference on Computer and Communications Security (CCS'15). 874-885.
53. Nagapramod Mandagere, Pin Zhou, Mark A. Smith, and Sandeep Uttamchandani. 2008. Demystifying data deduplication. In Proceedings of the ACM/IFIP/USENIX Middleware 2008 Conference Companion (Companion'08). 12-17.
54. Ralph C. Merkle. 1990. A certified digital signature. In Advances in Cryptology-CRYPTO 1989. Lecture Notes in Computer Science, Vol. 435. Springer, 218-238. DOI:http://dx.doi.org/10.1007/0-387-34805-0-21.
55. Dutch T. Meyer and William J. Bolosky. 2012. A study of practical deduplication. ACM Transactions on Storage 7, 4, 1-20.
56. Meixia Miao, Jianfeng Wang, Hui Li, and Xiaofeng Chen. 2015. Secure multi-server-Aided data deduplication in cloud computing. Pervasive and Mobile Computing 24, C, 129-137. DOI:http://dx.doi.org/10.1016/j.pmcj.2015.03.002.
57. Martin Mulazzani, Sebastian Schrittwieser, Manuel Leithner, Markus Huber, and Edgar R. Weippl. 2011. Dark clouds on the horizon: Using cloud storage as attack vector and online slack space. In Proceedings of the 2011 USENIX Security Symposium.
58. Wee Keong Ng, Yonggang Wen, and Huafei Zhu. 2012. Private data deduplication protocols in cloud storage. In Proceedings of the 27th Annual ACM Symposium on Applied Computing (SAC'12). 441-446.
59. One Drive. 2016. Home Page. Retrieved December 7, 2016, from https://onedrive.live.com.
60. Open Dedup. 2016. Home Page. Retrieved December 7, 2016, from http://www.opendedup.org.
61. Pascal Paillier. 1999. Public-key cryptosystems based on composite degree residuosity classes. In Advances in Cryptology-EUROCRYPT 1999. Lecture Notes in Computer Science, Vol. 1592. Springer, 223-238. DOI:http://dx.doi.org/10.1007/3-540-48910-X-16.
62. João Paulo and José Pereira. 2014. A survey and classification of storage deduplication systems. ACM Computing Surveys 47, 1, 1-30. DOI:http://dx.doi.org/10.1145/2611778.
63. Torben Pryds Pedersen. 1992. Non-interactive and information-Theoretic secure verifiable secret sharing. In Advances in Cryptology-CRYPTO 1992. Lecture Notes in Computer Science, Vol. 576. Springer, 129-140. DOI:http://dx.doi.org/10.1007/3-540-46766-1-9.
64. Tobias Pulls. 2012. (More) side channels in cloud storage. Privacy and Identity Management for Life 375, 102-115.
65. Pasquale Puzio, Refik Molva, Melek Onen, and Sergio Loureiro. 2013. Clou Dedup: Secure deduplication with encrypted data for cloud storage. In Proceedings of the 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom'13). 363-370.
66. Quantum. 2016. Home Page. Retrieved December 7, 2016, from http://www.quantum.com/products/cloudservices/q-cloud/index.aspx.
67. Michael Rabin. 1981. Fingerprinting by Random Polynomials. Center for Research in Computing Technology, Aiken Computation Laboratory, Harvard University, Cambridge, MA.
68. Michael Rabin. 1989. Efficient dispersal of information for security, load balancing, and fault tolerance. Journal of the ACM 36, 335-348.
69. Jason K. Resch, James S. Plank, Jason K. Resch, and James S. Plank. 2011. AONT-RS: Blending security and performance in dispersed storage systems. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST'11).
70. Adi Shamir. 1979. How to share a secret. Communications of the ACM 22, 11, 612-613. DOI:http://dx.doi.org/10.1145/359168.359176.
71. Youngjoo Shin, Junbeom Hur, and Kwangjo Kim. 2012. Security Weakness in the Proof of Storage with Deduplication. Retrieved December 7, 2016, from https://eprint.iacr.org/2012/554.
72. Youngjoo Shin and Kwangjo Kim. 2015. Differentially private client-side data deduplication protocol for cloud storage services. Security and Communication Networks 8, 2114-2123. DOI:http://dx.doi.org/10.1002/sec.1159.
73. Jan Stanek, Alessandro Sorniotti, Elli Androulaki, and Lukas Kencl. 2013. A secure data deduplication scheme for cloud storage. In Financial Cryptography and Data Security. Lecture Notes in Computer Science, Vol. 8437. Springer, 99-118.
74. Mark W. Storer, Kevin Greenan, Darrell D. E. Long, and Ethan L. Miller. 2008. Secure data deduplication. In Proceedings of the 4th ACM International Workshop on Storage Security and Survivability (StorageSS' 08). 1-10.
75. Stor Reduce. 2016. Home Page. Retrieved December 7, 2016, from http://www.storreduce.com.
76. Mi Wen, Kejie Lu, Jingsheng Lei, Fengyong Li, and Jing Li. 2015. BDO-SD: An efficient scheme for big data outsourcing with secure deduplication. In Proceedings of the 2015 IEEE INFOCOM Workshop on Big Data Security. 1-6.
77. Wikipedia. 2016a. Comparison of Disk Encryption Software. Retrieved December 7, 2016, from https://en.wikipedia.org/wiki/Comparison-of-disk-encryption-software.
78. Wikipedia. 2016b. Comparison of TLS Implementations. Retrieved December 7, 2016, from https://en.wikipedia.org/wiki/Comparison-of-TLS-implementations.
79. Wuala. 2015. Home Page. Retrieved December 7, 2016, from https://en.wikipedia.org/wiki/Wuala.
80. Jia Xu, Ee-Chien Chang, and Jianying Zhou. 2011. Leakage-Resilient Client-Side Deduplication of Encrypted Data in Cloud Storage. Retrieved December 7, 2016, from https://eprint.iacr.org/2011/538.
81. Jia Xu, Ee-Chien Chang, and Jianying Zhou. 2013. Weak leakage-resilient client-side deduplication of encrypted data in cloud storage. In Proceedings of the 8th ACMSymposium on Information, Computer, and Communications Security (ASIACCS'13). 195.
82. Chao Yang, Jianfeng Ma, and Jian Ren. 2015. Provable ownership of encrypted files in de-duplication cloud storage. Ad Hoc and Sensor Wireless Networks 26, 43-72.
83. Chao Yang, Jian Ren, and Jianfeng Ma. 2013a. Provable ownership of file in de-duplication cloud storage. In Proceedings of the 2013 IEEE Global Communications Conference (GLOBECOM'13). 695-700.
84. Chao Yang, Jian Ren, and Jianfeng Ma. 2013b. Provable ownership of files in deduplication cloud storage. Security and Communication Networks 8, 14, 2457-2468. DOI:http://dx.doi.org/10.1002/sec.784.
85. Jiawei Yuan and Shucheng Yu. 2013. Secure and constant cost public cloud storage auditing with deduplication. In Proceedings of the 2013 IEEE Conference on Communications and Network Security (CNS'13). 145-153.
86. Qingji Zheng and Shouhuai Xu. 2012. Secure and efficient proof of storage with deduplication. In Proceedings of the 2nd ACM Conference on Data and Application Security and Privacy (CODASPY'12). 1-12.
87. Yifeng Zheng, Xingliang Yuan, Xinyu Wang, Jinghua Jiang, Cong Wang, and Xiaolin Gui. 2015. Enabling encrypted cloud media center with secure deduplication. In Proceedings of the 10th ACM Symposium on Information, Computer, and Communications Security (ASIACCS'15). 63-72.
88. Y. Zhou, D. Feng, W. Xia, M. Fu, F. Huang, Y. Zhang, and C. Li. 2015. Sec Dep: A user-Aware efficient fine-grained secure deduplication scheme with multi-level key management. In Proceedings of the 31st International Conference on Massive Storage Systems and Technology (MSST'15).