Depot: Cloud storage with minimal trust

ACM Transactions on Computer Systems

Volumn 29, Issue 4, 2011, Pages

  Mahajan, Prince ^a   Setty, Srinath ^a   Lee, Sangmin ^a   Clement, Allen ^a   Alvisi, Lorenzo ^a   Dahlin, Mike ^a   Walfish, Michael ^a  

^a University of Texas at Austin   (United States)

Author keywords

Byzantine fault tolerance; Cloud storage; Fork consistency; Fork Join Causal (FJC) consistency

Indexed keywords

BYZANTINE FAULT TOLERANCE; FAULTY NODE; FORK CONSISTENCY; FORK-JOIN-CAUSAL (FJC) CONSISTENCY; LIVENESS; MALICIOUS BEHAVIOR; RECOVERY PROPERTIES; STORAGE SYSTEMS; TRUST ASSUMPTIONS; TWO LAYERS;

COMPUTER SCIENCE; COMPUTER SYSTEMS;

FAULT TOLERANCE;

EID: 84863181209     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2063509.2063512     Document Type: Article

References (75)

1. ABU-LIBDEH, H., PRINCEHOUSE, L., AND WEATHERSPOON, H. 2010. RACS: A case for cloud storage diversity. In Proceedings of the ACM Symposium on Cloud Computing (SOCC).
2. AHAMAD, M., NEIGER, G., BURNS, J. E., KOHLI, P., AND HUTTO, P. 1995. Causal memory: Definitions, implementation and programming. Distrib. Comput. 9, 1, 37-49.
3. AMAZON. 2011. Summary of the Amazon EC2 and Amazon RDS service disruption in the US East region. http://aws.amazon.com/message/65648.
4. AMAZON S3 TEAM. 2008. Amazon S3 Team. Amazon S3 availability event: July 20, 2008. http://status.aws.amazon.com/s3-20080720.html.
5. BECKMANN, C. 2009. Google App Engine: Information regarding 2 July 2009 outage. http://groups.google.com/group/google-appengine/browsethread/thread/ e9237fc7b0aa7df5/ba95ded980c8c179.
6. BELARAMANI, N., DAHLIN, M., GAO, L., NAYATE, A., VENKATARAMANI, A., YALAGANDULA, P., AND ZHENG, J. 2006. PRACTI replication. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
7. BIRRELL, A., LEVIN, R., NEEDHAM, R., AND SCHROEDER, M. 1982. Grapevine: An exercise in distributed computing. Comm. ACM 25, 4.
8. CACHIN, C., SHELAT, A., AND SHRAER, A. 2007. Efficient fork-linearizable access to untrusted shared memory. In Proceedings of the ACM Symposium on the Principles of Distributed Computing (PODC).
9. CACHIN, C., KEIDAR, I., AND SHRAER, A. 2009. Fail-aware untrusted storage. In Proceedings of the International Conference on Dependable Systems and Networks (DSN).
10. CALORE, M. 2009. Magnolia suffers major data loss, site taken offline. Wired Mag.
11. CASTRO, M. AND LISKOV, B. 2002. Practical Byzantine fault tolerance and proactive recovery. ACM Trans. Comput. Syst. 20, 4.
12. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W., WALLACH, D., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. 2006. Bigtable: A distributed storage system for structured data. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
13. CHUN, B.-G., MANIATIS, P., SHENKER, S., AND KUBIATOWICZ, J. 2007. Attested append-only memory: Making adversaries stick to their word. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
14. CIRCLEID. 2009. Survey: Cloud computing 'no hype', but fear of security and control slowing adoption. http://www.circleid.com/posts/20090226-cloud- computing-hype-security/.
15. CLEMENT, A., KAPRITSOS, M., LEE, S., WANG, Y., ALVISI, L., DAHLIN, M., AND RICHÉ, T. 2009. UpRight cluster services. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
16. CNET NEWS. 2011. Google probing lost Gmail messages, contacts. http://news.cnet.com/8301-10233-20037019-93.html.
17. COOK, B. 2009. Seattle data center fire knocks out Bing Travel, other web sites. http://www.techflash.com/seattle/2009/07/Seattle-data-center-fire- knocks-out-Bing-Travel-other-Web-sites-49876777.html.
18. COOPER, B., RAMAKRISHNAN, R., SRIVASTAVA, U., SILBERSTEIN, A., BOHANNON, P., JACOBSEN, H., PUZ, N., WEAVER, D., AND YERNENI, R. 2008. PNUTS: Yahoo!'s hosted data serving platform. In Proceedings of the International Conference on Very Large Data Bases (VLDB).
19. DECANDIA, G., HASTORUN, D., JAMPANI, M., KAKULAPATI, G., LAKSHMAN, A., PILCHIN, A., SIVASUB-RAMANIAN, S., VOSSHALL, P., AND VOGELS, W. 2007. Dynamo: Amazon's highly available key-value store. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
20. DEMMER, M., DU, B., AND BREWER, E. 2008. TierStore: A distributed filesystem for challenged networks in developing regions. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST).
21. FELDMAN, A. J., ZELLER, W. P., FREEDMAN, M. J., AND FELTEN, E. W. 2010. SPORC: Group collaboration using untrusted cloud resources. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
22. FRIGO, M. AND LUCHANGCO, V. 1998. Computation-centric memory models. In Proceedings of the ACM Symposium on Parallelism in Algorithms and Architectures (SPAA).
23. FU, K., KAASHOEK, M. F., AND MAZIÈRES, D. 2002. Fast and secure distributed read-only file system. ACM Trans. Comput. Syst. 20, 1, 1-24. (Pubitemid 135707562)
24. GILBERT, S. AND LYNCH, N. 2002. Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services. SIGACT News 33, 51-59.
25. GOH, E.-J., SHACHAM, H., MODADUGU, N., AND BONEH, D. 2003. SiRiUS: Securing remote untrusted storage. In Proceedings of the Annual Network & Distributed System Security Symposium (NDSS).
26. GRAY, J. AND SHENOY, P. 2000. Rules of thumb in data engineering. In Data Engineering. 3-12.
27. GUERRAOUI, R., KNEZEVIC, N., QUEMA, V., AND VUKOLIC, M. 2010. The next 700 BFT protocols. In Proceedings of the European Conference on Computer Systems (EuroSys).
28. HAEBERLEN, A., MISLOVE, A., AND DRUSCHEL, P. 2005. Glacier: Highly durable, decentralized storage despite massive correlated failures. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
29. HAEBERLEN, A., KOUZNETSOV, P., AND DRUSCHEL, P. 2007. PeerReview: Practical accountability for distributed systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
30. HENDRICKS, J., GANGER, G. R., AND REITER, M. K. 2007. Low-overhead Byzantine fault-tolerant storage. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
31. HERLIHY, M. P. AND WING, J. M. 1990. Linearizability: A correctness condition for concurrent objects. ACM Trans. Program. Lang. Syst. 12, 3.
32. KALLAHALLA, M., RIEDEL, E., SWAMINATHAN, R., WANG, Q., AND FU, K. 2003. Plutus: Scalable secure file sharing on untrusted storage. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST).
33. KANG, B. 2004. S2D2: A framework for scalable and secure optimistic replication. Ph.D. thesis, University of California Berkeley.
34. KARGER, D., LEHMAN, E., LEIGHTON, T., PANIGRAHY, R., LEVINE, M., AND LEWIN, D. 1997. Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the world wide web. In Proceedings of the ACM Symposium on Theory of Computing (STOC).
35. KISTLER, J. AND SATYANARAYANAN, M. 1992. Disconnected operation in the coda file system. ACM Trans. Comput. Syst. 10, 1, 3-5.
36. KOTLA, R., ALVISI, L., AND DAHLIN, M. 2007. SafeStore: A durable and practical storage system. In Proceedings of the USENIX Annual Technical Conference (ATC).
37. KUBIATOWICZ, J., BINDEL, D., CHEN, Y., CZERWINSKI, S., EATON, P., GEELS, D., GUMMADI, R., RHEA, S., WEATHERSPOON, H., WEIMER, W., WELLS, C., AND ZHAO, B. 2000. OceanStore: An architecture for global-scale persistent storage. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).
38. LAMPORT, L. 1978. Time, clocks, and the ordering of events in a distributed system. Comm. ACM 21, 7.
39. LAMPORT, L. 1979. How to make a multiprocessor computer that correctly executes multiprocess programs. IEEE Trans. Comput. 28, 9, 690-691. (Pubitemid 10420526)
40. LAMPORT, L., SHOSTAK, R., AND PEASE, M. 1982. The Byzantine generals problem. ACM Trans. Program. Lang. Syst. 4, 3, 382-401.
41. LEVIN, D., DOUCEUR, J. R., LORCH, J. R., AND MOSCIBRODA, T. 2009. TrInc: Small trusted hardware for large distributed systems. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
42. LI, J. AND MAZIÈRES, D. 2007. Beyond one-third faulty replicas in Byzantine fault tolerant systems. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
43. LI, J., KROHN, M., MAZIÈRES, D., AND SHASHA, D. 2004. Secure untrusted data repository (SUNDR). In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
44. MALKHI, D. AND REITER, M. 1998. Byzantine quorum systems. Distrib. Comput. 11, 4, 203-213. (Pubitemid 128489949)
45. MANIATIS, P. 2003. Historic integrity in distributed systems. Ph.D. thesis, Stanford.
46. MAZIÈRES, D., KAMINSKY, M., KAASHOEK, M. F., AND WITCHEL, E. 1999. Separating key management from file system security. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
47. MILLER, R. 2009. FBI siezes servers at Dallas data center. http://www.datacenterknowledge.com/archives/2009/04/03/fbi-seizes-servers-at- dallas-data-center/.
48. NATH, S., YU, H., GIBBONS, P. B., AND SESHAN, S. 2006. Subtleties in tolerating correlated failures in wide-area storage systems. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
49. NEWS, C. 2002. Victims of lost files out of luck. http://news.cnet.com/ Victims-of-lost-files-out-of-luck/2100-10233-887849.html.
50. NIGHTINGALE, E., VEERARAGHAVAN, K., CHEN, P., AND FLINN, J. 2008. Rethink the sync. ACM Trans. Comput. Syst. 26, 3.
51. OPPENHEIMER, D., GANAPATHI, A., AND PATTERSON, D. A. 2003. Why do Internet services fail, and what can be done about it? In Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS).
52. OPREA, A. AND REITER, M. 2006. On consistency of encrypted files. In Proceedings of the International Symposium on Distributed Computing (DISC).
53. PARKER, D. S., POPEK, G. J., RUDISIN, G., STOUGHTON, A., WALKER, B. J., WALTON, E., CHOW, J. M., KISER, S., EDWARDS, D., AND KLINE, C. 1983. Detection of mutual inconsistency in distributed systems. IEEE Trans. Softw. Engin. 9, 3, 240-247.
54. PETERSEN, K., SPREITZER, M. J., TERRY, D. B., THEIMER, M. M., AND DEMERS, A. J. 1997. Flexible update propagation for weakly consistent replication. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
55. PINHEIRO, E., WEBER, W., AND BARROSO, L. 2007. Failure trends in a large disk drive population. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST).
56. POPA, R. A., LORCH, J. R., MOLNAR, D., WANG, H. J., AND ZHUANG, L. 2011. Enabling security in cloud storage SLAs with CloudProof. In Proceedings of the USENIX Annual Technical Conference (ATC).
57. PRABHAKARAN, V., BAIRAVASUNDARAM, L., AGRAWAL, N., GUNAWI, H., ARPACI-DUSSEAU, A., AND ARPACI-DUSSEAU, R. 2005. IRON file systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
58. RAMASUBRAMANIAN, V., RODEHEFFER, T., TERRY, D. B., WALRAED-SULLIVAN, M., WOBBER, T., MARSHALL, C. C., AND VAHDAT, A. 2009. Cimbiosys: A platform for content-based partial replication. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
59. REIHER, P., HEIDEMANN, J., RATNER, D., SKINNER, G., AND POPEK, G. 1994. Resolving file conflicts in the Ficus file system. In Proceedings of the USENIX Summer Technical Conference.
60. S3 APP CATALOG. 2011. AWS forum: Customer app catalog. http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=66.
61. SCHIPER, A., BIRMAN, K., AND STEPHENSON, P. 1991. Lightweight causal and atomic group multicast. ACM Trans. Comput. Syst. 9, 3.
62. SHAH, M., BAKER, M., MOGUL, J., AND SWAMINATHAN, R. 2007. Auditing to keep online storage services honest. In Proceedings of the Workshop on Hot Topics in Operating Systems (HotOS).
63. SHRAER, A., CACHIN, C., CIDON, A., KEIDAR, I., MICHALEVSKY, Y., AND SHAKET, D. 2010. Venus: Verification for untrusted cloud storage. In Proceedings of the ACM Cloud Computing Security Workshop (CCSW).
64. SINGH, A., FONSECA, P., KUZNETSOV, P., RODRIGUES, R., AND MANIATIS, P. 2009. Zeno: Eventually consistent Byzantine fault tolerance. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
65. STRUNK, J., GOODSON, G., SCHEINHOLTZ, M., SOULES, C., AND GANGER, G. 2000. Self-Securing storage: Protecting data in compromised systems. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
66. TERRY, D. B., DEMERS, A. J., PETERSEN, K., SPREITZER, M., THEIMER, M., AND WELCH, B. W. 1994. Session guarantees for weakly consistent replicated data. In Proceedings of the International Conference on Parallel and Distributed Information Systems (PDIS).
67. TERRY, D. B., THEIMER, M. M., PETERSEN, K., DEMERS, A. J., SPREITZER, M. J., AND HAUSER, C. H. 1995. Managing update conflicts in Bayou, a weakly connected replicated storage system. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).
68. US. 2005. US Secret Service report on insider attacks. http://www.sei.cmu.edu/about/press/insider-2005.html.
69. VOGELS, W. 2006. Life is not a state-machine: The long road from research to production. In Proceedings of the ACM Symposium on the Principles of Distributed Computing (PODC).
70. WHITE, B., LEPREAU, J., STOLLER, L., RICCI, R., GURUPRASAD, S., NEWBOLD, M., HIBLER, M., BARB, C., AND JOGLEKAR, A. 2002. An integrated experimental environment for distributed systems and networks. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
71. WOBBER, T., RODEHEFFER, T. L., AND TERRY, D. B. 2010. Policy-Based access control for weakly consistent replication. In Proceedings of the European Conference on Computer Systems (EuroSys).
72. YAHOO. 2011. Yahoo's offloading of delicious a reminder of cloud risks. http://www.infoworld.com/t/cloud-computing/yahoos-offloading-delicious-reminder- cloud-risks-735.
73. YANG, J., SAR, C., AND ENGLER, D. 2006. EXPLODE: A lightweight, general system for finding serious storage system errors. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI).
74. YIP, A., CHEN, B., AND MORRIS, R. 2006. Pastwatch: A distributed version control system. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).
75. YUMEREFENDI, A. AND CHASE, J. 2007. Strong accountability for network storage. ACM Trans. Storage 3, 3.