Lithium: Virtual machine storage for the cloud

Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10

Volumn , Issue , 2010, Pages 15-26

  Hansen, Jacob Gorm ^a   Jul, Eric ^b  

^a VMWARE INC   (United States)

^b LUCENT TECHNOLOGIES   (United States)

Author keywords

Design; Experimentation; Performance; Reliability

Indexed keywords

APPLICATION SOFTWARES; BYZANTINE FAULT TOLERANCE; CLOUD COMPUTING; COMMODITY HARDWARE; DATA CENTERS; DATA CORRUPTION; DISK ARRAY; DISTRIBUTED STORAGE SYSTEM; EXPERIMENTATION; FIBRE CHANNEL; PERFORMANCE RELIABILITY; RUNNING-IN; SHARED STORAGE; SMALL CLUSTERS; VERSION CONTROL; VIRTUAL MACHINES; VIRTUALIZATIONS; WORK LOADS;

COMPUTER SOFTWARE; DESIGN; DISTRIBUTED COMPUTER SYSTEMS; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; QUALITY ASSURANCE;

LITHIUM;

EID: 77954903726     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1807128.1807134     Document Type: Conference Paper

References (48)

1. M. K. Aguilera, S. Spence, and A. Veitch. Olive: distributed point-in-time branching storage for real systems. In NSDI'06: Proceedings of the 3rd conference on Networked Systems Design & Implementation, pages 27-27, Berkeley, CA, USA, 2006. USENIX Association.
2. Amazon. Amazon Elastic Block Store (Amazon EBS). http://aws.amazon.com/ ebs, 2009.
3. Amazon. Amazon Simple Storage Service (Amazon S3). http://aws.amazon.com/ S3, 2009.
4. L. N. Bairavasundaram, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, G. R. Goodson, and B. Schroeder. An analysis of data corruption in the storage stack. Trans. Storage, 4(3):1-28, 2008.
5. G. Bartels and T. Mann. Cloudburst: A Compressing, Log-Structured Virtual Disk for Flash Memory. Technical Report 2001-001, Compaq Systems Research Center, February 2001.
6. B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Communications of the ACM, 13:422-426, 1970.
7. W. J. Bolosky, J. R. Douceur, and J. Howell. The farsite project: a retrospective. SIGOPS Oper. Syst. Rev., 41(2):17-26, 2007.
8. J. Bonwick, M. Ahrens, V. Henson, M. Maybee, and M. Shellenbaum. The Zettabyte File System. Technical report, Sun Microsystems, 2003.
9. B.-G. Chun, F. Dabek, A. Haeberlen, E. Sit, H. Weatherspoon, M. F. Kaashoek, J. Kubiatowicz, and R. Morris. Eficient replica maintenance for distributed storage systems. In NSDI'06: Proceedings of the 3rd conference on Networked Systems Design & Implementation, pages 4-4, Berkeley, CA, USA, 2006. USENIX Association.
10. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of the 2nd Networked Systems Design and Implementation NSDI '05, May 2005.
11. A. T. Clements, I. Ahmad, M. Vilayannur, and J. Li. Decentralized Deduplication in SAN Cluster File Systems. In Proc. USENIX Annual Technical Conference, San Diego, CA, 2009.
12. G. Coulouris, J. Dollimore, and T. Kindberg. Distributed Systems Concepts and Design. International Computer Science Series. Addison-Wesley, 4 edition, 2005.
13. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with CFS. In SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles, pages 202-215, New York, NY, USA, 2001. ACM.
14. W. de Jonge, M. F. Kaashoek, and W. C. Hsieh. The logical disk: a new approach to improving file systems. In SOSP '93: Proceedings of the fourteenth ACM symposium on Operating systems principles, pages 15-28, New York, NY, USA, 1993. ACM Press.
15. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In SOSP '07: Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles, pages 205-220, New York, NY, USA, 2007. ACM.
16. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37(5):29-43, 2003.
17. A. Haeberlen, A. Mislove, and P. Druschel. Glacier: highly durable, decentralized storage despite massive correlated failures. In NSDI'05: Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, pages 143-158, Berkeley, CA, USA, 2005. USENIX Association.
18. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Trans. Comput. Syst., 6(1):51-81, 1988. (Pubitemid 18574134)
19. J. J. Kistler and M. Satyanarayanan. Disconnected operation in the Coda file system. ACM Trans. Comput. Syst., 10(1):3-25, 1992.
20. L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133-169, 1998.
21. E. K. Lee and C. A. Thekkath. Petal: distributed virtual disks. SIGOPS Oper. Syst. Rev., 30(5):84-92, 1996.
22. B. Liskov, S. Ghemawat, R. Gruber, P. Johnson, and L. Shrira. Replication in the Harp file system. SIGOPS Oper. Syst. Rev., 25(5):226-238, 1991.
23. J. MacCormick, N. Murphy, M. Najork, C. A. Thekkath, and L. Zhou. Boxwood: abstractions as the foundation for storage infrastructure. In OSDI'04: Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, pages 8-8, Berkeley, CA, USA, 2004. USENIX Association.
24. M. Mackall. Mercurial revision control system. http://mercurial.selenic. com/.
25. J. N. Matthews. Improving file system performance with adaptive methods. PhD thesis, 1999. Co-Chair-Anderson, Thomas E. and Co-Chair-Hellerstein, Joseph M.
26. D. Mazières and D. Shasha. Building secure file systems out of byzantine storage. In PODC '02: Proceedings of the twenty-first annual symposium on Principles of distributed computing, pages 108{117, New York, NY, USA, 2002. ACM.
27. M. K. McKusick and S. Quinlan. Gfs: Evolution on fast-forward. Queue, 7(7):10-20, 2009.
28. D. T. Meyer, G. Aggarwal, B. Cully, G. Lefebvre, M. J. Feeley, N. C. Hutchinson, and A. Warfield. Parallax: virtual disks for virtual machines. SIGOPS Oper. Syst. Rev., 42(4):41-54, 2008.
29. M. Naor and U. Wieder. Scalable and dynamic quorum systems. In PODC '03: Proceedings of the twenty-second annual symposium on Principles of distributed computing, pages 114-122, New York, NY, USA, 2003. ACM.
30. M. Naor and A. Wool. Access control and signatures via quorum secret sharing. Parallel and Distributed Systems, IEEE Transactions on, 9(9):909-922, Sep 1998.
31. D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, and A. Rowstron. Migrating server storage to SSDs: analysis of tradeoffs. In EuroSys '09: Proceedings of the 4th ACM European conference on Computer systems, pages 145-158, New York, NY, USA, 2009. ACM.
32. M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proceedings of the 2005 Annual USENIX Technical Conference, April 2005.
33. B. M. Oki and B. H. Liskov. Viewstamped replication: A new primary copy method to support highly-available distributed systems. In PODC '88: Proceedings of the seventh annual ACM Symposium on Principles of distributed computing, pages 8-17, New York, NY, USA, 1988. ACM.
34. A. Phanishayee, E. Krevat, V. Vasudevan, D. G. Andersen, G. R. Ganger, G. A. Gibson, and S. Seshan. Measurement and analysis of tcp throughput collapse in cluster-based storage systems. In FAST'08: Proceedings of the 6th USENIX Conference on File and Storage Technologies, pages 1-14, Berkeley, CA, USA, 2008. USENIX Association.
35. S. Rhea, P. Eaton, D. Geels, H. Weatherspoon, B. Zhao, and J. Kubiatowicz. Pond: The oceanstore prototype. In FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies, pages 1-14, Berkeley, CA, USA, 2003. USENIX Association.
36. M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26-52, 1992.
37. A. Rowstron and P. Druschel. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. SIGOPS Oper. Syst. Rev., 35(5):188-201, 2001.
38. Y. Saito, S. Frolund, A. Veitch, A. Merchant, and S. Spence. FAB: building distributed enterprise disk arrays from commodity components. In ASPLOS-XI: Proceedings of the 11th international conference on Architectural support for programming languages and operating systems, pages 48-58, New York, NY, USA, 2004. ACM.
39. R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, and B. Lyon. Design and Implementation of the Sun Network Filesystem. In Proceedings of the Summer 1985 USENIX Conference, pages 119-130, 1985.
40. F. B. Schneider. Implementing fault-tolerant services using the state machine approach: a tutorial. ACM Comput. Surv., 22(4):299-319, 1990.
41. A. Singh, P. Fonseca, P. Kuznetsov, R. Rodrigues, and P. Maniatis. Zeno: eventually consistent byzantine-fault tolerance. In NSDI'09: Proceedings of the 6th USENIX symposium on Networked systems design and implementation, pages 169-184, Berkeley, CA, USA, 2009. USENIX Association.
42. J. Terrace and M. J. Freedman. Object storage on CRAQ: High-throughput chain replication for read-mostly workloads. In Proc. USENIX Annual Technical Conference, San Diego, CA, 2009.
43. D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conicts in Bayou, a weakly connected replicated storage system. In SOSP '95: Proceedings of the fifteenth ACM symposium on Operating systems principles, pages 172-182, New York, NY, USA, 1995. ACM.
44. VMware. VMware High Availability. http://www.vmware.com/pdf/hadatasheet. pdf, 2009.
45. VMware. VMware VMFS. http://www.vmware.com/pdf/vmfsdatasheet.pdf, 2009.
46. W. Wang, Y. Zhao, and R. Bunt. Hylog: A high performance approach to managing disk layout. In FAST '04: Proceedings of the 3rd USENIX Conference on File and Storage Technologies, pages 145-158, Berkeley, CA, USA, 2004. USENIX Association.
47. H. Weatherspoon, P. Eaton, B.-G. Chun, and J. Kubiatowicz. Antiquity: exploiting a secure log for wide-area distributed storage. In EuroSys '07: Proceedings of the 2007 EuroSys conference, pages 371-384, New York, NY, USA, 2007. ACM Press.
48. S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn. Ceph: a scalable, high-performance distributed file system. In OSDI '06: Proceedings of the 7th symposium on Operating systems design and implementation, pages 307-320, Berkeley, CA, USA, 2006. USENIX Association.