Take me to your leader! Online optimization of distributed storage configurations

Proceedings of the VLDB Endowment

Volumn 8, Issue 12 12, 2015, Pages 1490-1501

  Sharov, Artyom ^a   Shraer, Alexander ^a   Merchant, Arif ^a   Stokely, Murray ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED STORAGE; DISTRIBUTED STORAGE SYSTEM; ONLINE OPTIMIZATION; OPTIMISATIONS; OPTIMIZATION FRAMEWORK; REPLICA LOCATION; REPLICATION PROTOCOL; RUNTIMES; SYSTEM ADMINISTRATORS; TRIAL AND ERROR;

EID: 84953864402     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2824032.2824047     Document Type: Chapter

References (29)

1. Amazon dynamodb. http://aws.amazon.com/dynamodb/.
2. Amazon simpledb. http://aws.amazon.com/simpledb/.
3. Basho riak. http://basho.com/riak.
4. Mongodb. http://www.mongodb.org/.
5. Inclusion exclusion principle. http://en.wikipedia.org/wiki/Inclusion-exclusion_principle#In_probability, Retrieved February 10, 2015.
6. Zookeeper feature request. https://issues.apache.org/jira/browse/ZOOKEEPER-2027, Retrieved February 10, 2015.
7. S. Agarwal et al. Volley: Automated data placement for geo-distributed cloud services. USENIX NSDI, Berkeley, CA, USA, 2010.
8. M. K. Aguilera, I. Keidar, D. Malkhi, J.-P. Martin, and A. Shraer. Reconfiguring replicated atomic storage: A tutorial. Bul. of EATCS, 102, 2010.
9. M. S. Ardekani and D. B. Terry. A self-configurable geo-replicated cloud storage system. USENIX OSDI, pages 367-381, Oct. 2014.
10. J. Baker et al. Megastore: Providing scalable, highly available storage for interactive services. CIDR, 2011.
11. M. Balakrishnan, D. Malkhi, J. D. Davis, V. Prabhakaran, M. Wei, and T. Wobber. CORFU: A distributed shared log. ACM Trans. Comput. Syst., 31(4):10, 2013.
12. K. Birman, D. Malkhi, and R. van Renesse. Virtually synchronous methodology for dynamic service replication. Technical Report 151, MSR, Nov. 2010.
13. M. Burrows. The chubby lock service for loosely-coupled distributed systems. In OSDI, pages 335-350, 2006.
14. S. Bykov, A. Geller, G. Kliot, J. R. Larus, R. Pandya, and J. Thelin. Orleans: cloud computing for everyone. In ACM SOCC, 2011.
15. B. Cooper et al. PNUTS: Yahoo!'s hosted data serving platform. Proc. VLDB Endow., 1(2), Aug. 2008.
16. J. Corbett et al. Spanner: Google's globally distributed database. ACM Trans. Comput. Syst., 31(3), Aug. 2013.
17. R. Escriva, B. Wong, and E. G. Sirer. Hyperdex: A distributed, searchable key-value store. In ACM SIGCOMM, 2012.
18. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In SOSP, pages 29-43, 2003.
19. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed. ZooKeeper: Wait-free coordination for internet-scale systems. In USENIX ATC, 2010.
20. S. Kadambi et al. Where in the world is my data? PVLDB, 4(11):1040-1050, 2011.
21. L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133-169, 1998.
22. L. Lamport, D. Malkhi, and L. Zhou. Reconfiguring a state machine. SIGACT News, 41(1):63-73, Mar. 2010.
23. J. Lorch et al. The smart way to migrate replicated stateful services. In EuroSys, 2006.
24. J. MacCormick et al. Boxwood: Abstractions as the foundation for storage infrastructure. In OSDI, 2004.
25. A. Shraer, B. Reed, D. Malkhi, and F. Junqueira. Dynamic reconfiguration of primary/backup clusters. USENIX ATC, 2012.
26. M. Stonebraker and A. Weisberg. The voltdb main memory DBMS. IEEE Data Eng. Bull., 36(2), 2013.
27. N. Tran, M. K. Aguilera, and M. Balakrishnan. Online migration for geo-distributed storage systems. USENIX ATC, pages 15-15, Berkeley, CA, USA, 2011.
28. O. Wolfson, S. Jajodia, and Y. Huang. An adaptive data replication algorithm. ACM Trans. Database Syst., 22(2):255-314, June 1997.
29. Z. Yin et al. An empirical study on configuration errors in commercial and open source systems. In SOSP, 2011.