Benchmarking eventual consistency: Lessons learned from long-term experimental studies

Proceedings - 2014 IEEE International Conference on Cloud Engineering, IC2E 2014

Volumn , Issue , 2014, Pages 47-56

  Bermbach, David ^a   Tai, Stefan ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

STORAGE AS A SERVICE (STAAS);

APPLICATION DEVELOPMENT; CLOUD STORAGE SERVICES; COST-EFFICIENT; EVENTUAL CONSISTENCY; LONG-TERM EXPERIMENTS; STORAGE SYSTEMS; SYSTEM IMPLEMENTATION;

BENCHMARKING;

EID: 84908566392     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IC2E.2014.37     Document Type: Conference Paper

References (35)

1. S. Gilbert and N. Lynch, "Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services," ACM SIGACT News, vol. 33, no. 2, p. 59, 2002.
2. D. Abadi, "Consistency tradeoffs in modern distributed database system design: Cap is only part of the story," Computer, vol. 45, no. 2, pp. 37-42, feb. 2012.
3. G. Young, "Quick thoughts on eventual consistency," http://codebetter. com/gregyoung/2010/04/14/quick-thoughts-on-eventual-consistency (accessed Jun 21,2013), 2010.
4. D. Terry, "The impact of eventual consistency on application developers," http://littlemindslargeclouds.wordpress.com/2013/09/27/the-impact-of-eventual-consistency-on-application-developers/(accessed Jan 13,2014), 2013.
5. D. Bermbach, J. Kuhlenkamp, B. Derre, M. Klems, and S. Tai, "A middleware guaranteeing client-centric consistency on top of eventually consistent datastores," in International Conference on Cloud Engineering (IC2E). IEEE, 2013.
6. B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with ycsb," in Proceedings of the 1st ACM symposium on Cloud computing. ACM, 2010, pp. 143-154.
7. D. Bermbach, S. Sakr, and L. Zhao, "Towards comprehensive measurement of consistency guarantees for cloud-hosted data storage services," in Proceedings of the Fifth TPC Technology Conference on Performance Evaluation & Benchmarking (TPCTC 2013). Springer, 2013.
8. D. Bermbach and S. Tai, "Eventual consistency: How soon is eventual? an evaluation of amazon s3's consistency behavior," in Proceedings of the 6th Workshop on Middleware for Service Oriented Computing. ACM, 2011, p. 1.
9. H. Wada, A. Fekete, L. Zhao, K. Lee, and A. Liu, "Data consistency properties and the trade offs in commercial cloud storages: the consumers' perspective," in 5th biennial Conference on Innovative Data Systems Research, CIDR, vol. 11, 2011.
10. E. Anderson, X. Li, M. Shah, J. Tucek, and J. Wylie, "What consistency does your key-value store actually provide," in Proceedings of the Sixth Workshop on Hot Topics in System Dependability (HotDep), 2010.
11. W. Golab, X. Li, and M. Shah, "Analyzing consistency properties for fun and profit," in Proceedings of the 30th annual ACM SIGACT-SIGOPS symposium on Principles of distributed computing. ACM, 2011, pp. 197-206.
12. S. Patil, M. Polte, K. Ren, W. Tantisiriroj, L. Xiao, J. Lopez, G. Gibson, A. Fuchs, and B. Rinaldi, "Ycsb++: benchmarking and performance debugging advanced features in scalable table stores," in Proceedings of the 2nd ACM Symposium on Cloud Computing. ACM, 2011, p. 9.
13. M. Rahman, W. Golab, A. AuYoung, K. Keeton, and J. Wylie, "Toward a principled framework for benchmarking consistency," in Proceedings of the 8th Workshop on Hot Topics in System Dependability, 2012.
14. P. Bailis, S. Venkataraman, M. Franklin, J. Hellerstein, and I. Stoica, "Probabilistically bounded staleness for practical partial quorums," PVLDB, vol. 5, no. 8, 2012.
15. A. Popescu, "Consistency in the acid and cap perspectives," http://nosql.mypopescu.com/post/4373459618/consistency-in-the-acid-and-cap-perspectives (accessed Aug 1,2013), 2011.
16. D. Bermbach and J. Kuhlenkamp, "Consistency in distributed storage systems: An overview of models, metrics and measurement approaches," in Proceedings of the International Conference on Networked Systems (NETYS). Springer, 2013.
17. A. S. Tanenbaum and M. V. Steen, Distributed Systems-Principles and Paradigms, 2nd ed. Upper Saddle River, NJ: Pearson Education, 2007.
18. W. Vogels, "Eventually consistent," Queue, vol. 6, pp. 14-19, October 2008. [Online]. Available: http://doi.acm.org/10.1145/1466443.1466448
19. D. B. Terry, A. J. Demers, K. Petersen, M. J. Spreitzer, M. M. Theimer, and B. B. Welch, "Session guarantees for weakly consistent replicated data," in Parallel and Distributed Information Systems, 1994., Proceedings of the Third International Conference on. IEEE, 1994, pp. 140-149.
20. R. Fischer, C. Janiesch, J. Strach, N. Bieber, W. Zink, and S. Tai, "Eine Bestandsaufnahme von Standardisierungspotentialen und-lucken im Cloud Computing," in Proceedings of the 11. Internationale Tagung Wirtschaftsinformatik (WI), 2013, pp. 1359-1373.
21. T. Kurze, M. Klems, D. Bermbach, A. Lenk, S. Tai, and M. Kunze, "Cloud federation," in CLOUD COMPUTING 2011, The Second International Conference on Cloud Computing, GRIDs, and Virtualization, 2011, pp. 32-38.
22. D. Bermbach, T. Kurze, and S. Tai, "Cloud federation: Effects of federated compute resources on quality of service and cost," in International Conference on Cloud Engineering (IC2E). IEEE, 2013.
23. D. Bermbach, M. Klems, S. Tai, and M. Menzel, "Metastorage: A federated cloud storage system to manage consistency-latency tradeoffs," in Cloud Computing (CLOUD), 2011 IEEE International Conference on. IEEE, 2011, pp. 452-459.
24. K. Bowers, A. Juels, and A. Oprea, "HAIL: A high-availability and integrity layer for cloud storage," in Proceedings of the 16th ACM conference on Computer and communications security. ACM, 2009, pp. 187-198.
25. H. Abu-Libdeh, L. Princehouse, and H. Weatherspoon, "RACS: a case for cloud storage diversity," in Proceedings of the 1st ACM symposium on Cloud computing. ACM, 2010, pp. 229-240.
26. Broberg, Buyya, and Tari, "Creating a Cloud Storage Mashup for High Performance, Low Cost Content Delivery," in Service-Oriented Computing-ICSOC 2008 Workshops. Springer, 2009, pp. 178-183.
27. J. Broberg, R. Buyya, and Z. Tari, "MetaCDN: Harnessing 'Storage Clouds' for high performance content delivery," Journal of Network and Computer Applications, vol. 32, no. 5, pp. 1012-1022, 2009.
28. M. Klems, D. Bermbach, and R. Weinert, "A runtime quality measurement framework for cloud database service systems," in Proceedings of the 8th International Conference on the Quality of Information and Communications Technology. Springer, 2012, Inproceedings, to appear.
29. A. Lakshman and P. Malik, "Cassandra: a decentralized structured storage system," ACM SIGOPS Operating Systems Review, vol. 44, no. 2, pp. 35-40, 2010.
30. L. Lamport, "On interprocess communication," Distributed computing, vol. 1, no. 2, pp. 86-101, 1986.
31. K. Zellag and B. Kemme, "How Consistent is your Cloud Application?" in SoCC, 2012.
32. S. Patil, M. Polte, K. Ren, W. Tantisiriroj, L. Xiao, J. Lopez, G. Gibson, A. Fuchs, and B. Rinaldi, "Ycsb++: benchmarking and performance debugging advanced features in scalable table stores," in Proceedings of the 2nd ACM Symposium on Cloud Computing. ACM, 2011, p. 9.
33. P. Bailis, S. Venkataraman, M. Franklin, J. Hellerstein, and I. Stoica, "Probabilistically bounded staleness for practical partial quorums," PVLDB, vol. 5, no. 8, 2012.
34. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, "Dynamo: amazon's highly available key-value store," in Proc. SOSP, 2007.
35. W. Vogels, "Amazon's dynamo," http://www.allthingsdistributed.com/2007/10/amazons dynamo.html (accessed Jan 13,2014), 2007.