Toward a principled framework for benchmarking consistency

Proceedings of the 8th Workshop on Hot Topics in System Dependability, HotDep 2012

Volumn , Issue , 2012, Pages

  Rahman, Muntasir Raihan ^a   Golab, Wojciech ^a   Young, Alvin Au ^a   Keeton, Kimberly ^a   Wylie, Jay J ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING TECHNIQUES; EVENTUAL CONSISTENCY; KEY-VALUE STORAGES; PARTITION TOLERANCES; PATTERN OF FAILURES; PROOF OF CONCEPT; STATE OF THE ART; SYSTEM UNDER TEST;

BENCHMARKING;

EID: 84900015095     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Cassandra. http://cassandra.apache.org/.
2. Cassandra Wiki. http://wiki.apache.org/cassandra/API.
3. SimpleDB. http://aws.amazon.com/simpledb/.
4. ABADI, D. Consistency tradeoffs in modern distributed database system design: CAP is only part of the story. IEEE Computer 45, 2 (2012), 37-42.
5. AIYER, A., ALVISI, L., AND BAZZI, R. A. On the availability of non-strict quorum systems. In DISC'05: Proc. of the 19th International Symposium on Distributed Computing (2005), pp. 48-62.
6. BAILIS, P., VENKATARAMAN, S., FRANKLIN, M. J., HELLERSTEIN, J. M., AND STOICA, I. Probabilistically bounded staleness for practical partial quorums. Proc. VLDB Endow. 5, 8 (Apr. 2012), 776-787.
7. BERMBACH, D., AND TAI, S. Eventual consistency: How soon is eventual? An evaluation of Amazon S3's consistency behavior. In MW4SOC'11: Proc. of the 6th Workshop on Middleware for Service Oriented Computing (2011), pp. 1:1-1:6.
8. BREWER, E. A. Towards robust distributed systems (Invited Talk). In PODC'00: 19th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (2000).
9. COOPER, B. F., SILBERSTEIN, A., TAM, E., RAMAKRISHNAN, R., AND SEARS, R. Benchmarking cloud serving systems with YCSB. In SOCC'10: Proc. of the 1st ACM Symposium on Cloud Computing (2010), pp. 143-154.
10. GIBBONS, P. B., AND KORACH, E. Testing shared memories. SIAM J. Comput. 26, 4 (1997), 1208-1244.
11. GOLAB, W., LI, X., AND SHAH, M. A. Analyzing consistency properties for fun and profit. In PODC'11: Proc. of the 30th annual ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (2011), pp. 197-206.
12. HERLIHY, M., AND WING, J. M. Linearizability: A correctness condition for concurrent objects. ACM TOPLAS 12, 3 (July 1990), 463-492.
13. HUNT, P., KONAR, M., JUNQUEIRA, F. P., AND REED, B. ZooKeeper: wait-free coordination for internet-scale systems. In USENIX ATC'10: Proc. of the 2010 USENIX Annual Technical Conference (2010), pp. 11-25.
14. KRISHNAMURTHY, S., SANDERS, W. H., AND CUKIER, M. An adaptive quality of service aware middleware for replicated services. IEEE Transactions on Parallel and Distributed Systems 14 (2003), 1112-1125.
15. LAMPORT, L. On interprocess communication, Part I: Basic formalism. Distributed Computing 1, 2 (1986), 77-85.
16. LLOYD, W., FREEDMAN, M. J., KAMINSKY, M., AND ANDERSEN, D. G. Don't settle for eventual: Scalable causal consistency for wide-area storage with COPS. In SOSP'11: Proc. of the 23rd ACM Symposium on Operating Systems Principles (2011), pp. 401-416.
17. LYNCH, N., AND GILBERT, S. Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News 33, 2 (June 2002), 51-59.
18. PAPADIMITRIOU, C. H. The serializability of concurrent database updates. J. ACM 26, 4 (1979), 631-653.
19. PATIL, S., POLTE, M., REN, K., TANTISIRIROJ, W., XIAO, L., LÓPEZ, J., GIBSON, G., FUCHS, A., AND RINALDI, B. YCSB++: benchmarking and performance debugging advanced features in scalable table stores. In SOCC'11: Proc. of the 2nd ACM Symposium on Cloud Computing (2011), pp. 9:1-9:14.
20. SHAPIRO, M., PREGUIÇA, N. M., BAQUERO, C., AND ZAWIRSKI, M. Conflict-free replicated data types. In SSS'11: Proc. of 13th International Symposium on Stabilization, Safety, and Security of Distributed Systems (2011), pp. 386-400.
21. SHAPIRO, M., PREGUIÇA, N. M., BAQUERO, C., AND ZAWIRSKI, M. Convergent and commutative replicated data types. Bulletin of the EATCS 104 (2011), 67-88.
22. TERRY, D. Replicated data consistency explained through baseball. Tech. Rep. MSR-TR-2011-137, Microsoft Research, October 2011.
23. TERRY, D. B., THEIMER, M. M., PETERSEN, K., DEMERS, A. J., SPREITZER, M. J., AND HAUSER, C. H. Managing update conflicts in Bayou, a weakly connected replicated storage system. In SOSP'95: Proc. of the 15th ACM Symposium on Operating Systems Principles (1995), pp. 172-182.
24. VOGELS, W. Amazon's dynamo. All Things Distributed (October 2007). http://www.allthingsdistributed.com/.
25. VOGELS, W. Eventually consistent. Queue 6, 6 (Oct. 2008), 14-19.
26. WADA, H., FEKETE, A., ZHAO, L., LEE, K., AND LIU, A. Data consistency properties and the trade-offs in commercial cloud storage: the consumers' perspective. In CIDR'11: Proc. of the 5th Biennial Conference on Innovative Data Systems Research (2011), pp. 134-143.
27. YU, H., AND VAHDAT, A. The costs and limits of availability for replicated services. In SOSP'01: Proc. of the 18th ACM Symposium on Operating Systems Principles (2001), pp. 29-42.
28. YU, H., AND VAHDAT, A. Design and evaluation of a conitbased continuous consistency model for replicated services. ACM Trans. Comput. Syst. 20, 3 (Aug. 2002), 239-282.
29. ZHANG, C., AND ZHANG, Z. Trading replication consistency for performance and availability: an adaptive approach. In ICDCS'03: Proc. of the 23rd International Conference on Distributed Computing Systems (2003), pp. 687-695.
30. ZHU, Y., AND WANG, J. Client-centric consistency formalization and verification for system with large-scale distributed data storage. Future Gener. Comput. Syst. 26, 8 (Oct. 2010), 1180-1188.