HAT, not CAP: Towards highly available transactions

14th Workshop on Hot Topics in Operating Systems, HotOS 2013

Volumn , Issue , 2013, Pages

  Bailis, Peter ^a   Fekete, Alan ^b   Ghodsi, Ali ^a,c   Hellerstein, Joseph M ^a   Stoica, Ion ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF SYDNEY   (Australia)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

HIGHLY AVAILABLE SYSTEMS; LOW LATENCY; WRITE OPERATIONS;

SEMANTICS;

EID: 84889691105     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (64)

1. Actian documentation: Isolation levels. http://docs.actian.com/ingres/10s/database-administrator-guide/ 2349-isolation-levels, January 2013.
2. Aerospike: Home > Performance > ACID. http://www.aerospike.com/performance/acid-compliance/, January 2013. Note: “multi-key operations may not be serialized with each other”; single-key immediate consistency roughly translates to Read Committed isolation.
3. Akiban Documentation: Transactions. http://www.akiban.com/ak-docs/admin/persistit/ Transactions.html, January 2013.
4. Clustrix System Administrator's Guide CLX 4100 Series, Version 4.1. http://www.clustrix.com/Portals/146389/docs/Clustrix_System_Administrators_ Guide_v4.1.pdf, January 2013.
5. DB2 10 for z/OS: Choosing an ISOLATION option. http://publib.boulder.ibm.com/infocenter/dzichelp/v2r2/index.jsp?topic=%2Fcom. ibm.db2z10.doc.perf%2Fsrc%2Ftpc%2Fdb2z_ chooseisolationoption.htm, January 2013. Note: DB2's “Repeatable Read” isolation matches serializability-the only instance in which we have found a stronger level than named.
6. Getting Started with Berkeley DB, Java Edition Transaction Processing: Isolation. http://docs.oracle.com/cd/E17277_02/html/ TransactionGettingStarted/isolation.html, January 2013.
7. Getting Started with Berkeley DB, Transaction Processing: Isolation. http://docs.oracle.com/cd/E17076_02/html/gsg_txn/JAVA/isolation.html, January 2013.
8. Greenplum database 4.2 database administrator guide rev: A01. http://media.gpadmin.me/wp-content/uploads/2012/11/GPDBAGuide.pdf, January 2013.
9. IBM Informix 11.50: SET ISOLATION statement. http://publib.boulder.ibm.com/infocenter/idshelp/v115/index.jsp?topic=%2Fcom.ibm. sqls.doc%2Fids_sqs_1161.htm, January 2013.
10. MemSQL 1b documentation: Transactions and isolation levels. http://developers.memsql.com/docs/1b/isolationlevel.html, January 2013.
11. Microsoft SQL Server 2012: SET TRANSACTION ISOLATION LEVEL (Transact-SQL). http://msdn.microsoft.com/en-us/library/ms173763.aspx, January 2013.
12. MySQL 5.6 Reference Manual: 13.3.6 SET TRANSACTION Syntax. http://dev.mysql.com/doc/refman/5.0/en/set-transaction.html, January 2013.
13. NuoDB: Transactions and Isolation Levels. http://www.nuodb.com/nuodb-online-documentation/ references/r_Lang/r_Transactions.html, January 2013.
14. Oracle Database Concepts 11g Release 1 (11.1): 13 Data Concurrency and Consistency. http://docs.oracle.com/cd/B28359_01/server.111/ b28318/consist.htm#autoId8, January 2013. Note: several sources note confirm that Oracle's “serializable isolation” is actually Snapshot Isolation [38, 49].
15. PostgreSQL 9.2.2 Documentation: 13.2. Transaction Isolation. http://www.postgresql.org/docs/9.2/static/transaction-iso.html, January 2013.
16. SAP HANA Reference: SET TRANSACTION. http://help.sap.com/hana/html/sql_set_transaction.html, January 2013. Note: the described “'SERIALIZABLE” isolation level is actually a description of Snapshot Implementation, like [14].
17. ScaleDB Cluster Manual: For versions 1,02 and higher. http://www.scaledb.com/pdfs/ScaleDB_Cluster_Manual.pdf, 23 December 2012.
18. The VoltDB FAQ. http://voltdb.com/dig-deeper/faq.php, also verified with VoltDB stakeholders, January 2013.
19. D. J. Abadi. Consistency tradeoffs in modern distributed database system design: CAP is only part of the story. IEEE Computer, 45(2), 2012.
20. A. Adya. Weak consistency: a generalized theory and optimistic implementations for distributed transactions. PhD thesis, Massachusetts Institute of Technology, 1999.
21. P. Alvaro, N. Conway, J. M. Hellerstein, and W. R. Marczak. Consistency analysis in Bloom: a CALM and collected approach. In CIDR 2011.
22. ISO/IEC 9075-2:2011 Information technology - Database languages - SQL - Part 2: Foundation (SQL/Foundation).
23. P. Bailis, A. Ghodsi, J. M. Hellerstein, and I. Stoica. Bolton causal consistency. In SIGMOD 2013.
24. J. Baker, C. Bond, J. Corbett, J. Furman, A. Khorlin, J. Larson, J. Léon, Y. Li, A. Lloyd, and V. Yushprakh. Megastore: Providing scalable, highly available storage for interactive services. In CIDR 2011, pages 223-234.
25. Barrkel. Hacker News comment thread. https://news.ycombinator.com/item?id=1163140, 2009. (Anecdotal but unequivocal.).
26. H. Berenson, P. Bernstein, J. Gray, J. Melton, E. O'Neil, and P. O'Neil. A critique of ansi sql isolation levels. In SIGMOD 1995.
27. P. Bernstein and N. Goodman. Concurrency control in distributed database systems. ACM Computing Surveys (CSUR), 13(2):185-221, 1981.
28. P. Bernstein, V. Hadzilacos, and N. Goodman. Concurrency control and recovery in database systems, volume 370. Addison-wesley New York, 1987.
29. S. Bykov, A. Geller, G. Kliot, J. R. Larus, R. Pandya, and J. Thelin. Orleans: cloud computing for everyone. In SOCC 2011.
30. R. Cattell. Scalable SQL and NoSQL data stores. SIGMOD Rec., 39(4):12-27, May 2011.
31. G. Clarke. The Register: NoSQL's CAP theorem busters: We don't drop ACID. http://www.theregister.co.uk/2012/11/22/ foundationdb_fear_of_cap_theorem/, November 2012.
32. B. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. Pnuts: Yahoo!'s hosted data serving platform. In VLDB 2008.
33. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's globally-distributed database. In OSDI 2012.
34. J. Cowling and B. Liskov. Granola: low-overhead distributed transaction coordination. In USENIX ATC 2012.
35. S. Das, D. Agrawal, and A. El Abbadi. G-store: a scalable data store for transactional multi key access in the cloud. In SOCC 2010, pages 163-174.
36. S. Davidson, H. Garcia-Molina, and D. Skeen. Consistency in partitioned networks. ACM Computing Surveys, 17(3):341-370, 1985.
37. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In SOSP 2007.
38. A. Fekete, D. Liarokapis, E. O'Neil, P. O'Neil, and D. Shasha. Making snapshot isolation serializable. ACM Trans. Database Syst., 30(2):492-528, June 2005.
39. D. Florescu and D. Kossmann. Rethinking cost and performance of database systems. ACM SIGMOD Record, 38(1):43-48, 2009.
40. A. Fox and E. A. Brewer. Harvest, yield, and scalable tolerant systems. In HotOS 1999.
41. H. Garcia-Molina and K. Salem. Sagas. In SIGMOD 1987.
42. S. Gilbert and N. Lynch. Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services. ACM SIGACT News, 33(2):51-59, 2002.
43. J. Gray, R. Lorie, G. Putzolu, and I. Traiger. Granularity of locks and degrees of consistency in a shared data base. Technical report, IBM Research Division, 1976.
44. T. Haerder and A. Reuter. Principles of transaction-oriented database recovery. ACM Computing Surveys (CSUR), 15(4):287-317, 1983.
45. P. Helland. Life beyond distributed transactions: an apostate's opinion. In CIDR 2007.
46. M. P. Herlihy and J. M. Wing. Linearizability: a correctness condition for concurrent objects. ACM Trans. Program. Lang. Syst., 12(3):463-492, July 1990.
47. T. Kraska. Building Database Applications in the Cloud. PhD thesis, 2010.
48. T. Kraska, G. Pang, M. Franklin, and S. Madden. Mdcc: Multi-data center consistency. In Eurosys 2013.
49. T. Kyte. Expert Oracle Database Architecture: Oracle Database 9i, 10g, and 11g Programming Techniques and Solutions. Apress, 2 edition, 2010. p. 253.
50. C. Li, D. Porto, A. Clement, J. Gehrke, N. Preguiça, and R. Rodrigues. Making geo-replicated systems fast as possible, consistent when necessary. In OSDI 2012.
51. W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Don't settle for eventual: scalable causal consistency for wide-area storage with COPS. In SOSP 2011.
52. W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Stronger semantics for low-latency geo-replicated storage. In NSDI 2013.
53. P. E. O'Neil. The escrow transactional method. ACM TODS, 11(4):405-430.
54. Oracle Database Administrator's Guide 11g Release 2 (11.2): Managing Read Consistency. http://docs.oracle.com/cd/E11882_01/server.112/e25789/consist.htm.
55. F. Pedone and R. Guerraoui. On transaction liveness in replicated databases. In Pacific Rim International Symposium on Fault-Tolerant Systems, pages 104-109. IEEE, 1997.
56. D. Pritchett. BASE: An Acid Alternative. Queue, 6(3):48-55, 2008.
57. Y. Saito and M. Shapiro. Optimistic replication. ACM Comput. Surv., 37(1), Mar. 2005.
58. S. Sakr, A. Liu, D. M. Batista, and M. Alomari. A survey of large scale data management approaches in cloud environments. IEEE Communications Surveys & Tutorials, 13(3):311-336.
59. Y. Sovran, R. Power, M. K. Aguilera, and J. Li. Transactional storage for geo-replicated systems. In SOSP, pages 385-400, 2011.
60. D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conflicts in bayou, a weakly connected replicated storage system. In SOSP 1995.
61. A. Thomson, T. Diamond, S. Weng, K. Ren, P. Shao, and D. Abadi. Calvin: Fast distributed transactions for partitioned database systems. In SIGMOD 2012.
62. W. Vogels. Eventually consistent. Commun. ACM, 52(1):40-44, Jan. 2009.
63. H. Yu and A. Vahdat. Design and evaluation of a conitbased continuous consistency model for replicated services. ACM TOCS, 20(3):239-282, 2002.
64. M. Zawirski, A. Bieniusa, V. Balegas, N. Preguica, S. Duarte, M. Shapiro, and C. Baquero. Geo-replication all the way to the edge. Personal communication and draft under submission (http://asc.di.fct.unl.pt/~nmp/swiftcomp/swiftcloud.html).