DARE: High-performance state machine replication on RDMA networks

HPDC 2015 - Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing

Volumn , Issue , 2015, Pages 107-118

  Poke, Marius ^a   Hoefler, Torsten ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Performance; RDMA; Reliability; Replicated State Machine

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; LARGE SCALE SYSTEMS; RELIABILITY;

ACCESS MANAGEMENT; DATA CENTER NETWORKS; PERFORMANCE; PERFORMANCE STATES; RDMA; REMOTE DIRECT MEMORY ACCESS; SINGLE COMPONENTS; STATE MACHINE;

MEMORY ARCHITECTURE;

EID: 84966646657     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2749246.2749267     Document Type: Conference Paper

References (41)

1. M. K. Aguilera, W. Chen, and S. Toueg. Failure detection and consensus in the crash-recovery model. Distributed Computing, 13(2):99-125, 2000.
2. A. Alexandrov, M. F. Ionescu, K. E. Schauser, and C. Scheiman. LogGP: Incorporating Long Messages into the LogP Model|One Step Closer Towards a Realistic Model for Parallel Computation. In Proc. 7th Annual ACM Symposium on Parallel Algorithms and Architectures, SPAA '95, pages 95-105, New York, NY, USA, 1995. ACM.
3. M. Balakrishnan, D. Malkhi, V. Prabhakaran, T. Wobber, M. Wei, and J. D. Davis. Corfu: A shared log design for ash clusters. In Proc. 9th USENIX Conference on Networked Systems Design and Implementation, NSDI'12, pages 1-1, Berkeley, CA, USA, 2012.
4. M. Burrows. The Chubby Lock Service for Loosely-coupled Distributed Systems. In Proc. 7th Symposium on Operating Systems Design and Implementation, OSDI '06, pages 335-350, Berkeley, CA, USA, 2006.
5. M. Castro and B. Liskov. Practical Byzantine Fault Tolerance. In Proc. 3rd Symposium on Operating Systems Design and Implementation, OSDI '99, pages 173-186, Berkeley, CA, USA, 1999.
6. T. D. Chandra and S. Toueg. Unreliable Failure Detectors for Reliable Distributed Systems. J. ACM, 43(2):225-267, Mar. 1996.
7. P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: High-performance, Reliable Secondary Storage. ACM Comput. Surv., 26(2):145-185, June 1994.
8. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking Cloud Serving Systems with YCSB. In Proc. 1st ACM Symposium on Cloud Computing, SoCC '10, pages 143-154, New York, NY, USA, 2010. ACM.
9. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's Globally-distributed Database. In Proc. 10th USENIX Conference on Operating Systems Design and Implementation, OSDI'12, pages 251-264, Berkeley, CA, USA, 2012.
10. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Commun. ACM, 51(1):107-113, Jan. 2008.
11. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's Highly Available Key-value Store. SIGOPS Oper. Syst. Rev., 41(6):205-220, Oct. 2007.
12. J. Domke, T. Hoeer, and S. Matsuoka. Fail-in-place Network Design: Interaction Between Topology, Routing Algorithm and Failures. In Proc. International Conference for High Performance Computing, Networking, Storage and Analysis, SC '14, pages 597-608, Piscataway, NJ, USA, 2014. IEEE Press.
13. A. Dragojevic, D. Narayanan, O. Hodson, and M. Castro. FaRM: Fast Remote Memory. In Proc. 11th USENIX Conference on Networked Systems Design and Implementation, NSDI'14, pages 401-414, Berkeley, CA, USA, 2014.
14. M. J. Fischer, N. A. Lynch, and M. S. Paterson. Impossibility of Distributed Consensus with One Faulty Process. J. ACM, 32(2):374-382, Apr. 1985.
15. E. Gafni and L. Lamport. Disk Paxos. Distrib. Comput., 16(1):1-20, Feb. 2003.
16. R. Gerstenberger, M. Besta, and T. Hoeer. Enabling Highly-scalable Remote Memory Access Programming with MPI-3 One Sided. In Proc. International Conference on High Performance Computing, Networking, Storage and Analysis, SC '13, pages 53:1-53:12, New York, NY, USA, 2013. ACM.
17. Global Scientific Information and Computing Center. Failure History of TSUBAME2.0 and TSUBAME2.5, 2014.
18. E. Heien, D. Kondo, A. Gainaru, D. LaPine, B. Kramer, and F. Cappello. Modeling and Tolerating Heterogeneous Failures in Large Parallel Systems. In Proc. of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC '11, pages 45:1-45:11, New York, NY, USA, 2011. ACM.
19. M. P. Herlihy and J. M. Wing. Linearizability: A Correctness Condition for Concurrent Objects. ACM Trans. Program. Lang. Syst., 12(3):463-492, July 1990.
20. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed. ZooKeeper: Wait-free Coordination for Internet-scale Systems. In Proc. 2010 USENIX Conference on USENIX Annual Technical Conference, USENIX ATC'10, pages 11-11, Berkeley, CA, USA, 2010.
21. InfiniBand Trade Association. InfiniBand Architecture Specification: Volume 1, Release 1.2.1. 2007
22. J. Jose, H. Subramoni, M. Luo, M. Zhang, J. Huang, M. Wasi-ur Rahman, N. S. Islam, X. Ouyang, H. Wang, S. Sur, and D. K. Panda. Memcached Design on High Performance RDMA Capable Interconnects. In Proc. 2011 International Conference on Parallel Processing, ICPP '11, pages 743-752, Washington, DC, USA, 2011.
23. J. Kirsch and Y. Amir. Paxos for System Builders: An Overview. In Proc. 2nd Workshop on Large-Scale Distributed Systems and Middleware, LADIS '08, pages 3:1-3:6, New York, NY, USA, 2008. ACM.
24. L. Lamport. The implementation of reliable distributed multiprocess systems. Computer Networks (1976), 2(2):95-114, 1978.
25. L. Lamport. The Part-time Parliament. ACM Trans. Comput. Syst., 16(2):133-169, May 1998.
26. L. Lamport. Paxos Made Simple. SIGACT News, 32(4):51-58, Dec. 2001.
27. L. Lamport. Generalized Consensus and Paxos, 2005.
28. T. Li, X. Zhou, K. Brandstatter, D. Zhao, K. Wang, A. Rajendran, Z. Zhang, and I. Raicu. ZHT: A Light-Weight Reliable Persistent Dynamic Scalable Zero-Hop Distributed Hash Table. In Proc. 2013 IEEE 27th International Symposium on Parallel and Distributed Processing, IPDPS '13, pages 775-787, Washington, DC, USA, 2013.
29. B. Liskov and J. Cowling. Viewstamped Replication Revisited. Technical Report MIT-CSAIL-TR-2012-021, MIT, July 2012.
30. Y. Mao, F. P. Junqueira, and K. Marzullo. Mencius: Building Efficient Replicated State Machines for WANs. In Proc. 8th USENIX Conference on Operating Systems Design and Implementation, OSDI'08, pages 369-384, Berkeley, CA, USA, 2008.
31. C. D. Martino, F. Baccanico, Z. Kalbarczyk, R. Iyer, J. Fullop, and W. Kramer. Lessons Learned From the Analysis of System Failures at Petascale: The Case of Blue Waters. Jun 2014.
32. C. Mitchell, Y. Geng, and J. Li. Using One-sided RDMA Reads to Build a Fast, CPU-efficient Key-value Store. In Proc. 2013 USENIX Conference on Annual Technical Conference, USENIX ATC'13, pages 103-114, Berkeley, CA, USA, 2013.
33. A. Moody, G. Bronevetsky, K. Mohror, and B. R. d. Supinski. Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System. In Proc. 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC '10, pages 1-11, Washington, DC, USA, 2010.
34. I. Moraru, D. G. Andersen, and M. Kaminsky. There is More Consensus in Egalitarian Parliaments. In Proc. 24th ACM Symposium on Operating Systems Principles, SOSP '13, pages 358-372, New York, NY, USA, 2013. ACM.
35. D. Ongaro and J. Ousterhout. In Search of an Understandable Consensus Algorithm. In 2014 USENIX Annual Technical Conference, USENIX ATC'14, Philadelphia, PA, June 2014.
36. E. Pinheiro, W.-D. Weber, and L. A. Barroso. Failure Trends in a Large Disk Drive Population. In Proc. 5th USENIX Conference on File and Storage Technologies, FAST '07, pages 2-2, Berkeley, CA, USA, 2007.
37. J. S. Plank, A. L. Buchsbaum, and B. T. Vander Zanden. Minimum Density RAID-6 Codes. Trans. Storage, 6(4):16:1-16:22, June 2011.
38. M. Poke and T. Hoeer. DARE: High-Performance State Machine Replication on RDMA Networks (Extended Version). http://spcl.inf.ethz.ch/Research/Parallel-Programming/DARE, 2015.
39. K. Sato, N. Maruyama, K. Mohror, A. Moody, T. Gamblin, B. R. de Supinski, and S. Matsuoka. Design and Modeling of a Non-blocking Checkpointing System. In Proc. International Conference on High Performance Computing, Networking, Storage and Analysis, SC '12, pages 19:1-19:10, Los Alamitos, CA, USA, 2012.
40. F. B. Schneider. Implementing Fault-tolerant Services Using the State Machine Approach: A Tutorial. ACM Comput. Surv., 22(4):299-319, Dec. 1990.
41. P. Unterbrunner, G. Alonso, and D. Kossmann. High Availability, Elasticity, and Strong Consistency for Massively Parallel Scans over Relational Data. The VLDB Journal, 23(4):627-652, Aug. 2014.