Rollup: Non-Disruptive Rolling Upgrade with Fast Consensus-Based Dynamic Reconfigurations

IEEE Transactions on Parallel and Distributed Systems

Volumn 27, Issue 9, 2016, Pages 2711-2724

  Gramoli, Vincent ^a   Bass, Len ^b   Fekete, Alan ^a   Sun, Daniel W ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b CSIRO   (Australia)

Author keywords

active replication; cluster management; membership change; online upgrade; Paxos; Quorum

Indexed keywords

DYNAMIC MODELS;

ACTIVE REPLICATION; CLUSTER MANAGEMENT; MEMBERSHIP CHANGE; ONLINE UPGRADE; PAXOS; QUORUM;

RECONFIGURABLE HARDWARE;

EID: 84982161582     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2015.2499772     Document Type: Article

References (55)

1. H. Abu-Libdeh, R. v. Renesse, and Y. Vigfusson, "Leveraging sharding in the design of scalable replication protocols," in Proc. 4th Annu. Symp. Cloud Comput., 2013, pp. 12:1-12:16.
2. M. K. Aguilera, I. Keidar, D. Malkhi, J.-P. Martin, and A. Shraer, "Reconfiguring replicated atomic storage: A tutorial," Bulletin EATCS, vol. 102, pp. 84-108, 2010.
3. M. K. Aguilera, I. Keidar, D. Malkhi, and A. Shraer, "Dynamic atomic storage without consensus," J. ACM, vol. 58, no. 2, pp. 1-32, 2011.
4. C. Arad, T. M. Shafaat, and S. Haridi, "CATS: A linearizable and self-organizing key-value store," in Proc. 4th Annu. Symp. Cloud Comput., 2013, pp. 1-2.
5. H. Attiya, A. Bar-Noy, and D. Dolev, "Sharing memory robustly in message-passing systems," J. ACM, vol 42, no. 1, pp. 124-142, Jan. 1995.
6. K. Birman., Guide to Reliable Distributed Systems - Building High- Assurance Applications and Cloud-Hosted Services. Texts in Computer Science. New York, NY, USA: Springer, 2012.
7. K. Birman, D. Malkhi, and R. v. Renesse, "Virtually synchronous methodology for dynamic service replication," Microsoft Res., Cambridge, MA, USA, Tech. Rep. MSR-TR-2010-151, 2010.
8. E. A. Brewer, "Towards robust distributed systems (abstract)," in Proc. 19th Annu. ACM Symp. Principles Distrib. Comput., 2000, p. 7.
9. S. Y. Cheung, M. H. Ammar, and M. Ahamad, "The grid protocol: A high performance scheme for maintaining replicated data," IEEE Trans. Knowl. Data Eng., vol. 4, no. 6, pp. 582-592, Dec. 1992.
10. G. Chockler, S. Gilbert, V. Gramoli, P. M. Musial, and A. A. Shvartsman, "Reconfigurable distributed storage for dynamic networks," J. Parallel Distrib. Comput., vol. 69, no. 1, pp. 100-116, Jan. 2009.
11. G. Chockler, S. Gilbert, V. Gramoli, P. M. Musial, and A. A. Shvartsman, "Reconfigurable distributed storage for dynamic networks," in Proc. 9th Int. Conf. Principles Distrib. Syst., Apr. 2005, pp. 351-365.
12. N. d. Condorcet. Essai sur l'application de l'analyse à la probabilité des décisions rendues à la pluralité des voix. Imprimerie Royale, 1785.
13. T. Dumitraş and P. Narasimhan, "Why do upgrades fail and what can we do about it?: Toward dependable, online upgrades in enterprise system," in Proc. 10th ACM/IFIP/USENIX Int. Conf. Middleware, 2009, pp. 18:1-18:20.
14. T. Dumitraş, P. Narasimhan, and E. Tilevich, "To upgrade or not to upgrade: Impact of online upgrades across multiple administrative domains," in Proc. ACM Int. Conf. Object Oriented Program. Syst. Lang. Appl., 2010, pp. 865-876.
15. T. Dumitraş, J. Tan, Z. Gho, and P. Narasimhan, "No more hotdependencies: Toward dependency-agnostic online upgrades in distributed systems," in Proc. 3rd workshop Hot Topics Syst. Dependability, 2007.
16. P. Dutta, R. Guerraoui, R. R. Levy, and A. Chakraborty, "How fast can a distributed atomic read be?" in Proc. 23rd Annu. ACM Symp. Principles Distrib. Comput., 2004, pp. 236-245.
17. D. G. Feitelson, E. Frachtenberg, and K. L. Beck, "Development and deployment at Facebook," IEEE Internet Comput., vol. 17, no. 4, pp. 8-17, Jul.-Augt. 2013.
18. M. J. Fischer, N. A. Lynch, and M. S. Paterson, "Impossibility of distributed consensus with one faulty process," J. ACM, vol. 32, no. 2, pp. 374-382, Apr. 1985.
19. S. J. Garland, N. A. Lynch, and M. Vaziri. IOA: A language for specifying, programming, and validating distributed systems, Cambridge, MA, USA: MIT Press, 2001.
20. C. Georgiou, N. Nicolaou, A. C. Russell, and A. A. Shvartsman, "Towards feasible implementations of low-latency multi-writer atomic registers," in Proc. 10th IEEE Int. Symp. Netw. Comput. Appl., Aug. 2011, pp. 75-82.
21. M. Ghosh, W. Wang, G. Holla, and I. Gupta, "Morphus: Supporting online reconfigurations in sharded NoSQL systems," in Proc. IEEE Int. Conf. Auton. Comput., 2015, pp. 1-10.
22. S. Gilbert, N. A. Lynch, and A. A. Shvartsman, "RAMBO II: Rapidly reconfigurable atomic memory for dynamic networks," in Proc. Int. Conf. Dependable Syst. Netw., 2003, pp. 259-268.
23. L. Glendenning, I. Beschastnikh, A. Krishnamurthy, and T. Anderson, "Scalable consistency in Scatter," in Proc. 23rd ACM Symp. Operat. Syst. Principle, 2011, pp. 15-28.
24. V. Gramoli, "RAMBO III: Speeding up the reconfiguration of an atomic memory service," M.S. thesis, Univ. Paris-Sud, Orsay, France, 2004.
25. V. Gramoli, E. Anceaume, and A. Virgillito, "SQUARE: Scalable quorum-based atomic memory with local reconfiguration," in Proc. ACM Symp. Appl. Comput., Mar. 2007, pp. 574-579.
26. V. Hadzilacos and S. Toueg, "A modular approach to the specification and implementation of fault-tolerant broadcasts," Dept. Comput. Sci., Cornell Univ., Ithaca, NY, USA, Tech. Rep. TR94-1425, May 1994.
27. M. Herlihy, "A quorum-consensus replication method for abstract data types," ACM Trans. Comput. Syst., vol. 4, no. 1, pp. 32-53, 1986.
28. M. Herlihy and J. Wing, "Linearizability: A correctness condition for concurrent objects," ACM Trans. Program. Lang. Syst., vol. 12, no. 3, pp. 463-492, 1990.
29. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed, "Zookeeper: Wait-free coordination for internet-scale systems," in Proc. Conf. USENIX Annu. Tech. Conf., 2010, p. 11.
30. F. Junqueira and B. Reed. ZooKeeper: Distributed Process Coordination. Sebastopol, CA, USA: O'Reilly Media, Nov. 2013.
31. F. Junqueira, B. C. Reed, and M. Serafini, "Zab: High-performance broadcast for primary-backup systems," in Proc. IEEE Conf. Dependable Syst. Netw., 2011, pp. 245-256.
32. L. Lamport, "The part-time parliament," ACM Trans. Comput. Syst., vol. 16, no. 2, pp. 133-169, 1998.
33. L. Lamport, D. Malkhi, and L. Zhou, "Reconfiguring a state machine," SIGACT News, vol. 41, no. 1, pp. 63-73, Mar. 2010.
34. L. Lamport and M. Massa, "Cheap Paxos," in Proc. IEEE Conf. Dependable Syst. Netw., 2004, pp. 307-314.
35. H. Lee, J. L. Welch, and N. H. Vaidya, "Location tracking using quorums in mobile ad hoc networks," Ad Hoc Netw., vol. 1, no. 4, pp. 371-381, 2003.
36. J. R. Lorch, A. Adya, W. J. Bolosky, R. Chaiken, J. R. Douceur, and J. Howell, "The smart way to migrate replicated stateful services," in Proc. Eur. Conf. Comput. Syst., 2006, pp. 103-115.
37. N. A. Lynch. Distributed Algorithms. Morgan Kaufmann, San Francisco, CA, USA, 1996.
38. N. A. Lynch and A. A. Shvartsman, "Robust emulation of shared memory using dynamic quorum-acknowledged broadcasts," in Proc. Symp. Fault-Tolerant Comput., 1997, pp. 272-281.
39. N. A. Lynch and A. A. Shvartsman, "RAMBO: A reconfigurable atomic memory service for dynamic networks," in Proc. 16th Int. Conf. Distrib. Comput., 2002, pp. 173-190.
40. IBM. Tivoli Endpoint Manager [Online]. Available: http://www- 01.ibm.com/software/tivoli/solutions/endpoint/
41. J.-P. Martin and L. Alvisi, "A framework for dynamic byzantine storage," in Proc. IEEE Conf. Dependable Syst. Netw., 2004, pp. 325-334.
42. P. M. Musial and A. A. Shvartsman, "Implementing a reconfigurable atomic memory service for dynamic networks," in Proc. 18th Int. Parallel Distrib. Symp., 2004, p. 208b.
43. M. Naor and A. Wool, "The load, capacity, and availability of quorum systems," SIAM J. Comput., vol. 27, no. 2, pp. 423-447, Apr. 1998.
44. I. Neamtiu and T. Dumitraş , "Cloud software upgrades: Challenges and opportunities," in Proc. IEEE Int. Workshop Maintenance Evolution Service-Oriented Cloud-Based Syst., 2011, pp. 1-10.
45. D. Ongaro and J. Ousterhout, "In search of an understandable consensus algorithm," in Proc. Conf. USENIX Annu. Tech. Conf., 2014, pp. 305-319.
46. Oracle Corporation. Database rolling upgrade using data guard SQL apply. Maximum availability architecture, Dec. 2008.
47. Oracle Corporation. (2012). Realizing the economic benefits of oracle enterprise manager ops center [Online]. Available: http:// www.oracle.com/us/products/enterprise-manager/economicbenefits- ops-center-185035.pdf
48. D. Peleg and A. Wool, "The availability of quorum systems," Inf. Comput., vol. 123, no. 2, pp. 210-223, 1995.
49. B. Philips. (2013). Distributed configuration data with etcd [Online]. Available: https://coreos.com/blog/distributed-configuration- with-etcd/
50. Microsoft Corporation. Windows Server Update Services. [Online]. Available: http://technet.microsoft.com/en-us/windowsserver/ bb332157.aspx
51. X. Shi, H. Lin, H. Jin, B. Bing Zhou, Z. Yin, S. Di, and S. Wu, "GIRAFFE: A scalable distributed coordination service for largescale systems," in Proc. IEEE Int. Conf. Cluster Comput., 2014, pp. 38-47.
52. A. Shraer, J.-P. Martin, D. Malkhi, and I. Keidar, "Data-centric reconfiguration with network-attached disks," in Proc. 4th Int. Workshop Large Scale Distrib. Syst. Middleware, 2010, pp. 22-26.
53. A. Shraer, B. Reed, D. Malkhi, and F. Junqueira, "Dynamic reconfiguration of primary/backup clusters," in Conf. Annu. Tech. Conf., 2012, p. 39.
54. W. Sun, D. Guimarans, A. Fekete, V. Gramoli, and L. Zhu, "Multiobjective optimisation for rolling upgrade allowing for failures in clouds," in Proc. IEEE Symp. Reliable Distrib. Syst., 2015, pp. 68-73.
55. VMware Inc. vSphere Update Manager. [Online]. Available: http://www.vmware.com/products/datacenter-virtualization/ vsphere/update -manager.html