Failure recovery: When the cure is worse than the disease

14th Workshop on Hot Topics in Operating Systems, HotOS 2013

Volumn , Issue , 2013, Pages

  Guo, Zhenyu ^a   McDirmid, Sean ^a   Yang, Mao ^a   Zhuang, Li ^a   Zhang, Pu ^a,b   Luo, Yingwei ^b   Bergan, Tom ^a,c   Bodik, Peter ^a   Musuvathi, Madan ^a   Zhang, Zheng ^a   Zhou, Lidong ^a  

^a MICROSOFT RESEARCH   (United States)

^b PEKING UNIVERSITY   (China)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PROGRAM DEBUGGING;

CLOUD SERVICES; FAILURE RECOVERY; SOFTWARE BUG;

OUTAGES;

EID: 85092778372     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. Amazon. Amazon Elastic Block Store (EBS). http://aws.amazon.com/ebs/.
2. Amazon. Amazon Relational Database Service (Amazon RDS). http://aws.amazon.com/rds/.
3. Amazon. Summary of the Amazon EC2, Amazon EBS, and Amazon RDS Service Event in the EU West Region. http://aws.amazon.com/message/2329B7/, August 2011.
4. Amazon. Summary of the Amazon EC2 and Amazon RDS Service Disruption in the US East Region. http://aws.amazon.com/message/65648/, April 2011.
5. Amazon. Summary of the December 24, 2012 Amazon ELB Service Event in the US-East Region. http://aws.amazon.com/message/680587/, December 2012.
6. E. A. Brewer. Lessons from giant-scale services. IEEE Internet Computing, 5(4), 2001.
7. B. Calder, J. Wang, A. Ogus, N. Nilakantan, A. Skjolsvold, S. McKelvie, Y. Xu, S. Srivastav, J. Wu, H. Simitci, J. Haridas, C. Uddaraju, H. Khatri, A. Edwards, V. Bedekar, S. Mainali, R. Abbasi, A. Agarwal, M. F. u. Haq, M. I. u. Haq, D. Bhardwaj, S. Dayanand, A. Adusumilli, M. McNett, S. Sankaran, K. Manivannan, and L. Rigas. Windows Azure storage: a highly available cloud storage service with strong consistency. In Proc. of SOSP. ACM, 2011.
8. T. D. Chandra, R. Griesemer, and J. Redstone. Paxos made live: an engineering perspective. In PODC, 2007.
9. K. M. Chandy and L. Lamport. Distributed snapshots: Determining global states of distributed systems. ACM Trans. Comput. Syst., 3(1), 1985.
10. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: a distributed storage system for structured data. In Proc. OSDI, 2006.
11. P. Checkland. Systems Thinking, Systems Practice. John Wiley & Sons, 1999.
12. F. Eberhardt, P. O. Hoyer, and R. Scheines. Combining experiments to discover linear cyclic models with latent variables. Journal of Machine Learning Research - Proceedings Track, 9:185-192, 2010.
13. Facebook. More details on today's outage. http://www.facebook.com/notes/facebookengineering/more-details-on-todaysoutage/431441338919, September 2010.
14. B. Ford. Icebergs in the clouds: the other risks of cloud computing. CoRR, 2012.
15. J. Forrester. Counterintuitive behavior of social systems. In Technology Review, 1971.
16. C. Girault and W. Reisig, editors. Application and Theory of Petri Nets, volume 52 of Informatik-Fachberichte. Springer, 1982.
17. Google. More on today's Gmail issue. http://gmailblog.blogspot.com/2009/09/more-on-todaysgmail-issue.html, September 2009.
18. Google. About today's App Engine outage. http://googleappengine.blogspot.jp/2012/10/abouttodays-app-engine-outage.html, October 2012.
19. J. Gray. Why do computers stop and what can be done about it? In Symposium on Reliability in Distributed Software and Database Systems, 1986.
20. J. Gray. A census of tandem system availability. In IEEE Transactions on Reliability, 1990.
21. S. D. Gribble. Robustness in complex systems. In HotOS, 2001.
22. Z. Guo, C. Hong, M. Yang, D. Zhou, L. Zhou, and L. Zhuang. Paxos made parallel. Technical Report MSR-TR-2012-118, 2012.
23. C. W. Kirkwood. System Dynamics Methods: A Quick Introduction. http://www.public.asu.edu/ kirkwood/sysdyn/SDIntro/SDIntro.htm.
24. L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133-169, 1998.
25. J. B. Leners, T. Gupta, M. K. Aguilera, and M. Walfish. Improving availability in distributed systems with failure informers. In Proc. of NSDI, 2013.
26. X. Liu, Z. Guo, X. Wang, F. Chen, X. Lian, J. Tang, M. Wu, M. F. Kaashoek, and Z. Zhang. D3S: Debugging Deployed Distributed Systems. In Proc. of NSDI, 2008.
27. Microsoft. Summary of Windows Azure Service Disruption on Feb 29th, 2012. http://blogs.msdn.com/b/windowsazure/archive/2012/03/09/summary-of-windows-azure-service-disruption-on-feb-29th-2012.aspx, February 2012.
28. J. C. Mogul. Emergent (mis)behavior vs. complex software systems. In EuroSys. ACM, 2006.
29. D. L. Oppenheimer, A. Ganapathi, and D. A. Patterson. Why do internet services fail, and what can be done about it? In USENIX Symposium on Internet Technologies and Systems, 2003.
30. S. Pertet and P. Narasimhan. Handling cascading failures: the case for topology-aware fault-tolerance. In HotDep, 2005.
31. Z. Qian, Y. He, C. Su, Z. Wu, H. Zhu, T. Zhang, L. Zhou, Y. Yu, and Z. Zhang. Timestream: Reliable stream computation in the cloud. In Eurosys, 2013.
32. Skype. CIO update: Post-mortem on the Skype outage. http://blogs.skype.com/en/2010/12/cio update.html, December 2010.
33. J. Yang, T. Chen, M. Wu, Z. Xu, X. Liu, H. Lin, M. Yang, F. Long, L. Zhang, and L. Zhou. MoDist: Transparent model checking of unmodified distributed systems. In Proc. of NSDI, 2009.