Fate and destini: A framework for cloud recovery testing

Proceedings of NSDI 2011: 8th USENIX Symposium on Networked Systems Design and Implementation

Volumn , Issue , 2011, Pages 239-252

  Gunawi, Haryadi S ^a   Do, Thanh ^b   Joshi, Pallavi ^a   Alvaro, Peter ^a   Hellerstein, Joseph M ^a   Arpaci Dusseau, Andrea C ^b   Arpaci Dusseau, Remzi H ^b   Sen, Koushik ^a   Borthakur, Dhruba ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c FACEBOOK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PROGRAM DEBUGGING; SPECIFICATIONS; SYSTEMS ANALYSIS;

CLOUD SERVICES; CLOUD SYSTEMS; CRITICAL FACTORS; FAILURE RECOVERY; FAILURE SCENARIOS; FAILURE TESTING; MULTIPLE FAILURES; TESTING FRAMEWORK;

RECOVERY;

EID: 85076526752     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. Amazon EC2. http://aws.amazon.com/ec2.
2. HDFS JIRA. http://issues.apache.org/jira/browse/HDFS.
3. Peter Alvaro, Tyson Condie, Neil Conway, Khaled Elmeleegy, Joseph M. Hellerstein, and Russell C Sears. BOOM Analytics: Exploring Data-Centric, Declarative Programming for the Cloud. In EuroSys '10.
4. Ken Birman, Gregory Chockler, and Robbert van Renesse. Towards a Cloud Computing Research Agenda. ACM SIGACT News, 40(2):68-80, June 2009.
5. Mike Burrows. The Chubby lock service for loosely-coupled distributed systems Export. In OSDI '06.
6. Tushar Chandra, Robert Griesemer, and Joshua Redstone. Paxos Made Live - An Engineering Perspective. In PODC '07.
7. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Michael Burrows, Tushar Chandra, Andrew Fikes, and Robert Gruber. Bigtable: A Distributed Storage System for Structured Data. In OSDI '06, pages 205-218.
8. Brian Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan, and Russell Sears. Benchmarking Cloud Serving Systems with YCSB. In SoCC '10.
9. Jeffrey Dean. Underneath the Covers at Google: Current Systems and Future Directions. In Google I/O '08.
10. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google File System. In SOSP '03, pages 29-43.
11. Garth Gibson. Reliability/Resilience Panel. In HEC-FSIO '10.
12. Salvatore Guarnieri and Benjamin Livshits. Gatekeeper: Mostly Static Enforcement of Security and Reliability Policies for JavaScript Code. In Usenix Security '09.
13. Haryadi S. Gunawi, Thanh Do, Pallavi Joshi, Peter Alvaro, Joseph M. Hellerstein, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Koushik Sen. FATE and DESTINI: A Framework for Cloud Recovery Testing. UC Berkeley Technical Report UCB/EECS-2010-127, September 2010.
14. Haryadi S. Gunawi, Thanh Do, Pallavi Joshi, Joseph M. Hellerstein, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Koushik Sen. Towards Automatically Checking Thousands of Failures with Micro-specifications. In HotDep '10.
15. Haryadi S. Gunawi, Abhishek Rajimwale, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. SQCK: A Declarative File System Checker. In OSDI '08.
16. James Hamilton. Cloud Computing Economies of Scale. In MIX '10.
17. James Hamilton. On Designing and Deploying Internet-Scale Services. In LISA '07.
18. Alyssa Henry. Cloud Storage FUD: Failure and Uncertainty and Durability. In FAST '09.
19. Patrick Hunt, Mahadev Konar, Flavio P. Junqueira, and Benjamin Reed. ZooKeeper: Wait-free coordination for Internet-scale systems. In USENIX ATC '10.
20. Lorenzo Keller, Paul Marinescu, and George Candea. AFEX: An Automated Fault Explorer for Faster System Testing. 2008.
21. Charles Killian, James Anderson, Ranjit Jhala, and Amin Vahdat. Life, Death, and the Critical Transition: Finding Liveness Bugs in Systems Code. In NSDI '07.
22. Hairong Kuang, Konstantin Shvachko, Nicholas Sze, Sanjay Radia, and Robert Chansler. Append/Hflush/Read Design. https://issues.apache.org/jira/secure/attachment/12445209/appendDesign3.pdf.
23. Avinash Lakshman and Prashant Malik. Cassandra - a decentralized structured storage system. In LADIS '09.
24. Xuezheng Liu, Zhenyu Guo, Xi Wang, Feibo Chen, Xiaochen Lian, Jian Tang, Ming Wu, M. Frans Kaashoek, and Zheng Zhang. D3S: Debugging Deployed Distributed Systems. In NSDI '08.
25. Xuezheng Liu, Wei Lin, Aimin Pan, and Zheng Zhang. WiDS Checker: Combating Bugs in Distributed Systems. In NSDI '07.
26. Boon Thau Loo, Tyson Condie, Joseph M. Hellerstein, Petros Maniatis, Timothy Roscoe, and Ion Stoica. Implementing Declarative Overlays. In SOSP '05.
27. Om Malik. When the Cloud Fails: T-Mobile, Microsoft Lose Sidekick Customer Data. http://gigaom.com.
28. Paul D. Marinescu, Radu Banabic, and George Candea. An Extensible Technique for High-Precision Testing of Recovery Code. In USENIX ATC '10.
29. Lucas Mearian. Facebook temporarily loses more than 10% of photos in hard drive failure. www.computerworld.com.
30. John Oates. Bank fined 3 millions pound sterling for data loss, still not taking it seriously. www.theregister.co.uk.
31. Xinming Ou, Sudhakar Govindavajhala, and Andrew W. Appel. MulVAL: A logic-based network security analyzer. In Usenix Security '05.
32. Patrick Reynolds, Janet L. Wiener, Jeffrey C. Mogul, Mehul A. Shah, Charles Killian, and Amin Vahdat. Pip: Detecting the unexpected in distrubted systems. In NSDI '06.
33. Konstantin Shvachko, Hairong Kuang, Sanjay Radia, and Robert Chansler. The Hadoop Distributed File System. In MSST '10.
34. Atul Singh, Petros Maniatis, Timothy Roscoe, and Peter Druschel. Using Queries for Distributed Monitoring and Forensics. In EuroSys '06.
35. Hadoop Team. Fault Injection framework: How to use it, test using artificial faults, and develop new faults. http://issues.apache.org.
36. Tom White. File Appends in HDFS. http://www.cloudera.com/blog/2009/07/file-appends-in-hdfs.
37. Maysam Yabandeh, Nikola Knezevic, Dejan Kostic, and Viktor Kuncak. CrystalBall: Predicting and Preventing Inconsistencies in Deployed. Distributed Systems. In NSDI '09.
38. Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, and Lidong Zhou. MODIST: Transparent Model Checking of Unmodified Distributed Systems. In NSDI '09.
39. Junfeng Yang, Can Sar, and Dawson Engler. EXPLODE: A Lightweight, General System for Finding Serious Storage System Errors. In OSDI '06.