Subtleties in tolerating correlated failures in wide-area storage systems

3rd Symposium on Networked Systems Design and Implementation, NSDI 2006

Volumn , Issue , 2006, Pages

  Nath, Suman ^a   Yu, Haifeng ^b   Gibbons, Phillip B ^b   Seshan, Srinivasan ^c  

^a MICROSOFT RESEARCH   (United States)

^b INTEL RESEARCH   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MULTIPROCESSING SYSTEMS; SYSTEMS ANALYSIS;

CORRELATED FAILURES; DESIGN PRINCIPLES; DISTRIBUTED STORAGE SYSTEM; FAILURE TRACES; HIGH AVAILABILITY; STORAGE LAYERS; SYSTEM BUILDERS; WIDE AREA STORAGE;

AVAILABILITY;

EID: 85046639315     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. Akamai Knocked Out, Major Websites Offline. http://techdirt.com/articles/20040524/0923243.shtml.
2. Emulab - network emulation testbed home. http://www.emulab.net.
3. PlanetLab - All Pair Pings. http://www.pdos.lcs.mit.edu/~strib/pl_app/.
4. The MIT RON trace. David G. Andersen, Private communication.
5. AIYER, A., ALVISI, L., AND BAZZI, R. On the Availability of Non-strict Quorum Systems. In DISC (2005).
6. BAKKALOGLU, M., WYLIE, J., WANG, C., AND GANGER, G. On Correlated Failures in Survivable Storage Systems. Tech. Rep. CMU-CS-02-129, Carnegie Mellon University, 2002.
7. BARBARA, D., AND GARCIA-MOLINA, H. The Reliability of Voting Mechanisms. IEEE Transactions on Computers 36, 10 (1987).
8. BHAGWAN, R., TATI, K., CHENG, Y., SAVAGE, S., AND VOELKER, G. M. TotalRecall: Systems Support for Automated Availability Management. In USENIX NSDI (2004).
9. BOLOSKY, W. J., DOUCEUR, J. R., ELY, D., AND THEIMER, M. Feasibility of a Serverless Distributed File System Deployed on an Existing Set of Desktop PCs. In ACM SIGMETRICS (2000).
10. CATES, J. Robust and Efficient Data Management for a Distributed Hash Table. Masters Thesis, Massachusetts Institute of Technology, 2003.
11. CHUN, B., AND VAHDAT, A. Workload and Failure Characterization on a Large-Scale Federated Testbed. Tech. Rep. IRB-TR-03-040, Intel Research Berkeley, 2003.
12. CORBETT, P., ENGLISH, B., GOEL, A., GRCANAC, T., KLEIMAN, S., LEONG, J., AND SANKAR, S. Row-Diagonal Parity for Double Disk Failure Correction. In USENIX FAST (2004).
13. DABEK, F., KAASHOEK, M. F., KARGER, D., MORRIS, R., AND STOICA, I. Wide-area Cooperative Storage with CFS. In ACM SOSP (2001).
14. DABEK, F., LI, J., SIT, E., ROBERTSON, J., KAASHOEK, M. F., AND MORRIS, R. Designing a DHT for Low Latency and High Throughput. In USENIX NSDI (2004).
15. DOUCEUR, J. R., AND WATTENHOFER, R. P. Competitive Hill-Climbing Strategies for Replica Placement in a Distributed File System. In DISC (2001).
16. FRIED, B. H. Ex Ante/Ex Post. Journal of Contemporary Legal Issues 13, 1 (2003).
17. GIBBONS, P. B., KARP, B., KE, Y., NATH, S., AND SESHAN, S. IrisNet: An Architecture for a Worldwide Sensor Web. IEEE Pervasive Computing 2, 4 (2003).
18. GOODSON, G., WYLIE, J., GANGER, G., AND REITER, M. Efficient Byzantine-tolerant Erasure-coded Storage. In IEEE DSN (2004).
19. HAEBERLEN, A., MISLOVE, A., AND DRUSCHEL, P. Glacier: Highly Durable, Decentralized Storage Despite Massive Correlated Failures. In USENIX NSDI (2005).
20. HARCHOL-BALTER, M., AND DOWNEY, A. B. Exploiting Process Lifetime Distributions for Dynamic Load Balancing. ACM Transactions on Computer Systems 15, 3 (1997).
21. JUNQUEIRA, F., BHAGWAN, R., HEVIA, A., MARZULLO, K., AND VOELKER, G. Surviving Internet Catastrophes. In USENIX Annual Technical Conference (2005).
22. KUBIATOWICZ, J., BINDEL, D., CHEN, Y., CZERWINSKI, S., EATON, P., GEELS, D., GUMMADI, R., RHEA, S., WEATHERSPOON, H., WEIMER, W., WELLS, C., AND ZHAO, B. OceanStore: An Architecture for Global-Scale Persistent Storage. In ACM ASPLOS (2000).
23. LAMPORT, L. The Part-Time Parliament. ACM Transactions on Computer Systems 16, 2 (1998).
24. LELAND, W. E., TAQQ, M. S., WILLINGER, W., AND WILSON, D. V. On the Self-similar Nature of Ethernet Traffic. In ACM SIG-COMM (1993).
25. LYNCH, N., AND SHVARTSMAN, A. RAMBO: A Reconfigurable Atomic Memory Service for Dynamic Networks. In DISC (2002).
26. NATH, S. Exploiting Redundancy for Robust Sensing. PhD thesis, Carnegie Mellon University, 2005. Tech. Rep. CMU-CS-05-166.
27. NATH, S., GIBBONS, P. B., AND SESHAN, S. Adaptive Data Placement for Wide-Area Sensing Services. In USENIX FAST (2005).
28. NATH, S., YU, H., GIBBONS, P. B., AND SESHAN, S. Tolerating Correlated Failures in Wide-Area Monitoring Services. Tech. Rep. IRP-TR-04-09, Intel Research Pittsburgh, 2004.
29. NATH, S., YU, H., GIBBONS, P. B., AND SESHAN, S. Subtleties in Tolerating Correlated Failures in Wide-Area Storage Systems. Tech. Rep. IRP-TR-05-52, Intel Research Pittsburgh, 2005. Also available at http://www.cs.cmu.edu/~yhf/correlated.pdf.
30. NURMI, D., BREVIK, J., AND WOLSKI, R. Modeling Machine Availability in Enterprise and Wide-area Distributed Computing Environments. In Euro-Par (2005).
31. PLANK, J. A Tutorial on Reed-Solomon Coding for Fault-Tolerance in RAID-like Systems. Software - Practice & Experience 27, 9 (1997).
32. ROWSTRON, A., AND DRUSCHEL, P. Storage Management and Caching in PAST, A Large-scale, Persistent Peer-to-peer Storage Utility. In ACM SOSP (2001).
33. SHI, J., AND MALIK, J. Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8 (2000).
34. TANG, D., AND IYER, R. K. Analysis and Modeling of Correlated Failures in Multicomputer Systems. IEEE Transactions on Computers 41, 5 (1992).
35. THOMAS, R. H. A Majority Consensus Approach to Concurrency Control for Multiple Copy Databases. ACM Transactions on Database Systems 4, 2 (1979).
36. WEATHERSPOON, H., CHUN, B.-G., SO, C. W., AND KUBIATOWICZ, J. Long-Term Data Maintenance: A Quantitative Approach. Tech. Rep. UCB/CSD-05-1404, University of California, Berkeley, 2005.
37. WEATHERSPOON, H., MOSCOVITZ, T., AND KUBIATOWICZ, J. Introspective Failure Analysis: Avoiding Correlated Failures in Peer-to-Peer Systems. In IEEE RPPDS (2002).
38. YALAGANDULA, P., NATH, S., YU, H., GIBBONS, P. B., AND SESHAN, S. Beyond Availability: Towards a Deeper Understanding of Machine Failure Characteristics in Large Distributed Systems. In USENIX WORLDS (2004).
39. YU, H. Overcoming the Majority Barrier in Large-Scale Systems. In DISC (2003).
40. YU, H. Signed Quorum Systems. In ACM PODC (2004).
41. YU, H., AND VAHDAT, A. Consistent and Automatic Replica Regeneration. ACM Transactions on Storage 1, 1 (2005).