Evaluation of distributed recovery in large-scale storage systems

IEEE International Symposium on High Performance Distributed Computing, Proceedings

Volumn , Issue , 2004, Pages 172-181

  Xin, Qin ^a   Miller, Ethan L ^a   Schwarz, Thoraas J E ^b  

^a University of California Santa Cruz   (United States)

^b Santa Clara University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA RELIABILITY; DISK FAILURE; FAST RECOVERY MECHANISM; STORAGE CLUSTERS;

COMPUTER SIMULATION; COSTS; DATA REDUCTION; PROBABILITY; REDUNDANCY; RELIABILITY; THROUGHPUT;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 4944242918     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. A. Adya, W. J. Bolosky, M. Castro, R. Chaiken, G. Cermak, J. R. Douceur, J. Howell, J. R. Lorch, M. Theimer, and R. Wattenhofer. FARSITE: Federated, available, and reliable storage for an incompletely misted environment In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, Dec. 2002. USENIX.
2. G. A. Alvarez, W. A. Burkhard, and F. Cristian. Tolerating multiple failures in RAID architectures with optimal storage and uniform declustering. In Proceedings of the 24th International Symposium on Computer Architecture, pages 62-72, Denver, CO, June 1997. ACM.
3. D. Bitton and J. Gray. Disk shadowing. In Proceedings of the 14th Conference on Very Large Databases (VLDB), pages 331-338, 1988.
4. M. Blaum, J. Brady, J. Bruck, and J. Menon. EVENODD: An efficient scheme for tolerating double disk failures in RAID architectures. IEEE Transactions on Computers, 44(2): 192-202, 1995.
5. W. A. Burkhard and J. Menon. Disk array storage system reliability. In. Proceedings of the 23rd International Symposium on Fault-Tolerant Computing (FTCS '93), pages 432-441, June 1993.
6. P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: High-performance, reliable secondary storage. ACM Computing Surveys, 26(2), June 1994.
7. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with CFS. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 202-215, Banff, Canada. Oct. 2001. ACM.
8. Disk drive specification: IBM Deskstar™ 180GXP hard disk drives.
9. J. R. Douceur and R. P. Wattenhofer. Large-scale simulation of replica placement algorithms for a serverless distributed file system. In Proceedings of the 9th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS '01), pages 311-319, Cincinnati, OH, Aug. 2001. IEEE.
10. J. G. Elerath. Specifying reliability in the disk drive industry: No more MTBF's. In Proceedings of the 2000 Annual Reliability and Maintainability, pages 194-199. IEEE, 2000.
11. S. Frølund, A. Merchant, Y. Saito, S. Spence, and A. Veitch. FAB: Enterprise storage systems on a shoestring. In Proceedings of the 9th Workshop on Hot Topics in Operating Systems (HotOS-IX), Kauai, HI, May 2003.
12. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP '03), Bolton Landing, NY, Oct. 2003. ACM.
13. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, F. W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg, and J. Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 92-103, San Jose, CA, Oct. 1998.
14. R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In Proceedings of the Winter 1995 USENIX Technical Conference, pages 201-212, New Orleans, LA, Jan. 1995. USENIX.
15. L. Hellerstein, G. A. Gibson, R. M. Karp, R. H. Katz, and D. A. Patterson. Coding techniques for handling failures in large disk arrays. Algorithmica, 12:182-208, 1994.
16. J. L. Hennessy and D. A. Patterson. Computer Architecture - A Quantitative Approach. Morgan Kaufmann Publishers, 3rd edition, 2003.
17. R. J. Honicky and E. L. Miller. Replication under scalable hashing: A family of algorithms for scalable decentralized data distribution. In Proceedings of the 18th International Parallel & Distributed Processing Symposium (IPDPS 2004), Santa Fe, NM, Apr. 2004. IEEE.
18. G. Hughes, J. Murray, K. Kreutz-Delgado, C. Elkan, and W. Tran. Improved disk-drive failure warnings. In IEEE Transactions on Reliability, 2000.
19. http://www.archive.org/web/researcher/data_available.php.
20. E. K. Lee and C. A. Thekkath. Petal: Distributed virtual disks. In Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 84-92, Cambridge, MA, 1996.
21. RS: A high-availability scalable distributed data structure using Reed Solomon codes. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, pages 237-248, Dallas, TX, May 2000. ACM.
22. P. Lyman, H. R. Varian, P. Charles, N. Good, L. L. Jordan, and J. Pal. How much information? 2003. http://www.sims.berkeley.edu/research/projects/how- much-info-2003/.
23. I. Menon and R. L. Mattson. Distributed sparing in disk arrays. In Proceedings of Compcon '92, pages 410-416, Feb. 1992.
24. R. A. Meyer and R. Bagrodia. PARSEC user manual, release 1.1. http://pcl.cs.ucla.edu/projects/parsec/.
25. R. R. Muntz and J. C. S. Lui. Performance analysis of disk arrays under failure. In Proceedings of the 16th Conference on Very Large Databases (VLDB), pages 162-173, 1990.
26. A. Muthitacharoen, R. Morris, T. M. Gil, arid B. Chen. Ivy: A read/write peer-to-peer file system. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, Dec. 2002.
27. J. S. Plank. A tutorial on Reed-Solomon coding for faulttolerance in RAID-like systems. Software - Practice and Experience (SPE), 27(9):995-1012, Sept. 1997. Correction in James S. Plank and Ying Ding, Technical Report UT-CS-03-504, U Tennessee, 2003.
28. S. Rhea, P. Eaton, D. Geels, H. Weatherspoon, B. Zhao, and J. Kubiatowicz. Pond: the OceanStore prototype. In Proceedings of the 2003 Conference on File and Storage Technologies (FAST), pages 1-14, Mar. 2003.
29. M. Ripeanu, A. Iamnitchi, and I. Foster. Mapping the Gnutella network. IEEE Internet Computing, 6(1):50-57, Aug. 2002.
30. A. Rowstron and P. Druschel. Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 188-201, Banff, Canada, Oct. 2001. ACM.
31. Y. Saito, C. Karamanolis, M. Karlsson, and M. Mahalingam. Taming aggressive replication in the Pangaea wide-area file system. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI). USENIX, Dec. 2002.
32. T. J. Schwarz. Generalized Reed Solomon codes for erasure correction in SDDS. In Workshop on Distributed Data and Structures (WDAS 2002), Paris, Mar. 2002.
33. T. J. Schwarz and W. A. Burkhard. Reliability and performance of RAIDs. IEEE Transactions on Magnetics, 31(2):1161-1166, 1995.
34. A. Takefusa, O. Tatebe, S. Matsuoka, and Y. Morita. Performance analysis of scheduling and replication algorithms on grid datafarm architecture for high energy physics applications. In Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing (HPDC), pages 34-43, Seattle, WA, June 2003. IEEE.
35. The International Disk Drive Equipment & Materials Association (IDEMA). R2-98: Specification of hard disk drive reliability.
36. H. Weatherspoon and J. Kubiatowicz. Erasure coding vs. replication: A quantitative comparison. In Proceedings of the First International Workshop on Peer-to-Peer Systems (IPTPS 2002), Cambridge, Massachusetts, Mar. 2002.
37. Q. Xin, E. L. Miller, T. J. Schwarz, D. D. E. Long, S. A. Brandt, and W. Litwin. Reliability mechanisms for very large storage systems. In Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, pages 146-156, Apr. 2003.