Reliability mechanisms for very large storage systems

Proceedings - 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, MSST 2003

Volumn , Issue , 2003, Pages 146-156

  Xin, Qin ^a   Miller, E L ^a   Schwarz, T ^b   Long, D D E ^a   Brandt, S A ^a   Litwin, W ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b SANTA CLARA UNIVERSITY   (United States)

^c UNIVERSITÉ PARIS DAUPHINE   (France)

Author keywords

Availability; Bandwidth; Costs; Disk drives; Error analysis; Fault tolerant systems; Frequency; High performance computing; Large scale systems; Redundancy

Indexed keywords

AVAILABILITY; BANDWIDTH; COSTS; ERROR ANALYSIS; ERRORS; LARGE SCALE SYSTEMS; NASA; REDUNDANCY; RELIABILITY; RELIABILITY ANALYSIS; VIRTUAL STORAGE;

DISK DRIVE; FAULT TOLERANT SYSTEMS; FREQUENCY; HIGH PERFORMANCE COMPUTING; IMPROVED TECHNIQUES; INDIVIDUAL COMPONENTS; LARGE-SCALE STORAGE SYSTEMS; RELIABILITY AND AVAILABILITY;

DIGITAL STORAGE;

EID: 84881101639     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MASS.2003.1194851     Document Type: Conference Paper

References (27)

1. A. Adya, W. J. Bolosky, M. Castro, R. Chaiken, G. Cermak, J. R. Douceur, J. Howell, J. R. Lorch, M. Theimer, and R. Wattenhofer. FARSITE: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, Dec. 2002. USENIX.
2. G. A. Alvarez, W. A. Burkhard, and F. Cristian. Tolerating multiple failures in RAID architectures with optimal storage and uniform declustering. In Proceedings of the 24th International Symposium on Computer Architecture, pages 62-72, Denver, CO, June 2002. ACM.
3. M. Castro and B. Liskov. Proactive recovery in a Byzantine-fault-tolerant system. In Proceedings of the 4th Symposium on Operating Systems Design and Implementation (OSDI), 2000.
4. P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: High-performance, reliable secondary storage. ACM Computing Surveys, 26(2), June 1994.
5. J. R. Douceur and R. P. Wattenhofer. Optimizing file availability in a secure serverless distributed file system. In Proceedings of the 20th Symposium on Reliable Distributed Systems (SRDS '01), pages 4-13, New Orleans, LA, Oct. 2001. IEEE.
6. F. Fabret, H. A. Jacobsen, F. Llirbat, J. Pereira, K. A. Ross, and D. Shasha. Filtering algorithms and implementation for very fast publish/subscribe systems. In Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, pages 115-126. ACM, 2001.
7. G. A. Gibson, D. F. Nagle, K. Amiri, J. Butler, F. W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg, and J. Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 92-103, San Jose, CA, Oct. 1998.
8. J. L. Hennessy and D. A. Patterson. Computer Architecture - A Quantitative Approach. Morgan Kaufmann Publishers, 3rd edition, 2003.
9. R. J. Honicky and E. L. Miller. A fast algorithm for online placement and reorganization of replicated data. In Proceedings of the 17th International Parallel & Distributed Processing Symposium, Nice, France, Apr. 2003.
10. J. Kubiatowicz, D. Bindel, Y. Chen, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. OceanStore: An architecture for global-scale persistent storage. In Proceedings of the 9th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Cambridge, MA, Nov. 2000. ACM.
11. R. Lidl and H. Niederreiter. Finite Fields. Cambridge University Press, 2nd edition, 1997.
12. RS: A high-availability scalable distributed data structure using Reed Solomon codes. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, pages 237-248, Dallas, TX, May 2000. ACM.
13. W. Litwin and T. Schwarz. Algebraic signatures for scalable distributed data structures. Technical Report CERIA Technical Report, Université Paris 9 Dauphine, Sept. 2002.
14. D. D. E. Long. A technique for managing mirrored disks. In Proceedings of the 20th IEEE International Performance, Computing and Communications Conference (IPCCC '01), pages 272-277, Phoenix, Apr. 2001. IEEE.
15. J. Menon and R. L. Mattson. Distributed sparing in disk arrays. In Proceedings of Compcon '92, pages 410-416, Feb. 1992.
16. R. Mokadem. Stockage de données en utilisant les signatures dans les sdds. Technical Report CERIA Technical Report, Université Paris 9 Dauphine, Sept. 2002.
17. R. R. Muntz and J. C. S. Lui. Performance analysis of disk arrays under failure. In Proceedings of the 16th Conference on Very Large Databases (VLDB), pages 162-173, 1990.
18. D. A. Patterson, A. Brown, P. Broadwell, G. Candea, M. Chen, J. Cutler, P. Enriquez, A. Fox, E. Kiciman, M. Merzbacher, D. Oppenheimer, N. Sastry, W. Tetzlaff, J. Traupman, and N. Treuhaft. Recovery-Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies. Technical Report UCB//CSD-02-1175, University of California, Berkeley, Mar. 2002.
19. J. S. Plank. A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems. Software - Practice and Experience (SPE), 27(9):995-1012, Sept. 1997.
20. Y. Saito and C. Karamanolis. Pangaea: A symbiotic wide-area file system. In Proceedings of the 2002 ACM SIGOPS European Workshop. ACM, Sept. 2002.
21. T. Schwarz. Generalized Reed Solomon codes for erasure correction in SDDS. In Workshop on Distributed Data and Structures (WDAS 2002), Paris, France, Mar. 2002.
22. T. Schwarz, R. W. Bowdidge, and W. A. Burkhard. Low cost comparison of files. In Proceedings of the 10th International Conference on Distributed Computing Systems (ICDCS '90), pages 196-201, 1990.
23. D. P. Siewiorek and R. S. Swarz. Reliable Computer Systems Design and Evaluation. The Digital Press, 2nd edition, 1992.
24. B. Tofel. Personal communication, Aug. 2002.
25. F. Wang, S. A. Brandt, E. L. Miller, and D. D. E. Long. OBFS: A file system for object-based storage devices. Submitted to the 2003 Usenix Technical Conference.
26. H. Weatherspoon and J. Kubiatowicz. Erasure coding vs. replication: A quantitative comparison. In Proceedings of the First International Workshop on Peer-to-Peer Systems (IPTPS 2002), Cambridge, Massachusetts, Mar. 2002.
27. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (SOSP '95), pages 96-108, Copper Mountain, CO, 1995. ACM Press.