Providing high reliability in a minimum redundancy archival storage system

Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS

Volumn , Issue , 2006, Pages 413-421

  Bhagwat, Deepavali ^a   Pollack, Kristal ^a   Long, Darrell D E ^a   Thomas Schwarz, S J ^a,b   Miller, Ethan L ^a   Pâris, Jehan François ^c  

^a University of California Santa Cruz   (United States)

^b Santa Clara University   (United States)

^c University of Houston   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARCHIVAL STORAGE SYSTEMS; COMPRESSION METHODS; COMPRESSION TECHNIQUES; CONVENTIONAL APPROACH; HIGH RELIABILITY; REPLICATION LEVEL; STORAGE SPACES; STORAGE SYSTEMS;

COMPUTER SIMULATION; REDUNDANCY; TELECOMMUNICATION SYSTEMS;

DIGITAL STORAGE;

EID: 83155172040     PISSN: 15267539     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. A. Adya, W. J. Bolosky, M. Castro, R. Chaiken, G. Cermak, J. R. Douceur, J. Howell, J. R. Lorch, M. Theimer, and R.Wattenhofer. FARSITE: Federated, available, and reliable storage for an incompletely trusted environment. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, Dec. 2002. USENIX.
2. M. Ajtai, R. Burns, R. Fagin, D. D. E. Long, and L. Stockmeyer. Compactly encoding unstructured inputs with differential compression. Journal of the Association for Computing Machinery, 49(3):318-367, May 2002.
3. G. A. Alvarez, W. A. Burkhard, and F. Cristian. Tolerating multiple failures in RAID architectures with optimal storage and uniform declustering. In Proceedings of the 24th International Symposium on Computer Architecture, pages 62- 72, Denver, CO, June 1997. ACM.
4. Avamar Technologies Inc. http://www.avamar.com.
5. M. Baker, M. Shah, D. S. H. Rosenthal, M. Roussopoulos, P. Maniatis, T. Giuli, and P. Bungale. A fresh look at the reliability of long-term digital storage. In Proceedings of EuroSys 2006, pages 221-234, Apr. 2006.
6. P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: High-performance, reliable secondary storage. ACM Computing Surveys, 26(2):145-185, June 1994.
7. Data Domain. http://www.datadomain.com.
8. Diligent Technologies. http://www.diligent.com.
9. F. Douglis and A. Iyengar. Application-specific deltaencoding via resemblance detection. In Proceedings of the 2003 USENIX Annual Technical Conference, pages 113- 126. USENIX, June 2003.
10. zlib Compression Library. http://www.zlib.net.
11. EMC Corporation. EMC Centera: Content Addressed Storage System, Data Sheet, Apr. 2002.
12. G. R. Goodson, J. J. Wylie, G. R. Ganger, and M. K. Reiter. Efficient Byzantine-tolerant erasure-coded storage. In Proceedings of the 2004 International Conference on Dependable Systems and Networking (DSN 2004), June 2004.
13. A. Haeberlen, A. Mislove, and P. Druschel. Glacier: Highly durable, decentralized storage despite massive correlated failures. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation (NSDI), Boston, MA, May 2005. USENIX.
14. J. Kubiatowicz, D. Bindel, Y. Chen, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. OceanStore: An architecture for global-scale persistent storage. In Proceedings of the 9th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), Cambridge, MA, Nov. 2000. ACM.
15. P. Maniatis, M. Roussopoulos, T. J. Giuli, D. S. H. Rosenthal, and M. Baker. The LOCKSS peer-to-peer digital preservation system. ACM Transactions on Computer Systems, 23(1):2-50, 2005.
16. J. McKnight, T. Asaro, and B. Babineau. Digital Archiving: End-User Survey and Market Forecast 2006-2010. The Enterprise Strategy Group, Jan. 2006.
17. A. Muthitacharoen, B. Chen, and D. Mazieres. A lowbandwidth network file system. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), Oct. 2001.
18. Nexsan Technologies. http://www.nexsan.com.
19. NIST. Secure hash standard. FIPS 180-1, Apr. 1995.
20. NIST. Secure hash standard. FIPS 180-2, Aug. 2002.
21. Permabit Inc. http://www.permabit.com.
22. J. S. Plank. A tutorial on Reed-Solomon coding for faulttolerance in RAID-like systems. Software-Practice and Experience (SPE), 27(9):995-1012, Sept. 1997.
23. Correction in James S. Plank and Ying Ding, Technical Report UT-CS-03- 504, U Tennessee, 2003.
24. S. Quinlan and S. Dorward. Venti: A new approach to archival storage. In Proceedings of the First Conference on File and Storage Technologies (FAST), pages 89-101, Monterey, California, USA, 2002. USENIX.
25. M. O. Rabin. Fingerprinting by random polynomials. Technical Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
26. R. Rivest. The MD5 message-digest algorithm. Request For Comments (RFC) 1321, IETF, Apr. 1992.
27. T. J. Schwarz. Generalized Reed Solomon codes for erasure correction in SDDS. In Workshop on Distributed Data and Structures (WDAS 2002), Paris, Mar. 2002.
28. T. J. E. Schwarz, Q. Xin, E. L. Miller, D. D. E. Long, A. Hospodor, and S. Ng. Disk scrubbing in large archival storage systems. In Proceedings of the 12th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS '04), pages 409-418. IEEE, Oct. 2004.
29. Storage Technology Corp. http://www.storagetek.com.
30. The Internet Archive. http://www.archive.org.
31. The Santa Cruz Sentinel. http://www.santacruzsentinel.com.
32. Q. Xin, E. L. Miller, T. J. Schwarz, D. D. E. Long, S. A. Brandt, and W. Litwin. Reliability mechanisms for very large storage systems. In Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, pages 146-156, Apr. 2003.
33. Q. Xin, E. L. Miller, and T. J. E. Schwarz. Evaluation of distributed recovery in large-scale storage systems. In Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing (HPDC), pages 172-181, Honolulu, HI, June 2004.
34. L. L. You and C. Karamanolis. Evaluation of efficient archival storage techniques. In Proceedings of the 21st IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies, College Park, MD, Apr. 2004.
35. L. L. You, K. T. Pollack, and D. D. E. Long. Deep Store: An archival storage system architecture. In Proceedings of the 21st International Conference on Data Engineering (ICDE '05), Tokyo, Japan, Apr. 2005. IEEE.
36. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory, 23(3):337-343, 1977.