A fresh look at the reliability of long-term digital storage

Proceedings of the 2006 EuroSys Conference

Volumn , Issue , 2006, Pages 221-234

  Baker, Mary ^a   Shah, Mehul ^a   Rosenthal, David S H ^b   Roussopoulos, Mema ^c   Maniatis, Petros ^d   Giuli, Tj ^e   Bungale, Prashanth ^c  

^a HEWLETT PACKARD LABORATORIES   (United States)

^b STANFORD UNIVERSITY   (United States)

^c HARVARD UNIVERSITY   (United States)

^d INTEL CORPORATION   (United States)

^e FORD MOTOR COMPANY   (United States)

Author keywords

Digital preservation; Storage systems

Indexed keywords

COMPUTER HARDWARE; COMPUTER SOFTWARE; FAULT TOLERANT COMPUTER SYSTEMS; RELIABILITY THEORY; WEB SERVICES; WEBSITES;

DIGITAL PRESERVATION; LONG-TERM STORAGE; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 34748917584     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1217935.1217957     Document Type: Conference Paper

References (58)

1. 104th Congress, United States of America. Public Law 104-191: Health Insurance Portability and Accountability Act (HIPAA), Aug. 1996.
2. 107th Congress, United States of America. Public Law 107-204: Sarbanes-Oxley Act of 2002, July 2002.
3. D. Akst. Postcard from Cyberspace. Los Angeles Times, Jan. 1995.
4. AMIA2003. Fact Sheet 5 - Estimating Tape Life. http://www.amianet.org/ publication/resources/guidelines/videofacts/tapelife.html, 2003.
5. D. Anderson, J. Dykes, and E. Riedel. More Than an Interface - SCSI vs. ATA. In FAST, 2003.
6. R. J. Anderson. The Eternity Service. In 1st Intl. Conf. on the Theory and Applications of Cryptology, 1996.
7. ARL - Association of Research Libraries. ARL Statistics 2000-01. http://www.arl.org/stats/arlstat/01pub/intro.html, 2001.
8. M. Baker, K. Keeton, and S. Martin. Why Traditional Storage Systems Don't Help Us Save Stuff Forever. In Proc. 1st IEEE Workshop on Hot Topics in System Dependability, 2005.
9. W. Bartlett and L. Spanhower. Commercial Fault Tolerance: A Tale of Two Systems. IEEE Transactions on Dependable and Secure Computing, 1(1):87-96, 2004.
10. P. M. Chen, E. L. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: High Performance, Reliable Secondary Storage. ACM Computing Surveys, 26(2):145-185, June 1994.
11. Y. Chen, J. Edler, A. Goldberg, A. Gottlieb, S. Sobti, and P. Yianilos. A Prototype Implementation of Archival Intermemory. In Intl. Conf. on Digital Libraries, 1999.
12. P. Corbett, B. English, A. Goel, T. Grcanac, S. Kleiman, J. Leong, and S. Sankar. Row-Diagonal Parity for Double Disk Failure Correction. In FAST, 2004.
13. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area Cooperative Storage with CFS. In SOSP, 2001.
14. T. Dawber, G. Meadors, and F. Moore. Epidemiological Approaches to Heart Disease: the Framingham Study. American Journal of Public Health, 41(3):279-81, Mar. 1951.
15. W. Diffie. Perspective: Decrypting The Secret to Strong Security. http://news.com.com/2010-1071-980462.html, Jan. 2003.
16. G. Goble. http://ghg.ecn.purdue.edu/~ghg/.
17. Google, Inc. About Gmail. http://gmail.google.com/gmail/help/about.html, June 2005.
18. J. Gray, A. Szalay, A. Thakar, C. Stoughton, and J. vandenBerg. Online Scientific Data Curation, Publication, and Archiving. Technical Report MSR-TR-2002-74, Microsoft Research, July 2002.
19. J. Gray and C. van Ingen. Emprical Measurements of Disk Failure Rates and Error Rates. Technical Report MSR-TR-2005-166, Microsoft Research, Dec. 2005.
20. E. Hansen. Hotmail Incinerates Customer Files. News.com, http://news.com.com/Hotmail+incinerates+customer+files/2100-1038_3-5226090.html, June 2004.
21. J. Horlings. CD-R's Binnen Twee Jaar Onleesbaar, 2003. PC Active, See http://www.cdfreaks.com/news/7751.
22. IT Committee Inst. of Chartered Accountants of India. Tape backup vis-à-vis online Backup. Harmony IT, http://isaicai.org/Harmony/ 2004-07/index_plain.htm, July 2004.
23. F. Junqueira, R. Bhagwan, A. Hevia, K. Marzullo, and G. M. Voelker. Surviving Internet Catastrophes. In Usenix Annual Technical Conference, 2005.
24. H. Kari. Latent Sector Faults and Reliability of Disk Arrays. PhD thesis, Computer Science Department, Helsinki University of Technology, Finaland, Espoo, Finland, 1997.
25. M. Keeney, E. Kowalski, D. Cappelli, A. Moore, T. Shimeall, and S. Rogers. Insider Threat Study: Computer System Sabotage in Critical Infrastructure Sectors, http://www.secretservice.gov/ntac/its_report_050516.pdf, May 2005.
26. K. Keeton and E. Anderson. A Backup Appliance Composed of High-capacity Disk Drives. In HotOS, May 2001.
27. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. OceanStore: An Architecture for Global-Scale Persistent Storage. In ASPLOS, 2000.
28. R. Lau. Personal Communication, Sept. 2004.
29. D. Lazarus. Precious Photos Disappear. San Francisco Chronicle, http://www.sfgate.com/cgi-bin/article.cgi?file=/chronicle/archive/2005/02/02/ BUG7QB3U0Si.DTL, Feb. 2005.
30. P. Luse and M. Schmisseur. Understanding Intelligent RAID 6. Technology @Intel Magazine, http://www.intel.com/technology/magazine/ computing/RAID-6-0505.htm, 2006.
31. R. Malda. The Myth of the 100 Year CD-Rom. Slashdot, http://slashdot.org/article.pl?sid=04/04/22/1658251&mode=flat&tid=137 &ti, Apr. 2004.
32. P. Maniatis, M. Roussopoulos, T. Giuli, D. S. H. Rosenthal, and M. Baker. The LOCKSS Peer-to-Peer Digital Preservation System. ACM TOCS, 23(1), Feb. 2005.
33. D. Milbank. White House Web Scrubbing, Dec. 2003. The Washington Post, http://www.washingtonpost.com/ac2/wp-dyn?pagename=article&node= &contentId=A9821-2003Dec17¬Found=true.
34. C. Mohan. Disk Read-Write Optimizations and Data Integrity in Transaction Systems Using Write-Ahead Logging. In ICDE, 1995.
35. NASA. Aviation Safety Reporting System. http://asrs.arc.nasa.gov/.
36. OCLC. Persistent Uniform Resource Locator. http://purl.ocle.org/.
37. K. Pang, K. Yau, and Hung-Hsiang Chou, The Earth's Palaeorotation, Postglacial Rebound and Lower Mantle Viscosity from Analysis of Ancient Chinese Eclipse Records. Pure and Applied Geophysics, 145(3-4):459-485, Sept. 1995.
38. D. Patterson, G. Gibson, and R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). In SIGMOD, 1988.
39. V. Prabhakaran, N. Agrawal, L. Bairavasundaram, H. Gunawi, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. IRON File Systems. In SOSP, 2005.
40. J. Reason. Human Error. Cambridge University Press, 1990.
41. Reuters. Time Warner Says Employee Data Lost by Outside Storage Company. The New York Times, http://www.nytimes.com/2005/05/02/business/business- tech-timewarner.html?ex=1272686400&en-39cc177d5da055d2&ei= 5090&partner=rssuserland&emc=rss, May 2005.
42. D. S. H. Rosenthal. A Digital Preservation Network Appliance Based on OpenBSD. In Proceedings of BSDcon 2003, San Mateo, CA, USA, Sept. 2003.
43. A. Rowstron and P. Druschel. Storage Management and Caching in PAST, A Large-scale, Persistent Peer-to-peer Storage Utility. In SOSP, 2001.
44. J. H. Saltzer. Fault-tolerance in Very Large Archival Systems. In SIGOPS European Workshop, 1990.
45. T. Schwarz, Q. Xin, E. Miller, D. Long, A. Hospodor, and S. Ng. Disk Scrubbing in Large Archival Storage Systems. In MASCOTS, 2004.
46. Seagate. ST3200822A Configuration and Specifications. http://www.seagate.com/support/disc/specs/ata/st3200822a.html, Sept. 2003.
47. Seagate. Cheetah 15K.4. http://www.seagate.com/cda/products/discsales/ enterprise/tech/0,1084,656,00.html, 2005.
48. R. F. Sproull and J. Eisenberg. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. http://www.nap.edu/catalog/11332.html, June 2005.
49. N. Talagala. Characterizing Large Storage Systems: Error Behavior and Performance Benchmarks. PhD thesis, CS Div., Univ. of California at Berkeley, Berkeley, CA, USA, Oct. 1999.
50. The Memory Hole. Department of Education to Delete Years of Research From Its Website. http://www.thememoryhole.org/edu/ed-info.htm, 2002.
51. The OpenRAW Working Group. The RAW Problem. http://openraw.org, 2005.
52. J. Tom. When Mutilators Stalk the Stacks. http://gort.ucsd.edu/preseduc/ bmlmutil.htm, 2000.
53. S. Towers. Personal Communication, July 2004.
54. M. Waldman and D. Mazières. Tangler: A Censorship-Resistant Publishing System Based On Document Entanglements. In ACM Conf. on Computer and Communications Security, 2001.
55. H. Weatherspoon and J. Kubiatowicz. Erasure Coding vs. Replication: A Quantitative Comparison. In IPTPS, Mar. 2002.
56. H. Weatherspoon, T. Moscovitz, and J. Kubiatowicz. Introspective Failure Analysis: Avoiding Correlated Failures in Peer-to-peer Systems. In Intl. Workshop on Reliable Peer-to-Peer Distributed Systems, 2002.
57. D. Whitehouse. Reworked Images Reveal Hot Venus. BBC News, Jan. 2004.
58. L. L. You, K. T. Pollack, and D. D. Long. Deep Store: An Archival Storage System Architecture. In ICDE, 2005.