Keeping bits safe: How hard can it be?

Communications of the ACM

Volumn 53, Issue 11, 2010, Pages 47-55

  Rosenthal, David S H ^a  

^a Silicon Valley ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMON MODE FAILURES; DATA BITS; DATA LOSS; EMBEDDED CPU; FLASH STORAGE; IDENTICAL SYSTEMS; LOW POWER; RAID ARRAYS; SOFT-COPY; SOFTWARE BUG; SYSTEM FAILURES;

CRIME; DISKS (STRUCTURAL COMPONENTS); PROGRAM PROCESSORS; SYSTEMS ENGINEERING;

DATA STORAGE EQUIPMENT;

EID: 78149245820     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/1839676.1839692     Document Type: Article

References (44)

1. Adams, D. The Hitchhiker's Guide to the Galaxy. British Broadcasting Corp., 1978.
2. Amazon. Amazon S3 API Reference (Mar. 2006); http://docs. amazonwebservices.com/AmazonS3/latest/API/.
3. Andersen, D.G., Franklin, J., Kaminsky, M., Phanishayee, A., Tan, L., Vasudevan, V. FA WN: A fast array of wimpy nodes. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (2009), 1-14.
4. Anderson. D. Hard drive directions (Sept. 2009); http://www. digitalpreservation.gov/news/events/other-meetings/storage09/docs/ 2-4-Andersonseagate-v3-HDtrends.pdf.
5. Bairavasundaram, L., Goodson, G., Schroeder, B., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H. An analysis of data corruption in the storage stack. In Proceedings of 6th Usenix Conference on File and Storage Technologies, (2008).
6. Baker, M., Shah, M., Rosenthal, D.S.H., Roussopoulos, M., Maniatis, P., Giuli, T.J., Bungale, P. A fresh look at the reliability of long-term digital storage. In Proceedings of EuroSys2006, (Apr. 2006).
7. Cappello, F., Geist, A., Gropp, B., Kale, S., Kramer, B., Snir, M. Toward exascale resilience. Technical Report TR-JLPC-09-101 INRIA-Illinois Joint Laboratory on Petascale Computing, (July 2009).
8. CERN . Worldwide LHC Computing Grid, 2008; http://lcg.web.cern.ch/LCG/.
9. Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A., Burrows, M., Chandra, T., Fikes, A., Grube, R.E. Bigtable: A distributed storage system for structured data. In Proceedings of the 7th Usenix Symposium on Operating System Design and Implementation, (2006), 205-218.
10. Christensen, C.M. The Innovator's Dilemma: When New Technologies Cause Great Firms to Fail. Harvard Business School Press (June 1997), Cambridge, MA.
11. Corbett, P., English, B., Goel, A., Grcanac, T., Kleiman, S., Leong, J., Sankar, S. Row-diagonal parity for double disk failure correction. In 3rd Usenix Conference on File and Storage Technologies (Mar. 2004).
12. Elerath. J. Hard-disk drives: The good, the bad, and the ugly. Commun. ACM 52, 6 (June 2009).
13. Elerath, J.G., Pecht, M. Enhanced reliability modeling of RAID storage systems. In Proceedings of the 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, (2007), 175-184.
14. Engler, D. A system's hackers crash course: techniques that find lots of bugs in real (storage) system code. In Proceedings of 5th Usenix Conference on File and Storage Technologies, (Feb. 2007).
15. Haber, S., Stornetta, W.S. How to timestamp a digital document. Journal of Cryptology 3, 2 (1991), 99-111.
16. Hafner, J.L., Deenadhayalan, V., Belluomini, W., Rao, K. Undetected disk errors in RAID arrays. IBM Journal of Research & Development 52, 4/5, (2008).
17. Jiang, W., Hu, C., Zhou, Y., Kanevsky, A. Are disks the dominant contributor for storage failures? A comprehensive study of storage subsystem failure characteristics. In Proceedings of 6th Usenix Conference on File and Storage Technologies, (2008).
18. Kelemen, P. Silent corruptions. In 8th Annual Workshop on Linux Clusters for Super Computing, (2007)
19. Klima, V. Finding MD5 collisions-A toy for a notebook. Cryptology ePrint Archive, Report 2005/075; http://eprint.iacr.org/2005/075.
20. Krioukov, A., Bairavasundaram, L.N., Goodson, G.R., Srinivasan, K., Thelen, R., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H. Parity lost and parity regained. In Proceedings of 6th Usenix Conference on File and Storage Technologies, (2008).
21. Maniatis, P., Roussopoulos, M., Giuli, T.J., Rosenthal, D.S.H., Baker, M., Muliadi, Y. Preserving peer replicas by rate-limited sampled voting. In Proceedings of the 19th ACM Symposium on Operating Systems Principles, (Oct. 2003), 44-59.
22. Marshall, C. "It's like a fire. You just have to move on:" Rethinking personal digital archiving. In 6th Usenix Conference on File and Storage Technologies, (2008).
23. Mearian, L. Start-up claims its DVDs last 1,000 years. Computerworld, (Nov. 2009).
24. Mellor, C. Drive suppliers hit capacity increase difficulties. The Register, (July 2010).
25. Michail, H.E., Kakarountas, A.P., Theodoridis, G., Goutis, C.E. A low-power and high-throughput implementation of the SHA-1 hash function. In Proceedings of the 9th WSEAS International Conference on Computers, (2005).
26. Mielke, N., Marquart, T., Wu1, N., Kessenich, J., Belgal, H., Schares, E., Trivedi, F., Goodness, E., Nevill, L.R. Bit error rate in NAN D flash memories. In 46th Annual International Reliability Physics Symposium, (2008), 9-19.
27. Moore, R. L., D'Aoust, J., McDonald, R. H., Minor, D. Disk and tape storage cost models. In Archiving 2007.
28. National Institute of Standards and Technology (NIST ). Federal Information Processing Standard Publication 180-181: Secure Hash Standard, (Apr. 1995).
29. Patterson, D. A., Gibson, G., Katz, R.H. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the ACM SIGMOD International Conference on Management of Data, (June 1988), 109-116.
30. Pinheiro, E., Weber, W.-D., Barroso, L. A. Failure trends in a large disk drive population. In Proceedings of 5th Usenix Conference on File and Storage Technologies, (Feb. 2007).
31. Prabhakaran, V., Agrawal, N., Bairavasundaram, L., Gunawi, H., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H. IRON file systems. In Proceedings of the 20th Symposium on Operating Systems Principles, (2005).
32. Rosenthal, D.S.H. Bit preservation: A solved problem? International Journal of Digital Curation 1, 5 (2010).
33. Rosenthal, D.S.H. LOCKSS: Lots of copies keep stuff safe. In NIST Digital Preservation Interoperability Framework Workshop, (Mar. 2010).
34. Rosenthal, D.S.H., Robertson, T.S., Lipkis, T., Reich, V., Morabito, S. Requirements for digital preservation systems: a bottom-up approach. D-Lib Magazine 11, 11 (2005).
35. Schroeder, B., Gibson, G. Disk failures in the real world: What does an MTF of 1,000,000 hours mean to you? In Proceedings of 5th Usenix Conference on File and Storage Technologies (Feb. 2007).
36. Schwarz, T., Baker, M., Bassi, S., Baumgart, B., Flagg, W., van Imngen, C., Joste, K., Manasse, M., Shah, M. Disk failure investigations at the Internet Archive. In Work-in-Progress Session, NASA/IEEE Conference on Mass Storage Systems and Technologies, (2006).
37. SDSS (Sloan Digital Sky Survey), 2008; http://www. sdss.org/.
38. Shah, M.A., Baker, M., Mogul, J.C., Swaminathan, R. Auditing to keep online storage services honest. In 11th Workshop on Hot Topics in Operating Systems, (May 2007).
39. Storer, M.W., Greenan, K. M., Miller, E.L., Voruganti, K. Pergamum: replacing tape with energy-efficient, reliable, disk-based archival storage. In Proceedings of 6th Usenix Conference on File and Storage Technologies, (2008).
40. Sun Microsystems. Sales Terms and Conditions, Section 11.2, (Dec. 2006); http://store.sun.com/CMTemplate/docs/legal-terms/TnC.jsp#11.
41. Sun Microsystems. ST 5800 presentation. Sun PAS IG Meeting, (June 2008).
42. Talagala, N. Characterizing large storage systems: error behavior and performance benchmarks. Ph.D. thesis, Computer Science Division, University of California at Berkeley, (Oct. 1999).
43. Williams, P., Rosenthal, D. S. H., Roussopoulos, M., Georgis, S. Predicting the archival life of removable hard disk drives. In Archiving 2008, (June 2008).
44. Zhang, Y., Rajimwale, A., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H. End-to-end data integrity for file systems: A ZFS case study. In 8th Usenix Conference on File and Storage Technologies, (2010).