End-to-end data integrity for file systems: A ZFS case study

Proceedings of FAST 2010: 8th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2010, Pages 29-42

  Zhang, Yupu ^a   Rajimwale, Abhishek ^a   Arpaci Dusseau, Andrea C ^a   Arpaci Dusseau, Remzi H ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CRIME; FILE ORGANIZATION; RELIABILITY ANALYSIS;

DATA INTEGRITY; END TO END; FAULT INJECTION; FILE SYSTEMS; MEMORY CORRUPTION; STORAGE SYSTEMS; SYSTEM CRASHES;

DIGITAL STORAGE;

EID: 85077089674     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (62)

1. CERT/CC Advisories. http://www.cert.org/advisories/.
2. Kernel Bug Tracker. http://bugzilla.kernel.org/.
3. US-CERT Vulnerabilities Notes Database. http://www.kb.cert.org/vuls/.
4. D. Anderson, J. Dykes, and E. Riedel. More Than an Interface: SCSI vs. ATA. In FAST, 2003.
5. L. N. Bairavasundaram, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Dependability Analysis of Virtual Memory Systems. In DSN, 2006.
6. L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler. An Analysis of Latent Sector Errors in Disk Drives. In SIGMETRICS, 2007.
7. L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. An Analysis of Data Corruption in the Storage Stack. In FAST, 2008.
8. L. N. Bairavasundaram, M. Rungta, N. Agrawal, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and M. M. Swift. Analyzing the Effects of Disk-Pointer Corruption. In DSN, 2008.
9. W. Bartlett and L. Spainhower. Commercial Fault Tolerance: A Tale of Two Systems. IEEE Trans. on Dependable and Secure Computing, 1(1), 2004.
10. J. Barton, E. Czeck, Z. Segall, and D. Siewiorek. Fault Injection Experiments Using FIAT. IEEE Trans. on Comp., 39(4), 1990.
11. R. Baumann. Soft errors in advanced computer systems. IEEE Des. Test, 22(3):258-266, 2005.
12. E. D. Berger and B. G. Zorn. Diehard: probabilistic memory safety for unsafe languages. In PLDI, 2006.
13. J. Bonwick. RAID-Z. http://blogs.sun.com/bonwick/entry/raid z.
14. J. Bonwick and B. Moore. ZFS: The Last Word in File Systems. http://opensolaris.org/os/community/zfs/docs/zfs last.pdf.
15. F. Buchholz. The structure of the Reiser file system. http://homes.cerias.purdue.edu/~florian/reiser/reiserfs.php.
16. R. Card, T. Ts'o, and S. Tweedie. Design and Implementation of the Second Extended Filesystem. In Proceedings of the First Dutch International Symposium on Linux, 1994.
17. J. Carreira, H. Madeira, and J. G. Silva. Xception: A Technique for the Experimental Evaluation of Dependability in Modern Computers. IEEE Trans. on Software Engg., 1998.
18. J. Chapin, M. Rosenblum, S. Devine, T. Lahiri, D. Teodosiu, and A. Gupta. Hive: Fault Containment for Shared-Memory Multiprocessors. In SOSP, 1995.
19. C. L. Chen. Error-correcting codes for semiconductor memories. SIGARCH Comput. Archit. News, 12(3):245-247, 1984.
20. A. Chou, J. Yang, B. Chelf, S. Hallem, and D. Engler. An Empirical Study of Operating System Errors. In SOSP, 2001.
21. N. Dor, M. Rodeh, and M. Sagiv. CSSV: towards a realistic tool for statically detecting all buffer overflows in C. In PLDI, 2003.
22. D. Engler, D. Y. Chen, S. Hallem, A. Chou, and B. Chelf. Bugs as Deviant Behavior: A General Approach to Inferring Errors in Systems Code. In SOSP, 2001.
23. A. Eto, M. Hidaka, Y. Okuyama, K. Kimura, and M. Hosono. Impact of neutron flux on soft errors in mos memories. In IEDM, 1998.
24. R. Green. EIDE Controller Flaws Version 24. http://mindprod.com/jgloss/eideflaw.html.
25. W. Gu, Z. Kalbarczyk, R. K. Iyer, and Z. Yang. Characterization of Linux Kernel Behavior Under Errors. In DSN, 2003.
26. H. S. Gunawi, A. Rajimwale, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. SQCK: A Declarative File System Checker. In OSDI, 2008.
27. S. Hallem, B. Chelf, Y. Xie, and D. Engler. A system and language for building system-specific, static analyses. In PLDI, 2002.
28. J. Hamilton. Successfully Challenging the Server Tax. http://perspectives.mvdirona.com/2009/09/03/Successfully ChallengingTheServerTax.aspx.
29. R. Hastings and B. Joyce. Purify: Fast detection of memory leaks and access errors. In USENIX Winter, 1992.
30. D. T. J. A white paper on the benefits of chipkill- correct ecc for pc server main memory. IBM Microelectronics Division, 1997.
31. W. Kao, R. K. Iyer, and D. Tang. FINE: A Fault Injection and Monitoring Environment for Tracing the UNIX System Behavior Under Faults. In IEEE Trans. on Software Engg., 1993.
32. A. Krioukov, L. N. Bairavasundaram, G. R. Goodson, K. Srinivasan, R. Thelen, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Parity Lost and Parity Regained. In FAST, 2008.
33. S. Krishnan, G. Ravipati, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and B. P. Miller. The Effects of Metadata Corruption on NFS. In StorageSS, 2007.
34. X. Li, K. Shen, M. C. Huang, and L. Chu. A memory soft error measurement on production systems. In USENIX, 2007.
35. T. C. May and M. H. Woods. Alpha-particle-induced soft errors in dynamic memories. IEEE Trans. on Electron Dev, 26(1), 1979.
36. N. Megiddo and D. Modha. Arc: A self-tuning, low overhead replacement cache. In FAST, 2003.
37. R. C. Merkle. A digital signature based on a conventional encryption function. In CRYPTO, 1987.
38. D. Milojicic, A. Messer, J. Shau, G. Fu, and A. Munoz. Increasing relevance of memory hardware errors: a case for recoverable programming models. In ACM SIGOPS European Workshop, 2000.
39. B. Moore. Ditto Blocks - The Amazing Tape Repellent. http://blogs.sun.com/bill/entry/ditto blocks the amazing tape.
40. E. Normand. Single event upset at ground level. Nuclear Science, IEEE Transactions on, 43(6):2742-2750, 1996.
41. T. J. O'Gorman, J. M. Ross, A. H. Taber, J. F. Ziegler, H. P. Muhlfeld, C. J. Montrose, H. W. Curtis, and J. L. Walsh. Field testing for cosmic ray soft errors in semiconductor memories. IBM J. Res. Dev., 40(1):41-50, 1996.
42. Oracle Corporation. Btrfs: A Checksumming Copy on Write Filesystem. http://oss.oracle.com/projects/btrfs/.
43. D. Patterson, G. Gibson, and R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). In SIGMOD, 1988.
44. V. Prabhakaran, L. N. Bairavasundaram, N. Agrawal, H. S. Gunawi, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. IRON File Systems. In SOSP, 2005.
45. F. Qin, S. Lu, and Y. Zhou. Safemem: Exploiting ecc-memory for detecting memory leaks and memory corruption during production runs. In HPCA, 2005.
46. B. Schroeder, E. Pinheiro, and W.-D. Weber. DRAM errors in the wild: a large-scale field study. In SIGMETRICS, 2009.
47. T. J. Schwarz, Q. Xin, E. L. Miller, D. D. Long, A. Hospodor, and S. Ng. Disk Scrubbing in Large Archival Storage Systems. In MASCOTS, 2004.
48. D. Siewiorek, J. Hudak, B. Suh, and Z. Segal. Development of a Benchmark to Measure System Robustness. In FTCS-23, 1993.
49. C. A. Stein, J. H. Howard, and M. I. Seltzer. Unifying File System Protection. In USENIX, 2001.
50. Sun Microsystems. Solaris Internals: FileBench. http://www.solarisinternals.com/wiki/index.php/FileBench.
51. Sun Microsystems. ZFS On-Disk Specification. http://www.opensolaris.org/os/community/zfs/docs/ondiskformat0822.pdf.
52. R. Sundaram. The Private Lives of Disk Drives. http://partners.netapp.com/go/techontap/matl/sample/0206tot resiliency.html.
53. M. M. Swift, B. N. Bershad, and H. M. Levy. Improving the Reliability of Commodity Operating Systems. In SOSP, 2003.
54. The Data Clinic. Hard Disk Failure. http://www.dataclinic.co.uk/hard-disk-failures.htm.
55. T. K. Tsai and R. K. Iyer. Measuring Fault Tolerance with the FTAPE Fault Injection Tool. In The 8th International Conference On Modeling Techniques and Tools for Computer Performance Evaluation, 1995.
56. S. C. Tweedie. Journaling the Linux ext2fs File System. In The Fourth Annual Linux Expo, Durham, North Carolina, 1998.
57. J. Wehman and P. den Haan. The Enhanced IDE/Fast-ATA FAQ. http://thef-nym.sci.kun.nl/cgi-pieterh/atazip/atafq.html.
58. G. Weinberg. The Solaris Dynamic File System. http://members.visi.net/~thedave/sun/DynFS.pdf.
59. A. Wenas. ZFS FAQ. http://blogs.sun.com/awenas/entry/zfs faq.
60. Y. Xie, A. Chou, and D. Engler. Archer: using symbolic, path-sensitive analysis to detect memory access errors. In FSE, 2003.
61. J. Yang, C. Sar, and D. Engler. EXPLODE: A Lightweight, General System for Finding Serious Storage System Errors. In OSDI, 2006.
62. J. F. Ziegler and W. A. Lanford. Effect of cosmic rays on computer memories. Science, 206(4420):776-788, 1979.