IRON file systems

Operating Systems Review (ACM)

Volumn 39, Issue 5, 2005, Pages 206-220

  Prabhakaran, Vijayan ^a   Bairavasundaram, Lakshmi N ^a   Agrawal, Nitin ^a   Gunawi, Haryadi S ^a   Arpaci Dusseau, Andrea C ^a   Arpaci Dusseau, Remzi H ^a  

^a University of Wisconsin   (United States)

Author keywords

Block corruption; Disks; Fail partial failure model; Fault tolerance; Internal redundancy; IRON file systems; Latent sector errors; Reliability; Storage

Indexed keywords

BLOCK CORRUPTION; FAIL-PARTIAL FAILURE MODELS; INTERNAL REDUNDANCY; IRON FILE SYSTEMS; LATENT SECTOR ERRORS;

COMPACT DISKS; COMPUTER SYSTEM RECOVERY; ERROR CORRECTION; FILE EDITORS; PRODUCT DESIGN; RAPID PROTOTYPING;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 33845454575     PISSN: 01635980     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1095809.1095830     Document Type: Article

References (76)

1. A. Acharya. Reliability on the Cheap: How I Learned to Stop Worrying and Love Cheap PCs. EASY Workshop '02, October 2002.
2. A. Altaparmakov. The Linux-NTFS Project. http://linux-ntfs.sourceforge. net/ntfs/, August 2005.
3. G. A. Alvarez, W. A. Burkhard, and F. Cristian. Tolerating Multiple Failures in RAID Architectures with Optimal Storage and Uniform Declustering. In Proceedings of the 24th Annual International Symposium on Computer Architecture (ISCA '97), pages 62-72, Denver, Colorado, May 1997.
4. D. Anderson. "Drive manufacturers typically don't talk about disk failures". Personal Communication from Dave Anderson of Seagate, 2005.
5. D. Anderson, J. Dykes, and E. Riedel. More Than an Interface: SCSI vs. ATA. In Proceedings of the 2nd USENIX Symposium on File and Storage Technologies (FAST '03), San Francisco, California, April 2003.
6. A. C. Arpaci-Dusseau and R. H. Arpaci-Dusseau. Information and Control in Gray-Box Systems. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 43-56, Banff, Canada, October 2001.
7. R. H. Arpaci-Dusseau and A. C. Arpaci-Dusseau. Fail-Stutter Fault Tolerance. In The Eighth Workshop on Hot Topics in Operating Systems (HotOS VIII), pages 33-38, Schloss Elmau, Germany, May 2001.
8. L. N. Bairavasundaram, M. Sivathanu, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. X-RAY: A Non-Invasive Exclusive Caching Mechanism for RAIDs. In Proceedings of the 31st Annual International Symposium on Computer Architecture (ISCA '04), pages 176-187, Munich, Germany, June 2004.
9. W. Bartlett and L. Spainhovver. Commercial Fault Tolerance: A Tale of Two Systems. IEEE Transactions on Dependable and Secure Computing, 1(1):87-96, January 2004.
10. J. Barton, E. Czeck, Z. Segall, and D. Siewiorek. Fault Injection Experiments Using FIAT. IEEE Transactions on Computers, 39(4):1105-1118, April 1990.
11. S. Best. JFS Overview. www.ibm.com/developerworks/library/l-jfs.html, 2004.
12. D. Bitton and J. Gray. Disk shadowing. In Proceedings of the 14th International Conference on Very Large Data Bases (VLDB 14), pages 331-338, Los Angeles, California, August 1988.
13. A. Brown and D. A. Patterson. Towards Maintainability, Availability, and Growth Benchmarks: A Case Study of Software RAID Systems. In Proceedings of the USENIX Annual Technical Conference (USENIX '00), pages 263-276, San Diego, California, June 2000.
14. G. Candea, S. Kawamoto, Y. Fujiki, G. Friedman, and A. Fox. Microreboot - A Technique for Cheap Recovery. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), pages 31-44, San Francisco, California, December 2004.
15. A. Chou, J.-F. Yang, B. Chelf, S. Hallem, and D. Engler. An Empirical Study of Operating System Errors. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 73-88, Banff, Canada, October 2001.
16. P. Corbett, B. English, A. Goel, T. Grcanac, S. Kleiman, J. Leong, and S. Sankar. Row-Diagonal Parity for Double Disk Failure Correction. In Proceedings of the 3rd USENIX Symposium on File and Storage Technologies (FAST '04), pages 1-14, San Francisco, California, April 2004.
17. J. De Vale and P. Koopman. Performance Evaluation of Exception Handling in I/O Libraries. In Proceedings of the International Conference on Dependable Systems and Networks (DSN-2001), Goteborg, Sweden, June 2001.
18. J. R. Douceur and W. J. Bolosky. A Large-Scale Study of File-System Contents, lit Proceedings of the 1999 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (SIGMETRICS '99), pages 59-69, Atlanta, Georgia, May 1999.
19. J. Dykes. "A modern disk has roughly 400,000 lines of code". Personal Communication from James Dykes of Seagate, August 2005.
20. EMC. EMC Centera: Content Addressed Storage System. http://www.emc.com/, 2004.
21. R. W. Emerson. Essays and English Traits - IV: Self-Reliance. The Harvard classics, edited by Charles W. Eliot. New York: P.F. Collier and Son, 1909-14, Volume 5, 1841. A foolish consistency is the hobgoblin of little minds, adored by little statesmen and philosophers and divines.
22. D. Engler, D. Y. Chen, S. Hallem, A. Chou, and B. Chelf. Bugs as Deviant Behavior: A General Approach to Inferring Errors in Systems Code. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 57-72, Banff, Canada, October 2001.
23. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google File System. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP '03), pages 29-43, Bolton Landing (Lake George), New York, October 2003.
24. G. A. Gibson, D. Rochberg, J. Zelenka, D. F. Nagle, K. Amiri, F. W. Chang, E. M. Feinberg, H. Gobioff, C. Lee, B. Ozceri, and E. Riedel. File server scaling with network-attached secure disks. In Proceedings of the 1997 Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/PERFORMANCE '97), pages 272-284, Seattle, Washington, June 1997.
25. J. Gray. A Census of Tandem System Availability Between 1985 and 1990. Technical Report 90.1, Tandem Computers, 1990.
26. R. Green. EIDE Controller Flaws Version 24. http://mindprod.com/eideflaw. html, February 2005.
27. W. Gu, Z. Kalbarczyk, R. K. Iyer, and Z. Yang. Characterization of Linux Kernel Behavior Under Error. In Proceedings of the International Conference on Dependable Systems and Networks (DSN-2003), pages 459-468, San Francisco, California, June 2003.
28. H. S. Gunawi, N. Agrawal, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and J. Schindler. Deconstructing Commodity Storage Clusters. In Proceedings of the 32nd Annual International Symposium on Computer Architecture (ISCA '05), pages 60-73, Madison, Wisconsin, June 2005.
29. V. Henson. A Brief History of UNIX File Systems. http://infohost.nmt.edu/ ~val/fs_slides.pdf, 2004.
30. D. Hitz, J. Lau, and M. Malcolm. File System Design for an NFS File Server Appliance. In Proceedings of the USENIX Winter Technical Conference (USENIX Winter '94), San Francisco, California, January 1994.
31. G. F. Hughes and J. F. Murray. Reliability and Security of RAID Storage Systems and D2D Archives Using SATA Disk Drives. ACM Transactions on Storage, 1(1):95-107, February 2005.
32. Intel Corp. and IBM Corp. Device Driver Hardening. http:// hardeneddrivers.sourceforge.net/, 2002.
33. H. H. Kari. Latent Sector Faults and Reliability of Disk Arrays. PhD thesis, Helsinki University of Technology, September 1997.
34. H. H. Kari, H. Saikkonen, and F. Lombardi. Detection of Defective Media in Disks. In The IEEE International Workshop on Defect and Fault Tolerance in VLSI Systems, pages 49-55, Venice, Italy, October 1993.
35. J. Katcher. PostMark: A New File System Benchmark. Technical Report TR-3022, Network Appliance Inc., October 1997.
36. S. R. Kleiman. Vnodes: An Architecture for Multiple File System Types in Sun UNIX. In Proceedings of the USENIX Summer Technical Conference (USENIX Summer '86), pages 238-247, Atlanta, Georgia, June 1986.
37. B. Lewis. Smart Filers and Dumb Disks. NSIC OSD Working Group Meeting, April 1999.
38. M. G. Luby, M. Mitzenmacher, M. A. Shokrollahi, D. A. Spielman, and V. Stemann. Practical Loss-Resilient Codes. In Proceedings of the Twenty-ninth Annual ACM symposium on Theory of Computing (STOC '97), pages 150-159, El Paso, Texas, May 1997.
39. W. lun Kao, R. K. Iyer, and D. Tang. FINE: A Fault Injection and Monitoring Environment for Tracing the UNIX System Behavior Under Faults. In IEEE Transactions on Software Engineering, pages 1105-1118, 1993.
40. M. K. McKusick, W. N. Joy, S. J. Leffler, and R. S. Fabry. A Fast File System for UNIX. ACM Transactions on Computer Systems, 2(3):181-197, August 1984.
41. M. K. McKusick, W. N. Joy, S. J. Leffler, and R. S. Fabry. Fsck - The UNIX File System Check Program. Unix System Manager's Manual - 4.3 BSD Virtual VAX-11 Version, April 1986.
42. A. Park and K. Balasubramanian. Providing fault tolerance in parallel secondary storage systems. Technical Report CS-TR-057-86, Department of Computer Science, Princeton University, November 1986.
43. 3FS: An In-kernel Integrity Checker and Intrusion detection File System. In Proceedings of the 18th Annual Large Installation System Administration Conference (LISA '04), Atlanta, Georgia, November 2004.
44. D. Patterson, A. Brown, P. Broadwell, G. Candea, M. Chen, J. Cutler, P. Enriquez, A. Fox, E. Kiciman, M. Merzbacher, D. Oppenheimer, N. Sastry, W. Tetzlaff, J. Traupman, and N. Treuhaft. Recovery Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies. Technical Report CSD-02-1175, U.C. Berkeley, March 2002.
45. D. Patterson, G. Gibson, and R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). In Proceedings of the 1988 ACM SIGMOD Conference on the Management of Data (SIGMOD '88), pages 109-116, Chicago, Illinois, June 1988.
46. J. Postel. RFC 793: Transmission Control Protocol, September 1981. Available from ftp://ftp.rfc-editor.org/in-notes/rfc793.txt as of August, 2003.
47. V. Prabhakaran, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Model-Based Failure Analysis of Journaling File Systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN-2005), Yokohama, Japan, June 2005.
48. D. D. Redell, Y. K. Dalal, T. R. Horsley, H. C. Lauer, W. C. Lynch, P. R. McJones, H. G. Murray, and S. C.Purcell. Pilot: An Operating System for a Personal Computer. Communications of the ACM, 23(2):81-92, February 1980.
49. H. Reiser. ReiserFS. www.namesys.com, 2004.
50. P. M. Ridge and G. Field. The Book of SCSI 2/E. No Starch, June 2000.
51. M. Rinard, C. Cadar, D. Dumitran, D. M. Roy, T. Leu, and J. William S. Beebe. Enhancing Server Availability and Security Through Failure-Oblivious Computing. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), San Francisco, California, December 2004.
52. M. Rosenblum and J. Ousterhout. The Design and Implementation of a Log-Structured File System. ACM Transactions on Computer Systems, 10(1):26-52, February 1992.
53. J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4):277-288, November 1984.
54. J. Schindler. "We have experienced a severe performance degradation that was identified as a problem with disk firmware. The disk drives had to be reprogrammed to fix the problem". Personal Communication from J. Schindler of EMC, July 2005.
55. S. W. Schlosser and G. R. Ganger. MEMS-based storage devices and standard disk interfaces: A square peg in a round hole? In Proceed ings of the 3rd USENIX Symposium on File and Storage Technologies (FAST '04), pages 87-100, San Francisco, California, April 2004.
56. F. B. Schneider. Implementing Fault-Tolerant Services Using The State Machine Approach: A Tutorial. ACM Computing Surveys, 22(4):299-319, December 1990.
57. T. J. Schwarz, Q. Xin, E. L. Miller, D. D. Long, A. Hospodor, and S. Ng. Disk Scrubbing in Large Archival Storage Systems. In Proceedings of the 12th Annual Meeting of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), Volendam, Netherlands, October 2004.
58. M. Seltzer, K. Bostic, M. K. McKusick, and C. Staelin. An Implementation of a Log-Structured File System for UNIX. In Proceedings of the USENIX Winter Technical Conference (USENIX Winter '93), pages 307-326, San Diego, California, January 1993.
59. D. Siewiorek, J. Hudak, B. Suh, and Z. Segal. Development of a Benchmark to Measure System Robustness. In Proceedings of the 23rd International Symposium on Fault-Tolerant Computing (FTCS-23), Toulouse, France, June 1993.
60. M. Sivathanu, L. N. Bairavasundaram, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Life or Death at Block Level. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), pages 379-394, San Francisco, California, December 2004.
61. M. Sivathanu, V. Prabhakaran, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Improving Storage System Availability with D-GRAID. In Proceedings of the 3rd USENIX Symposium on File and Storage Technologies (FAST '04), pages 15-30, San Francisco, California, April 2004.
62. M. Sivathanu, V. Prabhakaran, F. I. Popovici, T. E. Denehy, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Semantically-Smart Disk Systems. In Proceedings of the 2nd USENIX Symposium on File and Storage Technologies (FAST '03), pages 73-88, San Francisco, California, April 2003.
63. D. A. Solomon. Inside Windows NT. Microsoft Programming Series. Microsoft Press, 2nd edition, May 1998.
64. C. A. Stein, J. H. Howard, and M. I. Seltzer. Unifying File System Protection. In Proceedings of the USENIX Annual Technical Conference (USENIX '01), Boston, Massachusetts, June 2001.
65. A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XFS File System. In Proceedings of the USENIX Annual Technical Conference (USENIX '96), San Diego, California, January 1996.
66. M. M. Swift, B. N. Bershad, and H. M. Levy. Improving the Reliability of Commodity Operating Systems. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP '03), Bolton Landing (Lake George), New York, October 2003.
67. N. Talagala and D. Patterson. An Analysis of Error Behaviour in a Large Storage System. In The IEEE Workshop on Fault Tolerance in Parallel and Distributed Systems, San Juan, Puerto Rico, April 1999.
68. The Data Clinic. Hard Disk Failure, http://www.dataclinic.co.uk/hard- disk-failures.htm, 2004.
69. Transaction Processing Council. TPC Benchmark B Standard Specification, Revision 3.2. Technical Report, 1990.
70. T. K. Tsai and R. K. Iyer. Measuring Fault Tolerance with the FTAPE Fault Injection Tool. In The 8th International Conference On Modeling Techniques and Tools for Computer Performance Evaluation, pages.26-40, September 1995.
71. S. C. Tweedie. Journaling the Linux ext2fs File System. In The Fourth Annual Lima Expo, Durham, North Carolina, May 1998.
72. J. Wehman and P. den Haan. The Enhanced IDE/Fast-ATA FAQ. http://thef-nym.sci.kun.nl/cgi-pieterh/atazip/atafq.html, 1998.
73. G. Weinberg. The Solaris Dynamic File System. http://members.visi.net/ ~thedave/sun/DynFS.pdf, 2004.
74. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID Hierarchical Storage System. ACM Transactions on Computer Systems, 14(1):108-136, February 1996.
75. J. Yang, P. Twohey, D. Engler, and M. Musuvathi. Using Model Checking to Find Serious File System Errors. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), San Francisco, California, December 2004.
76. X. Yu, B. Gum, Y. Chen, R. Y. Wang, K. Li, A. Krishnamurthy, and T. E. Anderson. Trading Capacity for Performance in a Disk Array. In Proceedings of the 4th Symposium on Operating Systems Design and Implementation (OSDI '00), San Diego, California, October 2000.