REO: A generic RAID engine and optimizer

FAST 2007 - 5th USENIX Conference on File and Storage Technologies

Volumn , Issue , 2007, Pages 261-276

  Kenchammana–Hosekote, Deepak ^a   He, Dingshan ^b   Hafner, James Lee ^a  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); ENGINES;

COST PROHIBITIVE; DATA LOSS; DATA STORAGE; DISK FAILURE; DISK RELIABILITIES; LEAST COST; OPTIMIZERS; TRACE DRIVEN SIMULATION;

DIGITAL STORAGE;

EID: 85008870476     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. K. Amiri, G. Gibson, and R. Golding. Highly concurrent shared storage. In 20th Intl. Conf. on Distributed Computing Sys., April 2000.
2. Archivas. http://www.archivas.com/.
3. M. Blaum, J. Brady, J. Bruck, and J. Menon. EVENODD:An optimal scheme for tolerating double disk failure in RAID architectures. IEEE Transactions on Computers, 44(2):192–202, 1995.
4. M. Blaum, J. Bruck, and A. Vardy. MDS array codes with independent parity symbols. IEEE Transactions on Information Theory, 42(2):529–542, March 1996.
5. E. Borowsky, R. Golding, A. Merchant, L. Schrier, E. Shriver, M. Spasojevic, and J. Wilkes. Using attribute-managed storage to achieve QoS, 1997.
6. Aarohi Communications. http://www.aarohi.net.
7. V. Deenadhayalan, J. Hafner, K. Rao, and J. Tomlin. Matrix methods for lost data reconstruction in erasure codes. In Proceedings of the Fourth USENIX Conference on File and Storage Technologies, pages 183–196, San Francisco, CA USA, December 2005.
8. Intel Digital Enterprise Group Storage Components Division. SCD roadmap update. Powerpoint slide deck, March 2005.
9. M. Abd el-Malek et. al. Ursa Minor: Versatile cluster-based storage. In USENIX File and Storage Technologies, pages 59–72, 2005.
10. A. Dholakia et. al. Analysis of a new intra-disk redundancy scheme for high-reliability raid storage systems in the presence of unrecoverable errors. In Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems, pages 373–374, 2006.
11. C. Fleiner et. al. Reliability of modular mesh-connected intelligent storage brick systems. IBM Journal of Research and Development, 50(2–3), 2006.
12. P. Corbett et. al. Row-diagonal parity for double disk failure. In Proceedings of the Third USENIX Conference on File and Storage Technologies, pages 1–14, 2004.
13. G. Ganger, B. Worthington, and Y. Patt. The DiskSim Simulation Environment - Version 2.0 Reference Manual.
14. G. Gibson, W. Courtright, M. Holland, and J. Zelenka. RAIDframe: Rapid prototyping for disk arrays. Technical Report CMU-CS-95-200, CMU, 1995.
15. G. Gibson and D. Patterson. Designing disk arrays for high data reliability. Journal of Parallel and Distributed Computing, 17(1–2):4–27, 1993.
16. G. Goodson, J. Wylie, G. Ganger, and M. Reiter. Efficient Byzantine-tolerant erasure-coded storage. In International Conference on Dependable Systems & Networks. IEEE, June 2004.
17. J. Gray. Storage bricks. FAST keynote, also as http://www.research.microsoft.com/ Gray/talks/Gray _Storage_FAST.ppt, January 2002.
18. J. Gray and C. van Ingen. Empirical measurements of disk failure rates and error rates. Technical Report MSR-TR-2005-166, Microsoft Research, December 2005.
19. J. Hafner. WEAVER codes: Highly Fault Tolerant Erasure Codes for Storage Systems. In Proceedings of the Fourth USENIX Conference on File and Storage Technologies, pages 211–224, San Francisco, CA USA, December 2005.
20. W. Hsu and A. Smith. Characteristics of I/O traffic in personal computer and server workloads. IBM Systems Journal, 42(2), 2003.
21. C. Huang and L. Xu. STAR: An efficient coding scheme for correcting triple storage node failures. In Proceedings of the Fourth USENIX Conference on File and Storage Technologies, San Francisco, CA USA, 2005.
22. Adaptec Inc. Adaptec SCSI RAID 2130SLP. http://www.adaptec.com/enUS/products/raid/ultra320_pcix/ASR-2130S/index.htm.
23. Network Appliance Inc. Netapp primary storage. http://www.netapp.com/products/filer/.
24. Intel. Intel IOP I/O Processor Chipset. http://www.intel.com/design/iio/iop331.htm.
25. iVivity. http://www.ivivity.com/.
26. Lawrence Livermore National Laboratory. Fifth Generation ASC Platform - Purple. http://www.llnl.gov/asc/platforms/purple/.
27. Aristos Logic. http://www.aristoslogic.com/.
28. F. MacWilliams and N. Sloane. The Theory of Error-correcting Codes. North Holland, 1997.
29. J. Menon and D. Mattson. Comparison of sparing alternatives for disk arrays. In Proc. International Symposium on Computer Architecture, pages 318–329, May 1992.
30. R. Muntz and J. Lui. Performance analysis of disk arrays under failure. In Proceedings of the 16th VLDB Conference, pages 162–173, 1990.
31. LeftHand Networks. http://www.lefthandnetworks.com/.
32. D. Patterson, G. Gibson, and R. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings ACM SIGMOD, pages 109–116. ACM, June 1988.
33. J. Plank. A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems. Software Practice and Experience, 27(9):995–1012, 1997.
34. K. Rao, J. Hafner, and R. Golding. Reliability for networked storage nodes. In International Conference on Dependable Systems and Networks, 2006.
35. D. Stodolsky, M. Holland, W. Courtright, and G. Gibson. Parity logging disk arrays. ACM Transactions on Computer Systems, 12(3):206–235, 1994.
36. Isilon Systems. Uncompromising reliability through clustered storage. http://www.isilon.com/media/pdf/Isilon _Uncompromising_Reliability.pdf, May 2005.
37. Terrascale Technologies. http://www.terrascale.com/.
38. st IEEE Symposium on High-Performance Computer Architecture, pages 186–197. IEEE, January 1995.
39. Various. Storage Performance Council Benchmark Version 1.0. http://www.storageperformance.org.
40. L. Vepstas. Linux RAID. http://www.tldp.org/HOWTO/Software-RAID0.4x-HOWTO.html, November 1998.
41. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. ACM Trans. Comput. Syst., 14(1):108–136, 1996.
42. L. Xu and J. Bruck. X–code: MDS array codes with optimal encoding. IEEE Transactions on Information Theory, 45:272–276, 1999.