A hybrid approach to failed disk recovery using RAID-6 codes: Algorithms and performance evaluation

ACM Transactions on Storage

Volumn 7, Issue 3, 2011, Pages

  Xiang, Liping ^a   Xu, Yinlong ^a   Lui, John C S ^b   Chang, Qian ^a   Pan, Yubiao ^a   Li, Runhui ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Disk failure; EVENODD code; RAID recovery; RDP code; Recovery algorithm

Indexed keywords

DISK FAILURE; EVENODD CODE; RAID RECOVERY; RDP CODE; RECOVERY ALGORITHM;

ALGORITHMS;

RECOVERY;

EID: 80455168608     PISSN: 15533077     EISSN: 15533093     Source Type: Journal    
DOI: 10.1145/2027066.2027071     Document Type: Conference Paper

References (39)

1. BAKER, M., SHAH, M., ROSENTHAL, D. S. H., ROUSSOPOULOS, M., MANIATIS, P., GIULI, T., AND BUNGALE, P. 2006. A fresh look at the reliability of long-term digital storage. In Proceedings of the EuroSys Conference (EuroSys'06). ACM, 221-234 (Pubitemid 47485749)
2. BLAUM, M., BRADY, J., BRUCK, J., AND MENON, J. 1995. EVENODD: An efficient scheme for tolerating double disk failures in RAID architectures. IEEE Trans. Comput. 44, 2, 192-202
3. BUCY, J., SCHINDLER, J., SCHLOSSER, S., AND GANGER, G. 2008. The DiskSim simulation environment (v4.0). Tech. rep. CMU PDL 08 101, Carnegie Melon University
4. CASSIDY, B. AND HAFNER, J. L. 2007. Space efficient matrix methods for lost data reconstruction in erasure codes. Tech. rep. RJ10415, IBM Research
5. CHEN, P. M., LEE, E. K., GIBSON, G. A., KATZ, R. H., AND PATTERSON, D. A. 1994. RAID: Highperformance, reliable secondary storage. ACM Comput. Surv. 26, 145-185
6. CORBETT, P., ENGLISH, B., GOEL, A., GRCANAC, T., KLEIMAN, S., LEONG, J., AND SANKAR, S. 2004. Rowdiagonal parity for double disk failure correction. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies (FAST'04). USENIX Association, Berkeley, CA, 1-14
7. DIMAKIS, A. G., GODFREY, P. B., WU, Y., WAINWRIGHT, M. J., AND RAMCHANDRAN, K. 2010. Network coding for distributed storage systems. IEEE Trans. Inform. Theory 56, 4539-4551
8. EMRICH, T., GRAF, F., KRIEGEL, H.-P., SCHUBERT, M., AND THOMA, M. 2010. On the impact of flash ssds on spatial indexing. In Proceedings of the 6th International Workshop on Data Management on New Hardware (DaMoN'10). ACM, New York, NY, 3-8
9. GHEMAWAT, S., GOBIOFF, H., AND LEUNG, S.-T. 2003. The Google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP'03). ACM, New York, NY, 29-43 (Pubitemid 40929686)
10. GREENAN, K. M., LI, X., AND WYLIE, J. J. 2010. Flat XOR-based erasure codes in storage systems: Constructions, efficient recovery, and tradeoffs. In Procceedings of the 26th Symposium on Mass Storage Systems and Technologies (MSST'10). IEEE, Los Alamitos, CA, 1-14
11. HAFNER, J. L., DEENADHAYALAN, V., RAO, K. K., AND TOMLIN, J. A. 2005. Matrix methods for lost data reconstruction in erasure codes. In Proceedings of the 4th USENIX Conference on File and Storage Technologies (FAST'05). USENIX Association, Berkeley, CA, 15-30
12. HOLLAND, M. 1994. On-line data reconstruction in redundant disk arrays. Ph.D. thesis, Carnegie Mellon University, Pittsburgh, PA
13. HOLLAND, M. AND GIBSON, G. A. 1992. Parity declustering for continuous operation in redundant disk arrays. In Proceedings of the 5th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS-V). ACM, New York, NY, 23-35 (Pubitemid 23642267)
14. HOLLAND, M., GIBSON, G. A., AND SIEWIOREK, D. P. 1993. Fast, on-line failure recovery in redundant disk arrays. In Proceedings of the 23rd Annual International Symposium on Fault-Tolerant Computing (FTCS'93). 422-431
15. HOLLAND, M.,GIBSON, G. A., AND SIEWIOREK,D. P. 1994. Architectures and algorithms for on-line failure recovery in redundant disk arrays. Distrib. Paral. Datab. 2, 3, 295-335
16. JOUKOV, N., KRISHNAKUMAR, A.M., PATTI, C., RAI, A., SATNUR, S., TRAEGER, A., AND ZADOK, E. 2007. RAIF: Redundant array of independent filesystems. In Proceedings of 24th IEEE Conference on Mass Storage Systems and Technologies (MSST'07). IEEE, Los Alamitos, CA, 199-212
17. KUBIATOWICZ, J., BINDEL, D., CHEN, Y., CZERWINSKI, S., EATON, P., GEELS, D., GUMMADI, R., RHEA, S., WEATHERSPOON, H., WEIMER, W., WELLS, C., AND ZHAO, B. 2000. Oceanstore: An architecture for global-scale persistent storage. In Proceedings of the 9th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'00). 190-201 (Pubitemid 32470898)
18. LEE, J. Y. B. AND LUI, J. C. S. 2002. Automatic recovery from disk failure in continuous-media servers. IEEE Trans. Paral. Distrib. Syst. 13, 5, 499-515 (Pubitemid 34669583)
19. LUETH, C. 2004. RAID-DP: Network Appliance implementation of RAID double parity for data protection. Tech. rep. No. 3298, Network Appliance Inc
20. LYMAN, P. AND VARIAN, H. R. 2003. How much information? http://www.sims.berkeley.edu/how-much-info-2003
21. MA, S. L. 1994. A survey of partial difference sets. Des. Codes Cryptog. 4, 3, 221-261
22. MENON, J. AND MATTSON., D. 1992. Comparison of sparing alternative for disk arrays. In Proceedings of the International Symposium on Computer Architecture (ISCA'92). 318-329 (Pubitemid 23579888)
23. MERCHANT, A. AND YU, P. S. 1996. Analytic modeling of clustered RAID with mapping based on nearly random permutation. IEEE Trans. Comput. 45, 3, 367-373 (Pubitemid 126772345)
24. MUNTZ, R. R. AND LUI, J. C. S. 1990. Performance analysis of disk arrays under failure. In Proceedings of the 16th International Conference on Very Large Databases (VLDB'90). Morgan Kaufmann Publishers Inc., San Francisco, CA, 162-173
25. PINHEIRO, E., WEBER, W.-D., AND BARROSO, L. A. 2007. Failure trends in a large disk drive population. In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST'07). USENIX Association, Berkeley, CA, 17-28
26. PLANK, J. S. 2008. The RAID-6 liberation codes. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST'08). USENIX Association, Berkeley, CA, 1-14
27. PLANK, J. S., LUO, J., SCHUMAN, C. D.,XU, L., AND WILCOX-O'HEARN, Z. 2009. A performance evaluation and examination of open-source erasure coding libraries for storage. In Proccedings of the 7th Conference on File and Storage Technologies (FAST'09). USENIX Association, Berkeley, CA, 253-265
28. PLESS, V. 1998. Introduction to the Theory of Error-Correcting Codes. Wiley Interscience
29. SCHROEDER, B. AND GIBSON, G. A. 2007. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST'07). USENIX Association, Berkeley, CA, 1-16
30. SEAGATE. 2007. Cheetah ® 15K.5 Fibre Channel 146-GB Hard Drive ST3146855FC Product Manual. Tech. rep. Cheetah 15K.5 FC, Seagate Inc
31. THOMASIAN, A. AND MENON, J. 1997. RAID-5 performance with distributed sparing. IEEE Trans. Paral. Distrib. Syst. 8, 6, 640-657
32. TIAN, L., FENG, D., JIANG, H., ZHOU, K., ZENG, L., CHEN, J., WANG, Z., AND SONG, Z. 2007. PRO: A popularity-based multi-threaded reconstruction optimization for RAID-structured storage systems. In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST'05). USENIX Association, Berkeley, CA, 301-314
33. VAN LINT, J., WILSON, R. M., AND HALE, J. K. 1993. A Course in Combinatorics. Cambridge University Press, Cambridge, UK
34. WIKIPEDIA. 2010. DDR2 SDRAM. http://en.wikipedia.org/wiki/DDR2 SDRAM
35. WU, S., JIANG, H., FENG, D., TIAN, L., AND MAO, B. 2009. Workout: I/O workload outsourcing for boosting RAID reconstruction performance. In Proccedings of the 7th USENIX Conference on File and Storage Technologies (FAST'09). USENIX Association, Berkeley, CA, 239-252
36. XIANG, L., XU, Y., LUI, J. C., AND CHANG, Q. 2010. Optimal recovery of single disk failure in RDP code storage systems. In Proceedings of the ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS'10). ACM, New York, NY, 119-130
37. XIN, Q., MILLER, E. L., SCHWARZ, T., LONG, D. D. E., BRANDT, S. A., AND LITWIN, W. 2003. Reliability mechanisms for very large storage systems. In Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'03). IEEE, Los Alamitos, CA, 146-156
38. XIN, Q., MILLER, E. L., AND SCHWARZ, T. J. E. 2004. Evaluation of distributed recovery in large-scale storage systems. In Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing (HPDC'04). IEEE, Los Alamitos, CA, 172-181
39. XU, L. AND BRUCK, J. 1999. X-code: MDS array codes with optimal encoding. IEEE Trans. Inform. Theory 45, 1, 272-276.