The MDS queue: Analysing the latency performance of erasure codes

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2014, Pages 861-865

  Shah, Nihar B ^a   Lee, Kangwook ^a   Ramchandran, Kannan ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); FORWARD ERROR CORRECTION; QUEUEING THEORY; REED-SOLOMON CODES; THROUGHPUT;

ARCHIVAL STORAGE SYSTEMS; CLOSED-FORM EXPRESSION; DATA STORAGE SYSTEMS; DISTRIBUTED DATA STORAGES; LATENCY PERFORMANCE; SCHEDULING POLICIES; STORAGE EFFICIENCY; UPPER AND LOWER BOUNDS;

DIGITAL STORAGE;

EID: 84906568882     PISSN: 21578095     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2014.6874955     Document Type: Conference Paper

References (22)

1. D. Ford et al., "Availability in globally distributed storage systems, " in USENIX OSDI, Oct. 2010.
2. K. V. Rashmi et al., "A solution to the network challenges of data recovery in erasure-coded distributed storage systems: A study on the Facebook warehouse cluster, " in Proc. USENIX HotStorage, Jun. 2013.
3. N. B. Shah, K. Lee, and K. Ramchandran, "The MDS queue: Analysing the latency performance of erasure codes." [Online]. Available: ArXiv:1211.5405 [cs.IT].
4. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes, "Hibernator: helping disk arrays sleep through the winter, " in ACM SIGOPS, 2005.
5. G. Varsamopoulos, Z. Abbasi, and S. K. Gupta, "Trends and effects of energy proportionality on server provisioning in data centers, " 2010.
6. A. S. Lebrecht, N. J. Dingle, and W. J. Knottenbelt, "A response time distribution model for zoned RAID, " in Analytical and Stochastic Modeling Techniques and Applications, 2008, pp. 144-157.
7. J. Gray and D. Bitton, "Disk shadowing, " in VLDB, 1988.
8. S. Chen et al., "When queueing meets coding: Optimal-latency data retrieving scheme in storage clouds, " in Infocomm, 2014.
9. H.-C. Lin and C. Raghavendra, "An approximate analysis of the join the shortest queue (jsq) policy, " IEEE Trans. on Par. and Dist. Sys., 1996.
10. S. Borkar, "Designing reliable systems from unreliable components: The challenges of transistor variability and degradation, " Micro, IEEE, 2005.
11. K. V. Rashmi, N. B. Shah, and P. V. Kumar, "Optimal exact-regenerating codes for the MSR and MBR points via a product-matrix construction, " IEEE Trans. on Inf. Th., Aug. 2011.
12. R. Feldman and C. Valdez-Flores, Applied Probability and Stochastic Processes (Chapter 13). Springer, 2010.
13. D. Bini, B. Meini, S. Steffé, and B. Van Houdt, "Structured markov chains solver: software tools, " in SMCTools, 2006.
14. L. Huang, S. Pawar, H. Zhang, and K. Ramchandran, "Codes can reduce queueing delay in data centers, " in ISIT, 2012.
15. U. Ferner, M. Medard, and E. Soljanin, "Toward sustainable networking: Storage area networks with network coding, " in Allerton Conf., 2012.
16. E. Varki, A. Merchant, and H. Chen, "The M/M/1 fork-join queue with variable sub-tasks, " 2008.
17. N. B. Shah, K. Lee, and K. Ramchandran, "When do redundant requests reduce latency?" in Allerton Conf., 2013.
18. G. Liang and U. C. Kozat, "TOFEC: Achieving optimal throughputdelay trade-off of cloud storage using erasure codes, " in Infocom, 2014.
19. G. Joshi, Y. Liu, and E. Soljanin, "Coding for fast content download, " in Allerton Conf., Oct. 2012.
20. A. Dimakis et al., "Network coding for distributed storage systems, " IEEE Trans. on Inf. Th., Sep. 2010.
21. D. Papailiopoulos, A. Dimakis, and V. Cadambe, "Repair optimal erasure codes through Hadamard designs, " in Allerton Conf., Sep. 2011.
22. I. Tamo, Z. Wang, and J. Bruck, "Access vs. bandwidth in codes for storage, " in ISIT, Jul. 2012.