Using straggler replication to reduce latency in large-scale parallel computing

Performance Evaluation Review

Volumn 43, Issue 3, 2015, Pages 7-11

  Wang, Da ^a   Joshi, Gauri ^b   Wornell, Gregory ^b  

^a Two Sigma Investments   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Parallel computation; Scheduling; Task replication

Indexed keywords

HEURISTIC ALGORITHMS; JOB SHOP SCHEDULING; SCHEDULING;

ANALYSIS TECHNIQUES; COMPUTING RESOURCE; HEURISTIC POLICIES; LARGE-SCALE PARALLEL COMPUTING; LATENCY REDUCTION; PARALLEL COMPUTATION; REPLICATION STRATEGIES; TASK REPLICATIONS;

COMPUTATION THEORY;

EID: 84997502419     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2847220.2847223     Document Type: Conference Paper

References (16)

1. Google cluster data. http://code.google.com/p/googleclusterdata/.
2. ANANTHANARAYANAN, G., GHODSI, A., AND S. SHENKER, I. S. Effective straggler mitigation: Attack of the clones. In USENIX NSDI (2013), pp. 185-198.
3. DAVID, H. A., AND NAGARAJA, H. N. Order statistics. John Wiley, Hoboken, N.J., 2003.
4. DE HAAN, L., AND FERREIRA, A. Extreme value theory an introduction. Springer, New York, 2006.
5. DEAN, J., AND GHEMAWAT, S. MapReduce: simplified data processing on large clusters. Communications of the ACM 51, 1 (2008), 107-113.
6. GHARE, G., AND LEUTENEGGER, S. T. Improving speedup and response times by replicating parallel programs on a SNOW. In International conference on Job Scheduling Strategies for Parallel Processing (Jan. 2005), pp. 264-287.
7. J. DEAN AND L. BARROSO. The Tail at Scale. Communications of the ACM 56, 2 (2013), 74-80.
8. JOSHI, G., LIU, Y., AND SOLJANIN, E. On the Delay-Storage Trade-off in Content Download from Coded Distributed Storage Systems. IEEE JSAC (May 2014), 989-997.
9. JOSHI, G., SOLJANIN, E., AND G., W. Queues with redundancy: Latency-cost analysis. In ACM SIGMETRICS Workshop on Mathematical Modeling and Analysis (jun 2015).
10. KOCHAR, S., AND WIENS, D. Partial orderings of life distributions with respect to their aging properties. Naval Research Logistics 34, 6 (1987), 823-829.
11. OUSTERHOUT, K., WENDELL, P., ZAHARIA, M., AND STOICA, I. Sparrow: Distributed, low latency scheduling. In ACM SOSP (2013), pp. 69-84.
12. REISS, C., TUMANOV, A., GANGER, G., KATZ, R. H., AND KOZUCH, M. A. Towards understanding heterogeneous clouds at scale: Google trace analysis. Intel Science and Technology Center for Cloud Computing, Tech. Rep (2012).
13. VULIMIRI, A., GODFREY, P. B., MITTAL, R., SHERRY, J., RATNASAMY, S., AND SHENKER, S. Low latency via redundancy. CoNEXT (2013), 283-294.
14. WANG, D. Computing with Unreliable Resources: Design, Analysis and Algorithms. PhD thesis, Massachusetts Institute of Technology, 2014.
15. WANG, D., JOSHI, G., AND WORNELL, G. Efficient task replication for fast response times in parallel computation. ACM Sigmetrics short paper (June 2014).
16. WANG, D., JOSHI, G., AND WORNELL, G. Using straggler replication to reduce latency in large-scale parallel computing (extended version). arXiv:1503.03128 [cs.dc] (Mar. 2015).