Coded computation over heterogeneous clusters

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2017, Pages 2408-2412

  Reisizadeh, Amirhossein ^a   Prakash, Saurav ^b   Pedarsani, Ramtin ^a   Avestimehr, Salman ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; INFORMATION THEORY; MATRIX ALGEBRA; REDUNDANCY; SYSTEMS ENGINEERING;

ASYMPTOTICALLY OPTIMAL; COMPUTING MACHINES; HETEROGENEOUS CLUSTERS; HOMOGENEOUS CLUSTER; LARGE SCALE DISTRIBUTED COMPUTING; LIMITED COMMUNICATION; MATRIX MULTIPLICATION; STORAGE REDUNDANCY;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 85019687756     PISSN: 21578095     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2017.8006961     Document Type: Conference Paper

References (12)

1. J. Dean and S. Ghemawat, "Mapreduce: simplified data processing on large clusters", Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, "Spark: cluster computing with working sets.", HotCloud, vol. 10, pp. 10-10, 2010.
3. M. Zaharia, A. Konwinski, A. D. Joseph, R. H. Katz, and I. Stoica, "Improving mapreduce performance in heterogeneous environments.", in OSDI, vol. 8, p. 7, 2008.
4. Q. Pu, G. Ananthanarayanan, P. Bodik, S. Kandula, A. Akella, P. Bahl, and I. Stoica, "Low latency geo-distributed data analytics", ACM SIGCOMM Computer Communication Review, vol. 45, no. 4, pp. 421-434, 2015.
5. S. Li, M. A. Maddah-Ali, and A. S. Avestimehr, "Coded MapReduce", 53rd Allerton Conference, Sept. 2015.
6. S. Li, M. A. Maddah-Ali, Q. Yu, and A. S. Avestimehr, "A fundamental tradeoff between computation and communication in distributed computing", arXiv preprint arXiv:1604.07086, 2016.
7. F. Bonomi, R. Milito, J. Zhu, and S. Addepalli, "Fog computing and its role in the internet of things", in Proceedings of the first edition of the MCC workshop on Mobile cloud computing, pp. 13-16, ACM, 2012.
8. K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran, "Speeding up distributed machine learning using codes", arXiv preprint arXiv:1512.02673, 2015.
9. S. Dutta, V. Cadambe, and P. Grover, "Short-dot: Computing large linear transforms distributedly using coded short dot products", in Advances In Neural Information Processing Systems, pp. 2092-2100, 2016.
10. R. Tandon, Q. Lei, A. G. Dimakis, and N. Karampatziakis, "Gradient coding", arXiv preprint arXiv:1612.03301, 2016.
11. A. Reisizadeh, S. Prakash, R. Pedarsani, and S. Avestimehr, "Coded computation over heterogeneous clusters", arXiv preprint arXiv:1701.05973, 2017.
12. G. Liang and U. C. Kozat, "Tofec: Achieving optimal throughput-delay trade-off of cloud storage using erasure codes", in IEEE INFOCOM 2014-IEEE Conference on Computer Communications, pp. 826-834, IEEE, 2014.