Rapier: Integrating routing and scheduling for coflow-aware data center networks

Proceedings - IEEE INFOCOM

Volumn 26, Issue , 2015, Pages 424-432

  Zhao, Yangming ^a   Chen, Kai ^b,g   Bai, Wei ^b,g   Yu, Minlan ^b   Tian, Chen ^c   Geng, Yanhui ^d   Zhang, Yiming ^e   Li, Dan ^f   Wang, Sheng ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b Institute of Nuclear Science and Technology   (China)

^c HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^d HUAWEI TECHNOLOGIES CO LTD   (China)

^e NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^f TNList and Department of Automation   (China)

^g HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DATA FLOW ANALYSIS; SCHEDULING; TIME SWITCHES;

APPLICATION PERFORMANCE; COMMODITY SWITCHES; DATA CENTER NETWORKS; INTEGRATING ROUTING; LARGE SCALE SIMULATIONS; NETWORK OPTIMIZATION; ROUTING AND SCHEDULING; STATE OF THE ART;

NETWORK ROUTING;

EID: 84954235562     PISSN: 0743166X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INFOCOM.2015.7218408     Document Type: Conference Paper

References (26)

1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," Commun. ACM, vol. 51, no. 1, pp. 107-113, Jan. 2008.
2. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," in Proceedings of the 2nd ACM SIGOPS/EuroSys, 2007, pp. 59-72.
3. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster computing with working sets," in Proceedings of the USENIX HotCloud 2010.
4. M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica, "Managing data transfers in computer clusters with orchestra." in Proceedings of the ACM SIGCOMM 2011, pp. 98-109.
5. M. Chowdhury and I. Stoica, "Coflow: A networking abstraction for cluster applications," in Proceedings of the 11th ACM Workshop on Hot Topics in Networks, 2012, pp. 31-36.
6. G. Malewicz, M. H. Austern, A. J. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: A system for large-scale graph processing," in Proceedings of the ACM SIGMOD 2010, pp. 135-146.
7. M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat, "Hedera: Dynamic flow scheduling for data center networks," in Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation, 2010.
8. M. Alizadeh, S. Yang, M. Sharif, S. Katti, N. McKeown, B. Prabhakar, and S. Shenker, "pfabric: Minimal near-optimal datacenter transport," in Proceedings of the ACM SIGCOMM 2013, 2013, pp. 435-446.
9. C.-Y. Hong, M. Caesar, and P. B. Godfrey, "Finishing flows quickly with preemptive scheduling," in Proceedings of the ACM SIGCOMM 2012, pp. 127-138.
10. A. Munir, G. Baig, S. Irteza, I. A. Qazi, F. Dogar, and A. Liu, "Friends, not Foes-Synthesizing Existing Data Center Transport Strategies," in Proceedings of the ACM SIGCOMM 2014.
11. C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron, "Better never than late: Meeting deadlines in datacenter networks," ACM SIGCOMM Comput. Commun. Rev., vol. 41, no. 4, pp. 50-61, Aug. 2011.
12. M. Chowdhury, Y. Zhong, and I. Stoica, "Efficient coflow scheduling with varys," in Proceedings of the ACM SIGCOMM 2014.
13. F. R. Dogar, T. Karagiannis, H. Ballani, and A. Rowstron, "Decentralized task-aware scheduling for data center networks," in Proceedings of the ACM SIGCOMM 2014.
14. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The google file system," in Proceedings of the SOSP 2003, pp. 29-43.
15. K. Chen, C. Guo, H. Wu, J. Yuan, Z. Feng, Y. Chen, S. Lu, and W. Wu, "Generic and automatic address configuration for data center networks," in Proceedings of the ACM SIGCOMM 2010.
16. M. Al-Fares, A. Loukissas, and A. Vahdat, "A scalable, commodity data center network architecture," SIGCOMM Comput. Commun. Rev., vol. 38, no. 4, pp. 63-74, Aug. 2008.
17. A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta, "Vl2: A scalable and flexible data center network," ACM SIGCOMM Comput. Commun. Rev., vol. 39, no. 4, pp. 51-62, Aug. 2009.
18. K. Chen, A. Singlay, A. Singhz, K. Ramachandranz, L. Xuz, Y. Zhangz, X. Wen, and Y. Chen, "Osa: An optical switching architecture for data center networks with unprecedented flexibility," in Proceedings of the USENIX NSDI 2012, pp. 18-29.
19. Y. Peng, K. Chen, G. Wang, W. Bai, Z. Ma, and L. Gu, "Hadoopwatch: A first step towards comprehensive traffic forecasting in cloud computing," in Proceedings of the IEEE INFOCOM 2014.
20. S. Even, A. Itai, and A. Shamir, "On the complexity of time table and multi-commodity flow problems," in Foundations of Computer Science, 1975., 16th Annual Symposium on, Oct 1975, pp. 184-193.
21. S. Radhakrishnan, Y. Geng, V. Jeyakumar, A. Kabbani, G. Porter, and A. Vahdat, "Senic: Scalable nic for end-host rate limiting," in Proceedings of the USENIX NSDI 2014, pp. 475-488.
22. T. Benson, A. Anand, A. Akella, and M. Zhang, "Microte: Fine grained traffic engineering for data centers," in Proceedings of the ACM CoNEXT 2011.
23. C.-Y. Hong, S. Kandula, R. Mahajan, M. Zhang, and V. Gill, "Achieving high utilization with software-driven wan," in Proceedings of the ACM SIGCOMM 2013, pp. 15-26.
24. S. Jain, A. Kumar, S. M, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. W, J. Zhou, M. Zhu, J. Zolla, U. Hlzle, S. Stuart, A. Vahdat, and G. Inc, "B4: Experience with a globally-deployed software defined wan," in Proceedings of the ACM SIGCOMM 2013.
25. H. H. Liu, X. Wu, M. Zhang, L. Yuan, R. Wattenhofer, and D. A. Maltz, "zupdate: updating data center networks with zero loss," in Proceedings of the ACM SIGCOMM 2013, pp. 411-422.
26. R. Gandhi, H. H. Liu, Y. C. Hu, G. Lu, J. Padhye, L. Yuan, and M. Zhang, "Duet: Cloud scale load balancing with hardware and software," in Proceedings of the ACM SIGCOMM 2014, pp. 27-38.