Race cars vs. trailer trucks: Switch buffers sizing vs. latency trade-offs in data center networks

Proceedings - 2016 IEEE 24th Annual Symposium on High-Performance Interconnects, HOTI 2016

Volumn , Issue , 2016, Pages 53-59

  Shpiner, Alexander ^a   Zahavi, Eitan ^a  

^a NVIDIA   (United States)

Author keywords

Data center network; Packet buffer sizing; Switch

Indexed keywords

SWITCHES;

APPLICATION PERFORMANCE; BUFFER SWITCHES; DATA CENTER NETWORKS; EFFECTIVE BANDWIDTH; END-TO-END NETWORK PERFORMANCE; NETWORK BEHAVIORS; NOCV2; PACKET BUFFERS; ROBUST SOLUTIONS;

ECONOMIC AND SOCIAL EFFECTS;

EID: 85010826038     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HOTI.2016.021     Document Type: Conference Paper

References (41)

1. A. Varga, "Omnet++", 2004. http://www.omnetpp.org/
2. INET framework" 2006. http://inet.omnetpp.org/.
3. Arista 7280E Series Specification, http://www.arista.com/en/products/7280e-series
4. Arista 7500E Switch Performance Test, Lippis Report, 2014, https://www.arista.com/assets/data/pdf/7500E-Lippis-Report.pdf
5. Juniper QFX10000 Modular Ethernet Switches, https://www.juniper.net/assets/us/en/local/pdf/datasheets/1000529-en.pdf
6. Cisco Nexus 7000 F1 and M1 Modules, http://www.cisco.com/c/en/us/td/docs/solutions/Enterprise/Data-Center/ VMDC/2-6/vmdcmodulesaag.pdf
7. Mellanox SwitchX-2 (SX1036) vs. Broadcom StrataXGS Trident II (Arista DCS-7050QX) Performance Evaluation Qualifying Data Center Ethernet Networks with RFC2544 at 40Gbps, Tolly Group Report, 2015, http://www.mellanox.com/related-docs/products/Tolly-215111-Mellanox-SwitchX-2-Performance.pdf.
8. Arista 7050X Series Specification, http://www.arista.com/en/products/7050x-series
9. Ancient History of Buffer Sizing", http://people.ucsc.edu/~warner/Bufs/buffer-requirements.
10. V. Arun, V. Sivaraman, and M. Thottan. "Perspectives on router buffer sizing: recent results and open problems", ACM SIGCOMM Computer Communication Review 39.2: 34-39, 2009.
11. Buffer Sizing in the Internet", http://yuba.stanford.edu/buffersizing/.
12. Y. Chen, et al., "Understanding TCP incast throughput collapse in datacenter networks." Proceedings of the 1st ACM workshop on Research on enterprise networking. ACM, 2009.
13. E. Krevat, V. Vasudevan, A. Phanishayee, D. G. Andersen, G. R. Ganger, G. A. Gibson and S. Seshan, "On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems," Supercomputing, 2007.
14. Y. Ren, et al., "A survey on TCP Incast in data center networks." International Journal of Communication Systems 27.8: 1160-1172, 2014.
15. V. Vasudevan, et al., "A (In) Cast of thousands: scaling datacenter TCP to kiloservers and gigabits. No. CMU-PDL-09-101. Carnegie-Mellon Univ. Pittsburgh, PA, Parallel Data Laboratory, 2009.
16. A. Dhamdhere, H. Jiang, and C. Dovrolis. "Buffer sizing for congested internet links." INFOCOM, 2005.
17. R. Morris, "TCP behavior with many flows," IEEE International Conference on Network Protocols, pp. 205-211, 1997.
18. G. Fairhurst, "Advice on network buffering", TSVWG Working Group, 2013, https://tools.ietf.org/id/draft-fairhurst-tsvwg-buffers-00.txt
19. Bufferbloat Project, http://www.bufferbloat.net/
20. J. Gettys and K. Nichols, "Bufferbloat: Dark Buffers in the Internet", 2011.
21. N. Beheshti, et al., "Obtaining high throughput in networks with tiny buffers", IWQoS, 2008.
22. M. Enachescu, et al., "Routers with Very Small Buffers." INFOCOM, 2006.
23. N. Beheshti, et al., "Experimental study of router buffer sizing", ACM SIGCOMM conference on Internet measurement, 2008.
24. M. Alizadeh, et al. "Data center tcp (DCTCP)," ACM SIGCOMM computer communication review 41.4: 63-74, 2011.
25. J. Rothschild, "High performance at massive scale: Lessons learned at facebook", mms://video-jsoe.ucsd.edu/calit2/JeffRothschildFacebook.wmv.
26. Incast, Parallel Data Lab Project, http://www.pdl.cmu.edu/Incast/
27. V. Vasudevan, et al., "Safe and Effective Fine-grained TCP Retransmissions for Datacenter Communication," SIGCOMM, 2009.
28. J. Dean and S. Ghemawat. "MapReduce: Simplified Data Processing on Large Clusters", In USENIX OSDI, pages 137-150, 2004.
29. T. Benson, A. Akella, and D. A. Maltz. "Network traffic characteristics of data centers in the wild." ACM SIGCOMM conference on Internet measurement, 2010.
30. N. Dukkipati, et al., "Proportional rate reduction for TCP", ACM SIGCOMM conference on Internet measurement conference, 2011.
31. M. Chowdhury, et al. "Managing data transfers in computer clusters with orchestra." ACM SIGCOMM Computer Communication Review 41.4: 98-109, 2011.
32. S. Kandula, et al., "The nature of data center traffic: measurements & analysis." ACM SIGCOMM conference on Internet measurement conference, 2009.
33. Y. Chen, et al., "Understanding tcp incast and its implications for big data workloads", No. UCB/EECS-2012-40. California Univ. Berkeley, Dept. of Electrical Engineering and Computer Science, 2012.
34. HPC challenge benchmark suite, http://icl.cs.utk.edu/hpcc/
35. R. Rabenseifner, Effective Bandwidth (b-eff) Benchmark, www.hlrs.de/mpi/b eff/
36. M. Ko, D. Eisenhauer, and R. Recio, "A case for convergence enhanced ethernet: Requirements and applications," IEEE ICC, 2008.
37. P802.1Qbb/D1.3 Virtual bridged local area networks -amendment: Priority-based flow control," IEEE Draft Standard, 2010. http://www.ieee802.org/1/pages/802.1bb.html
38. A. S. Anghel, R. Birke, D. Crisan, and M. Gusat, "Cross-layer flow and congestion control for datacenter networks," DC-CaVES, 2011.
39. D. Crisan, et al. "Short and fat: TCP performance in CEE datacenter networks", IEEE High Performance Interconnects (HOTI), 2011.
40. M. Gusat, Cyriel Minkenberg, and Gergely János Paljak. "Flow and congestion control for datacenter networks", RZ3742, 2009.
41. A. Shpiner, E. Zahavi, and O. Rottenstreich. "The Buffer Size vs Link Bandwidth Tradeoff in Lossless Networks", IEEE High-Performance Interconnects (HOTI), 2014.