A switch-based approach to throughput collapse and starvation in data centers

Computer Networks

Volumn 56, Issue 14, 2012, Pages 3333-3346

  Shpiner, Alexander ^a   Keslassy, Isaac ^a   Bracha, Gabi ^b   Dagan, Eyal ^b   Iny, Ofer ^b   Soha, Eyal ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b BROADCOM CORPORATION   (United States)

Author keywords

Data centers; Switching; TCP

Indexed keywords

CONGESTED LINKS; DATA CENTERS; END USERS; HIGH-CAPACITY; LOW DELAY; O(1) COMPLEXITY; PACKET REORDERING; SWITCH BUFFERS; TCP; TCP FLOWS;

INTERNET; SWITCHING;

THROUGHPUT;

EID: 84865730851     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2012.06.001     Document Type: Article

References (35)

1. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D.G. Andersen, G.R. Ganger, G.A. Gibson, A (In)cast of Thousands: Scaling Datacenter TCP to Kiloservers and Gigabits, Technical Report CMU-PDL-09-101, Carnegie Mellon, February 2009.
2. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D.G. Andersen, G.R. Ganger, G.A. Gibson, B. Mueller, Safe and effective fine-grained TCP retransmissions for datacenter communication, in: ACM SIGCOMM'09, August 17-21, 2009.
3. E. Krevat, V. Vasudevan, A. Phanishayee, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems, in: Supercomputing'07, November 10-16, 2007.
4. Y. Chen, R. Griffith, J. Liu, R.H. Katz, A.D. Joseph, Understanding TCP incast throughput collapse in datacenter networks, in: WREN'09, August 21, 2009.
5. A. Phanishayee, E. Krevat, V. Vasudevan, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, Measurement and analysis of TCP throughput collapse in cluster-based storage systems, in: FAST '08, February 2008.
6. J. Zhang, F. Ren, C. Lin, Modeling and understanding TCP incast in data center networks, in: IEEE INFOCOM '11, April 2011.
7. David Newman, Latency and jitter: cut-through design pays off for Arista, Blade, Network World. < http://www.networkworld.com/reviews/2010/011810- ethernet-switch-test-latency.html >.
8. R. Morris, TCP behavior with many flows, in: IEEE International Conference on Network Protocols (ICNP'97), October 1997.
9. R. Morris, Scalable TCP congestion control, in: IEEE Infocom'00, Tel Aviv, Israel, March 2000.
10. C. Villamizar, and C. Song High performance TCP in ANSNET ACM Computer Communications Review 24 5 1994 45 60
11. G. Appenzeller, I. Keslassy, N. McKeown, Sizing router buffers, in: ACM SIGCOMM, 2004.
12. H. Wu, Z. Feng, C. Guo, Y. Zhang, ICTCP: incast congestion control for TCP in data center networks, in: ACM Co-NEXT '10.
13. Y. Sun, C.C. Lee, R. Berry, A.H. Haddad, An application of the control theoretic modeling for a scalable TCP ACK pacer, in: AACC, 2004.
14. J. Wu, Y. Shi, P. Zhang, S. Cheng, and J. Ma ACK delay control for improving TCP throughput over satellite links Networks 28 1999 303 312
15. M. Barbera, A. Lombardo, C. Panarello, G. Schembra, Active window management: an efficient gateway mechanism for TCP traffic control, in: ICC, 2007.
16. D. Stiliadis, and A. Varma Latency-rate servers: a general model for analysis of traffic scheduling algorithms IEEE/ACM Transactions on Networking 1998
17. M. Shreedhar, and G. Varghese Efficient fair queuing using deficit round-robin IEEE/ACM Transactions on Networking 4 3 1996 375 385
18. A.K. Parekh, and R.G. Gallager A generalized processor sharing approach to flow control inintegrated services networks: the multiple node case IEEE/ACM transactions on networking 1994
19. P.E. McKenney, Stochastic fairness queueing, in: IEEE INFOCOM '90, vol. 2, June 1990, pp. 733-740.
20. S. Floyd, and V. Jacobson Random early detection (RED) gateways for congestion avoidance IEEE/ACM Transactions on Networking 1 4 1993 397 413
21. D. Lin, R. Morris, ynamics of random early detection, in: Proc. of ACM SIGCOMM, September 1997.
22. W. Feng, D. Kandlur, D. Saha, K. Shin, Blue: a new class of active queue management algorithms, in: UM CSE-TR-387-99, April 1999.
23. W. Feng, D.D. Kandlur, D. Saha, K.G. Shin, Stochastic fair blue: a queue management algorithm for enforcing fairness, IEEE Infocom '01, vol. 3, April 2001, pp. 1520-1529.
24. K.K. Ramakrishnan, S. Floyd, D. Black, The addition of explicit congestion notification (ECN) to IP, in: RFC 3168, September 2001.
25. M. Alizadeh, A. Greenberg, D.A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, M. Sridharan, Datacenter TCP (DCTCP), in: ACM SIGCOMM'10, August-September 2010.
26. I. Maki, G. Hasegawa, M. Murata, T. Murase, Throughput analysis of TCP proxy mechanism, in: ATNAC'04, September 2004.
27. O. Rottenstreich, Y. Kanizo and I. Keslassy, The variable-increment counting bloom filter, in: IEEE Infocom '12.
28. C. Estan, G. Varghese, New directions in traffic measurement and accounting, in: ACM SIGCOMM'02, vol. 32(4), 2002, pp. 323-336.
29. The network simulator 2. < http://www.isi.edu/nsnam/ns >.
30. The NewReno modification to TCP's fast recovery algorithm, RFC 3782. < http://www.ietf.org/rfc/rfc3782.txt >.
31. K. Kant, Towards a virtualized data center transport protocol, in: IEEE Infocom Workshop on High-Speed Networks, Phoenix, AZ, April 2008.
32. C. Minkenberg, M. Gusat, Flow congestion management for 10G Ethernet, in: Interconnection Network Architectures: On-Chip, Multi-Chip (INA-OCMC'09), January 2009.
33. R. Luijten, Data Center Interconnects - Trends for IB and Ethernet, Presentation, IBM Zurich Research Lab, Switzerland, 2006.
34. Y. Birk, V. Zdornov, Improving communication-phase completion times in HPC clusters through congestion mitigation, in: SYSTOR'09, May 2009.
35. A. Shpiner, I. Keslassy, Modeling the interactions of congestion control and switch scheduling, in; IEEE IWQoS '09, July 2009.