Socket buffer auto-sizing for high-performance data transfers

Journal of Grid Computing

Volumn 1, Issue 4, 2003, Pages 361-376

  Prasad, Ravi S ^a   Jain, Manish ^a   Dovrolis, Constantinos ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Available bandwidth; Bottleneck bandwidth; Fast long distance networks; Grid computing and networking; Tcp throughput

Indexed keywords

APPLICATION LAYERS; AVAILABLE BANDWIDTH; BANDWIDTH DELAY PRODUCT; BOTTLENECK BANDWIDTH; BUFFER OVERFLOWS; BULK TRANSFER; DATA-INTENSIVE GRID APPLICATIONS; DIRECT MEASUREMENT; GRIDFTP; HIGH PERFORMANCE NETWORKS; NETWORK PATHS; PATH CHARACTERISTIC; PRIOR KNOWLEDGE; ROUND-TRIP TIME; SOCKET BUFFERS; TCP PROTOCOL; TCP THROUGHPUT; TCP TRANSFERS; TRANSPORT PROTOCOLS;

BANDWIDTH; DATA TRANSFER; GRID COMPUTING; THROUGHPUT; WIDE AREA NETWORKS;

TRANSMISSION CONTROL PROTOCOL;

EID: 33244470626     PISSN: 15707873     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:GRID.0000037554.67413.52     Document Type: Article

References (35)

1. S. Shalunov and B. Teitelbaum, Bulk TCP Use and Performance on Internet2", 2002. Also see http://netflow.internet2.edu/weekly/
2. B. Tierney, "TCP Tuning Guide for Distributed Applications on Wide Area Networks", USENIX & SAGE Login, February 2001.
3. T. Dunigan, M. Mathis and B. Tierney, "A TCP Tuning Daemon", in Proceedings of SuperComputing: High-Performance Networking and Computing, November 2002.
4. M. Allman and V. Paxson, "On Estimating End-to-End Network Path Properties", in Proceedings of ACM SIGCOMM, September 1999, pp. 263-274.
5. S. Floyd, "HighSpeed TCP for Large Congestion Windows", December 2003. RFC 3649 (experimental).
6. C. Jin, D.X. Wei and S.H. Low, "FAST TCP: Motivation, Architecture, Algorithms, Performance", in Proceedings of IEEE INFOCOM, March 2004.
7. D. Katabi, M. Handley and C. Rohrs, "Congestion Control for High Bandwidth-Delay Product Networks", in Proceedings of ACM SIGCOMM, August 2002.
8. T. Kelly, "Scalable TCP: Improving Performance in Highspeed Wide Area Networks", ACM Computer Communication Review (CCR), April 2003.
9. R. Krishnan, C. Partridge, D. Rockwell, M. Allman and J. Sterbenz, "A Swifter Start for TCP", Technical Report BBN-TR-8339, BBN, March 2002.
10. R. Wang, M. Valla, M.Y. Sanadidi and M. Gerla, "Using Adaptive Rate Estimation to Provide Enhanced and Robust Transport over Heterogeneous Networks", in Proceedings of IEEE ICNP, November 2002.
11. H. Sivakumar, S. Bailey and R.L. Grossman, "PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks", in Proceedings of SuperComputing: High-Performance Networking and Computing, November 2000.
12. T.J. Hacker and B.D. Athey, "The End-To-End Performance Effects of Parallel TCP Sockets on a Lossy Wide-Area Network", in Proceedings of IEEE-CS/ACM International Parallel and Distributed Processing Symposium, 2002.
13. M. Mathis and R. Reddy, "Enabling High Performance Data Transfers", January 2003. Available at http://www.psc.edu/networking/perf_tune.html
14. J. Semke, J. Madhavi and M. Mathis, "Automatic TCP Buffer Tuning", in Proceedings of ACM SIGCOMM, August 1998.
15. M.K. Gardner, W.-C. Feng and M. Fisk, "Dynamic Right- Sizing in FTP (drsFTP): Enhancing Grid Performance in User-Space", in Proceedings of IEEE Symposium on High-Performance Distributed Computing, July 2002.
16. L.L. Peterson and B.S. Davie, Computer Networks, A Systems Approach. Morgan Kaufmann, 2000.
17. W. Allcock, J. Bester, J. Bresnahan, A. Chevenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel and S. Tuecke, "gridFTP", 2000. See http://www.globus.org/datagrid/gridftp.html
18. M. Allman, V. Paxson and W. Stevens, "TCP Congestion Control", IETF RFC 2581, April 1999.
19. M. Jain and C. Dovrolis, "End-to-End Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput", in Proceedings of ACM SIGCOMM, August 2002, pp. 295-308.
20. "Resilient Overlay Network (RON)", June 2003. http://nms.lcs.mit.edu/ron/
21. M. Jain, R.S. Prasad and C. Dovrolis, "The TCP Bandwidth-Delay Product Revisited: Network Buffering, Cross Traffic, and Socket Buffer Auto-Sizing", Technical Report GIT-CERCS-03-02, Georgia Tech, February 2003. Available at http://www.cercs.gatech.edu/tech-reports/
22. J. Padhye, V. Firoiu, D. Towsley and J. Kurose, "Modeling TCP Throughput: A Simple Model and its Empirical Validation", in Proceedings of ACM SIGCOMM, 1998.
23. Y. Zhang, N. Duffield, V. Paxson and S. Shenker, "On the Constancy of Internet Path Properties", in Proceedings of ACM SIGCOMM Internet Measurement Workshop, November 2001, pp. 197-211.
24. D. Borman, R. Braden and V. Jacobson, "TCP Extensions for High Performance", IETF RFC 1323, May 1992.
25. R. Braden, "Requirements for Internet Hosts - Communication Layers", IETF RFC 1122, October 1989.
26. S. Floyd, "Limited Slow-Start for TCP with Large Congestion Windows", July 2003. Internet Draft: draft-ietf-tsvwgslowstart-00.txt (work-in-progress).
27. C. Dovrolis, P. Ramanathan and D. Moore, "What do Packet Dispersion Techniques Measure?", in Proceedings of IEEE INFOCOM, April 2001, pp. 905-914.
28. M. Carson and D. Santay, "NIST Net - A Linux-based Network Emulation Tool", ACM Computer Communication Review, Vol. 33, July 2003, pp. 111-126.
29. NLANR MOAT, "Passive Measurement and Analysis", December 2003. http://pma.nlanr.net/PMA/
30. J. Guojun, "Network Characterization Service", July 2001. http://www-didc.lbl.gov/pipechar/
31. J. Liu and J. Ferguson, "Automatic TCP Socket Buffer Tuning", in Proceedings of SuperComputing: High-Performance Networking and Computing, November 2000.
32. E. Weigle and W.-C. Feng, "A Comparison of TCP Automatic Tuning Techniques for Distributed Computing", in Proceedings of IEEE Symposium on High-Performance Distributed Computing, July 2002.
33. L.S. Brakmo and L.L. Peterson, "TCP Vegas: End to End Congestion Avoidance on a Global Internet", IEEE Journal on Selected Areas of Communications, Vol. 13, October 1995.
34. J.S. Ahn, P. Danzig, Z. Liu and L. Yan, "Evaluation of TCP Vegas: emulation and experiment", in Proceedings of ACM SIGCOMM, 1995, pp. 185-195.
35. A. Kuzmanovic and E.W. Knightly, "TCP-LP: A Distributed Algorithm for Low Priority Data Transfer", in Proceedings of IEEE INFOCOM, 2003.