Automatic flow-control adaptation for enhancing network performance in computational grids

Journal of Grid Computing

Volumn 1, Issue 1, 2003, Pages 63-74

  Feng, Wu chun ^a   Gardner, Mark K ^a   Fisk, Michael E ^a   Weigle, Eric H ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Auto tuning; Buffer tuning; Dynamic right sizing; Flow control; TCP

Indexed keywords

AUTOTUNING; AVAILABLE BANDWIDTH; BUFFER SIZES; COMPUTATIONAL GRIDS; CRITICAL COMPONENT; GRID APPLICATIONS; GRID ENVIRONMENTS; GRID INFRASTRUCTURES; PROTOCOL STACK; TCP; TCP FLOW CONTROL; TUNING SYSTEM;

GRID COMPUTING; NETWORK PERFORMANCE; SEMANTICS; WIDE AREA NETWORKS;

TRANSMISSION CONTROL PROTOCOL;

EID: 1242337038     PISSN: 15707873     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1024087611940     Document Type: Article

References (41)

1. W. Allcock et al., "GridFTP: Protocol Extensions to FTP for the Grid," 2001. http://www-fp.mcs.anl.gov/dsl/GridFTPProtocol-RFC-Draft.pdf.
2. M. Allman et al., "Ongoing TCP Research Related to Satellites," IETF RFC 2760, 2000.
3. M. Allman, D. Glover and L. Sanchez, "Enhancing TCP over Satellite Channels Using Standard Mechanisms," IETF RFC 2488, 1999.
4. D. Bansal, H. Balakrishnan, S. Floyd and S. Shenker, "Dynamic Behavior of Slowly-Responsive Congestion Control Algorithms," in SIGCOMM 2001, San Diego, CA, 2001.
5. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury and S. Tuecke, "The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets," International Journal of Supercomputer Applications, Vol. 23, No. 3, pp. 187-200, 2001.
6. L. Childers, T. Disz, R. Olson, M.E. Papka, R. Stevens and T. Udeshi, "Access Grid: Immersive Group-to-Group Collaborative Visualization," in Proceedings of the 4th International Immersive Projection Workshop, 2000.
7. W. Feng and P. Tinnakornsrisuphap, "The Failure of TCP in High-Performance Computational Grids," in Proceedings of SC 2000: High-Performance Networking and Computing Conference, 2000.
8. M. Fisk and W. Feng, "Dynamic Adjustment of TCP Window Sizes," Technical Report Los Alamos Unclassified Report (LAUR) 00-3221, Los Alamos National Laboratory, 2000.
9. M. Fisk and W. Feng, "Dynamic Right-Sizing: TCP Flow-Control Adaptation," in Proceedings of SC 2001: High-Performance Networking and Computing Conference, 2001.
10. S. Floyd, "HighSpeed TCP for Large Congestion Windows," 2002. http://www.ietf.org/internet-drafts/draft-floydtcp-highspeed-01.txt.
11. I. Foster and C. Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, 1998.
12. I. Foster, C. Kesselman and S. Tuecke, "The Anatomy of the Grid: Enabling Scalable Virtual Organizations," International Journal of Supercomputer Applications, 2001.
13. M. Gardner, W. Feng and M. Fisk, "Dynamic Right-Sizing in FTP: Enhancing Grid Performance in User Space," in Proceedings of the IEEE Symposium on High-Performance Distributed Computing, 2002.
14. V. Jacobson, R. Braden and D. Borman, "TCP Extensions for High Performance," IETF RFC 1323, 1992.
15. M. Jain and C. Dovrolis, "End-to-End Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput," in Proceedings of the Annual Conference of the Special Interest Group on Data Communication (SIGCOMM), 2002.
16. G. Jin, G. Yang, B. Crowley and D. Agrawal, "Network Characterization Service," in Proceedings of the IEEE Symposium on High-Performance Distributed Computing, 2001.
17. T. Kelly, "On Engineering a Stable and Scalable TCP Variant," Technical Report CUED/F-INFENG/TR.435, Cambridge University Engineering Department, 2002. http://wwwlce.eng.cam.ac.uk/~ctk21/papers/sstcp-variant.pdf.
18. K. Lai and M. Baker, "Nettimer: A Tool for Measuring Bottleneck Link Bandwidth," in Proceedings of the USENIX Symposium on Internet Technologies and Systems, 2001.
19. Lawrence Berkley National Laboratory, "Nettest: Secure Network Testing and Monitoring." http://www-itg.lbl.gov/nettest/.
20. J. Liu and J. Ferguson, "Automatic TCP Socket Buffer Tuning," in Proceedings of SC 2000: High-Performance Networking and Computing Conference (Research Gem), 2000. http://dast.nlanr.net/Projects/Autobuf.
21. B. Mah, "pchar: A Tool for Measuring Internet Path Characteristics." http://www.employees.org/~bmah/Software/pchar.
22. M. Mathis, "Pushing up Performance for Everyone." http://www.ncne.nlanr.net/news/workshop/19999/991205/Talks/mathis_991205_Pushing_Up.Performance/.
23. M.J. Muuss, "The TTCP Program." http://ftp.arl.mil/~mike/ttcp.html.
24. National Center for Atmospheric Research and Pittsburgh Supercomputing Center and National Center for Supercomputing Applications, "The Web100 Project." http://www.web100.org/.
25. National Laboratory for Applied Network Research, "Automatic TCP Window Tuning and Applications." http://dast.nlanr.net/Projects/Autobuf_vl.0/autotcp.html.
26. NcFTP Software Client and Server. http://www.ncftp.com/.
27. C. Partridge and T. Shepard, "TCP/IP Performance over Satellite Links," IEEE Network, 1997.
28. Pittsburgh Supercomputing Center, "Enabling High-Performance Data Transfers on Hosts." http://www.psc.edu/networking-/perf_tune.html/.
29. J. Postel and J. Reynolds, "File Transfer Protocol (FTP)," IETF RFC 959, 1995.
30. J. Semke, J. Mahdavi and M. Mathis, "Automatic TCP Buffer Tuning," Computer Communications Review, ACM SIGCOMM Vol. 28, No. 4, 1998.
31. H. Sivakumar, S. Bailey and R.L. Grossman, "PSockets: The Case for Application-Level Network Striping for Data Intensive Applications Using High Speed Wide Area Networks," in Supercomputing, 2000.
32. B. Tierney, "TCP Tuning Guide for Distributed Applications on Wide-Area Networks," in USENIX & SAGE Login, 2001. http://www-didc.lbl.gov/tcp-wan.html.
33. B. Tierney, D. Gunter, J. Lee and M. Stoufer, "Enabling Network-Aware Applications," in Proceedings of the IEEE International Symposium on High-Performance Distributed Computing, 2001.
34. A. Tirumala and J. Ferguson, "IPERF," 2001. http://dast.nlanr.net/Projects/Iperf/index.html.
35. The Netkit FTP Client. http://freshmeat.net/projects/netkit/.
36. The Particle Physics Data Grid. http://www.cacr.caltech.edu/ppdg/.
37. The Washington University Archive FTP Daemon (wu-ftpd). http://www.wu-ftpd.org/.
38. University of Kansas, Information & Telecommunication Technology Center. "NetSpec: A Tool for Network Experimentation and Measurement." http://www.ittc.ukans.edu/netspec/.
39. E. Weigle and W. Feng, "Dynamic Right-Sizing: A Simulation Study," in Proceedings of IEEE International Conference on Computer Communications and Networks, 2001. http://public.lanl.gov/ehw/papers/ICCCN-2001-DRS.ps.
40. E. Weigle and W. Feng, "A Comparison of TCP Automatic Tuning Techniques for Distributed Computing," in Proceedings of the IEEE Symposium on High-Performance Distributed Computing (HPDC-11), 2002.
41. E. Weigle and W. Feng "TICKETing High-Speed Traffic with Commodity Hardware and Software," in Proceedings of the Third Annual Passive and Active Measurement Workshop (PAM2002), 2002.