Designing efficient FTP mechanisms for high performance data-transfer over infiniband

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2009, Pages 156-163

  Lai, Ping ^a   Subramoni, Hari ^a   Narravula, Sundeep ^a   Mamidala, Amith ^a   Panda, Dhabaleswar K ^a  

^a The Ohio State University   (United States)

Author keywords

FTP; IB WAN; InfiniBand; RDMA; Zero copy

Indexed keywords

CONTENT REPLICATION; CPU UTILIZATION; DATA CENTERS; DATA SESSIONS; DATA STAGING; GAINING MOMENTUM; HIGH END COMPUTING; HIGH PERFORMANCE COMMUNICATION; INFINIBAND; PERFORMANCE DATA; PROTOCOL PROCESSING; RAPID GROWTH; REMOTE SITES; TYPICAL APPLICATION; ZERO-COPY;

COMMUNICATION; INTERNET PROTOCOLS; MACHINE DESIGN; QUEUEING NETWORKS; SCALABILITY;

DATA TRANSFER;

EID: 77951493186     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2009.72     Document Type: Conference Paper

References (26)

1. Architectural Specifications for RDMA over TCP/IP. http://www. rdmaconsortium.org.
2. BayNetworks. www.baynetworks.com/.
3. Gigabit Ethernet Jumbo Frames. http://sd.wareonearth.com/phil/jumbo.html.
4. Infiniband Trade Association. http://www.infinibandta.org.
5. MVAPICH2: High Performance MPI over InfiniBand and iWARP. http://mvapich.cse.ohio-state.edu/.
6. Obsidian research corp. http://www.obsidianresearch.com/.
7. Open Fabrics Enterprise Distribution. http://www.openfabrics.org/.
8. Sun Microsystems and The Ohio State University. NFS over RDMA Design, Version 1.1, Aug 2007.
9. TCP Overhead. http://www.cs.duke.edu/ari/trapeze/freenix/node11.html.
10. W. Allcock. GridFTP: Protocol Extensions to FTP for the Grid. Global Grid ForumGFD-R-P.020,2003.
11. W. Allcock and J. Bresnahan. Maximizing Your Globus Toolkit GridFTP Server. In CLUSTERWORLD, 2004.
12. M. Allman and S. Ostermann. Multiple Data Connection FTP Extensions. Technical report, Ohio University, 1996.
13. M. Allman, S. Ostermann, and C. Metz. FTP Extensions for IPv6 and NATs. RFC 2428. Sep. 1998.
14. F. Anklesaria and et.al. The Internet Gopher Protocol. RFC 1436. Network Working Group, Mar. 1993.
15. D. Bush. UFTP. http://www.tcnj.edu/bush/uftp.html.
16. S. Ladha and P. D. Amer. Improving Multiple File Transfers Using SCTP Multistreaming. In Int'l on Performance, Computing, and Communications Conference, April 2004.
17. J. Liu, J. Wu, S. P. Kini, P. Wyckoff, and D. K. Panda. High Performance RDMA-Based MPI Implementation over InfiniBand. In ACM Int'l Conference on Supercomputing, 2003.
18. Mellanox OFED Stack for Linux Users Manual. http://www.mellanox.com/pdf/ products/software.
19. S. Narravula, H. Subramoni, P. Lai, R. Noronha, and D. K. Panda. Performance of HPC Middleware over InfiniBand WAN. In Int'l Conference on Parallel Processing, Sept. 2008.
20. Net NX 5010 High Speed Exchange. http://www.net.com.
21. J. Postel and J. Reynolds. File Transfer Protocol. RFC 959.
22. S. Carter and M. Minich and N. S. V. Rao. Experimental evaluation of infiniband transport over local- and wide-area networks. In High Performance Computing Symposium, 2007.
23. K. R. Sollins. The Trivial File Transfer Protocol- TFTP 2 RFC 1350. July, 1992.
24. W. Allock, J. Bresnahan, R. Kettimuthu, and M. Link. The Globus Striped GridFTP Framework and Server. In Super Computing, ACM Press, 2005.
25. W. Yu, N. S. Rao, P.Wyckoff, and J. S. Vetter. Performance of RDMA-capable Storage Protocols on Wide-Area Network. In Peta-byte Storage Workshop, in conjunction with SC08, 2008.
26. G. K. Zipf. Human Behavior and the Principle of Least Effort. Addison-Wesley Press, 1949.