Efficient data transfer protocols for big data

2012 IEEE 8th International Conference on E-Science, e-Science 2012

Volumn , Issue , 2012, Pages

  Tierney, Brian ^a   Kissel, Ezra ^b   Swany, Martin ^b   Pouyoul, Eric ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

40-GBPS; BIG DATUM; DATA MOVEMENTS; DATA SET SIZE; DATA TRANSFER PROTOCOLS; HIGH PERFORMANCE NETWORKS; NETWORK PATHS; NEW TECHNOLOGIES; ON CURRENTS; PCI EXPRESS; SANDY BRIDGES; SYSTEM CALLS; TCP PERFORMANCE; ZERO-COPY;

COMPUTER OPERATING SYSTEMS; TRANSMISSION CONTROL PROTOCOL;

DATA TRANSFER;

EID: 84873665059     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/eScience.2012.6404462     Document Type: Conference Paper

References (33)

1. Connectx-2 EN with RDMA over Ethernet (RoCE). http://www.mellanox.com/ related-docs/prod-software/ConnectX-2-RDMA-RoCE.pdf.
2. Gem: Network impairment emulator. http://www.spirent.com/Solutions- Directory/Impairments-GEM.
3. Infiniband trade association. http://www.infinibandta.org.
4. Ofed: Open fabrics enterprise distribution. https://openfabrics.org/ofed- for-linux-ofed-for-windows/ofed-overview.html.
5. Infiniband. architecture specification release 1.2.1 annex a16: Roce. Infiniband Trade Association, 2010.
6. Intel direct ethernet transport (det). http://software.intel.com/en-us/ articles/intel-direct-ethernet-transport, 2010.
7. P. Balaji. Sockets vs rdma interface over 10-gigabit networks: An indepth analysis of the memory traffic bottleneck. In In RAIT workshop .04, page 2004, 2004.
8. C. Barakat, E. Altman, and W. Dabbous. On tcp performance in a heterogeneous network: A survey. IEEE Communications Magazine, 38:40-46, 2000.
9. BES Science Network Requirements, Report of the Basic Energy Sciences Network Requirements Workshop. Basic Energy Sciences Program Office, DOE Office of Science and the Energy Sciences Network, 2010.
10. B. Callaghan, T. Lingutla-Raj, A. Chiu, P. Staubach, and O. Asad. Nfs over rdma. In Proceedings of the ACM SIGCOMM workshop on Network-I/O convergence: experience, lessons, implications, NICELI '03, pages 196-208, New York, NY, USA, 2003. ACM.
11. A. L. Caro, Jr., J. R. Iyengar, P. D. Amer, S. Ladha, G. J. Heinz, II, and K. C. Shah. Sctp: A proposed standard for robust internet data transport. Computer, 36:56-63, November 2003.
12. S. Carter, M. Minich, and N. S. V. Rao. Experimental evaluation of infiniband transport over local- and wide-area networks. In Proceedings of the 2007 spring simulation multiconference - Volume 2, SpringSim '07, pages 419-426, San Diego, CA, USA, 2007. Society for Computer Simulation International.
13. D. N. Williams et al. Data Management and Analysis for the Earth System Grid. Journal of Physics: Conference Series, SciDAC 08 conference proceedings, volume 125 012072, 2008.
14. D. Dalessandro and P. Wyckoff. A performance analysis of the ammasso rdma enabled ethernet adapter and its iwarp api. In In Proceedings of the IEEE Cluster 2005 Conference, RAIT Workshop, 2005.
15. A. C. de Melo. The new linux 'perf' tools. http://vger.kernel.org/~acme/ perf/lk2010-perf-paper.pdf, 2010.
16. S. Floyd. HighSpeed TCP for Large Congestion Windows. RFC 3649 (Experimental), December 2003.
17. GridFTP. http://www.globus.org/datagrid/gridftp.html.
18. Y. Gu and R. Grossman. Udt: Udp-based data transfer for high-speed wide area networks. Computer Networks (Elsevier) Volume 51, Issue 7, 2007.
19. V. Jacobsen, R. Braden, and D. Borman. Tcp extensions for high performance. RFC 1323, May 1992.
20. D. Katabi, M. Handley, and C. Rohrs. Congestion control for high bandwidth-delay product networks. In Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, SIGCOMM '02, pages 89-102, New York, NY, USA, 2002. ACM.
21. R. Kettimuthu, W. Liu, J. M. Link, and J. Bresnahan. A gridftp transport driver for globus xio. In PDPTA, pages 843-849, 2008.
22. E. Kissel and M. Swany. Evaluating high performance data transfer with rdma-based protocols in wide-area networks. In Proceedings of the 14th IEEE International Conference on High Performance Computing and Communications (HPCC-12), 2012. To appear.
23. S. Molnár, B. Sonkoly, and T. A. Trinh. A comprehensive tcp fairness analysis in high speed networks. Comput. Commun., 32(13-14):1460-1484, 2009.
24. S. Narravula, H. Subramoni, P. Lai, R. Noronha, and D. K. Panda. Performance of hpc middleware over infiniband wan. In Proceedings of the 2008 37th International Conference on Parallel Processing, ICPP '08, pages 304-311, Washington, DC, USA, 2008. IEEE Computer Society.
25. netperf. http:/www.netperf.org/.
26. nmon. http://nmon.sourceforge.net/.
27. nuttcp. http://wcisd.hpc.mil/nuttcp/Nuttcp-HOWTO.html.
28. M. Oberg, H. M. Tufo, T. Voran, and M. Woitaszek. Evaluation of rdma over ethernet technology for building cost effective linux clusters. In 7th LCI International Conference on Linux Clusters: The HPC Revolution, 2006.
29. N. S. V. Rao, W. Yu, W. R. Wing, S. W. Poole, and J. S. Vetter. Widearea performance profiling of 10gige and infiniband technologies. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC '08, pages 14:1-14:12, Piscataway, NJ, USA, 2008. IEEE Press.
30. D. X. Wei, C. Jin, S. H. Low, and S. Hegde. Fast tcp: motivation, architecture, algorithms, performance. IEEE/ACM Trans. Netw., 14(6):1246-1259, 2006.
31. W. Yu, N. Rao, P. Wyckoff, and J. Vetter. Performance of rdma-capable storage protocols on wide-area network. In 3rd Petascale Data Storage Workshop PSDW 2008, 2008.
32. W. Yu, Y. Tian, J. Vetter, N. S. Rao, T. Liu, and G. Shainer. Exio: Enabling globus on rdma networks - a case study with infiniband. Technical Report AU-CSSE-PASL/10-TR01, PASL, Dept. of CDDSSE, Auburn University, 2010.
33. W. Yu, Y. Tian, and J. S. Vetter. Efficient zero-copy noncontiguous i/o for globus on infiniband. In Proceedings of the 2010 39th International Conference on Parallel Processing Workshops, ICPPW '10, pages 362-368, Washington, DC, USA, 2010. IEEE Computer Society.