Exploiting network parallelism for improving data transfer performance

Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012

Volumn , Issue , 2012, Pages 1600-1606

  Gunter, Dan ^a   Kettimuthu, Raj ^b   Kissel, Ezra ^c   Swany, Martin ^c   Yi, Jun ^d   Zurawski, Jason ^e  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c INDIANA UNIVERSITY   (United States)

^d UNIVERSITY OF CHICAGO   (United States)

^e Internet2   (United States)

Author keywords

multipath gridftp netlogger xsp session layer

Indexed keywords

BULK DATA TRANSFER; COARSE-GRAINED; DEDICATED NETWORKS; GRIDFTP; OPPORTUNISTIC NETWORKS; SCIENTIFIC APPLICATIONS; SOFTWARE DEFINED NETWORKING (SDN); TRANSFER PERFORMANCE;

BANDWIDTH;

DATA TRANSFER;

EID: 84876551273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.Companion.2012.337     Document Type: Conference Paper

References (27)

1. Globus online-reliable file transfer. no it required. https://www.globusonline.org.
2. Network development and deployment initiative (nddi). http://www.internet2.edu/network/ose/.
3. Phedex cms data transfers. https://cmsweb.cern.ch/phedex/.
4. W. Allcock, J. Bester, J. Bresnahan, S. Meder, P. Plaszczak, and S. Tuecke. Gridftp: Protocol extensions to ftp for the grid. Security, (August):2010-2010, 2003.
5. W. Allcock, J. Bresnahan, R. Kettimuthu, and J. Link. The globus extensible input/output system (xio): A protocol independent io system for the grid. In Protocol-Independent I/O System for the Grid. Joint Workshop on HighPerformance Grid Computing and High-Level Parallel Programming Models in conjunction with International Parallel and Distributed Processing Symposium, 2005.
6. W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link. The globus striped gridftp framework and server. In Proceedings of the ACM/IEEE SC 2005 Conference, page 54, 2005.
7. D. Andersen, H. Balakrishnan, M. Kaashoek, and R. Morris. Resilient overlay networks. Proc. 18th ACM SOSP, Banff, Canada, October 2001.
8. D. Andersen, H. Balakrishnan, M. Kaashoek, and R. Morris. The case for resilient overlay networks. In Proceedings of the 8th Annual Workshop on Hot Topics in Operating Systems (HotOS-VIII), 2001.
9. A. Bobyshev, M. Crawford, P. DeMar, V. Grigaliunas, M. Grigoriev, A. Moibenko, D. Petravick, and R. Rechenmacher. Lambda station: On-demand flow based routing for data intensive grid applications over multitopology networks. In Proceedings of the 3rd Intenational Conference on Broadband Communications (IEEE), 2006.
10. A. N. S. for Information Processing Systems. Open systems interconnection-basic connection oriented session protocol specification. ANSI/ISO 8327-1987, 1992.
11. B. Gibbard, D. Katramatos, and D. Yu. Terapaths: A qos-enabled collaborative data sharing infrastructure for peta-scale computing research. In Proceedings of the 3rd Intenational Conference on Broadband Communications (IEEE), 2006.
12. A. Hanemann, J. Boote, E. Boyd, J. Durand, L. Kudarimoti, R. Lapacz, M. Swany, S. Trocha, and J. Zurawski. PerfSONAR: A service oriented architecture for multi-domain network monitoring. In In Proceedings of the Third International Conference on Service Oriented Computing (ICSOC 2005), ACM Sigsoft and Sigweb, pages 241-254, December 2005.
13. Internet2 ION. http://www.internet2.edu/ion/.
14. G. Khanna, U. Catalyurek, T. Kurc, R. Kettimuthu, P. Sadayappan, I. Foster, and J. Saltz. Using overlays for efficient data transfer over shared wide-area networks. In SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, pages 1-12, Piscataway, NJ, USA, 2008. IEEE Press.
15. E. Kissel, G. Fernandes, A. El-Hassany, M. Swany, D. Gunter, T. Samak, and J. Schopf. Scalable integrated performance analysis of multi-gigabit networks. In 5th Intl. Workshop on Distributed Autonomous Network Management Systems (DANMS), 2012.
16. E. Kissel, G. Fernandes, M. Jaffee, M. Swany, and M. Zhang. Driving software defined networks with XSP. In Workshop on Software Defined Networks (SDN'12), Co-located with the IEEE International Conference on Communications (ICC), 2012.
17. E. Kissel and M. Swany. The extensible session protocol: A protocol for future internet architectures. Technical Report UDEL-2012/001, http: //damsl.cis.udel.edu/projects/phoebus/kissel xsp.pdf.
18. E. Kissel, M. Swany, and A. Brown. Phoebus: A system for high throughput data movement. J. Parallel Distrib. Comput., 71:266-279, February 2011.
19. N. McKeown, T. Anderson, H. Balakrishnan, G. M. Parulkar, L. L. Peterson, J. Rexford, S. Shenker, and J. S. Turner. Openflow: enabling innovation in campus networks. Computer Communication Review, 38(2):69-74, 2008.
20. ESnet On-demand Secure Circuits and Advance Reservation System (OSCARS). http://www.es.net/oscars/.
21. L. Ramakrishnan, C. Guok, K. Jackson, E. Kissel, D. M. Swany, and D. Agarwal. On-demand overlay networks for large scientific data transfers. Cluster Computing and the Grid, IEEE International Symposium on, 0:359-367, 2010.
22. P. Rizk, C. Kiddle, R. Simmonds, and B. Unger. Performance of a gridftp overlay network. Future Gener. Comput. Syst., 24(5):442-451, 2008.
23. J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4):277-288, 1984.
24. B. Tierney and D. Gunter. Netlogger: A toolkit for distributed system performance analysis. In Proc. of the IEEE Mascots 2000 Conference (Mascots, 2000.
25. B. Wang, W. Wei, J. Kurose, D. Towsley, K. R. Pattipati, Z. Guo, and Z. Peng. Application-layer multipath data transfer via tcp: Schemes and performance tradeoffs. Perform. Eval., 64(9-12):965-977, Oct. 2007.
26. J. Zhang, Y. Gui, C. Liu, and X. Li. To improve throughput via multipathing and parallel tcp on each path. In Proceedings of the 2009 Fourth ChinaGrid Annual Conference, CHINAGRID '09, pages 16-21, Washington, DC, USA, 2009. IEEE Computer Society.
27. M. Zhang, J. Lai, A. Krishnamurthy, L. Peterson, and R. Wang. A transport layer approach for improving end-to-end performance and robustness using redundant paths. In Proceedings of the annual conference on USENIX Annual Technical Conference, ATEC '04, pages 8-8, Berkeley, CA, USA, 2004. USENIX Association.