Dynamic protocol tuning algorithms for high performance data transfers

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8097 LNCS, Issue , 2013, Pages 725-736

  Arslan, Engin ^a   Ross, Brandon ^a   Kosar, Tevfik ^a  

^a the State University of New York   (United States)

Author keywords

Application level protocol tuning; data replication; data intensive applications; throughput optimization; wide area networks

Indexed keywords

APPLICATION-LEVEL PROTOCOL; DATA REPLICATION; DATA-INTENSIVE APPLICATION; DISTRIBUTED APPLICATIONS; NETWORK BANDWIDTH; NETWORK CONDITION; PROTOCOL PARAMETERS; THROUGHPUT OPTIMIZATION;

ALGORITHMS; WIDE AREA NETWORKS;

DATA TRANSFER;

EID: 84883163613     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-40047-6_72     Document Type: Conference Paper

References (24)

1. Allen, B., Bresnahan, J., Childers, L., Foster, I., Kandaswamy, G., Kettimuthu, R., Kordas, J., Link, M., Martin, S., Pickett, K., Tuecke, S.: Software as a service for data scientists. Communications of the ACM 55(2), 81-88 (2012)
2. Altman, E., Barman, D.: Parallel TCP sockets: Simple model, throughput and validation. In: Proceedings of IEEE INFOCOM (2006)
3. Bresnahan, J., Link, M., Kettimuthu, R., Fraser, D., Foster, I.: Gridftp pipelining. In: Proceedings of TeraGrid (2007)
4. Farkas, K., Huang, P., Krishnamurthy, B., Zhang, Y., Padhye, J.: Impact of TCP variants on HTTP performance. In: Proceedings of High Speed Networking, vol. 2 (2002)
5. Freed, N.: SMTP service extension for command pipelining, http://tools.ietf.org/html/rfc2920
6. Hacker, T.J., Noble, B.D., Athey, B.D.: Adaptive data block scheduling for parallel TCP streams. In: Proceedings of HPDC (2005)
7. Hacker, T.J., Noble, B.D., Atley, B.D.: The end-to-end performance effects of parallel TCP sockets on a lossy wide area network. In: Proc. of IPDPS (2002)
8. Khanna, G., Catalyurek, U., Kurc, T., Kettimuthu, R., Sadayappan, P., Foster, I., Saltz, J.: Using overlays for efficient data transfer over shared wide-area networks. In: Proceedings of SC, Piscataway, NJ, USA (2008)
9. Kim, J., Yildirim, E., Kosar, T.: A highly-accurate and low-overhead prediction model for transfer throughput optimization. In: Proceedings of ACM SC 2012 DISCS Workshop (2012)
10. Kosar, T.: A new paradigm in data intensive computing: Stork and the data-aware schedulers. In: Proceedings of IEEE HPDC 2006 CLADE Workshop (2006)
11. Kosar, T., Balman, M.: A new paradigm: Data-aware scheduling in grid computing. Future Generation Computing Systems 25(4), 406-413 (2009)
12. Kosar, T., Balman, M., Yildirim, E., Kulasekaran, S., Ross, B.: Stork data scheduler: Mitigating the data bottleneck in e-science. The Phil. Transactions of the Royal Society A 369(3254-3267) (2011)
13. Kosar, T., Livny, M.: Stork: Making data placement a first class citizen in the grid. In: Proceedings of ICDCS 2004, pp. 342-349 (March 2004)
14. Liu, W., Tieman, B., Kettimuthu, R., Foster, I.: A data transfer framework for large-scale science experiments. In: Proceedings of DIDC Workshop (2010)
15. LONI: Louisiana optical network initiative (LONI), http://www.loni.org/
16. Lu, D., Qiao, Y., Dinda, P.A., Bustamante, F.E.: Modeling and taming parallel TCP on the wide area network. In: Proceedings of IPDPS (2005)
17. Raiciu, C., Pluntke, C., Barre, S., Greenhalgh, A., Wischik, D., Handley, M.: Data center networking with multipath TCP. In: Proceedings of Hotnets-IX (2010)
18. XSEDE: Extreme Science and Engineering Discovery Environment, http://www.xsede.org/
19. Yildirim, E., Kim, J., Kosar, T.: How gridftp pipelining, parallelism and concurrency work: A guide for optimizing large dataset transfers. In: Proceedings of Network-Aware Data Management Workshop (NDM 2012) (November 2012)
20. Yildirim, E., Kim, J., Kosar, T.: Optimizing the sample size for a cloud-hosted data scheduling service. In: Proc. of IEEE/ACM CCGrid CCSA Workshop (2012)
21. Yildirim, E., Kosar, T.: Network-aware end-to-end data throughput optimization. In: Proceedings of Network-Aware Data Management Workshop (NDM 2011) (2011)
22. Yildirim, E., Yin, D., Kosar, T.: Prediction of optimal parallelism level in wide area data transfers. IEEE TPDS 22(12) (2011)
23. Yildirim, E., Yin, D., Kosar, T.: Balancing TCP buffer vs parallel streams in application level throughput optimization. In: Proceedings of DADC Workshop (2009)
24. Yin, D., Yildirim, E., Kosar, T.: A data throughput prediction and optimization service for widely distributed many-task computing. IEEE TPDS 22(6) (2011)