A data throughput prediction and optimization service for widely distributed many-task computing

Proceedings of the 2nd ACM Workshop on Many-Task Computing on Grids and Supercomputers 2009, MTAGS '09

Volumn , Issue , 2009, Pages

  Yin, Dengpan ^a   Yildirim, Esma ^a   Kosar, Tevfik ^a  

^a LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

Many task computing; Modeling; Optimization; Parallel TCP streams; Prediction; Scheduling; Stork

Indexed keywords

DATA THROUGHPUT; DISTRIBUTED ENVIRONMENTS; END-TO-END THROUGHPUT; GRIDFTP; MANY-TASK COMPUTING; NETWORK THROUGHPUT; NEW SERVICES; OPTIMAL NUMBER; PARALLEL STREAMS; PARALLEL TCP; TASK COMPUTING; TRANSFER TIME;

DATA TRANSFER; MATHEMATICAL MODELS; SCHEDULING; SUPERCOMPUTERS; TRANSMISSION CONTROL PROTOCOL;

OPTIMIZATION;

EID: 74049104464     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1646468.1646472     Document Type: Conference Paper

References (24)

1. I. Raicu, I. T. Foster, and Y. Zhao. Many-Task Computing for Grids and Supercomputers. IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS08), 2008.
2. E. Altman, D. Barman, B. Tuffin, and M. Vojnovic. Parallel tcp sockets: Simple model, throughput and validation. In Proc. IEEE Conference on Computer Communications (INFOCOM06), pages 1-12, Apr. 2006.
3. H. Balakrishman, V. N. Padmanabhan, S. Seshan, and R. H. K. M. Stemm. Tcp behavior of a busy internet server: Analysis and improvements. In Proc. IEEE Conference on Computer Communications (INFOCOM98), pages 252-262, California, USA, Mar. 1998.
4. J. Crowcroft and P. Oechslin. Differentiated end-to-end internet services using a weighted proportional fair sharing tcp. ACM SIGCOMM Computer Communication Review, 28(3):53-69, July 1998.
5. L. Eggert, J. Heideman, and J. Touch. Effects of ensemble tcp. ACM Computer Communication Review, 30(1):15-29, Jan. 2000.
6. T. J. Hacker, B. D. Noble, and B. D. Atley. The end-to-end performance effects of parallel tcp sockets on a lossy wide area network. In Proc. IEEE International Symposium on Parallel and Distributed Processing (IPDPS02), pages 434-443, 2002.
7. T. J. Hacker, B. D. Noble, and B. D. Atley. Adaptive data block scheduling for parallel streams. In Proc. IEEE International Symposium on High Performance Distributed Computing (HPDC05), pages 265-275, July 2005.
8. C. Jin, D. X. Wei, S. H. Low, G. Buhrmaster, J. Bunn, D. H. Choe, R. L. A. Cottrell, J. C. Doyle, W. Feng, O. Martin, H. Newman, F. Paganini, S. Ravot, and S. Singh. Fast tcp: from theory to experiments. IEEE Trans. on Network, 19(1):4-11, Feb. 2005.
9. R. P. Karrer, J. Park, and J. Kim. Adaptive data block scheduling for parallel streams. Technical report, Deutsche Telekom Laboratories, 2006.
10. T. Kelly. Scalable tcp: Improving performance in highspeed wide area networks. Computer Communication Review, 32(2), Apr. 2003.
11. G. Kola and M. K. Vernon. Target bandwidth sharing using endhost measures. Performance Evaluation, 64(9-12):948-964, Oct. 2007.
12. J. Lee, D. Gunter, B. Tierney, B. Allcock, J. Bester, J. Bresnahan, and S. Tuecke. Applied techniques for high bandwidth data transfers across wide area networks. In Proc. International Conference on Computing in High Energy and Nuclear Physics (CHEP01), Beijing, China, Sept. 2001.
13. D. Lu, Y. Qiao, and P. A. Dinda. Characterizing and predicting tcp throughput on the wide area network. In Proc. IEEE International Conference on Distributed Computing Systems (ICDCS05), pages 414-424, June 2005.
14. D. Lu, Y. Qiao, P. A. Dinda, and F. E. Bustamante. Modeling and taming parallel tcp on the wide area network. In Proc. IEEE International Symposium on Parallel and Distributed Processing (IPDPS05), page 68b, Apr. 2005.
15. H. Sivakumar, S. Bailey, and R. L. Grossman. Psockets: The case for application-level network striping for data intensive applications using high speed wide area networks. In Proc. IEEE Super Computing Conference (SC00), pages 63-63, Texas, USA, Nov. 2000.
16. Pathload, a measurement tool for the available bandwidth of network paths. http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/pathload.html.
17. Pathchirp. http://www.spin.rice.edu/Software/pathChirp/.
18. Stork project. http://www.storkproject.org.
19. Globus gridftp. http://www.globus.org.
20. Condor. http://www.cs.wisc.edu/condor.
21. Rfc3649: Highspeed tcp for large congestion windows.
22. The network weather service. http://nws.cs.ucsb.edu/.
23. Iperf. http://dast.nlanr.net/Projects/Iperf.
24. Spruce. http://project-iris.net/spruce/.