A dynamic scheduling approach for coordinated wide-area data transfers using GridFTP

IPDPS Miami 2008 - Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium, Program and CD-ROM

Volumn , Issue , 2008, Pages

  Khanna, Gaurav ^a   Catalyurek, Umit ^b   Kurc, Tahsin ^b   Kettimuthu, Rajkumar ^c   Sadayappan, P ^a   Saltz, Joel ^b  

^a Ohio State University

^b OHIO STATE UNIVERSITY   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GRIDFTP; WIDE-AREA;

BOOLEAN FUNCTIONS; COMPUTER NETWORKS; DISTRIBUTED PARAMETER NETWORKS;

DATA TRANSFER;

EID: 51049118366     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2008.4536325     Document Type: Conference Paper

References (16)

1. The Large Haldron Collider (LHC) . http://lhc.web.cern.ch/lhc/.
2. Globus ftp client api. http://www.globus.org/api/c/globus_ftp_client/ html/index.html, 2002.
3. Globus metrics, version 1.4. http://incubator.globus.org/metrics/ reports/2007-02.pdf, 2007.
4. W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link. The globus striped gridftp framework and server. In SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing, Washington, DC, USA, 2005. IEEE Computer Society.
5. M. Castro, P. Druschel, A.-M. Kermarrec, A. Nandi, A. Rowstron, and A. Singh. Splitstream: high-bandwidth multicast in cooperative environments. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, pages 298-313, New York, NY, USA, 2003. ACM.
6. A. Giersch, Y. Robert, and F. Vivien. Scheduling tasks sharing files from distributed repositories. In Euro-Par 2004: Parallel Processing: 10th International Euro-Par Conference, volume 3149 of LNCS, pages 246-253, Sept. 2004.
7. O. Ibarra and C. Kim. Heuristic algorithms for scheduling independent tasks on nonindentical processors. Journal of the ACM, 24(2):280-289, Apr 1977.
8. G. Khanna, U. Catalyurek, T. Kurc, P. Sadayappan, and J. Saltz. Scheduling file transfers for data-intensive jobs on heterogeneous clusters. In A.-M. Kermarrec, L. Bouge, and T. Priol, editors, Euro-Par, volume 4641 of Lecture Notes in Computer Science, pages 214-223. Springer, 2007.
9. G. Khanna, N. Vydyanathan, T. Kurc, U. Catalyurek, P. Wyckoff, J. Saltz, and P. Sadayappan. A hypergraph partitioning based approach for scheduling of tasks with batch-shared i/o. In CCGRID '05: Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2, pages 792-799, Washington, DC, USA, 2005. IEEE Computer Society.
10. T. Kosar and M. Livny. Stork: Making data placement a first class citizen in the grid. In ICDCS '04: Proc.of the 24th International Conference on Distributed Computing Systems (ICDCS'04), pages 342-349, Washington, DC, USA, 2004. IEEE Computer Society.
11. D. Kostić, A. Rodriguez, J. Albrecht, and A. Vahdat. Bullet: high bandwidth data dissemination using an overlay mesh. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, pages 282-297, New York, NY, USA, 2003. ACM.
12. V. S. Pai, K. Kumar, K. Tamilmani, V. Sambamurthy, and A. E. Mohr. Chainsaw: Eliminating trees from overlay multicast. In M. Castro and R. van Renesse, editors, IPTPS, volume 3640 of Lecture Notes in Computer Science, pages 127-140. Springer, 2005.
13. M. Piatek, T. Isdal, T. E. Anderson, A. Krishnamurthy, and A. Venkataramani. Do incentives build robustness in bittorrent? In NSDI. USENIX, 2007.
14. M. Swany. Improving throughput for grid applications with network logistics. In SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing, page 23, Washington, DC, USA, 2004. IEEE Computer Society.
15. TeraGrid. http://www.teragrid.org.
16. L. Yang, J. M. Schopf, and I. Foster. Improving parallel data transfer times using predicted variances in shared networks. In CCGRID '05: Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2, pages 734-742, Washington, DC, USA, 2005. IEEE Computer Society.