Data transfers in the grid: Workload analysis of globus gridFTP

International Symposium on High Performance Distributed Computing, HPDC 2008 - Proceedings of the 2008 International Workshop on Data-aware Distributed Computing 2008, DADC'08

Volumn , Issue , 2008, Pages 29-37

  Kourtellis, Nicolas ^a   Prieto, Lydia ^a   Lamnitchi, Adriana ^a   Zarrate, Gustavo ^a   Fraser, Dan ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Data transfers; Globus toolkit; Gridftp; Teragrid; Trace analysis

Indexed keywords

BEHAVIORAL RESEARCH; DATA TRANSFER; INFORMATION MANAGEMENT; MANAGEMENT; RESOURCE ALLOCATION; SCHEDULING; TECHNICAL PRESENTATIONS;

ALL OVER THE WORLDS; DATA REPLICATIONS; FTP PROTOCOLS; GLOBUS TOOLKIT; GLOBUS TOOLKITS; GRIDFTP; JOB SCHEDULING; MULTIPLE IMPLEMENTATIONS; REMOTE MACHINES; RESOURCE MANAGEMENT SERVICES; SECURITY MODELS; SOFTWARE COMPONENTS; TERAGRID; THREE DIMENSIONS; TUNING CAPABILITIES; USER BEHAVIORS; WORKLOAD ANALYSIS;

TRACE ANALYSIS;

EID: 57349147040     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1383519.1383523     Document Type: Conference Paper

References (27)

1. A. Iamnitchi, S. Doraimani, and G. Garzoglio, "Filecules in High-Energy Physics: Characteristics and Impact on Resource Management," presented at HPDC 2006, Paris, 2006.
2. A. Iosup, C. Dumitrescu, D. Epema, H. Li, and L. Wolters, "How are Real Grids Used? The Analysis of Four Grid Traces and Its Implications," presented at 7th IEEE/ACM International Conference on Grid Computing, 2006.
3. Globus, "About Globus Toolkit," [Online]. Available: http://www.globus.org/toolkit/about.html.
4. Globus, "Metrics Project," [Online]. Available: http://incubator.globus.org/metrics.
5. Globus, "Metrics Report 2007/02," [Online]. Available: http://incubator.globus.org/metrics/reports/2007-02.pdf.
6. W. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, S. Tuecke, and I. Foster, "Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing," presented at MSS '01. Eighteenth IEEE Symposium on Mass Storage Systems and Technologies., 2001.
7. W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link, "The Globus Striped GridFTP Framework and Server," presented at Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, 2005.
8. W. Allcock, "GridFTP: Protocol Extensions to FTP for the Grid," Global Grid Forum Draft April 2003.
9. Globus, "GridFTP Manual," [Online]. Available: http://www.globus.Org/toolkit/docs/4.0/data/gridftp/.
10. W. Allcock and J. Bresnahan, "Maximizing Your Globus Toolkit™ GridFTP Server," in CLUSTERWORLD, vol. 2, 2004, pp. 1-7.
11. Teragrid, "Data: Transfer Overview," [Online]. Available: http://www.teragrid.org/userinfo/data/transfer.php., 2007.
12. S. Venugopal, R. Buyya, and K. Ramamohanarao, "A taxonomy of Data Grids for distributed data sharing, management, and processing," ACM Computing Surveys, vol. 38, 2006.
13. "PhEDEx - CMS Data Transfers," [Online]. Available: http://cmsdoc.cern.ch/cms/aprom/phedex/prod/Activity::Tran sferDetails?view= global.
14. Maxmind, "Maxmind web page," [Online] http://www.maxmind.com/.
15. B.Kónya, O. Smirnova. "Performance evaluation of the GridFTP within the NorduGrid project," [Online]. Available: http://www.nordugrid. org/documents/gridftp-report.pdf E-print cs.DS/0205023, October 15 2001.
16. NorduGrid, "General Link," [Online]. Available: http://www.nordugrid.org/.
17. S. Thulasidasan, W. Feng, and M. K. Gardner, "Optimizing GridFTP through Dynamic Right-Sizing," presented at Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03), 2003.
18. H. Ohsaki and M. Imase, "On Modeling GridFTP Using Fluid-Flow Approximation for High Speed Grid Networking," presented at Proceedings of the 2004 Symposium on Applications and the Internet-Workshops (SAINT 2004 Workshops), 2004.
19. T. Ito, H. Ohsaki, and M. Imase, "On parameter tuning of data transfer protocol GridFTP for wide-area grid computing," presented at Broadband Networks, 2005 2nd International Conference on, 2005.
20. T. Ito, H. Ohsaki, and M. Imase, "GridFTP-APT: Automatic Parallelism Tuning Mechanism for Data Transfer Protocol GridFTP," presented at Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06) 2006.
21. T. Ito, H. Ohsaki, and M. Imase, "Automatic Parameter Configuration Mechanism for Data Transfer Protocol GridFTP," presented at Proceedings of the International Symposium on Applications on Internet, 2006.
22. P. Rizk, C. Kiddle, and R. Simmonds, "Improving GridFTP Performance with Split TCP Connections," presented at Proceedings of the First International Conference on e-Science and Grid Computing, 2005.
23. X. Liu, H. Xia, and A. A. Chien, "Network Emulation Tools for Modeling Grid Behavior," presented at 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2003, 2003.
24. R. M. Rahman, K. Barker, and R. Alhajj, "Predicting the performance of gridFTP transfers," presented at 18th International Parallel and Distributed Processing Symposium Proceedings., 2004.
25. S. Vazhkudai and J. M. Schopf, "Predicting sporadic grid data transfers," presented at 11th IEEE International Symposium on High Performance Distributed Computing, 2002. HPDC-11 2002. Proceedings., 2002.
26. S. Vazhkudai and J. M. Schopf, "Using Regression Techniques to Predict Large Data Transfers," International Journal of High Performance Computing Applications, vol. 17, pp. 249-268, 2003.
27. UCSB, "Network Weather Service," [Online]. Available: http://nws.cs.ucsb.edu/ewiki/.