An anticipative recursively-adjusting mechanism for redundant parallel file transfer in data grids

13th IEEE Asia-Pacific Computer Systems Architecture Conference, ACSAC 2008

Volumn , Issue , 2008, Pages

  Yang, Chao Tung ^a   Chi, Yao Chun ^a   Yang, Ming Feng ^a   Hsu, Ching Hsien ^b  

^a TUNGHAI UNIVERSITY   (Taiwan)

^b CHUNG HUA UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER SYSTEMS; DISTRIBUTED COMPUTER SYSTEMS; GRID COMPUTING; RECURSIVE FUNCTIONS; SYSTEMS ENGINEERING; TELECOMMUNICATION SYSTEMS; TRAFFIC CONGESTION;

ADJUSTING MECHANISMS; COMPLETION TIMES; DATA GRIDS; DATA SETS; FILE TRANSFER TIMES; FILE TRANSFERS; FINISH TIMES; GRID ENVIRONMENTS; IDLE TIMES; KEY FACTORS; NETWORK BANDWIDTHS; NETWORK LINKS; NETWORK PERFORMANCES; PARALLEL DOWNLOADS; PARALLEL TRANSFERS; REDUNDANT PARALLELS; REPLICA SERVERS; UNDERLYING NETWORKS;

SERVERS;

EID: 55849102099     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/APCSAC.2008.4625456     Document Type: Conference Paper

References (27)

1. B. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I.Foster, C. Kesselman, S. Meder, V. Nefedova, D.Quesnel, and S. Tuecke, "Data Management and Transfer in High-Performance Computational Grid Environments," Parallel Computing, 28(5), pp.749-771, May 2002.
2. R.S. Bhuvaneswaran, Y. Katayama, and N. Takahashi, "Dynamic Co-allocation Scheme for Parallel Data Transfer in Grid Environment," Proceedings of First International Conference on Semantics, Knowledge, and Grid (SKG 2005), pp. 17, 2005.
3. R.S. Bhuvaneswaran, Y. Katayama, and N. Takahashi, "A Framework for an Integrated Co-allocator for Data Grid in Multi-Sender Environment," IEICE Transactions on Communications, Vol. E90-B, No. 4, pp.742-749, 2007.
4. A. Chervenak, E. Deelman, I. Foster, L. Guy, W. Hoschek, A. Iamnitchi, C. Kesselman, P. Kunszt, and M. Ripeanu, "Giggle: A Framework for Constructing Scalable Replica Location Services," Proceedings of the 2002 ACM/IEEE conference on Supercomputing, pp.l-17, November 2002.
5. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, "The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets," Journal of Network and Computer Applications, 23: pp. 187-200, 2001.
6. K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman, "Grid Information Services for Distributed Resource Sharing," Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10'01), pp. 181-194, August 2001.
7. K. Czajkowski, I. Foster, and C. Kesselman. "Resource Co-Allocation in Computational Grids," Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing (HPDC-8'99), August 1999.
8. I. Foster, C. Kesselman, and S. Tuecke. "The Anatomy of the Grid: Enabling Scalable Virtual Organizations." International Journal of Supercomputer Applications and High Performance Computing, 15(3), pp. 200-222, 2001.
9. I. Foster and C. Kesselman, "Globus: A Metacomputing Infrastructure Toolkit," International Journal of Supercomputer Applications and High Performance Computing, 11(2), pp. 115-128, 1997.
10. W. Hoschek, J. Jaen-Martinez, A. Samar, H. Stockinger, and K. Stockinger, "Data Management in an International Data Grid Project," Proceedings of the First IEEE/ACM International Workshop on Grid Computing - Grid 2000, Bangalore, India, December 2000.
11. IBM Red Books, "Introduction to Grid Computing with Globus," IBM Press, www.redbooks.ibm.com/redbooks/pdfs/sg246895.pdf.
12. Open Grid Forum, http://www.ogf.org/
13. H. Stockinger, A. Samar, B. Allcock, I. Foster, K. Holtman, and B. Tierney, "File and Object Replication in Data Grids," Journal of Cluster Computing, 5(3), pp.305-314, 2002.
14. S. Vazhkudai, "Enabling the Co-Allocation of Grid Data Transfers," Proceedings of Fourth International Workshop on Grid Computing, pp. 44-51, 17 November 2003.
15. S. Vazhkudai, S. Tuecke, and I. Foster, "Replica Selection in the Globus Data Grid," Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGRID 2001), pp. 106-113, May 2001.
16. S. Vazhkudai and J. Schopf, "Using Regression Techniques to Predict Large Data Transfers," International Journal of High Performance Computing Applications (IJHPCA), 17:249-268, August 2003
17. S. Vazhkudai and J. Schopf, "Predicting Sporadic Grid Data Transfers," Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11 '02), pp. 188-196, July 2002.
18. S. Vazhkudai, J. Schopf, and I. Foster, "Predicting the Performance of Wide Area Data Transfers," Proceedings of the 16th International Parallel and Distributed Processing Symposium (IPDPS 2002), pp.34-43, April 2002.
19. S. Venugopal, R. Buyya, and K. Ramamohanarao, "A Taxonomy of Data Grids for Distributed Data Sharing, Management, and Processing," Proceedings of the ACM Computing Surveys, Vol.38 Article 3, March 2006.
20. C.M. Wang, C.C. Hsu, H.M. Chen, and J.J. Wu, "Efficient Multi-Source Data Transfer in Data Grids," Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06), pp 421-424, 16-19 May 2006.
21. The Globus Alliance, http://www.globus.org/
22. C.T. Yang, C.H. Chen, K.C. Li, and C.H. Hsu, "Performance Analysis of Applying Replica Selection Technology for Data Grid Environments," PaCT 2005, Lecture Notes in Computer Science, vol. 3603, pp. 278-287, Springer-Verlag, September 2005.
23. C.T. Yang, S.Y. Wang, and C.P. Fu, "A Dynamic Adjustment Mechanism for Data Transfer in Data Grids," Network and Parallel Computing: IFIP International Conference, NPC 2007, Lecture Notes in Computer Science, vol. 4672, pp. 61-70, Springer, ISSN 1611-3349, September 17-20, 2007.
24. C.T. Yang, I.H. Yang, K.C. Li, and S.Y. Wang, "Improvements on Dynamic Adjustment Mechanism in Co-Allocation Data Grid Environments," The Journal of Supercomputing, Springer Netherlands, vol. 40, no. 3, pp. 269-280, June 2007.
25. C.T. Yang, I.H. Yang, K.C. Li, and C.H. Hsu "A Recursive-Adjustment Co-Allocation Scheme in Data Grid Environments," ICA3PP 2005 Algorithm and Architecture for Parallel Processing, Lecture Notes in Computer Science, vol. 3719, pp. 40-49, Springer-Verlag, October 2005.
26. L. Yang, J. Schopf, and I. Foster, "Improving Parallel Data Transfer Times Using Predicted Variances in Shared Networks," Proceedings of the fifth IEEE International Symposium on Cluster Computing and the Grid, (CCGrid '05), pp 734-742, 9-12 May 2005.
27. X. Zhang, J. Freschl, and J. Schopf, "A Performance Study of Monitoring and Information Services for Distributed Systems", Proceedings of 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12 '03), pp. 270-282, August 2003.