An Anticipative Recursively Adjusting Mechanism for parallel file transfer in Data Grids

Concurrency and Computation: Practice and Experience

Volumn 22, Issue 15, 2010, Pages 2144-2169

  Yang, Chao Tung ^a   Yang, Ming Feng ^a   Chi, Yao Chun ^a   Hsu, Ching Hsien ^b  

^a TUNGHAI UNIVERSITY   (Taiwan)

^b CHUNG HUA UNIVERSITY   (Taiwan)

Author keywords

Co allocation; Data Grid; Dynamic; Parallel file transfer; Recursively Adjusting

Indexed keywords

BANDWIDTH; DIGITAL STORAGE; DYNAMICS; GRID COMPUTING; HIGH ENERGY PHYSICS; NETWORK PERFORMANCE; TRAFFIC CONGESTION;

ADJUSTING MECHANISM; ASTROPHYSICAL OBSERVATORY; CO-ALLOCATION; DATA GRID; PARALLEL FILE TRANSFER; PERFORMANCE VARIATIONS; RECURSIVELY ADJUSTING; UNDERLYING NETWORKS;

ELECTRONIC DOCUMENT EXCHANGE;

EID: 77955515775     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1565     Document Type: Article

References (33)

1. Allcock B, Bester J, Bresnahan J, Chervenak A, Foster I, Kesselman C, Meder S, Nefedova V, Quesnel D, Tuecke S. Data management and transfer in high-performance computational grid environments. Parallel Computing 2002;28(5):749-771.
2. Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of Supercomputer Applications and High Performance Computing 2001;15(3):200-222. (Pubitemid 33099013)
3. Wang CM, Hsu CC, Chen HM, Wu JJ. Efficient multi-source data transfer in data grids. Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06), Singapore Management University (SMU) Campus, 16-19 May 2006;421-424. Available at: http://pdcc.ntu.edu.sg/ccgrid2006/ .
4. Yang CT, Yang IH, Wang SY, Li KC, Hsu CH. A recursively-adjusting co-allocation scheme with a cyber-transformer in data grids. Future Generation Computer Systems, vol. 25 (7). Elsevier B. V: Amsterdam, July 2009;695-703.
5. Yang CT, Yang MF, Chiang WC. Implementation of a cyber transformer for parallel download in co-allocation data grid environments. Proceedings of the Seventh International Conference on Grid and Cooperative Computing (GCC2008) and Second EchoGRID Conference, Shenzhen, Guangdong, China, 24-26 October 2008;242-253.
6. Yang CT, Wang SY, Chu WC. Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids. Journal of Supercomputing 2009; DOI: 10.1007/s11227-009-0307-4.
7. Venugopal S, Buyya R, Ramamohanarao K. A taxonomy of data grids for distributed data sharing, management, and processing. Proceedings of the ACM Computing Surveys 2006;38:1-53. Article 3.
8. Yang L, Schopf J, Foster I. Improving parallel data transfer times using predicted variances in shared networks. Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid '05), Cardiff City Hall, U. K., 9-12 May 2005;734-742. Available at: http://www.cs.cf.ac.uk/ ccgrid2005/.
9. Hoschek W, Jaen-Martinez J, Samar A, Stockinger H, Stockinger K. Data management in an international data grid project. Proceedings of the First IEEE/ACM International Workshop on Grid Computing-Grid 2000, Bangalore, India, December 2000.
10. Stockinger H, Samar A, Allcock B, Foster I, Holtman K, Tierney B. File and object replication in data grids. Journal of Cluster Computing 2002;5(3):305-314.
11. Vazhkudai S. Enabling the co-allocation of grid data transfers. Proceedings of Fourth International Workshop on Grid Computing, Phoenix, AZ, U. S. A., 17 November 2003;44-51.
12. Vazhkudai S, Tuecke S, Foster I. Replica selection in the globus data grid. Proceedings of the First International Symposium on Cluster Computing and the Grid (CCGRID 2001), Brisbane, Australia, 15-18 May 2001;106-113. Available at: http://www.informatik.uni-trier.de/~ley/db/conf/ccgrid/ccgrid2001.html.
13. Ranganathan K, Foster IT. Identifying dynamic replication strategies for a high-performance data grid. GRID 2001, Denver, CO, U. S. A., 12 November 2001;75-86. Available at: http://www.gridcomputing.org/grid2001/.
14. Ranganathan K, Foster I. Computation scheduling and data replication algorithms for data grids. Grid Resource Management: State of the Art and Future Trends, Nabrzyski J, Schopf J, Weglarz J (eds.). Kluwer: Dordrecht, 2003.
15. Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 2001;23:187-200 (based on conference publication from Proceedings of NetStore Conference 1999).
16. Bhuvaneswaran RS, Katayama Y, Takahashi N. Dynamic co-allocation scheme for parallel data transfer in grid environment. Proceedings of First International Conference on Semantics, Knowledge, and Grid (SKG2005), Beijing, China, 28-29 November 2005;17. Available at: http://kg.ict.ac.cn/SKG2005/ SKG2005.htm.
17. Bhuvaneswaran RS, Katayama Y, Takahashi N. A framework for an integrated co-allocator for data grid in multi-sender environment. IEICE Transactions on Communications 2007; E90-B (4):742-749.
18. Donno F, Gaido L, Ghiselli A, Prelz F, Sgaravatto M. DataGrid Prototype 1. TERENA Networking Conference. Available at: http://tnc2002.terena.org/Papers/ p5a2-ghiselli.pdf [5 February 2009].
19. The Globus Alliance. Available at: http://www.globus.org/[5 February 2010].
20. Open Grid Forum. Available at: http://www.ggf.org/[5 February 2010].
21. Foster I, Kesselman C. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 1997;11(2):115-128. (Pubitemid 127673968)
22. IBM Red Books. Introduction to Grid Computing with Globus. IBM Press. Available at: http://www.redbooks.ibm.com/abstracts/sg246895.html?Open, 1 October 2003 [5 February 2010].
23. Czajkowski K, Fitzgerald S, Foster I, Kesselman C. Grid information services for distributed resource sharing. Proceedings of the 10th IEEE International Symposium on High-performance Distributed Computing (HPDC-10'01), San Francisco, CA, 7-10 August 2001;181-194.
24. Zhang X, Freschl J, Schopf J. A performance study of monitoring and information services for distributed systems. Proceedings of 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12 '03), Seattle, WA, U. S. A., August 2003;270-282. Available at: http://www-csag.ucsd. edu/HPDC-12/.
25. Yang CT, Yang IH, Chen CH, Wang SY. Implementation of a dynamic adjustment mechanism with efficient replica selection in co-allocation data grid environments. Proceedings of the 21st Annual ACM Symposium on Applied Computing (SAC 2006)-Distributed Systems and Grid Computing (DSGC) Track, vol. 1, Dijon, France, 23-27 April 2006;797-804.
26. Chervenak A, Deelman E, Foster I, Guy L, Hoschek W, Iamnitchi A, Kesselman C, Kunszt P, Ripeanu M. Giggle: A framework for constructing scalable replica location services. Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, Baltimore, MD, U. S. A., 16-22 November 2002;1-17. Available at: http://www.sc-2002.org/.
27. Vazhkudai S, Schopf J. Using regression techniques to predict large data transfers. International Journal of High Performance Computing Applications (IJHPCA) 2003;17:249-268.
28. Vazhkudai S, Schopf J. Predicting sporadic grid data transfers. Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11 '02), Edinburgh, Scotland, July 2002;188-196.
29. Vazhkudai S, Schopf J, Foster I. Predicting the performance of wide area data transfers. Proceedings of the 16th International Parallel and Distributed Processing Symposium (IPDPS 2002), Fort Lauderdale, FL, April 2002;34-43. Available at: http://www.ipdps.org/ipdps2002/.
30. Yang CT, Yang IH, Li KC, Wang SY. Improvements on dynamic adjustment mechanism in co-allocation data grid environments. Journal of Supercomputing 2007;40(3):269-280.
31. Yang CT, Chen CH, Li KC, Hsu CH. Performance analysis of applying replica selection technology for data grid environments. PaCT 2005 (Lecture Notes in Computer Science, vol. 3603). Springer: Berlin, September 2005;278-287.
32. Czajkowski K, Foster I, Kesselman C. Resource co-allocation in computational grids. Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing (HPDC-8'99), Redondo Beach, CA, 3-6 August 1999. Available at: http://www.ece.arizona.edu/?hpdc/hpdc8/.
33. Chen CH, Yang CT, Lai CL. Towards an efficient replica selection for data grid. Proceedings of the First Workshop on Grid Technologies and Applications (Wo G TA ' 0 4), Hsinchu, Taiwan, 7-8 December 2004;89-94.