Enhancement of anticipative recursively adjusting mechanism for redundant parallel file transfer in data grids

Journal of Network and Computer Applications

Volumn 32, Issue 4, 2009, Pages 834-845

  Yang, Chao Tung ^a   Yang, Ming Feng ^a   Chiang, Wen Chung ^b  

^a TUNGHAI UNIVERSITY   (Taiwan)

^b HSIUPING INSTITUTE OF TECHNOLOGY   (Taiwan)

Author keywords

Burst Mode; Co allocation; Data grid; Parallel file transfer; Recursively adjusting

Indexed keywords

BURST MODE; CO-ALLOCATION; DATA GRID; PARALLEL FILE TRANSFER; RECURSIVELY ADJUSTING;

GRID COMPUTING; LARGE SCALE SYSTEMS; PARALLEL ARCHITECTURES; RECURSIVE FUNCTIONS; SODIUM COMPOUNDS; TRANSMISSION CONTROL PROTOCOL;

DATA TRANSFER RATES;

EID: 67349252828     PISSN: 10848045     EISSN: 10958592     Source Type: Journal    
DOI: 10.1016/j.jnca.2009.02.002     Document Type: Article

References (36)

1. Allcock B., Bester J., Bresnahan J., Chervenak A., Foster I., Kesselman C., et al. Data management and transfer in high-performance computational grid environments. Parallel Computing 28 5 (2002) 749-771
2. Altman Eitan, Barman Dhiman, Tuffin Bruno, Vojnovic Milan. Parallel TCP sockets: simple model, throughput and validation. In: INFOCOM 2006, April 2006.
3. Bhuvaneswaran RS, Katayama Y, Takahashi N. Dynamic co-allocation scheme for parallel data transfer in grid environment. In: Proceedings of first international conference on semantics, knowledge, and grid (SKG 2005), 2005. p. 17.
4. Bhuvaneswaran R.S., Katayama Y., and Takahashi N. A framework for an integrated co-allocator for data grid in multi-sender environment. IEICE Transactions on Communications E90-B 4 (2007) 742-749
5. Bolliger Juerg, Gross Thomas, Hengartner Urs. Bandwidth modelling for network-aware applications. In: INFOCOM '99, March 1999.
6. Chervenak A., Foster I., Kesselman C., Salisbury C., and Tuecke S. The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 23 3 (2001) 187-200
7. Chervenak A, Deelman E, Foster I, Guy L, Hoschek W, Iamnitchi A, et al. Giggle: a framework for constructing scalable replica location services. In: Proceedings of the 2002 ACM/IEEE conference on supercomputing, November 2002. p. 1-17.
8. Czajkowski K, Foster I, Kesselman C. Resource co-allocation in computational grids. In: Proceedings of the eighth IEEE international symposium on high performance distributed computing (HPDC-8 '99), August 1999.
9. Czajkowski K, Fitzgerald S, Foster I, Kesselman C. Grid information services for distributed resource sharing. In: Proceedings of the tenth IEEE international symposium on high-performance distributed computing (HPDC-10 '01), August 2001. p. 181-94.
10. Foster I., and Kesselman C. Globus: a metacomputing infrastructure toolkit. International Journal of High Performance Computing Applications 11 2 (1997) 115-128
11. Foster I., Kesselman C., and Tuecke S. The anatomy of the grid: enabling scalable virtual organizations. International Journal of High Performance Computing Applications 15 3 (2001) 200-222
12. Hacker Thomas J, Athey Brian D. The end-to-end performance effects of parallel TCP sockets on a lossy wide-area network, parallel and distributed processing symposium. In: Proceedings international, IPDPS 2002, 10.1109/IPDPS.2002.1015527.
13. Hoschek W, Jaen-Martinez J, Samar A, Stockinger H, Stockinger K. Data management in an international data grid project. In: Proceedings of the first IEEE/ACM international workshop on grid computing-grid 2000, Bangalore, India, December 2000.
14. Kelly F. Fairness and stability of end-to-end congestion control. European Journal of Control (2003) 159-176
15. Mamatas L., Harks T., and Tsaoussidis V. Approaches to congestion control in packet networks. Journal of Internet Engineering 1 1 (2007) 2
16. Mathis M., Semke J., Mahdavi J., and Ott T. The macroscopic behavior of the TCP congestion avoidance algorithm. Computer Communication Review 27 3 (1997)
17. Open Grid Forum. 〈http://www.ogf.org/〉.
18. Padhye J, Firoiu V, Towsley D, Kurose J. Modeling TCP throughput: a simple model and its empirical validation. In: ACMSIGCOMM, September 1998.
19. Stockinger H., Samar A., Allcock B., Foster I., Holtman K., and Tierney B. File and object replication in data grids. Journal of Cluster Computing 5 3 (2002) 305-314
20. The Globus Alliance. 〈http://www.globus.org/〉.
21. Vazhkudai S. Enabling the co-allocation of grid data transfers. In: Proceedings of fourth international workshop on grid computing, 17 November 2003. p. 44-51.
22. Vazhkudai S, Schopf J. Predicting sporadic grid data transfers. In: Proceedings of 11th IEEE international symposium on high performance distributed computing (HPDC-11 '02), July 2002. p. 188-96.
23. Vazhkudai S., and Schopf J. Using regression techniques to predict large data transfers. International Journal of High Performance Computing Applications (IJHPCA) 17 3 (2003) 249-268
24. Vazhkudai S, Tuecke S, Foster I. Replica selection in the globus data grid. In: Proceedings of the first international symposium on cluster computing and the grid (CCGRID 2001), May 2001. p. 106-13.
25. Vazhkudai S, Schopf J, Foster I. Predicting the performance of wide area data transfers. In: Proceedings of the 16th international parallel and distributed processing symposium (IPDPS 2002), April 2002. p. 34-43.
26. Venugopal S., Buyya R., and Ramamohanarao K. A taxonomy of data grids for distributed data sharing, management, and processing. ACM Computing Surveys 38 1 (2006) (Article 3)
27. Wang CM, Hsu CC, Chen HM, Wu JJ. Efficient multi-source data transfer in data grids. In: Proceedings of the sixth IEEE international symposium on cluster computing and the grid (CCGRID '06), 16-19 May 2006. p. 421-4.
28. Yang CT, Chen CH, Li KC, Hsu CH. Performance analysis of applying replica selection technology for data grid environments. In: PaCT 2005, Lecture Notes in Computer Science, vol. 3603. Berlin: Springer; 2005. p. 278-87.
29. Yang CT, Yang IH, Chen CH, Wang SY. Implementation of a dynamic adjustment mechanism with efficient replica selection in co-allocation data grid environments. Proceedings of the 21st Annual ACM Symposium on Applied Computing (SAC 2006) - Distributed Systems and Grid Computing Track, France, April 23-27, 2006. pp. 797-804.
30. Yang CT, Chi YC, Han TF, Hsu CH. Redundant parallel file transfer with anticipative recursively-adjusting scheme in data grids. Distributed and Parallel Computing: 7th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2007, Lecture Notes in Computer Science, vol. 4494, 2007a. p. 242-53.
31. Yang C.T., Yang I.H., Li K.C., and Wang S.Y. Improvements on dynamic adjustment mechanism in co-allocation data grid environments. Journal of Supercomputing 40 3 (2007) 269-280
32. Yang CT, Wang SY, Fu CP. A dynamic adjustment mechanism for data transfer in data grids. In: Network and parallel computing: IFIP international conference, NPC 2007, Lecture Notes in Computer Science, vol. 4672, September 17-20. Berlin: Springer; 2007c. p. 61-70, ISSN 1611-3349.
33. Yang CT, Yang MF, Chiang WC. Implementation of a cyber transformer for parallel download in co-allocation data grid environments. Proceedings of the 7th International Conference on Grid and Cooperative Computing (GCC2008) and Second EchoGRID Conference, October 24-26, 2008, in Shenzhen, Guangdong, China. pp. 242-53.
34. Yang CT, Yang IH, Wang SY, Hsu CH, Li KC. A recursively-adjusting co-allocation scheme with cyber-transformer in data grids. Future Generation Computer Systems, in press (available online 21 January 2007).
35. Yang L, Schopf J, Foster I. Improving parallel data transfer times using predicted variances in shared networks. In: Proceedings of the fifth IEEE international symposium on cluster computing and the grid (CCGrid '05), 9-12 May 2005. p. 734-42.
36. Zhang X, Freschl J, Schopf J. A performance study of monitoring and information services for distributed systems. In: Proceedings of 12th IEEE international symposium on high performance distributed computing (HPDC-12 '03), August 2003. p. 270-82.