RACAM: Design and implementation of a Recursively Adjusting co-allocation method with efficient replica selection in Data Grids

Concurrency and Computation: Practice and Experience

Volumn 22, Issue 15, 2010, Pages 2170-2194

  Yang, Chao Tung ^a   Yang, I Hsien ^a   Chen, Chun Hsiang ^a  

^a TUNGHAI UNIVERSITY   (Taiwan)

Author keywords

Grid computing; Data Grid; replica selection; co allocation; data transfer; Globus toolkit; GridFTP; parallel transfer

Indexed keywords

DATA TRANSFER; GRID COMPUTING; HIGH ENERGY PHYSICS;

ACCESS EFFICIENCIES; ASTROPHYSICAL OBSERVATORY; DATA GRID; DESIGN AND IMPLEMENTATIONS; PARALLEL DOWNLOADING; REPLICA SELECTIONS; SCIENTIFIC APPLICATIONS; STORAGE RESOURCES;

DIGITAL STORAGE;

EID: 77957596256     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1571     Document Type: Article

References (36)

1. Allcock B, Bester J, Bresnahan J, Chervenak A, Foster I, Kesselman C, Meder S, Nefedova V, Quesnel D, Tuecke S. Secure efficient data transport and replica management for high-performance data-intensive computing. Proceedings of the 18th IEEE Symposium on Mass Storage Systems and Technologies, San Diego, CA, U. S. A., 17-20 April 2001;13-28.
2. Allcock B, Tuecke S, Foster I, Chervenak A, Kesselman C. Protocols and services for distributed data-intensive science. ACAT2000 Proceedings, Fermi National Accelerator Laboratory, Batavia, Illinois, IL, U. S. A., 2000;161-163.
3. Chervenak A, Deelman E, Foster I, Guy L, Hoschek W, Iamnitchi A, Kesselman C, Kunszt P, Ripeanu M, Schwarz B, Stockinger H, Stockinger K, Tierney B. Giggle: A framework for constructing scalable replica location services. Proceedings of SC 2002, Baltimore, MD, 2002.
4. Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of Supercomputer Applications and High Performance Computing 2001;15(3):200-222. (Pubitemid 33099013)
5. Hoschek W, Jaen-Martinez J, Samar A, Stockinger H, Stockinger K. Data management in an international data grid project. First IEEE/ACM International Workshop on Grid Computing-Grid 2000, Bangalore, India, December 2000.
6. IBM Red Books. Introduction to Grid Computing with Globus. IBM Press. ISBN: 0738427969, IBM Form Number SG24-6895-01, 1 October 2003. Available at: http://www.redbooks.ibm.com/redbooks/pdfs/sg246895.pdf [5 March 2010].
7. Donno F, Gaido L, Ghiselli A, Prelz F, Sgaravatto M. DataGrid Prototype 1. TERENA Networking Conference. Available at: http://tnc2002.terena.org/Papers/ p5a2-ghiselli.pdf [5 March 2010].
8. Stockinger H, Samar A, Allcock B, Foster I, Holtman K, Tierney B. File and object replication in data grids. Journal of Cluster Computing 2002;5(3):305-314.
9. Vazhkudai S. Enabling the co-allocation of grid data transfers. Proceedings of Fourth International Workshop on Grid Computing, Phoenix, AZ, U. S. A., 17 November 2003;41-51.
10. Vazhkudai S, Tuecke S, Foster I. Replica selection in the globus data grid. Proceedings of the First International Symposium on Cluster Computing and the Grid (CCGRID 2001), Brisbane, Australia, 15-18 May 2001;106-113.
11. Zhang X, Freschl J, Schopf J. A performance study of monitoring and information services for distributed systems. Proceedings of 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12 '03), Seattle, WA, 22-24 June 2003;270-282.
12. Allcock B, Bester J, Bresnahan J, Chervenak A, Foster I, Kesselman C, Meder S, Nefedova V, Quesnel D, Tuecke S. Data management and transfer in high-performance computational grid environments. Parallel Computing 2002;28(5):749-771.
13. Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 2001;23:187-200.
14. Koo SGM, Rosenberg C, Xu D. Analysis of parallel downloading for large file distribution. Proceedings of the Ninth IEEE Workshop on Future Trends of Distributed Computing Systems (FTDCS '03), San Juan, Puerto Rico, 28-30 May 2003;128-137.
15. Rodriguez P, Biersack EW. Dynamic parallel access to replicated content in the internet. IEEE/ACM Transactions on Networking 2002;10(4):455-465.
16. Tian Y, Wu D, Ng KW. Analyzing multiple file downloading in BitTorrent. Proceedings of the 2006 International Conference on Parallel Processing (ICPP'06), Columbus, OH, U. S. A., 14-18 August 2006;297-306.
17. Funasaka J. An analysis on adaptive parallel downloading method. Proceedings of the 19th International Conference on Advanced Information Networking and Applications (AINA'05), Taipei, Taiwan, vol. 1, 28-30 July 2005;835-840.
18. Yang C-T, Yang I-H, Wang S-Y, Hsu C-H, Li K-C. A recursively-adjusting co-allocation scheme with a cyber-transformer in data grids. Future Generation Computer Systems 2009;25(7):695-703.
19. Yang C-T, Yang I-H, Li K-C, Wang S-Y. Improvements on dynamic adjustment mechanism in co-allocation data grid environments. The Journal of Supercomputing 2007;40(3):269-280.
20. Yang C-T, Yang I-H, Chen C-H, Wang S-Y. Implementation of a dynamic adjustment mechanism with efficient replica selection in co-allocation data grid environments. Proceedings of the 21st Annual ACM Symposium on Applied Computing (SAC 2006)-Distributed Systems and Grid Computing Track, Dijon, France, 23-27 April 2006;797-804.
21. Yang C-T, Wang S-Y, Chu WC. Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids. Journal of Supercomputing 2009. DOI: 10.1007/s11227-009-0307-4.
22. von Laszewski G, Foster I, Gawor J, Lane P. Java CoG Kit, a Java commodity grid kit. Concurrency and Computation: Practice and Experience 2001;13(89):643-662.
23. The Globus Alliance. Available at: http://www.globus.org/[5 March 2010].
24. Foster I, Kesselman C. Globus: A metacomputing infrastructure toolkit. Intlernational Journal of Supercomputer Applications 1997;11(2):115-128. (Pubitemid 127673968)
25. Global Grid Forum. Available at: http://www.ogf.org/[5 March 2010].
26. Czajkowski K, Fitzgerald S, Foster I, Kesselman C. Grid information services for distributed resource sharing. Proceedings of the 10th IEEE International Symposium on High-performance Distributed Computing (HPDC-10'01), San Francisco, CA, U. S. A., 7-9 August 2001;181-194.
27. The Globus Projects. Available at: http://www.globus.org/alliance/ projects.php [5 March 2010].
28. Allcock W, Bresnahan J, Kettimuthu R, Link M, Dumitrescu C, Raicu I, Foster I. The globus striped GridFTP framework and server. Proceedings of SC'05. ACM Press: New York, 2005. Available at: http://www.globus.org/alliance/ publications/papers/gridftpfinal.pdf [5 March 2010].
29. Globus Toolkit 4.2.1 GridFTP User's Guide. Available at: http://www.globus.org/toolkit/docs/latest-stable/data/gridftp/user/ #gridftp-user-quickstart [5 March 2010].
30. Wolski R, Spring N, Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 1999;15(5-6): 757-768.
31. Czajkowski K, Foster I, Kesselman C. Resource co-allocation in computational grids. Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing (HPDC-8'99), Redondo Beach, CA, U. S. A., 3-6 August 1999.
32. Yang C-T, Chen C-H, Li K-C, Hsu C-H. Performance analysis of applying replica selection technology for data grid environments. PaCT 2005 (Lecture Notes in Computer Science, vol. 3603). Springer: Berlin, September 2005;278-287.
33. Vazhkudai S, Schopf J. Using regression techniques to predict large data transfers. International Journal of High Performance Computing Applications (IJHPCA) 2003;17:249-268.
34. Vazhkudai S, Schopf J. Predicting sporadic grid data transfers. Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11 '02), Edinburgh, Scotland, 24-26 July 2002;188-196.
35. Vazhkudai S, Schopf J, Foster I. Predicting the performance of wide area data transfers. Proceedings of the 16th International Parallel and Distributed Processing Symposium (IPDPS 2002), Rhodes Island, Greece, 25-29 April 2002;34-43.
36. SYSSTAT utilities home page. Available at: http://perso.wanadoo.fr/ sebastien.godard/[5 March 2010].