The impact of data replication on job scheduling performance in the Data Grid

Future Generation Computer Systems

Volumn 22, Issue 3, 2006, Pages 254-268

  Tang, Ming ^a,b   Lee, Bu Sung ^a,c   Tang, Xueyan ^a   Yeo, Chai Kiat ^a,d  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b Nanyang Technological University ^*  (Singapore)

^c Asia Pacific Advance Network (APAN)   (Mexico)

^d School of Computer Engineering   (Singapore)

Author keywords

Data Grid; Data replication; Grid scheduling; Simulation

Indexed keywords

DATA GRID; DATA REPLICATION; GRID SCHEDULING; JOB SCHEDULING;

ALGORITHMS; COMPUTER SIMULATION; DATA ACQUISITION; HEURISTIC METHODS; SCHEDULING; TURNAROUND TIME;

JOB ANALYSIS;

EID: 28044460017     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2005.08.004     Document Type: Article

References (27)

1. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker Web caching and Zipf-like distributions: evidence and implications. Proceedings of IEEE INFOCOM New York, March 1999 1999 126 134
2. D.G. Cameron, A.P. Millar, C. Nicholson, R. Carvajal Schiaffino, F. Zini, and K. Stockinger Analysis of scheduling and replica optimisation strategies for data grids using OptorSim J. Grid Comp. 2 1 2004 57 69
3. S.J. Chapin, W. Cirne, D.G. Feitelson, J.P. Jones, S.T. Leutenegger, U. Schwiegelshohn, W. Smith, and D. Talby Benchmarks and standards for the evaluation of parallel job schedulers Proceedings of 5th Job Scheduling Strategies for Parallel Processing April 1999
4. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke The Data Grid: towards an architecture for the distributed management and analysis of large scientific datasets J. Netw. Comp. Appl. 23 3 2000 187 200
5. W. Cirne, and F. Berman When the herd is smart: aggregate behavior in the selection of job request IEEE Trans. Parallel Distrib. Syst. 14 2 2003 181 192
6. D.G. Feitelson, and L. Rudolph Metrics and benchmarking for parallel job scheduling Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing 1998 1 24
7. D.G. Feitelson, L. Rudolph, U. Schwiegelshohn, K.C. Sevcik, and P. Wong Theory and practice in parallel job scheduling G. Dror Feitelson Rudolph Larry Job Scheduling Strategies for Parallel Processing 1997 Springer-Verlag 1 34
8. I. Foster, and C. Kesselman The Grid: Blueprint for a New Computing Infrastructure 1998 Morgan Kaufmann
9. V. Hamscher, U. Schwiegelshohn, A. Streit, and R. Yahyapour Evaluation of job-scheduling strategies for Grid computing Proceedings of the First International Workshop on Grid Computing 2000 191 202
10. K. Holtman Hepgrid2001: a model of a virtual data Grid application Proceedings of HPCN Europe, vol. 2110 Springer LNCS, Amsterdam 2000 711 720
11. W. Hoschek, J. Jaen-Martinez, A. Samar, H. Stockinger, and K. Stockinger Data management in an international Data Grid project Proceedings of the First IEEE/ACM International Workshop on Grid Computing 2000 77 90
12. A. Iamnitchi, M. Ripeanu, and I. Foster Locating data in (small-world?) peer-to-peer scientific collaborations Proceedings of the First International Workshop on Peer-to-Peer Systems (IPTPS) 2002 232 241
13. H. Lamehamedi, Z. Shentu, and B. Szymanski Simulation of dynamic data replication strategies in Data Grids Proceedings of 12th Heterogeneous Computing Workshop (HCW'03) April 2001
14. C.B. Lee, Y. Schwartzman, J. Hardy, and A. Snavely Are user runtime estimates inherently inaccurate? Proceedings of 10th Job Scheduling Strategies for Parallel Processing June 2004
15. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, and R.F. Freund Dynamic mapping of a class of independent tasks onto heterogeneous computing systems J. Parallel Distrib. Comput. 59 November (2) 1999 107 131
16. Globus Monitoring and Discovery Service(MDS), http://www.globus.org/mds/.
17. A.W. Mu'alem, and D.G. Feitelson Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling IEEE Trans. Parallel Distrib. Syst. 12 June (6) 2001 529 543
18. Network Weather Service (NWS), http://nws.cs.ucsb.edu/.
19. M. Rabinovich, I. Rabinovich, R. Rajaraman. Dynamic Replication on the Internet, Technical Report HA6177000-980305-01-TM, AT&T Labs, March 1998.
20. K. Ranganathan, and I. Foster Identifying dynamic replication strategies for high performance Data Grids Proceedings of the Second International Workshop on Grid Computing November 2001 75 86
21. K. Ranganathan, and I. Foster Simulation studies of computation and data scheduling algorithms for data grids J. Grid Comput. 1 2003 53 62
22. Globus Replica Location Service (RLS), http://www.globus.org/rls/.
23. H. Shan, and L. Oliker Job superscheduler architecture and performance in computational Grid environments Proceedings of the ACM/IEEE SC2003 Conference November 2003
24. A. Takefusa, O. Tatebe, S. Matsuoka, and Y. Morita Performance analysis of scheduling and replication algorithms on Grid Datafarm architecture for high-energy physics applications Proceedings of 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03) June 2003
25. M. Tang, B.-S. Lee, C.-K. Yeo, and X. Tang Dynamic replication algorithms for the multi-tier Data Grid Future Gen. Comp. Syst. FGCS 21 5 2005 775 790
26. O. Wolfson, S. Jajodia, and Y. Huang An adaptive data replication algorithm ACM Trans. Database Syst. 22 4 1997 255 314
27. G.K. Zipf Human Behavior and the Principles of Least Effort 1949 Addison-Wesley