A study on performance of dynamic file replication algorithms for real-time file access in Data Grids

Future Generation Computer Systems

Volumn 25, Issue 8, 2009, Pages 829-839

  Doǧan, Atakan ^a  

^a ANADOLU UNIVERSITY   (Turkey)

Author keywords

Data grid; Discrete event simulation; Dynamic file replication; Real time

Indexed keywords

BEST-EFFORT; DATA GRID; DATA GRID ENVIRONMENT; DISCRETE EVENTS; DYNAMIC REPLICATION; FILE ACCESS; FILE REPLICATION ALGORITHMS; GRID INFRASTRUCTURES; JOB COMPLETION; NETWORK BANDWIDTH; NUMBER OF DATUM; PROCESS-ORIENTED; REAL TIME CONSTRAINTS; REAL TIME PERFORMANCE; REAL-TIME; SCIENCE AND ENGINEERING; SIMULATION STUDIES; TIME GRID;

ALGORITHMS; LARGE SCALE SYSTEMS;

GRID COMPUTING;

EID: 67349189473     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2009.02.002     Document Type: Article

References (49)

1. Theys M.D., Tan M., Beck N., Siegel H.J., and Jurczyk M. A mathematical model and scheduling heuristic for satisfying prioritized data requests in an oversubscribed communication network. IEEE Transactions on Parallel and Distributed Systems 11 9 (2000) 969-988
2. Y. Shi, A. Shortridge, J. Bartholic, Grid computing for real-time distributed collaborative geoprocessing, in: Symposium on Geospatial Theory, Processing and Applications, 2002
3. H. Takeuchi, T. Kondo, Y. Koyama, J. Nakajima, VLBI@home-VLBI correlator by GRID computing system, in: International VLBI Service for Geodesy and Astrometry 2004 General Meeting Proceedings, 2004, pp. 200-204
4. K. Keahey, M.E. Papka, Q. Peng, D. Schissel, G. Abla, T. Araki, J. Burruss, E. Feibush, P. Lane, S. Klasky, T. Leggett, D. McCune, L. Randerson, Grids for experimental science: The virtual control room, in: Challenges of Large Applications in Distributed Environments, CLADE, 2004
5. J. Montagnat, V. Breton, I.E. Magnin, Using grid technologies to face medical image analysis challenges, in: Int'l Workshop on Biomedical Computations on the Grid, BioGrid'03, 2003, pp. 588-593
6. Fox G., Ko S.-H., Pierce M., Balsoy O., Kim J., Lee S., Kim K., Oh S., Rao X., Varank M., Bulut H., Gunduz G., Qiu X., Pallickara S., Uyar A., and Youn C. Grid services for earthquake science. Concurrency and Computation: Practice and Experience 14 6-7 (2002) 371-393
7. Allcock W., Bresnahan J., Bunnb J., Hegded S., Insley J., Kettimuthu R., Newmanb H., Ravotb S., Rimovsky T., Steenberg C., and Winkler L. Grid-enabled particle physics event analysis: Experiences using a 10 Gb, high-latency network for a high-energy physics application. Future Generation Computer Systems 19 (2003) 983-997
8. L. Caviglione, F. Davoli, P. Molini, S. Zappatore, Design and preliminary analysis of a framework for integrating real and virtual instrumentation within a grid infrastructure, http://www.gridcc.org/publicdocuments.php
9. G. von Laszewski, M. Su, J.A. Insley, I. Foster, J. Bresnahan, C. Kesselman, M. Thiebaux, M.L. Rivers, S. Wang, B. Tieman, I. McNulty, Real-time analysis, visualization, and steering of microtomography experiments at photon sources, in: The Ninth SIAM Conference on Parallel Processing for Scientific Computing, 1999
10. I. Foster, What is the Grid? A three point checklist, GRIDToday, 2002
11. I. Foster, C. Kesselman, C. Lee, Rç Lindell, K. Nahrstedt, A. Roy, A distributed resource management architecture that supports advance reservation and co-allocation, in: Int'l Workshop on Quality of Service, 1999, pp. 27-36
12. K. Czasjkowski, A. Dan, J. Rofrano, S. Tuecke, M. Xu, Agreement-based grid service management (OGSI-Agreement), in: Global Grid Forum, GRAAP-WG Author Contribution, 2003
13. Al-Ali R.J., Amin K., von Laszewski G., Rana O.F., Walker D.W., Hategan M., and Zaluzec N. Analysis and provision of QoS for distributed grid applications. Journal of Grid Computing 2 2 (2004) 163-182
14. L.-O. Burchard, M. Hovestadt, O. Kao, A. Keller, B. Linnert, The virtual resource manager: An architecture for SLA-aware resource management, in: IEEE/ACM Int'l Symposium on Cluster Computing and the Grid, 2004
15. K. Czajkowski1, I. Foster, C. Kesselman, V. Sander, S. Tuecke, SNAP: A protocol for negotiating service level agreements and coordinating resource management in distributed systems, in: The 8th Workshop on Job Scheduling Strategies for Parallel Processing, 2002
16. Chervenak A., Foster I., Kesselman C., Salisbury C., and Tuecke S. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 23 3 (2000) 187-200
17. Allock B., Bester J., Bresnahan J., Chervenak A.L., Foster I., Kesselman C., Mader S., Nefedova V., Quesnel D., and Tuecke S. Data management and transfer in high performance computational grid environments. Parallel Computing Journal 28 5 (2002) 749-771
18. The datagrid project, http://eu-datagrid.web.cern.ch/eu-datagrid/
19. GridPP, http://www.gridpp.ac.uk/
20. Enabling grids for E-science, http://www.eu-egee.org/
21. A. Chervenak, E. Deelman, I. Foster, L. Guy, W. Hoschek, A. Iamnitchi, C. Kesselman, P. Kunst, M. Ripeanu, B Schwartzkopf, H Stockinger, K. Stockinger, B. Tierney, Giggle: A framework for constructing sclable replica location services, Supercomputing, 2002
22. L. Guy, P. Kunszt, E. Laure, H. Stockinger, K. Stockinger, Replica management in data grids, Technical Report, GGF5 Working Draft, 2002
23. Camaron D.G., Millar A.P., Nicholson C., -Schiaffino R.C., Zini F., and Stockinger K. Analysis of scheduling and replica optimisation strategies for data grids using optorsim. Journal of Grid Computing 2 1 (2004) 57-69
24. C. Nicholson, D.G. Camaron, A.T. Doyle, A.P. Millar, K. Stockinger, Dynamic data replication in LCG 2008, in: UK e-Science All Hands Conference, 2006
25. H. Lamehamedi, Z. Shentu, B. Szymanski, E. Deelman, Simulation of dynamic data replication strategies in data grids, in: Heterogeneous Computing Workshop, 2003, p. 100b
26. Ranganathan K., and Foster I. Simulation studies of computation and data scheduling algorithms for data grids. Journal of Grid Computing 1 1 (2003) 63-74
27. Ranganathan K., and Foster I. Identifying dynamic replication strategies for a high-performance data grid. Lecture Notes In Computer Science vol. 2242 (2001) 75-86
28. Tang M., Lee B.-S., Yeo C.-K., and Tang X. Dynamic replication algorithms for the multi-tier data grid. Future Generation Computer Systems 21 (2005) 775-790
29. Tang M., Lee B.-S., Tang X., and Yeo C.-K. The impact of data replication on job scheduling performance in the data grid. Future Generation Computer Systems 22 (2006) 254-268
30. M.R. Rahman, K. Barker, R. Alhaji, Replica placement design with static optimality and dynamic maintainability, in: IEEE Int'l Symposium on Cluster Computing and the Grid, 2006
31. Desprez F., and Vernois A. Simultaneous scheduling of replication and computation for data-intensive applications on the grid. Journal of Grid Computing 4 1 (2006) 19-31
32. Y.-F. Lin, P. Liu, J.-J. Wu, Optimal placement of replicas in data grid environments with locality assurance, in: Int'l Conference on Parallel and Distributed Systems, 2006
33. Chang R.-S., Chang J.-S., and Lin S.-Y. Job scheduling and data replication performance on data grids. Future Generation Computer Systems 23 (2007) 846-860
34. Machida Y., Takizawa S., Nakada H., and Matsuoka S. Intelligent data staging with overlapped execution of grid applications. Future Generation Computer Systems 24 (2008) 425-433
35. Kosar T., and Balman M. A new paradigm: Data-aware scheduling in grid computing. Future Generation Computer Systems 25 (2009) 406-413
36. D. Britton, A.J. Cass, P.E.L. Clarke, J. Coles, D.J. Colling, A.T. Doyle, N.I. Geddes, J.C. Gordon, R.W.L. Jones, D.P. Kelsey, S.L. Lloyd, R.P. Middleton, G.N. Patrick, R.A. Sansum, S.E. Pearce, GridPP - the UK grid for particle physics, UK e-Science All Hands Conference, 2008
37. Avery P. Data grids: A new computational infrastructure for data intensive science. Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences 360 (2002) 1191-1209
38. Orda A. Routing with end-to-end QoS guarantees in broadband networks. IEEE/ACM Transactions on Networking 7 3 (1999)
39. R.A. Guerin, A. Orda, Networks with advance reservations: The routing perspective, Infocom, 2000
40. I. Stoica, H. Zhang, Providing guaranteed services without per flow management, in: ACM SIGCOMM, 1999, pp. 81-94
41. RFC 1633 Integrated services in the internet architecture: An overview
42. RFC 2212 specification of guranteed quality of service
43. RFC 2205 Resource Reservation Protocol (RSVP)
44. Cormen T.H., Leiserson C.E., Rivest R.L., and Stein C. Introduction to Algorithms. Second ed. (2001), MIT Press, McGraw-Hill
45. Wolski R., Spring N., and Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computing Systems 15 (1999) 757-768
46. Asiki A., Doka K., Konstantinou I., Zissimos A., and Tsoumakos D. A grid middleware for data management exploiting peer-to-peer techniques. Future Generation Computer Systems 25 (2009) 426-435
47. A. Doǧan, Performance of file replication policies for real-time file access in data grids, in: First International Conference on Networks for Grid Applications, 2007
48. User's guide: CSIM19 simulation engine (C Version), http://www.mesquite.com/documentation/index.htm#userc
49. Rizk P., Kiddle C., Simmonds R., and Unger B. Performance of a GridFTP overlay network. Future Generation Computer Systems 24 (2008) 442-451