Performance engineering in data Grids

Concurrency and Computation: Practice and Experience

Volumn 17, Issue 2-4, 2005, Pages 171-191

  Laure, Erwin ^a   Stockinger, Heinz ^a   Stockinger, Kurt ^a  

^a CERN   (Switzerland)

Author keywords

Data Grid; Performance; Replica management; Scheduling

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER SOFTWARE; DATABASE SYSTEMS; EFFICIENCY; MIDDLEWARE; OPTIMIZATION; PROJECT MANAGEMENT; RESOURCE ALLOCATION; SCHEDULING;

DATA GRIDS; GRID COMPUTING; PERFORMANCE ENGINEERING; REPLICA MANAGEMENT;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 14244251718     PISSN: 15320626     EISSN: None     Source Type: Journal    
DOI: 10.1002/cpe.923     Document Type: Article

References (41)

1. Foster I, Kesselman C (eds.). The Grid Morgan Kaufmann: San Mateo, CA, 1999.
2. Foster I, Kesselman C. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 1997; 11(2):115-128.
3. Grimshaw A, Wulf W. The legion vision of a Worldwide virtual computer. Communications of the ACM 1997; 40(1):39-45.
4. Unicore. http://www.unicore.org [October 2004].
5. The Global Grid Forum, http://www.ggf.org [November 2004].
6. Chervenak A, Foster I, Kesselman C, Salisburyand C, Tuccke S. The data Grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 2001; 23:187-200.
7. WP12 - Project Management. The DataGrid architecture. Deliverable D12.4, EU DataGrid Project, February 2002.
8. European DataGrid Project, http://www.eu-datagrid.org [March 2004].
9. ED DataGrid Project. Description of work. Technical Annex V5, EU DataGrid Project, January 2002.
10. WP8 - HEP Technical Working Group. Long term specifications of LHC experiments. Deliverable D8.1b, EU DataGrid Project, September 2001.
11. Bonacorsi D et al. Running CMS software on GRID testbeds. Computing in High Energy and Nuclear Physics, CHEP03, La Jolla, CA, U.S.A., March 2003. Available at: http://www.arxiv.org.
12. WP10 - Grid-aware Biomedical Applications. Report on the 1st bio-testbed release. Deliverable D10.3, EU DataGrid Project, April 2003.
13. WP10 - Grid-aware Biomedical Applications. Requirements for Grid-aware biology applications. Deliverable D10.1, EU DataGrid Project, September 2001.
14. WP9 - Earth Observation Applications. Requirements specification - EO application requirements for GRID. Deliverable D9.1, EU DataGrid Project, August 2001.
15. Stockinger H, Rana O, Moore R, Merzky A. Data management in a Grid environment. Proceedings of the European High Performance Computing and Networking Conference (HPCN2001), Amsterdam, The Netherlands, 25-27 June 2001.
16. Stockinger K, Stockinger H, Dutka L, Slota R, Nikolow D, Kitowski J. Access cost estimation for unified Grid storage systems. Proceedings of the 4th International Workshop on Grid Computing (Grid2003), Phoenix, AZ, 17 November 2003.
17. Allcock W, Bester J, Bresnahan J, Chervenak A, Liming L, Meder S, Tuecke S. GridFTP protocol specification. GGF GridFTP Working Group Document, September 2002.
18. Andrews G. Concurrent Programming: Principles and Practice. Benjamin/Cummings: New York, 1991.
19. High Performance Fortran Language Specification, Version 2.0, January 1997.
20. Message Passing Interface Forum. MPI: A Message-Passing Interface Standard Version 1.1, June 1995.
21. Skillicorn D, Talia D. Models and languages for parallel computation. ACM Computing Surveys 1998; 30(2): 123-169.
22. Livny M, Basney J, Raman R, Tannenbaum T. Mechanisms for high throughput computing. SPEEDUP Journal 1997; 11(1).
23. Laure E. High level support for distributed high performance computing. PhD Thesis, Institute for Software Science, University of Vienna, Austria, February 2001.
24. Laure E. OpusJava: A Java framework for distributed high performance computing. Future Generation Computer Systems 2001;18(2):235-251.
25. Foster I, Kesselman C, Tuecke S. The anatomy of the Grid. The International Journal of High Performance Computing Applications 2001; 15(3):200-222.
26. Bird I et al. Srm joint functional design. Global Grid Forum Document, GGF4, Toronto, February 2002.
27. Stockinger H, Stockinger K, Schikuta E, Willers I. Towards a cost model for distributed and replicated data stores. Proceedings of the 9th Euromicro Workshop on Parallel and Distributed Processing PDP 2001. Mantova, Italy, 7-9 February 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001.
28. Stockinger H. Distributed database management systems and the data Grid. Proceedings of the 18th IEEE Symposium on Mass Storage Systems and 9th NASA Goddard Conference on Mass Storage Systems and Technologies, San Diego, CA, 17-20 April 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001.
29. Guyton J, Schwartz M. Locating nearby copies of replicated Internet servers. Proceedings of ACM SIGCOMM'95. ACM Press: New York, 1995.
30. Schopf J. Ten actions when superscheduling. GGF Scheduling Request for Comments:8.5, July 2001.
31. Tirumala A, Qin F, Dugan J, Ferguson J, Gibbs K. Iperf Version 1.7.0. http://dast.nlanr.net/Projects/Iperf/ [September 2003].
32. Guy L, Kunszt P, Laure E, Stockinger H, Stockinger K. Replica management in data Grids. Technical Report GGF5, Working Draft, July 2002.
33. Kunszt P, Laure E, Stockinger H, Stockinger K. Advanced replica management with reptor. International Conference on Parallel Processing and Applied Mathematics, Czestochowa, Poland, September 2003. Springer: Berlin, 2003.
34. Chervenak A et al. Giggle: A framework for constructing scalable replica location services. SC'2002, Baltimore, MD, November 2002. IEEE Computer Society Press: Los Alamitos, CA, 2002.
35. WP1 - Workload Management. Definition of architecture, technical plan and evaluation criteria for scheduling, resource management, security and job description. Deliverable D1.2, EU DataGrid Project, September 2001.
36. Bent J, Venkataramani V, LeRoy N, Roy A, Stanley J, Arpaci-Dusseau A, Arpaci-Dusseau R, Livny M. Flexibility, manageability, and performance in a Grid storage appliance. Symposium on High Performance Distributed Computing, Edinburgh, Scotland, July 2002. IEEE Computer Society Press: Los Alamitos, CA, 2002.
37. Basney J, Livny M, Tannenbaum T. High throughput computing with condor. HPCU News 1997; 1(2).
38. Baru C, Moore R, Rajasekar A, Wan M. The SDSC storage resource broker. CASCON'98 Conference, Toronto, Canada, November 1998. IBM, 1998.
39. Bell W, Cameron D, Capozza L, Millar P, Stockinger K, Zini F. Optorsim: A Grid simulator for studying dynamic data replication strategies. International Journal of High Performance Computing Applications 2003; 17(4):403-416.
40. Bell W, Cameron D, Carvajal-Schiaffino R, Millar P, Stockinger K, Zini F. Evaluation of an economy-based file replication strategy for a data Grid. International Workshop on Agent based Cluster and Grid Computing at CCGrid 2003, Tokyo, Japan, May 2003. IEEE Computer Society Press: Los Alamitos, CA, 2003.
41. Ranganathan K, Foster I. Simulation studies of computation and data scheduling algorithms for data Grids. Journal of Grid Computing 2003; l(1):53-62.