Advanced Resource Connector middleware for lightweight computational Grids

Future Generation Computer Systems

Volumn 23, Issue 2, 2007, Pages 219-240

  Ellert, M ^a   Gronager M ^b   Konstantinov, A ^c,d   Konya B ^e   Lindemann, J ^e   Livenson, I ^f   Nielsen, J L ^g   Niinimaki M ^c   Smirnova, O ^e   Waananen A ^g  

^a UPPSALA UNIVERSITY   (Sweden)

^b The Danish IT Centre for Education and Research   (Denmark)

^c UNIVERSITY OF OSLO   (Norway)

^d VILNIUS UNIVERSITY   (Lithuania)

^e LUND UNIVERSITY   (Sweden)

^f UNIVERSITY OF TARTU   (Estonia)

^g UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Cluster; Distributed computing; Globus; Grid; Linux; Middleware; Scheduling

Indexed keywords

COMPUTER OPERATING SYSTEMS; DISTRIBUTED COMPUTER SYSTEMS; MAINTENANCE; RELIABILITY; SCHEDULING;

CLUSTER; DISTRIBUTED COMPUTING; GLOBUS; LINUX;

MIDDLEWARE;

EID: 33748521553     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2006.05.008     Document Type: Article

References (78)

1. M. Litzkow, M. Livny, M. Mutka, Condor - A hunter of idle workstations, in: Proceedings of the 8th International Conference of Distributed Computing Systems, 1988, pp. 104-111
2. Foster I., and Kesselman C. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 11 2 (1997) 115-128
3. Foster I., et al. A security architecture for computational grids. CCS '98: Proceedings of the 5th ACM Conference on Computer and Communications Security (1998), ACM Press 83-92
4. In: Foster I., and Kesselman C. (Eds). The Grid: Blueprint for a New Computing Infrastructure. 2nd edition (2003), Morgan Kaufmann
5. The NorduGrid Collaboration, Web site. URL http://www.nordugrid.org
6. M. Romberg, The UNICORE architecture: Seamless access to distributed resources, in: Proceedings of 8th IEEE International Symposium on High Performance Distributed Computing, HPDC-8 '99, 1999, p. 44
7. Laure E., et al. The EU datagrid setting the basis for production grids. Journal of Grid Computing 2 4 (2004) 299-400
8. Wäänänen A., et al. An overview of an architecture proposal for a high energy physics grid. PARA'02: Proceedings of the 6th International Conference on Applied Parallel Computing Advanced Scientific Computing. Lecture Notes in Computer Science vol. 2367 (2002), Springer-Verlag 76-88
9. Ellert M., et al. The NorduGrid project: Using Globus toolkit for building Grid infrastructure. Nuclear Instrumentation and Methods A 502 (2003) 407-410
10. Ould-Saada F. The NorduGrid collaboration. SWITCH Journal 1 (2004) 23-24
11. Estonian Grid, Web site. URL http://grid.eenet.ee
12. SWEGRID: The Swedish Grid testbed, Web site. URL http://www.swegrid.se
13. Danish Center for Grid Computing, Web site. URL http://www.dcgc.dk
14. S. Gadomski et al., The Swiss ATLAS Computing Prototype, Tech. Rep. CERN-ATL-COM-SOFT-2005-007, ATLAS note, 2005
15. Eerola P., et al. Building a production grid in Scandinavia. IEEE Internet Computing 7 4 (2003) 27-35
16. K. Pajchel et al., Usage statistics and usage patterns on the NorduGrid: Analyzing the logging informations collected on one of the largest production grids in the world, in: A. Aimar, J. Harvey, N. Knoors (Eds.), Proc. of CHEP 2004, CERN-2005-002, vol. 1, 2005, pp. 711-714
17. Eerola P., et al. Atlas data-challenge 1 on NorduGrid. Proc. of CHEP 2003 (2003), La Jolla, California
18. The ATLAS Collaboration, ATLAS - A Toroidal LHC ApparatuS, Web site. URL http://atlas.web.cern.ch
19. Nordic universities network, Web site. URL http://www.nordu.net
20. Deelman E., et al. Mapping abstract complex workflows onto grid environments. Journal of Grid Computing 1 1 (2003) 25-39
21. T.A. Howes, M.C. Smith, A Scalable, deployable directory service framework for the internet, Tech. Rep. 95-7, CITI (Center for Information Technology Integration), University of Michigan, USA, 1995
22. Stockinger H., et al. File and object replication in data grids. Cluster Computing 5 3 (2002) 305-314
23. Chervenak A.L., et al. Performance and scalability of a replica location service. Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing. HPDC'04 (2004), IEEE Computer Society Press 182-191
24. EGEE User's Guide: gLite Data Management Catalog CLI, Tech. Rep. EGEE-TECH-570780-v1.0, EGEE, EU INFSO-RI-508833, 2005. URL https://edms.cern.ch/file/570780/1/EGEE-TECH-570780-v1.0.pdf
25. EGEE gLite, gLite - Lightweight Middleware for Grid Computing, Web site. URL http://glite.web.cern.ch/glite/
26. EGEE, EGEE - Enabling Grids for E-science, Web site. URL http://egee-intranet.web.cern.ch/egee-intranet/gateway.html
27. Alfieri R., et al. From gridmap-file to VOMS: Managing authorization in a Grid environment. Future Generation Computer Systems 21 4 (2005) 549-558
28. Foster I., and Kesselman C. Globus: A toolkit-based grid architecture. The Grid: Blueprint for a New Computing Infrastructure (1999), Morgan Kaufmann 259-278
29. CERN, The LHC Computing Grid Project - LCG, Web site, 2003. URL http://lcg.web.cern.ch/LCG/
30. In: Nabrzyski J., Schopf J.M., and Weglarz J. (Eds). Grid Resource Management: State of the Art and Future Trends (2004), Kluwer Academic Publishers, Norwell, MA, USA
31. Frey J., et al. Condor-G: A computation management agent for multi-institutional grids. Cluster Computing 5 3 (2002) 237-246
32. Kosar T., and Livny M. Stork: Making data placement a first class citizen in the grid. Proceedings of the 24th International Conference on Distributed Computing Systems. ICDCS'04 (2004), IEEE Computer Society 342-349
33. Shirasuna S., et al. Performance comparison of security mechanisms for grid services. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing. GRID'04 (2004), IEEE Computer Society Press 360-364
34. Aloisio G., et al. Secure web services with globus GSI and gSOAP. In: Kosch H., Böszörményi L., and Hellwagner H. (Eds). Euro-Par 2003 Parallel Processing: Proceedings of 9th International Euro-Par Conference. Lecture Notes in Computer Science vol. 2790 (2003), Springer-Verlag 421-426
35. Henderson R.L. Job scheduling under the portable batch system. In: Feitelson D.G., and Rudolph L. (Eds). IPPS '95: Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing. Lecture Notes in Computer Science vol. 949 (1995), Springer-Verlag 279-294
36. Gentzsch W. Sun grid engine: Towards creating a compute power grid. CCGRID'01: Proceedings of the 1st International Symposium on Cluster Computing and the Grid (2001), IEEE Computer Society Press 35
37. Runtime Environment Registry, Web site. URL http://www.csc.fi/grid/rer/
38. A. Anjomshoaa et al., JSDL-WG, Job Submission Description Language Work Group, Tech. Rep. GFD-R-P.056, GGF Document Series, 2005. URL https://forge.gridforum.org/projects/jsdl-wg/document/draft-ggf-jsdl-spec/en/28
39. A. Konstantinov, The NorduGrid Grid Manager And GridFTP Server: Description And Administrator's Manual, The NorduGrid Collaboration, NORDUGRID-TECH-2. URL http://www.nordugrid.org/documents/GM.pdf
40. McNab A. The gridsite web/grid security system: research articles. Softw. Pract. Exper. 35 9 (2005) 827-834
41. R. Housley et al., RFC 2459, Internet X.509 Public Key Infrastructure Certificate and CRL Profile, 1999. URL http://www.ietf.org/rfc/rfc2459.txt
42. Storage Resource Management Working Group, Web site. URL http://sdm.lbl.gov/srm-wg/
43. Jackiewicz T. Deploying OpenLDAP (2004), Apress, Berkeley, CA, USA
44. Fitzgerald S., et al. A directory service for configuring high-performance distributed computations. Proc. 6th IEEE Symp. on High Performance Distributed Computing (1997), IEEE Computer Society Press 365-375
45. Czaijkowski K., et al. Grid information services for distributed resource sharing. Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing. HPDC-10'01 (2001), IEEE Computer Society Press 181-194
46. B. Kónya, The NorduGrid/ARC Information System, The NorduGrid Collaboration, NORDUGRID-TECH-4. URL http://www.nordugrid.org/documents/arc_infosys.pdf
47. J.M. Schopf et al., Monitoring and discovery in a web services framework: Functionality and performance of the globus toolkit's MDS4, Tech. Rep. ANL/MCS-P1248-0405, Argonne National Laboratory, 2005
48. Cooke A.W., et al. The relational grid monitoring architecture: Mediating information about the grid. Journal of Grid Computing 2 4 (2004) 323-339
49. L. Field et al. Grid deployment experiences: The path to a production quality LDAP based grid information system, in: A. Aimar, J. Harvey, N. Knoors (Eds.), Proc. of CHEP 2004, CERN-2005-002, vol. 1, 2005, pp. 711-714
50. The Globus Alliance, The Globus Resource Specification Language RSL v1.0, Web site. URL http://www-fp.globus.org/gram/rsl_spec1.html
51. O. Smirnova, Extended Resource Specification Language, The NorduGrid Collaboration, NORDUGRID-MANUAL-4. URL http://www.nordugrid.org/documents/xrsl.pdf
52. Bogdanski M., et al. Grid Service Provider: How to improve flexibility of grid user interfaces?. In: Sloot P., et al. (Ed). Proceedings of the 3rd International Conference on Computational Science vol. 1. Lecture Notes in Computer Science vol. 2567 (2003), Springer 255-263
53. O.-K. Kwon et al. A grid resource allocation system for scientific application: Grid resource allocation services package (GRASP), in: Proceedings of the 13th Annual Mardi Gras Conference: Frontiers of Grid Applications and Technologies, 2005, pp. 23-28
54. A. Konstantinov, Protocols, Uniform Resource Locators (URL) and Extensions Supported in ARC, The NorduGrid Collaboration, NORDUGRID-TECH-7. URL http://www.nordugrid.org/documents/URLs.pdf
55. O. Smirnova, The Grid Monitor, The NorduGrid Collaboration, NORDUGRID-MANUAL-5. URL http://www.nordugrid.org/documents/monitor.pdf
56. NorduGrid Web site, The Grid Monitor, the interface. URL http://www.nordugrid.org/monitor
57. Converse T., and Park J. PHP 4 Bible (2000), John Wiley & Sons, Inc., New York, NY, USA
58. Beazley D.M. Automated scientific software scripting with SWIG. Future Generation Computer Systems 19 5 (2003) 599-609
59. Lutz M. Programming Python: Object-Oriented Scripting (2001), O'Reilly & Associates, Inc., Sebastopol, CA, USA
60. von Laszewski G., et al. A Java commodity grid kit. Concurrency and Computation: Practice and Experience 13 8-9 (2001) 645-662
61. Weltman R., and Dahbura T. LDAP Programming with Java (2000), Addison Wesley
62. A. Shoshani, A. Sim, J. Gu, Storage Resource Managers: Middleware components for Grid Storage, in: Proc. of the 19th IEEE Symposium on Mass Storage Systems, MSS'02, 2002, pp. 209-223
63. Novotny J., Tuecke S., and Welch V. An online credential repository for the grid: MyProxy. Proc. of the 10th International Symposium on High Performance Distributed Computing. HPDC-10'01 (2001), IEEE Computer Society 104
64. Global Grid Forum, Web site. URL http://www.ggf.org
65. Lunarc - Center for Technical and Scientific Computing, Lund University, Web site. URL http://www.lunarc.lu.se
66. Karlström G., et al. MOLCAS: A program package for computational chemistry. Computational Materials Science 28 2 (2003) 222-239
67. Hibbitt, Karlsson and Sorensen Inc, Pawtucket, USA, ABAQUS Theory Manual, 2005
68. Etter D.M., Kuncicky D., and Hull D. Introduction to MATLAB 7 (2005), Prentice Hall PTR, Upper Saddle River, NJ, USA
69. C. Esterbrook, Introduction to webware for Python, in: Proceedings of the 9th International Python Conference, 2001. http://www.webwareforpython.org/Papers/IntroToWebware.html
70. Fielding R.T., and Kaiser G. The apache HTTP server project. IEEE Internet Computing 1 4 (1997) 88-90
71. Sjöstrand T., and Skands P.Z. Baryon number violation and string topologies. Nuclear Physics B 659 1-2 (2003) 243-298
72. Syljuåsen O. Directed loop updates for quantum lattice models. Physics Review E 67 1 (2003) 46701-1-17
73. J. Černák, Inhomogeneous sandpile model: Crossover from multifractal scaling to finite size scaling, ePrint: cond-mat/0510326, 2005. http://arxiv.org/abs/cond-mat/0501070
74. R. Sturrock et al., Performance of the NorduGrid ARC and the Dulcinea Executor in ATLAS Data Challenge 2, in: A. Aimar, J. Harvey, N. Knoors (Eds.), Proc. of CHEP 2004, CERN-2005-002, vol. 1, 2005, pp. 765-768
75. Foster I., et al. The Grid2003 production grid: Principles and practice. Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing. HPDC'04 (2004), IEEE Computer Society Press 236-245
76. Foster I., et al. The physiology of the Grid. Grid Computing (2003), John Wiley & Sons Ltd. 217-250
77. K. Czajkowski et al., Modeling stateful resources with web services, Tech. Rep., Globus Alliance, 2004. URL http://www.ibm.com/developerworks/library/ws-resource/ws-modelingresources.pdf
78. A. Konstantinov, The HTTP(s,g) and SOAP framework, The NorduGrid Collaboration, NORDUGRID-TECH-9. URL http://www.nordugrid.org/documents/HTTP_SOAP.pdf