Scalable Grid-wide capacity allocation with the SweGrid Accounting System (SGAS)

Concurrency and Computation: Practice and Experience

Volumn 20, Issue 18, 2008, Pages 2089-2122

  Gardfjäll, Peter ^a   Elmroth, Erik ^a   Johnsson, Lennart ^b   Mulmo, Olle ^b   Sandholm, Thomas ^b  

^a UMEÅ UNIVERSITY   (Sweden)

^b ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Globus Toolkit; Grid accounting; Grid capacity allocation; Quota enforcement; Service virtualization; Service oriented architecture (SOA); Web services

Indexed keywords

INFORMATION SERVICES; MIDDLEWARE; SCALABILITY; SERVICE ORIENTED ARCHITECTURE (SOA); WEB SERVICES; WEBSITES;

CAPACITY ALLOCATION; GLOBUS TOOLKIT; GRID ACCOUNTING; QUOTA ENFORCEMENT; SERVICE VIRTUALIZATION;

INTEROPERABILITY;

EID: 58049201902     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1310     Document Type: Article

References (57)

1. Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. Internatinnal Journal of High Performance Computing Applications 2001; 15(3):200-222.
2. Hardin G. The tragedy of the commons. Science 1968; 162(3859): 1243-1248.
3. SGAS Project Page. June 2006. http://www.sgas.se [4 January 2008].
4. Elmroth E, Gardfjäll P, Mulmo O, Sandholm T. An OGSA-based bank service for grid accounting systems. Applied Parallel Computing (Lecture Notes in Computer Science). Springer: Berlin, 2006; 1051-1060.
5. Sandholm T, Gardfjäll P, Elmroth E, Johnsson L, Mulmo O. An OGSA-based accounting system for allocation enforcement across HPC centers. ICSOC'04, U.S.A., 2004. ACM: New York, 2004; 279-288.
6. Sandholm T, Gardfjäll P, Elmroth E, Johnsson L, Mulmo O. A service-oriented approach to enforce grid resource allocations. International Journal of Cooperative Information Systems 2006; 15(3):439-459.
7. Smirnova O, Eerola P, Ekelöf T, Ellert M, Hansen JR, Konstantinov A, Kónya B, Nielsen JL, Ould-Saad F, Wäänänen A. The NorduGrid Architecture and Middleware for Scientific Applications (Lecture Notes in Computer Science, vol. 2657), 2003; 264-273.
8. SNAC - Swedish National Allocations Committee. June 2006. http://www.snac.vr.se/ [4 January 2008].
9. Srinivasan L, Treadwell J. An overview of service-oriented architecture, web services and grid computing. November http://h71028.www7.hp.com/ERC/ downloads/SOA-Grid-HP-WhitePaper.pdf [4 January 2008].
10. Usage Record WG (UR-WG). June 2006. https://forge.gridforum.org/projects/ ur-wg/ [4 January 2008].
11. Piro RM, Guarise A, Werbrouck A. An economy-based accounting infrastructure for the DataGrid. GRID '03: Proceedings of the Fourth International Workshop on Grid Computing, Washington, DC, U.S.A. IEEE Computer Society: Silver Spring, MD, 2003; 202-204.
12. Wolski R, Plank JS, Brevik J, Bryan T. G-commerce: Market formulations controlling resource allocation on the computational grid. International Parallel and Distributed Processing Symposium (IPDPS), San Francisco, April 2001. IEEE Press: New York, 2001.
13. Buyya R, Abramson D, Giddy J. An economy driven resource management architecture for global computational power grids. The International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), Las Vegas, June 2000.
14. Chun BN, Culler DE. Market-based proportional resource sharing for clusters. Technical Report CSD-1092, Computer Science Division, University of California at Berkeley. January 2000; 1-19.
15. Lai K. Markets are dead, long live markets. Technical Report, HP Labs, Palo Alto, CA, U.S.A., February 2005; 1-5.
16. Lai K, Rasmusson L, Adar E, Sorkin S, Zhang L, Huberman BA. Tycoon: An implementation of a distributed market-based resource allocation system. Technical Report arXiv:cs.DC/041203H, HP Labs, Palo Alto, CA, U.S.A., December 2004; 1-26.
17. Sandholm T, Lai K, Andrade J, Odeberg J. Market-based resource allocation using price prediction in a high performance computing grid for scientific applications. HPDC '06: Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing. IEEE Press: New York, 2006; 132-143.
18. Global Grid Forum. August 2006. http://www.ggf.org [4 January 2008].
19. Open Grid Services Architecture WG (OGSA-WG). August 2006. https://forge.gridforum.org/projects/ogsa-wg [4 January 2008].
20. Globus: WSRF - The WS-Resource Framework. August 2006. http://www.globus.org/wsrf/ [4 January 2008].
21. Foster I. Globus Toolkit Version 4: Software for service-oriented systems. IFIP International Conference on Network and Parallel Computing (Lecture Notes in Computer Science, vol. 3779). Springer: Berlin, 2005; 2-13.
22. Apache Web Services Project - Axis. August 2006. http://ws.apachc.org/ axis [4 January 2008].
23. Foster I, Frey J, Graham S, Tuecke S, Czajkowski K, Ferguson D, Leymann F, Nally M, Sedukhin I, Snelling D, Storey T, Vambenepe W, Weerawarana S. Modeling Stateful Resources with Web Services. 2004. http://www-128.ibm.com/ developerworks/library/ws-resource/ws-modelingresources.pdf [4 January 2008].
24. Gudgin M, Hadlcy M. Web Services Addressing - Core. December 2004. http://www.w3.org/TR/2004/WD-ws-addr-core20041208/ [4 January 2008].
25. Graham S, Treadwell J. Web Services Resource Properties 1.2 (WS-ResourceProperties). June 2004. http://docs.oasis-open.org/wsrf/2004/06/ wsrf-WS-ResourceProperties-1.2-draft-04.pdf [4 January 2008].
26. Srinivasan L, Banks T. Web Services Resource Lifetime 1.2 (WS-ResourceLifetime). June 2004. http://docs.oasis-open.org/wsrf/2004/06/wsrf- WS-ResourccLifetime-1.2-draft-03.pdf [4 January 2008].
27. Clark J, DeRose S. XML Path Language (XPath) Version 1.0. November 1999. http://www.w3.org/TR/xpath [4 January 2008].
28. eXist - Open Source Native XML Database. August 2006. http://exist.sourceforgc.net/ [4 January 2008].
29. Gawor J, Meder S. GT4 WS Java Core Design. November 2004. http://www.globus.org/toolkit/docs/4.0/common/javawscorc/dcveloper/ JavaWSCoreDcsign.pdf [4 January 2008].
30. Graham S, Murray B. Web Services Base Notification 1.2 (WS-BaseNotification). June 2004. http://docs.oasis-open.org/wsn/2004/06/wsn-WS- BaseNotification-1.2-draft-03.pdf [4 January 2008].
31. Nadalin A, Kaler C, Hallam-Baker P, Monzillo R. Web Services Security: SOAP Message Security 1.0. March 2004. http://www.oasis-open.org/committees/ download.php/16790/wss-v1.1-spec-os-SOAPMessageSecurity.pdf [4 January 2008].
32. Gudgiri M, Nadalin A. Web Services Secure Conversation Language (WS-SecureConversation). February 2005. http://specs.xmlsoap.org/ws/2005/02/sc/ WS-SecureConversation.pdf [4 January 2008].
33. Dierks T, Allen C. The TLS Protocol Version 1.0. January 1999. http://tools.ietf.org/html/rfc2246 [4 January 2008].
34. Godik S, Moses T. extensible Access Control Markup Language (XACML) Version 1.0. February 2003. http://www.oasis-open.org/committees/download.php/ 2406/oasis-xacml-1.0.pdf [4 January 2008].
35. Pereira M. Resource Namespace Service Specification. 2006. https://forgc.gridforum.org/sf/projects/gfs-wg [4 January 2008].
36. Grimshaw A, Snelling D. WS-Naming Specification. September 2006. https://forge.gridforum.org/sf/projects/ogsa-naming-wg [4 January 2008].
37. Dumitrescu C, Raicu I, Ripeanu M, Foster I. DiPerF: An Automated Distributed PERformance Testing Framework. Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04), Washington, DC, U.S.A., 2004. IEEE Computer Society: Silver Spring, MD, 2005; 289-296.
38. Jackson S. The Gold Accounting and Allocation Manager. 2006. http://sss.scl.ameslab.gov/gold.shtml.
39. Jackson S. QBank - Allocation Manager. 2006. http://sss.scl.ameslab.gov/ qbank.shtml.
40. Distributed Grid Accounting System (DGAS). August 2006. http://www.to.infn.it/grid/accounting/ [4 January 2008].
41. Enabling Grids for E-sciencE. August 2006. http://www.cu-cgec.org/ [4 January 2008].
42. LCG Middleware. August 2006. http://lcg.web.cern.ch/LCG/activities/ middleware.html [4 January 2008].
43. Barmouta A, Buyya R. A grid accounting services architecture (GASA) for distributed systems sharing and integration. IPDPS'03, France, 2003.
44. Byrom R, Cordenonsi R, Cornwall L, Craig M, Djaoui A, Duncan A, Fisher S, Gordon J, Hicks S, Kant D, Leakec J, Middleton R, Thorpe M, Walk J, Wilson A. APEL: An implementation of grid accounting using R-GMA. U.K. e-Science All Hands Conference, Nottingham, U.K., September 2005.
45. R-GMA: Relational Grid Monitoring Architecture. August 2006. http://www.r-gma.org/ [4 January 2008].
46. Lee B-S, Tang M, Zhang J, Soon OY, Zheng C, Arzberger P, Abramson D. Analysis of Jobs in a multi-organizational grid test-bed. Proceedings of the Sixth IEEE International Symposium on Cluster Computing and Grid Workshops. IEEE Press: New York, 2006.
47. Dumitrescu C, Foster I. Usage policy-based CPU sharing in virtual organizations. Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04), Washington, DC, U.S.A., 2004. IEEE Computer Society: Silver Spring, MD, 2004; 53-60.
48. Elmroth E, Gardfjäll P. Design and evaluation of a decentralized system for grid-wide fairshare scheduling. e-Science 2005: First International Conference on e-Science and Grid Computing, Washington, DC, U.S.A., 2005. IEEE Computer Society: Silver Spring, MD, 2005; 221-229.
49. Ardaiz O, Artigas P, Eymann T, Freitag F, Navarro L, Reinicke M. The catallaxy approach for decentralized economic-based allocation in grid resource and service markets. Applied Intelligence 2006; 25(2):131-145.
50. Wolski R, Brevik J, Plank JS, Bryan T. Grid resource allocation and control using computational economies. Grid Computing: Making The Global Infrastructure a Reality, Chapter 32, Berman F, Fox G, Hey A (eds.). Wiley: New York, 2003.
51. Nakai J, Van Der Wijngaart RF. Applicability of markets to global scheduling in grids. Technical Report NAS-03-004, NASA Advanced Supercomputing (NAS) Division, February 2003; 1-37.
52. Shneidman J, Ng C, Parkes DC, AuYoung A, Snoeren AC, Vahdat A, Chun B. Why markets could (but don't currently) solve resource allocation problems in systems. HotOS-X '05: Proceedings of the 10th USENIX Workshop on Hot Topics in Operating Systems, Santa Fe, NM, June 2005.
53. Rückcmann C-P. Müller W, von Voigt G. Comparison of grid accounting concepts for D-grid. Proceedings of Cracow Grid Workshop 06, Cracow, October 2006.
54. Dimitrakos T, Randal DM, Yuan F, Gaeta M, Laria G, Ritrovato P, Serhan B, Wesner S, Wulf K. An emerging architecture enabling grid-based application service provision. Proceedings of EDOC.03, 7th IEEE International Enterprise Distributed Object Computing. IEEE Press: New York, 2003.
55. Beardsmore A, Hartley K, Hawkins S, Laws S, Magowan J, Twigg A. GSAX Grid Service Accounting Extensions. September 2002. http://www.doc.ic.ac.uk/~sjn5/ GGF/ggf-rus-gsax-01.pdf [4 January 2008].
56. Nimrod/G web site. August 2007. http://www.cssc.nionash.cdu.au/~davida/ nimrod/nimrodg.htm [4 January 2008].
57. Göhner M, Waldburger M, Gubler F, Rodosek GD, Stiller B. An accounting model for dynamic virtual organizations. Technical Report No. 2006.11, University of Zürich, Department of Informatics, November 2006; 1-13.