Designing a resource broker for heterogeneous grids

Software - Practice and Experience

Volumn 38, Issue 8, 2008, Pages 793-825

  Venugopal, Srikumar ^a   Nadiminti, Krishna ^a   Gibbins, Hussein ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Extensibility; Grid computing; Heterogeneous systems; Resource broker; Software design

Indexed keywords

COMPUTER SOFTWARE; MIDDLEWARE;

APPLICATION COMPOSITION; DYNAMIC ENVIRONMENTS; GRID INFRASTRUCTURES; GRID MIDDLEWARE; GRID RESOURCE BROKER; HETEROGENEOUS RESOURCES; JOB PROFILES; MULTIPLE ORGANIZATIONS; RESOURCE BROKERING;

USER INTERFACES;

EID: 47049095252     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.849     Document Type: Article

References (56)

1. Foster I, Kesselman C (eds.). The Grid: Blueprint for a Future Computing Infrastructure. Morgan Kaufmann: U.S.A., 1999.
2. Foster I, Kesselman C. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications 1997; 11(2):115-128.
3. Chapin S, Karpovich J, Grimshaw A. The Legion resource management system. Proceedings of the 5th Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), San Juan, Puerto Rico, (Lecture Notes in Computer Science, vol. 1659). Springer: Berlin, Germany, 1999.
4. Casanova H, Dongarra J. NetSolve: A network server for solving computational science problems. Proceedings of the 1996 ACM/IEEE Conference on Supercomputing (SC '96), Pittsburgh, PA, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1996.
5. Nakada H, Sato M, Sekiguchi S. Design and implementation of Ninf: Towards a global computing infrastructure. Future Generation Computing Systems 1999; 15(5-6):649-658.
6. Allen G, Benger W, Goodale T, Hege H-C, Lanfermann G, Merzky A, Radke T, Seidel E, Shalf J. The cactus code: A problem solving environment for the grid. Proceedings of the 9th International Symposium on High Performance Distributed Computing (HPDC-9), Pittsburgh, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2000.
7. Berman F, Chien A, Cooper K, Dongarra J, Foster I, Gannon D, Johnsson L, Kennedy K, Kesselman C, Mellor-Crumme J, Reed D, Torczon L, Wolski R. The GrADS project: Software support for high-level grid application development. International Journal of High Performance Computing Applications 2001; 15(4):327-344.
8. Berman F, Wolski R. The AppLeS project: A status report. Proceedings of the 8th NEC Research Symposium, Berlin, Germany, 1997.
9. Buyya R, Abramson D, Giddy J. Nimrod/G: An architecture for a resource management and scheduling system in a global computational grid. Proceedings of the 4th International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2000), Beijing, China. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2000.
10. Casanova H, Obertelli G, Berman F, Wolski R. The AppLeS parameter sweep template: User-level middleware for the grid. Proceedings of the 2000 ACM/IEEE Conference on Supercomputing (SC'00), Dallas, TX. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2000.
11. Frey J, Tannenbaum T, Livny M, Foster I, Tuecke S. Condor-G: A computation management agent for multi-institutional grids. Cluster Computing 2002; 5(3):237-246.
12. Venugopal S, Buyya R, Winton L. A grid service broker for scheduling e-Science applications on global data grids. Concurrency and Computation: Practice and Experience 2006; 18(6):685-699.
13. Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications 2001; 15(3):200-222.
14. Baker M, Buyya R, Laforenza D. Grids and grid technologies for wide-area distributed computing. Software-Practice and Experience 2002; 32(15):1437-1466.
15. Vraalsen F, Aydt R, Mendes C, Reed D. Performance contracts: Predicting and monitoring grid application behavior. Proceedings of the 2nd International Workshop on Grid Computing (GRID 2001), Denver, CO, (Lecture Notes in Computer Science, vol. 2242). Springer: Berlin, Germany, 2001.
16. Yu J, Venugopal S, Buyya R. A market-oriented grid directory service for publication and discovery of grid service providers and their services. Journal of Supercomputing 2006; 36(1):17-31.
17. Czajkowski K, Fitzgerald S, Foster I, Kesselman C. Grid information services for distributed resource sharing. Proceedings of 10th IEEE International Symposium on High Performance Distributed Computing (HPDC-10). IEEE Computer Society Press: U.S.A., 2001.
18. Eriksson H-E, Penker M. Business Modeling with UML: Business Patterns at Work. Wiley: New York, U.S.A., 2000.
19. Bjorkander M, Kobryn C. Architecting systems with UML 2.0. IEEE Software 2003; 20(4):57-61.
20. Abramson D, Sosic R, Giddy J, Hall B. Nimrod: A tool for performing parametrised simulations using distributed workstations. Proceedings of the 4th IEEE International Symposium on High Performance Distributed Computing (HPDC '95), Pentagon City, VA, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1995.
21. Anjomshoaa A, Brisard F, Drescher M, Fellows D, Ly A, McGough S, Pulsipher D, Savva A. Job submission description language (JSDL) specification, version 1.0. Technical Report, Global Grid Forum, 2005.
22. von Laszewski G, Foster I, Gawor J, Lane P. A Java commodity grid kit. Concurrency and Computation: Practice and Experience 2001; 13(8-9):643-662.
23. Bayucan A, Henderson R, Lesiak C, Mann B, Proett T, Tweten D. Portable batch system: External reference specification. Technical Report, MRJ Technology Solutions, 1999.
24. Gentzsch W. Sun grid engine: Towards creating a compute power grid. Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGRID '01), Brisbane, Australia. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2001.
25. Luther A, Buyya R, Ranjan R, Venugopal S. Peer-to-peer grid computing and a .NET-based Alchemi framework. High Performance Computing: Paradigm and Infrastructure. Wiley: U.S.A., 2005.
26. Erwin DW, Snelling DF. UNICORE: A grid computing environment. Proceedings of the 7th International Euro-Par Conference on Parallel Processing (Euro-Par '07), Manchester, U.K. Springer: Berlin, Germany, 2001.
27. Litzkow M, Livny M, Mutka MW. Condor - A hunter of idle workstations. Proceedings of the 8th International Conference of Distributed Computing Systems (ICDCS 1988), San Jose, CA, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1988.
28. Kramer D, MacInnis M. Utilization of a local grid of Mac OS X-based computers using Xgrid, Poster Paper. Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing (HPDC '04), Honolulu, HI, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2004.
29. Foster I, Czajkowski K, Ferguson D, Frey J, Graham S, Maguire T, Snelling D, Tuecke S. Modeling and managing state in distributed systems: the role of OGSI and WSRF. Proceedings of the IEEE 2005; 93(3):604-612.
30. Czajkowski K, Foster I, Karonis N, Kesselman C, Martin S, Smith W, Tuecke S. A resource management architecture for metacomputing systems. Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), (Lecture Notes in Computer Science, vol. 1459), Feitelson DG, Rudolph L (eds). Springer: Berlin, Germany, 1998.
31. Czajkowski K, Foster I, Kesselman C. Resource co-allocation in computational grids. Proceedings of the Eighth IEEE International Symposium on High Performance Distributed Computing (HPDC '99), Redondo Beach, CA, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1999.
32. Gibbins H, Nadiminti K, Beeson B, Chhabra RK, Smith B, Buyya R. The Australian BioGrid portal: Empowering the molecular docking research community. Proceedings of the 3rd APAC Conference and Exhibition on Advanced Computing, Grid Applications and eResearch (APAC 2005), Gold Coast, Australia, 2005.
33. Dias de Assuncao M, Nadiminti K, Venugopal S, Ma T, Buyya R. An integration of global and enterprise grid computing: Gridbus broker and Xgrid perspective. Proceedings of the 4th International Conference on Grid and Cooperative Computing (GCC 2005), Beijing, China, (Lecture Notes in Computer Science). Springer: Berlin, Germany, 2005.
34. Kolbe S, Ma T, Liu W, Soh W, Buyya R, Egan G. A platform for distributed analysis of neuroimaging data on global grids. Proceedings of the 1st IEEE International Conference on e-Science and Grid Computing (e-Science 2005), Melbourne, Australia. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2005.
35. Soh H, Haque S, Liao W, Nadiminti K, Buyya R. GTPE: A thread programming environment for the grid. Proceedings of the 13th International Conference on Advanced Computing and Communications (ADCOM 2005), Coimbatore, India, 2005.
36. Buyya R, Abramson D, Giddy J, Stockinger H. Economic models for resource management and scheduling in grid computing. Concurrency and Computation: Practice and Experience 2002; 14(13-15): 1507-1542.
37. Barmouta A, Buyya R. GridBank: A grid accounting services architecture (GASA) for distributed systems sharing and integration. Proceedings of Workshop on Internet Computing and E-Commerce: 17th Annual International Parallel and Distributed Processing Symposium (IPDPS 2003), Nice, France. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2003.
38. Venugopal S, Buyya R. A deadline and budget constrained scheduling algorithm for e-Science applications on data grids. Proceedings of the 6th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP-2005), Melbourne, Australia, (Lecture Notes in Computer Science, vol. 3719). Springer: Berlin, Germany, 2005.
39. Lamanna M, Koblitz B, Chen T, Ueng W, Herrala J, Liko D, Maier A, Moscicki J, Peters A, Orellana F, Pose V, Demichev A, Feichtinger D. Experiences with the gLite Grid Middleware. Proceedings of Conference on Computing in High Energy Physics (CHEP '04), Interlaken, Switzerland, 2004.
40. Huedo E, Montero RS, Llorente IM. A framework for adaptive execution on grids. Software-Practice and Experience 2004; 34:631-651.
41. Dumitrescu C, Raicu I, Foster I. DI-GRUBER: A distributed approach to grid resource brokering. Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, Seattle, WA. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2005.
42. In J, Arbree A, Avery P, Cavanaugh R, Katageri S, Ranka S. Sphinx: A scheduling middleware for data intensive applications on a grid. Technical Report, GriPhyN 2003-17, Grid Physics Network, 2003.
43. Seidel E, Allen G, Merzky A, Nabrzyski J. GridLab - a grid application toolkit and testbed. Future Generation Computer Systems 2002; 18(8):1143-1153.
44. Abramson D, Giddy J, Kotier L. High performance parametric modeling with Nimrod/G: Killer application for the global grid? Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS 2000), Cancun, Mexico, 1-5 May 2000. IEEE Computer Society Press: U.S.A., 2000.
45. Ayyub S, Abramson D, Enticott C, Garic S, Tan J. Executing large parameter sweep applications on a multi-VO testbed. Proceedings of the 7th International Symposium on Cluster Computing and Grid (CCGrid 2007), Rio de Janeiro, Brazil, 14-17 May 2007. IEEE Computer Society Press: Los Alamitos, CA, U.S.A.
46. Buyya R, Giddy J, Abramson D. An evaluation of economy-based resource trading and scheduling on computational power grids for parameter sweep applications. Proceedings of the 2nd Workshop on Active Middleware Services (AMS 2000), Pittsburgh, U.S.A., 2000. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2000.
47. Abramson D, Lewis A, Peachy T. Nimrod/O: A tool for automatic design optimization. Proceedings of the 4th International Conference on Algorithms & Architectures for Parallel Processing (ICA3PP 2000), Hong Kong, 11-13 December 2000.
48. Casanova H, Legrand A, Zagorodnov D, Berman F. Heuristics for scheduling parameter sweep applications in grid environments. Proceedings of the 9th Heterogeneous Computing Systems Workshop (HCW 2000), Cancun, Mexico. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2000.
49. Yang Y, Casanova H. UMR: A multi-round algorithm for scheduling divisible workloads. Proceedings of the 17th International Symposium on Parallel and Distributed Processing (IPDPS '03), Nice, France, 2003. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2003.
50. Wolski R, Spring N, Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computing Systems (FGCS) 1999; 15:757-768.
51. Litzkow M, Livny M, Mutka MW. Condor - A hunter of idle workstations. Proceedings of the 8th International Conference of Distributed Computing Systems, San Jose, CA, U.S.A. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1988.
52. Raman R, Livny M, Solomon M. Matchmaking: Distributed resource management for high throughput computing. Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing (HPDC-7 '98). IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 1998.
53. Thain D, Basney J, Son S, Livny M. The Kangaroo approach to data movement on the grid. Proceedings of the 10th IEEE Symposium on High Performance Distributed Computing (HPDC10), San Francisco, CA. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2001.
54. Kosar T, Livny M. Stork: Making data placement a first class citizen in the grid. Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04), Tokyo, Japan. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2004.
55. Hughes B, Venugopal S, Buyya R. Grid-based indexing of a newswire Corpus. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (GRID 2004), Pittsburgh, 8 November 2004. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2004.
56. Yu J, Buyya R. A novel architecture for realizing grid workflow using tuple spaces. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (GRID '04), Pittsburgh, PA, 2004. IEEE Computer Society Press: Los Alamitos, CA, U.S.A., 2004.