A case for cooperative and incentive-based federation of distributed clusters

Future Generation Computer Systems

Volumn 24, Issue 4, 2008, Pages 280-295

  Ranjan, Rajiv ^a   Harwood, Aaron ^a   Buyya, Rajkumar ^a  

^a P2P Group   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL EFFICIENCY; COMPUTER SIMULATION; RESOURCE ALLOCATION; SCHEDULING;

COMPUTATIONAL ECONOMY; DISTRIBUTED CLUSTERS; GRID ENVIRONMENT;

GRID COMPUTING;

EID: 36048952109     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2007.05.006     Document Type: Article

References (40)

1. Abramson D., Buyya R., and Giddy J. A computational economy for grid computing and its implementation in the Nimrod-G resource broker. Future Generation Computer Systems 18 8 (2002) 1061-1074
2. Alexander B., and Buyya R. Gridbank: A grid accounting services architecture for distributed systems sharing and integration. Workshop on Internet Computing and E-Commerce, Proceedings of the 17th Annual International Parallel and Distributed Processing Symposium. IPDPS 2003, April 22-26, Nice, France (2003), IEEE Computer Society Press, USA
3. Allen A.O. Probability, Statistics and Queuing Theory with Computer Science Applications (1978), Academic Press, INC.
4. Andrade N., Cirne W., Brasileiro F., and Roisenberg P. OurGrid: An approach to easily assemble grids with equitable resource sharing. Proceedings of the 9th Workshop on Job Scheduling Strategies. Lecture Notes in Computer Science (2003)
5. A. Auyoung, B. Chun, A. Snoeren, A. Vahdat, Resource allocation in federated distributed computing infrastructures, in: OASIS '04: 1st Workshop on Operating System and Architectural Support for the Ondemand IT InfraStructure, Boston, MA, October 2004
6. F. Berman, R. Wolski, The apples project: A status report, in: Proceedings of the 8th NEC Research Symposium, Berlin, Germany, 1997
7. Bode B., Halstead D., Kendall R., and Jackson D. PBS: The portable batch scheduler and the maui scheduler on linux clusters. Proceedings of the 4th Linux Showcase and Conference. Atlanta, GA (2000), USENIX Press, Berkley, CA
8. Raza Butt A., Zhang R., and Hu Y.C. A self-organizng flock of condors. SC '03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing (2003), IEEE Computer Society, Washington, DC, USA
9. Buyya R., Abramson D., Giddy J., and Stockinger H. Economic models for resource management and scheduling in grid computing. Concurrency and Computation: Practice and Experience 14 (2002) 13-15
10. Buyya R., and Murshed M. Gridsim: A toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurrency and Computation: Practice and Experience 14 13-15 (2002) 1175-1220
11. M. Cai, M. Frank, J. Chen, P. Szekely, Maan: A multi-atribute addressable network for grid information services, in: Proceedings of the Fourth IEEE/ACM International Workshop on Grid Computing, 2003, pp. 184-191
12. Casanova H., and Dongara J. Netsolve: A network server solving computational science problem. International Journal of Supercomputing Applications and High Performance Computing 11 3 (1997) 212-223
13. Chapin S., Karpovich J., and Grimshaw A. The legion resource management system. Proceedings of the 5th Workshop on Job Scheduling Strategies for Parallel Processing. San Juan, Puerto Rico, 16 April (1999), Springer, Berlin
14. J. Chase, L. Grit, D. Irwin, J. Moore, S. Sprenkle, Dynamic virtual clusters in a grid site manager, in: The Twelfth International Symposium on High Performance Distributed Computing, HPDC-12, June, 2003
15. Cheng J.Q., and Wellman M.P. The WALRAS algorithm: A convergent distributed implementation of general equilibrium outcomes. Computational Economics 12 1 (1998) 1-24
16. B. Chun, D. Culler, A decentralized, secure remote execution environment for clusters, in: Proceedings of the 4th Workshop on Communication, Architecture and Applications for Network-Based Parallel Computing, Toulouse, France, 2000
17. Feigenbaum J., and Shenker S. Distributed algorithmic mechanism design: Recent results and future directions. DIALM '02: Proceedings of the 6th International Workshop on Discrete Algorithms and Methods for Mobile Computing and Communications (2002), ACM Press, New York, NY, USA 1-13
18. Feitelson D.G., and Tsafrir D. Workload sanitation for performance evaluation. IEEE Intl. Symp. Performance Analysis of Systems and Software (2006), Springer-Verlag, London, UK 221-230
19. Foster I., and Kesselman C. The Grid: Blueprint for a New Computing Infrastructure (1998), Morgan Kaufmann Publishers, USA
20. Foster I., Kesselman C., and Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of Supercomputer Applications 15 3 (2001)
21. Frey J., Tannenbaum T., Livny M., Foster I., and Tuecke S. Condor-G: A computation management agent for multi-institutional grids. 10th IEEE International Symposium on High Performance Distributed Computing. HPDC-10 '01, 2001 (2001), IEEE Computer Society, Washington, DC, USA 237-246
22. W. Gentzsch, Sun grid engine: Towards creating a compute power grid, in: CCGrid, 00:35, 2001
23. Grosu D., and Chronopoulos T. Algorithmic mechanism design for load balancing in distributed systems. IEEE Transactions on Systems Man and Cybernetics Part B (2004) 77-84
24. Howell F., and McNab R. Simjava: A discrete event simulation package for java applications in computer systems modeling. First International Conference on Web-Based Modeling and Simulation. San Diego, CA, 1998 (1998), SCS Press, San Diego, CA
25. A. Iamnitchi, I. Foster, On fully decentralized resource discovery in grid environments, in: International Workshop on Grid Computing, Denver, CO, 2001
26. J. In, P. Avery, R. Cavanaugh, S. Ranka, Policy based scheduling for simple quality of service in grid computing, in: Proceedings of the 18th International Parallel and Distributed Processing Symposium, IPDPS'04, 2004
27. K. Lai, B.A. Huberman, L. Fine, Tycoon: A distributed market-based resource allocation system, Technical Report, HP Labs, 2004
28. Litzkow J., Livny M., and Mukta M.W. Condor - A Hunter of Idle Workstations (1988), IEEE
29. Moore D., and Hebeler J. Peer-to-Peer: Building Secure, Scalable, and Manageable Networks (2001), McGraw-Hill, Osborne
30. R. Ranjan, A. Harwood, R. Buyya, Grid-Federation: A resource management model for cooperative federation of distributed clusters, Technical Report, GRIDS-TR-2004-10, Grid Computing and Distributed Systems Laboratory, University of Melbourne, Australia, 2004
31. A. Rowstron, P. Druschel, Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems, in: Middleware'01: Proceedings of IFIP/ACM International Conference on Distributed Systems Platforms, Heidelberg, Germany, 2001, pp. 329-359
32. J.M. Schopf, Ten actions when superscheduling, in: Global Grid Forum, 2001
33. Shan H., Oliker L., and Biswas R. Job superscheduler architecture and performance in computational grid environments. SC '03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing (2003), IEEE Computer Society, Washington, DC, USA 44
34. Sherwani J., Ali N., Lotia N., Hayat Z., and Buyya R. Libra: A computational economy-based job scheduling system for clusters. Software: Practice and Experience 34 6 (2004) 573-590
35. Smale S. Convergent process of price adjustment and global newton methods. American Economic Review 66 2 (1976) 284-294
36. Stonebraker M., Devine R., Kornacker M., Litwin W., Pfeffer A., Sah A., and Staelin C. An economic paradigm for query processing and data migration in maiposa. Proceedings of 3rd International Conference on Parallel and Distributed Information Systems. Austin, TX, USA, September 28-30 (1994), IEEE CS Press
37. Waldspurger C., Hogg T., Huberman B., Kephart J., and Stornetta W. Spawn: A distributed computational economy. IEEE Transactions on Software Engineering 18 2 (1992)
38. J.B. Weissman, A. Grimshaw, Federated model for scheduling in wide-area systems, in: Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, HPDC, August 1996, pp. 542-550
39. Wolski R., Plank J.S., Brevik J., and Bryan T. G-commerce: Market formulations controlling resource allocation on the computational grid. IPDPS '01: Proceedings of the 15th International Parallel & Distributed Processing Symposium (2001), IEEE Computer Society, Washington, DC, USA 46
40. S. Zhou, LSF: Load sharing in large-scale heterogeneous distributed systems, in: Proceedings of the Workshop on Cluster Computing, Tallahassee, FL, 1992