Cooperative and decentralized workflow scheduling in global grids

Future Generation Computer Systems

Volumn 26, Issue 5, 2010, Pages 753-768

  Rahman, Mustafizur ^a   Ranjan, Rajiv ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Decentralized coordination; Global grids; Peer to peer systems; Workflow scheduling

Indexed keywords

BLACKBOARD SYSTEMS; CENTRALIZED MODELS; CENTRALIZED SERVER; CLIENT/SERVER; CONTROL DOMAINS; COOPERATION MECHANISM; COOPERATIVE WORKFLOW; COORDINATION TECHNIQUE; DECENTRALIZED COORDINATION; DECENTRALIZED WORKFLOW; DIFFERENT SIZES; DISTRIBUTED HASH TABLES; DISTRIBUTED RESOURCES; E-SCIENCE; EFFICIENT SCHEDULING; GRID RESOURCE; GRID SCHEDULING SYSTEMS; HIERARCHICAL MODEL; INDEX SPACE; LOAD-BALANCING; MAKESPAN; NETWORK BANDWIDTH; NETWORK CONGESTIONS; NON-COOPERATIVE; PEER-TO-PEER SYSTEM; PERFORMANCE BOTTLENECKS; RESOURCE DISCOVERY; RESOURCE SHARING; SCHEDULING DECISIONS; SCHEDULING TECHNIQUES; SINGLE POINT; TRACE DRIVEN SIMULATION; WORKFLOW SCHEDULING;

AD HOC NETWORKS; CLIENT SERVER COMPUTER SYSTEMS; COMPUTER SUPPORTED COOPERATIVE WORK; COORDINATION REACTIONS; HIERARCHICAL SYSTEMS; MANAGEMENT; SCALABILITY; SCHEDULING; SCHEDULING ALGORITHMS;

PEER TO PEER NETWORKS;

EID: 77950019639     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2009.07.002     Document Type: Article

References (39)

1. Foster I., and Kesselman C. The Grid: Blueprint for a New Computing Infrastructure (1998), Morgan Kaufmann Publishers, USA
2. Paterson L., and Roscoe T. The design principles of planetlab. Operating Systems Review 40 1 (2006) 11-16
3. Y. Fu, J. Chase, B. Chun, S. Schwab, A. Vahdat, SHARP: An architecture for secure resource peering, in: Proceedings of the 9th ACM symposium on Operating systems principles, NY, USA, 2003
4. S. Fitzgerald, I. Foster, C. Kesselman, G. von Laszewski, W. Smith, S. Tuecke, A directory service for configuring high-performance distributed computations, in: Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing, Portland, USA, 1997
5. X. Zhang, J.L. Freschl, J.M. Schopf, A performance study of monitoring and information services for distributed systems, in: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, Seattle, USA, 2003
6. M. Rahman, S. Venugopal, R. Buyya, A dynamic critical path algorithm for scheduling scientific workflow applications on global grids, in: Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing, Bangalore, India, 2007
7. Z. Li, M. Parashar, Comet: A scalable coordination space for decentralized distributed environments, in: Proceedings of the 2nd International Workshop on Hot Topics in Peer-to-Peer Systems, Sun Diego, USA, 2005
8. R. Ranjan, A. Harwood, R. Buyya, Coordinated load management in peer-to-peer coupled federated grid systems, Technical Report, GRIDS-TR-2008-2, Grid Computing and Distributed Systems Laboratory, The University of Melbourne, Australia, 2008
9. I. Stoica, R. Morris, D. Karger, M.F. Kaashoek, H. Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, in: Proceedings of the ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, San Diego, USA, 2001
10. A. Rowstron, P. Druschel, Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems, in: Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms, 2001
11. Tanin E., Harwood A., and Samet H. Using a distributed quadtree index in peer-to-peer networks. VLDB Journal 16 2 (2007) 165-178
12. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.H. Su, K. Vahi, M. Livny, Pegasus: Mapping scientific workflow onto the grid, in: Proceedings of the Across Grids Conference, Cyprus, 2004
13. I. Taylor, M. Shields, I. Wang, Resource management of triana p2p services, Grid Resource Management, Netherlands, June 2003
14. Oinn T., Addis M., Ferris J., Marvin D., Senger M., Greenwood M., Carver T., Glover K., Pocock M.R., Wipat A., and Li P. Taverna: A tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20 17 (2004) 3045-3054
15. Litzkow M., Livny M., and Mutka M. Condor-a hunter of idle workstations. Proceedings of the 8th International Conference of Distributed Computing Systems (1988), IEEE CS Press, USA
16. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., Lee E.A., Tao J., and Zhao Y. Scientific workflow management and the kepler system. Concurrency and Computation: Practice and Experience (2005) Special Issue on Scientific Workflows
17. Y. Yang, J. Chen, J. Lignier, H. Jin, Peer-to-peer based grid workflow runtime environment of swindew-g, in: Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing, India, December 2007
18. Yu J., and Buyya R. A novel architecture for realizing grid workflow using tuple spaces. Proceedings of the 5th IEEE/ACM Workshop on Grid Computing (2004), IEEE CS Press, USA
19. Fahringer T., et al. Askalon: A tool set for cluster and grid computing. Concurrency and Computation: Practice and Experience 17 (2005) 143-169
20. R. Raman, M. Livny, M. Solomon, Resource management through multilateral matchmaking, in: Proceedings of the 9th IEEE International Symposium on High-Performance Distributed Computing, USA, August 2000
21. J. Yao, C.K. Tham, K.Y. Ng, Decentralized dynamic workflow scheduling for grid computing using reinforcement learning, in: Proceedings of the14th IEEE International Conference on Networks, Singapore, 2006
22. Chen G., Low C.P., and Yang Z. Coordinated service provisioning in peer-to-peer environments. IEEE Transactions on Parallel and Distributed Systems 19 4 (2008)
23. Ranjan R., Harwood A., and Buyya R. A case for cooperative and incentive based coupling of distributed clusters. Future Generation Computing Systems, 0167-739X 24 4 (2008) 280-295
24. B. Bode, D. Halstead, R. Kendall, D. Jackson, PBS: The portable batch scheduler and the maui scheduler on linux clusters. in: Proceedings of the 4th Linux Showcase and Conference, Atlanta, USA, 2000
25. W. Gentzsch, Sun grid engine: Towards creating a compute power grid, in: Proceedings of 1st IEEE International Symposium on Cluster Computing and the Grid, Brisbane, Australia, 2001
26. Samet H. The Design and Analysis of Spatial Data Structures (1989), Addison-Wesley Publishing Company
27. E. Byun, Y. Kee, E. Deelman, K. Vahi, G. Mehta, J. Kim, Estimating Resource Needs for Time-Constrained Workflows, in: Proceedings of 4th IEEE International Conference on eScience, USA, December 2008
28. P. Blaha, K. Schwarz, G.K.H. Madsen, D. Kvasnicka, J. Luitz, Wien2k - An augmented plane wave plus local orbitals program for calculating crystal properties, Technical report, Vienna University of Technology, Austria, 2001
29. Theiner D., and Rutschmann P. An inverse modelling approach for the estimation of hydrological model parameters. Journal of Hydroinformatics (2005), IWA Publishing
30. F. Schuller, J. Qin, Towards a Workflow Model for Meteorological Simulations on the AustrianGrid, in: Proceedings of 1st Austrian Grid Symposium, Schloss Hagenberg, Austria, December 2005
31. L. Clementi, et al. Services oriented architecture for managing workflows of avian flu grid, in: Proceedings of 4th IEEE International Conference on eScience, USA, December 2008
32. L. Ramakrishnan, M. Reed, J. Tilson, D. Reed, Grid Portals for Bioinformatics, Renaissance Computing Institute, University of North Carolina, USA
33. F. Dabek, B. Zhao, P. Druschel, J. Kubiatowicz, I. Stoica, Towards a common api for structured peer-to-peer overlays, in: Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS03), CA, USA, 2003
34. Gropp W., Lusk E., and Skjellum A. Using MPI: Portable Parallel Programming with the Message Passing Interface (1999), MIT press
35. Ranjan R., Harwood A., and Buyya R. Peer-to-peer resource discovery in global grids: A tutorial. IEEE Communications Surveys and Tutorials 10 2 (2008) 6-33 Second Quarter
36. A. Gupta, O.D. Sahin, D. Agrawal, A. El Abbadi, Meghdoot: Content-based publish/subscribe over p2p networks, in: Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, Toronto, Canada, 2004
37. Buyya R., and Murshed M. Gridsim: A toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurrency and Computation: Practice and Experience 14 13-15 (2002) 1175-1220
38. P. Garca, C. Pairot, R. Mondjar, J. Pujol, H. Tejedor, R. Rallo, Planetsim: A new overlay network simulation framework, in: Proceedings of Software Engineering and Middleware, Linz, Austria, 2004
39. L. Chan, S. Karunasekera, Designing configurable publish-subscribe scheme for decentralised overlay networks, in: Proceedings of the 21st IEEE International Conference on Advanced Information Networking and Applications, Canada, 2007