A workflow model for heterogeneous computing environments

Future Generation Computer Systems

Volumn 25, Issue 4, 2009, Pages 414-425

  Curran, Oisín ^a   Shearer, Andy ^a  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

Author keywords

Condensed graphs; Fine grained workflow; Heterogeneous resource aggregation; Pre emptive environments; Webcom

Indexed keywords

APPLICATIONS; COMPUTER RESOURCE MANAGEMENT; MANAGERS; PLANNING; RESOURCE ALLOCATION; WORK SIMPLIFICATION;

CONDENSED GRAPHS; FINE GRAINED WORKFLOW; HETEROGENEOUS RESOURCE AGGREGATION; PRE-EMPTIVE ENVIRONMENTS; WEBCOM;

MANAGEMENT;

EID: 58149269433     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.09.010     Document Type: Article

References (42)

1. D.P. Anderson, C. Christensen, B. Allen, Designing a runtime system for volunteer computing, in: Supercomputing'06 (The International Conference for High Performance Computing, Networking, Storage and Analysis), 2006
2. A. Bayucan, R.L. Henderson, C. Lesiak, B. Mann, T. Proett, D. Tweten, Portable batch system: External reference specification, Tech. Rep., MRJ Technology Solutions, 2672 Bayshore Parkway, Suite 810, Mountain View, CA 94043 (July 2005)
3. Briquet C., Dalem X., Jodogne S., and de Marneffe P.-A. Scheduling data-intensive bags of tasks in P2P grids with bittorrent-enabled data distribution. Proceedings of the Second Workshop on Use of P2P, GRID and Agents for the Development of Content Networks. UPGRADE'07 (2007), ACM Press, New York, NY, USA
4. Butt A.R., Zhang R., and Hu C.Y. A self-organising flock of Condors. Journal of Parallel and Distributed Computing 66 (2006) 145-161
5. Cappello F., Djilali S., Fedak G., Herault T., Magniette F., Néri V., and Lodygensky O. Computing on large-scale distributed systems: Xtremweb architecture, programming models, security, tests and convergence with grid. Future Generation Computer Systems 21 3 (2005) 417-437
6. Celaya J., and Arronategui U. Scalable architecture for allocation of idle CPUs in a P2P network. In: Gerndt M., and Kranzlmüller D. (Eds). HPCC. Lecture Notes in Computer Science vol. 4208 (2006), Springer
7. Chien A., Calder B., Elber S., and Bhati K. Entropia: Architecture and performance of an enterprise desktop grid system. Journal of Parallel and Distributed Computing 63 5 (2003) 597-610
8. W. Cirne, D. Paranhos, L. Costa, E. Santo-Neto, et al. Running bag-of-tasks applications on computational grids: The mygrid approach, in: 2003 International Conference on Parallel Processing, 2003
9. Coghlan B., Shearer A., Manzke M., and Morrison J.P. Grid Research in Ireland. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (2001), CSREA Press, Las Vagas
10. B. Cohen, Incentives build robustness in BitTorrent, 2003. Available online: http://www.bittorrent.org/bittorrentecon.pdf (accessed 08.06.07)
11. P. Downes, O. Curran, J. Cunniffe, A. Shearer, Distributed radiotherapy simulation with the webcom workflow system (2008) (in preparation)
12. Epema D., Livny M., van Dantzig R., Evers X., and Pruyne J. A worldwide flock of Condors: Load sharing among workstation clusters. Future Generation Computer Systems 12 (1996) 53-65
13. Foster I. Globus toolkit version 4: Software for service-oriented systems. IFIP International Conference on Network and Parallel Computing (2005), Springer-Verlag
14. Foster I., and Kesselman C. The globus project: A status report. Future Generation Computer Systems 15 5-6 (1999) 735-743
15. Frey J., Tannenbaum T., Foster I., Livny M., and Tuecke S. Condor-G: A computation management agent for multi-institutional grids. Cluster Computing 5 (2002) 237-246
16. Henderson R.L. Job scheduling under the portable batch system. Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing. IPPS'95 (1995), Springer-Verlag, London, UK
17. Karp R., and Miller R. Properties of a model for parallel computations: Determinacy, termination, queueing. SIAM Journal of Applied Mathematics 14 6 (1966) 1390-14111
18. M.P. Kenirons, O. Curran, J. Cunniffe, J. Ryan, P. Ryan, A. Shearer, The MarineGrid Project in Ireland with Webcom, Computers & Geosciences. Pre-print online: http://www.fixme.com
19. J.-S. Kim, B. Bhattacharjee, P. Keleher, A. Sussman, Matching jobs to resources in distributed desktop grid environments, Tech. Rep. CS-TR-4791 and UMIACS-RT-2006-15, University of Maryland, Dept of Computer Science and UMIACS (April 2006)
20. J.-S. Kim, B. Nam, P. Keleher, M. Marsh, B. Bhattacharjee, A. Sussman, Trade-offs in matching jobs and balancing load for distributed desktop grids, Future Generation Computer Systems 23 (6)
21. Litke A., Skoutas D., Tserpes K., and Varvarigou T. Efficient task replication and management for adaptive fault tolerance in mobile grid environments. Future Generation Computer Systems 23 2 (2006) 163-178
22. D.S. Milojicic, et al., Peer-to-peer computing, Tech. Rep. HPL-2002-57, HP Laboratories Palo Alto (March 2002)
23. Morrison J., Coghlan B., Shearer A., Foley S., Power D., and Perrot R. WebCom-G: A candidate middleware for grid-Ireland. International Journal of High Performance Computing Applications 20 3 (2006) 409-422
24. J.P. Morrison, Condensed graphs: Unifying availability-driven, coercion-driven and control-driven computing, Ph.D. Thesis, Technische Universiteit Eindhoven, 1996
25. Neubauer F., Hoheisel A., and Geiler J. Workflow-based grid applications. Future Generation Computer Systems 22 1-2 (2006) 6-15
26. Oram A. Peer-to-peer: Harnessing the Power of Disruptive Technologies (2001), O'Reilly & Associates, Inc, Sebastopol, CA, USA
27. R. Raman, M. Livny, M. Solomon, Resource management through multilateral matchmaking, in: Proceedings of the Ninth IEEE Symposium on High Performance Distributed Computing, HPDC9, Pittsburgh, PA, 2000
28. A. Rowstron, P. Druschel, Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems, in: Proceedings of the Middleware 2001, IFIP/ACM International Conference on Distributed Systems Platforms, 2001
29. Sabin G., Kettimuthu R., Rajan A., and Sadayappan P. Scheduling of parallel jobs in a heterogeneous multi-site environment. In: Feitelson D.G., Rudolph L., and Schwiegelshohn U. (Eds). Job Scheduling Strategies for Parallel Processing. Lect. Notes Comput. Sci. vol. 2862 (2003), Springer Verlag 87-104
30. Sinnen O., Sousa L., and Sandnes F.E. Towards a realistic task scheduling model. IEEE Transactions on Parallel and Distributed Systems 17 3 (2006) 263-275
31. Stioca I., et al. Chord: A scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Transactions on Networking 11 1 (2003) 17-32
32. Tannenbaum T., Wright D., Miller K., and Livny M. Condor-a distributed job scheduler. In: Sterling T. (Ed). Beowulf Cluster Computing with Linux (2001), MIT Press 1-33
33. Thain D., Tannenbaum T., and Livny M. Condor and the grid. In: Berman F., Fox G., and Hey T. (Eds). Grid Computing: Making the Global Infrastructure a Reality (2002), John Wiley & Sons Inc 11-33
34. Thain D., Tannenbaum T., and Livny M. Distributed computing in practice: The Condor experience. Concurrency and Computation: Practice and Experience 17 2-4 (2005) 323-356
35. T. Toyama, Y. Yamada, K. Konishi, A resource management system for data-intensive applications in desktop grid environments, in: Parallel and Distributed Computing and Systems-2006, 2006
36. Tuairisg S.O., Browne M., Cunniffe J., and Shearer A. Webcom-G: Implementing an astronomical data analysis pipeline on a grid-type infrastructure. In: Shopbell P., Britton M., and Ebert R. (Eds). Astrophysical Data Analysis Software and Systems XIV, Vol. XXX (2005)
37. Tucker A.B. Programming Languages: Principles and Paradigms (2002), McGraw-Hill
38. Voisin B., Cunniffe J., Browne M., and Shearer A. Grid-enabled distributed data mining with Webcom-G. In: Gabriel, Arviset, Ponz, and Solano (Eds). Proceedings of the 15th Annual Conference on Astronomical Data Analysis Software and Systems (2005), Publications of the Astronomy Society of the Pacific
39. H. Wang, H. Takizawa, H. Kobayashi, A dependable peer-to-peer computing platform, Future Generation Computer Systems 23 (8)
40. Wei B., Fedak G., and Cappello F. Towards efficient data distribution on computational desktop grids with bittorrent. Future Generation Computer Systems 23 8 (2007) 983-989
41. Weng C., and Lu X. Heuristic scheduling for bag-of-tasks applications in combination with qos in the computational grid. Future Generation Computer Systems 21 2 (2005) 271-280
42. D. Zhou, V. Lo, Wavegrid: A scalable fast-turnaround heterogeneous peer-based desktop grid system, in: International Parallel and Distributed Processing Symposium, 2006