Towards a general model of the multi-criteria workflow scheduling on the grid

Future Generation Computer Systems

Volumn 25, Issue 3, 2009, Pages 237-256

  Wieczorek, Marek ^a   Hoheisel, Andreas ^b   Prodan, Radu ^a  

^a UNIVERSITY OF INNSBRUCK   (Austria)

^b FRAUNHOFER FIRST   (Germany)

Author keywords

Grid computing; Multi criteria scheduling; Taxonomy; Workflow

Indexed keywords

GRID COMPUTING; MANAGEMENT; TAXONOMIES;

GENERAL MODELS; GRID WORKFLOW; MULTI-CRITERIA SCHEDULING; RESOURCE MODELS; SCHEDULING PROCESSES; TASK MODELS; USE CASES; WORKFLOW; WORKFLOW MODELS; WORKFLOW SCHEDULING;

SCHEDULING;

EID: 55949098372     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.09.002     Document Type: Article

References (99)

1. T'kindt V., and Billaut J. Multicriteria Scheduling (2002), Springer Verlag, Berlin
2. E. Tsiakkouri, R. Sakellariou, H. Zhao, M.D. Dikaiakos, Scheduling workflows with budget constraints, in: S. Gorlatch, M. Danelutto (Eds.), Proceedings of the CoreGRID Workshop "Integrated research in Grid Computing", 2005, pp. 347-357
3. Yu J., Buyya R., and Tham C.K. QoS-based scheduling of workflow applications on service Grids. Proceedings of the 1st IEEE International Conference on e-Science and Grid Computing. e-Science 2005 (2005), IEEE, IEEE CS Press, Melbourne, Australia
4. Yu J., and Buyya R. A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms. Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing. HPDC 2006 (2006), IEEE, IEEE CS Press, Paris, France
5. Yu J., and Buyya R. Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Scientific Programming (2006), IOS Press 14-217
6. Doǧan A., and Özgüner F. Biobjective scheduling algorithms for execution time-reliability trade-off in heterogeneous computing systems. Comput. J. 48 3 (2005) 300-314
7. Qin X., and Jiang H. A novel fault-tolerant scheduling algorithm for precedence constrained tasks in real-time heterogeneous systems. Parallel Comput. 32 5 (2006) 331-356
8. Brandic I., Benkner S., Engelbrecht G., and Schmidt R. QoS support for time-critical Grid workflow applications. E-SCIENCE'05: Proceedings of the First International Conference on e-Science and Grid Computing (2005), IEEE Computer Society, Washington, DC, USA 108-115
9. Brandic I., Pllana S., and Benkner S. Amadeus: A holistic service-oriented environment for Grid workflows. GCCW'06: Proceedings of the Fifth International Conference on Grid and Cooperative Computing Workshops (2006), IEEE Computer Society, Washington, DC, USA 259-266
10. Wieczorek M., Podlipnig S., Prodan R., and Fahringer T. Bi-criteria scheduling of scientific workflows for the Grid. Proc. of the Eighth IEEE International Symposium on Cluster Computing and the Grid. CCGrid 2008 (2008), IEEE Computer Society, Lyon, France
11. Neubauer F., Hoheisel A., and Geiler J. Workflow-based Grid applications. Future Generation Comput. Syst. 22 1-2 (2006) 6-15
12. Hoheisel A., Alt M., and Nets P. In: Taylor I.J., Gannon D.B., Deelman E., and Shields M. (Eds). Workflows for e-Science-Scientific Workflows for Grids (2006), Springer. 978-1-84628-519-6
13. Hoheisel A. User tools and languages for graph-based Grid workflows: Research articles. Concurr. Comput. Pract. Exper. 18 10 (2006) 1101-1113
14. The K-WfGrid project. http://www.kwfgrid.net
15. Fahringer T., Qin J., and Hainzer S. Specification of Grid workflow applications with AGWL: An Abstract Grid Workflow Language. Proceedings of IEEE International Symposium on Cluster Computing and the Grid 2005. CCGrid 2005 (2005), IEEE Computer Society Press, Cardiff, UK
16. Fahringer T., Prodan R., Duan R., Hofer J., Nadeem F., Nerieri F., Podlipnig S., Qin J., Siddiqui M., Truong H.-L., Villazón A., and Wieczorek M. ASKALON: A development and grid computing environment for scientific workflows. Workflows for e-Science (2007), Springer-Verlag 450-471
17. T. Andrews, et al., Business process execution language for web services, Tech. Rep., BEA Systems, et al., May 2003
18. Krauter K., Buyya R., and Maheswaran M. A taxonomy and survey of Grid resource management systems for distributed computing. Softw. Pract. Exper. 32 2 (2002) 135-164
19. Venugopal S., Buyya R., and Ramamohanarao K. A Taxonomy of data Grids for distributed data sharing, management, and processing. ACM Comput. Surv. 38 1 (2006) 1-53
20. Zanikolas S., and Sakellariou R. A taxonomy of Grid monitoring systems. Future Generation Comput. Syst. 21 1 (2005) 163-188
21. Yeo C.S., and Buyya R. A taxonomy of market-based resource management systems for utility-driven cluster computing. Softw. Pract. Exper. 36 13 (2006) 1381-1419
22. Plankensteiner K., Prodan R., Fahringer T., Kertész A., and Kacsuk P. Fault tolerant behaviour in state-of-the-art workflow management systems. In: Gorlatch S., Fragopoulou P., and Priol T. (Eds). CoreGRID Integration Workshop (2008), Crete University Press, Hersonissos, Greece 455-466
23. Truong H.L., Dustdar S., and Fahringer T. Performance metrics and ontologies for Grid workflows. Future Generation Comput. Syst. 23 6 (2007) 760-772. http://dblp.uni-trier.de/db/journals/fgcs/fgcs23.html#TruongDF07
24. van der Aalst W.M.P., ter Hofstede A.H.M., Kiepuszewski B., and Barros A.P. Workflow patterns. Distrib. Parallel Databases 14 1 (2003) 5-51
25. W.M. van der Aalst, Workflow patterns. http://www.workflowpatterns.com/
26. Yu J., and Buyya R. A taxonomy of workflow management systems for Grid computing. J. Grid Comput. 3 3-4 (2005) 171-200
27. Casavant T.L., and Kuhl J.G. A taxonomy of scheduling in general-purpose distributed computing systems. IEEE Trans. Softw. Eng. 14 2 (1988) 141-154
28. F. Dong, S.G. Akl, Scheduling algorithms for Grid computing: State of the art and open problems, Tech. Rep. 2006-504, School of Computing, Queen's University, Kingston, Ontario, January 2006
29. Resource Description Framework. http://www.w3.org/RDF/
30. Jablonski, Workflow management: Modeling concepts, architecture and implementation, 1996
31. Kiepuszewski B., ter Hofstede A.H.M., and van der Aalst W.M.P. Fundamentals of control flow in workflows. Acta Inform. 39 3 (2003) 143-209. http://dblp.uni-trier.de/db/journals/acta/acta39.html#KiepuszewskiHA03
32. Java CoG Kit Karajan Guide. http://www.cogkit.org/current/manual/workflow.pdf
33. T. Kosar, M. Livny, Stork: Making data placement a first class citizen in the Grid, 2004
34. Gounaris A., Sakellariou R., Paton N., and Fernandes A. A novel approach to resource scheduling for parallel query processing on computational Grids. Distrib. Parallel Databases 19 May (2006) 87-106 (20)
35. M. Mair, J. Qin, M. Wieczorek, T. Fahringer, Workflow conversion and processing in the ASKALON Grid environment, in: 2nd Austrian Grid Symposium
36. Kertesz A., Sipos G., and Kacsuk P. Multi-Grid brokering with the P-GRADE portal. In: Volkert J., Fahringer T., Kranzlmuller D., and Schreiner W. (Eds). 2nd Austrian Grid Symposium (2006), OCG Verlag, Austria 166-178
37. R. Sakellariou, H. Zhao, A hybrid heuristic for DAG scheduling on heterogeneous systems, in: IPDPS, 2004
38. Zhao H., and Sakellariou R. Scheduling multiple DAGs onto heterogeneous systems. 15th Heterogeneous Computing Workshop. HCW'06 (2006), IEEE Computer Society Press, Rhodes, Greece
39. Mika M., Waligóra G., and Weglarz J. A metaheuristic approach to scheduling workflow jobs on a Grid. Grid Res. Manag. State Art Future Trends (2004) 295-318
40. Ma T., and Buyya R. Critical-path and priority based algorithms for scheduling workflows with parameter sweep tasks on global grids. Proceedings of the 17th International Symposium on Computer Architecture and High Performance Computing. SBAC-PAD 2005 (2005), IEEE Computer Society Press, Rio de Janeiro, Brazil
41. Abramson D., Buyya R., and Giddy J. A computational economy for Grid computing and its implementation in the nimrod-g resource broker. Future Generation Comput. Syst. 18 8 (2002) 1061-1074
42. H. Casanova, A. Legrand, D. Zagorodnov, F. Berman, Heuristics for scheduling parameter sweep applications in Grid environments, in: Proceedings of 9th Heterogeneous Computing Workshop, HCW, Cancun, Mexico, 2000, pp. 349-363
43. Subhlok J., and Vondran G. Optimal use of mixed task and data parallelism for pipelined computations. J. Parallel Distrib. Comput. 60 March (2000) 297-319 (23)
44. Deelman E., Singh G., Su M.-H., Blythe J., Gil Y., Kesselman C., Mehta G., Vahi K., Berriman G.B., Good J., Laity A., Jacob J.C., and Katz D. Pegasus: a Framework for mapping complex scientific workflows onto distributed systems. Sci. Programm. J. 13 2 (2005) 219-237
45. Luo P., Lü K., Shi Z., and He Q. Distributed data mining in Grid computing environments. Future Generation Comput. Syst. 23 1 (2007) 84-91
46. Luo P., Lü K., Huang R., He Q., and Shi Z. A heterogeneous computing system for data mining workflows in multi-agent environments. Expert Syst. 23 November (2006) 258-272 (15)
47. Gubała T., Harȩzlak D., Bubak M., and Malawski M. Constructing abstract workflows of applications with workflow composition tool. In: Bubak M., and Unger S. (Eds). Proceedings of Cracow'06 Grid Workshop. October 15-18, 2006, Krakow, Poland. The Knowledge-based Workflow System for Grid Applications (2007), ACC Cyfronet AGH 25-30
48. Dutka L., Kitowski J., and Natanek S. Automatic application builder - Tool for automatic service selection. In: Bubak M., and Unger S. (Eds). Proceedings of Cracow'06 Grid Workshop. October 15-18, 2006, Krakow, Poland. The Knowledge-based Workflow System for Grid Applications (2007), ACC Cyfronet AGH 31-38
49. Tian L., and Chandy K.M. Resource allocation in streaming environments. Proceedings of 7th IEEE/ACM International Conference on Grid Computing. Grid'06 (2006), IEEE Computer Society Press, Barcelona, Spain
50. S. Schmidt, Quality-of-service-aware data stream processing, Ph.D. Thesis, Dresden, 2007
51. Altair Engineering, Inc., PBS Professional. http://www.altair.com/software/pbspro.htm
52. Sun Microsystems, Inc., Grid Engine. http://gridengine.sunsource.net/
53. Platform Computing Inc., Platform LSF. http://www.platform.com/Products/Platform.LSF.Family/
54. Cluster Resources, Inc., Maui Cluster Scheduler
55. Wieczorek M., Siddiqui M., Villazon A., Prodan R., and Fahringer T. Applying advance reservation to increase predictability of workflow execution on the Grid. E-SCIENCE'06: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing (2006), IEEE Computer Society, Washington, DC, USA 82
56. Schuller B., Demuth B., Mix H., Rasch K., Romberg M., Sild S., Maran U., Bala P., del Grosso E., Casalegno M., Piclin N., Pintore M., Sudholt W., and Baldrige K. Chemomentum - UNICORE 6 based infrastructure for complex applications in science and technology. UNICORE Summit 2007 (2007), Springer-Verlag, Rennes, France
57. A. Hoheisel, H. Rose, Konzept für das Scheduling von Workflow-Aktivitäten in Instant Grid, Tech. Rep., Fraunhofer Institut für Rechnerarchitektur und Softwaretechnik, June 2006
58. Li J., and Yahyapour R. A negotiation model supporting co-allocation for Grid scheduling. Proceedings of 7th IEEE/ACM International Conference on Grid Computing. Grid'06 (2006), IEEE Computer Society Press, Barcelona, Spain
59. Li J., and Yahyapour R. Negotiation strategies for Grid scheduling. The First International Conference on Grid and Pervasive Computing. GPC2006. Lecture Notes in Computer Science vol. 3947 (2006), Springer-Verlag, Tunghai University, Taiwan 42-52
60. Li J., and Yahyapour R. Learning-based negotiation strategies for Grid scheduling. IEEE Int'l Symposium on Cluster Computing and the Grid. CCGrid 2006 (2006), IEEE Press, Singapore 567-583
61. Pipino L., Lee Y.W., and Wang R.Y. Data quality assessment. Communications of the ACM 45 4 (2002) 211-218
62. P. Fleury, Dynamic scheme selection in image coding, Ph.D. Thesis, Lausanne, 1999
63. Ballou D.P., and Pazer H.L. Modeling data and process quality in multi-input, multi-output information systems. Manag. Sci. 31 2 (1985) 150-162
64. Čaplinskas A., and Gasperovič J. Techniques to aggregate the characteristics of internal quality of an IS specification language. Informatica, Lith. Acad. Sci. 16 4 (2005) 519-540. http://www.vtex.lt/Informatica/htm/INFO614.htm
65. Mela C.F., and Lehmann D.R. Using fuzzy set theoretic techniques to identify preference rules from interactions in the linear model: An empirical study. Fuzzy Sets Syst. 71 2 (1995) 165-181
66. Xiao X., and Ni L.M. Internet QoS: A big picture. IEEE Netw. 13 2 (1999) 8-18
67. R. Buyya, H. Stockinger, J. Giddy, D. Abramson, Economic models for management of resources in Peer-to-Peer and Grid computing, Tech. Rep. 0108001, Economics Working Paper Archive at WUSTL. Available at http://ideas.repec.org/p/wpa/wuwpco/0108001.html (2001)
68. Buyya R., Abramson D., and Venugopal S. The Grid economy. In: Parashar M., and Lee C. (Eds). Proceedings of the IEEE. Grid Computing vol. 93 (2005), IEEE Press, NJ, USA 698-714 (special issue)
69. Wolski R., Plank J.S., Brevik J., and Bryan T. Analyzing Market-Based Resource Allocation Strategies for the Computational Grid 15 3 (2001) 258-281
70. Chien C.-H., Chang P.H.-M., and Soo V.-W. Market-oriented multiple resource scheduling in Grid computing environments. AINA'05: Proceedings of the 19th International Conference on Advanced Information Networking and Applications (2005), IEEE Computer Society, Washington, DC, USA 867-872
71. Jennings N.R., Faratin P., Lomuscio A.R., Parsons S., Sierra C., and Woodlidge M. Automated negotiation: Prospects, methods and challenges. International Journal of Group Decision and Negotiation 10 2 (2001) 199-215
72. Singh G., Kesselman C., and Deelman E. Application-level resource provisioning on the Grid. e-science (2006) 83
73. Sih G.C., and Lee E.A. A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures. IEEE Trans. Parallel Distrib. Syst. 4 2 (1993) 175-187
74. Kellerer H., Pferschy U., and Pisinger D. Knapsack Problems (2004), Springer-Verlag, Berlin
75. Bertsekas D.P. Dynamic Programming and Optimal Control, Vol. I (2005), Athena Scientific, Belmont, MA
76. Schrijver A. Theory of Linear and Integer Programming (1987), Wiley schRI a 87:1 1.Ex
77. Deelman E., Blythe J., Gil Y., and Kesselman C. Workflow management in GriPhyN. Grid Res. Manag. State Art Future Trends (2004) 99-116
78. Topcuouglu H., Hariri S., and you Wu M. Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13 3 (2002) 260-274
79. Jugravu A., and Fahringer T. JavaSymphony, a programming model for the Grid. Future Gener. Comput. Syst. 21 1 (2005) 239-246
80. Yu Z., and Shi W. An adaptive rescheduling strategy for Grid workflow applications. Proceedings of the 21st IPDPS 2007 (2007), IEEE Computer Society Press, Long Beach, USA
81. Vraalsen F., Aydt R.A., Mendes C.L., and Reed D.A. Performance Contracts: Predicting and Monitoring Grid Application Behavior. Lecture Notes in Computer Science vol. 2242 (2001) 154-166
82. H. Dail, O. Sievert, F. Berman, H. Casanova, A. YarKhan, S. Vadhiyar, J. Dongarra, C. Liu, L. Yang, D. Angulo, I. Foster, Scheduling in the Grid Application Development Software Project, 2003
83. Berman F., et al. New Grid scheduling and rescheduling methods in the GrADS project. Internat. J. Parallel Programm. 33 June (2005) 209-229 (21)
84. Zhao H., and Sakellariou R. Advance reservation policies for workflows. Proceedings of the 12th International Workshop on Job Scheduling Strategies for Parallel Processing. Lecture Notes in Computer Science vol. 4376 (2006), Springer-Verlag, Saint-Malo, France 47-67
85. Foster I., Kesselman C., and Tuecke S. The anatomy of the Grid: Enabling scalable virtual organizations. Internat. J. Supercomput. Appl. 15 3 (2001) 2001
86. O. Wäldrich, W. Ziegler, P. Wieder, A meta-scheduling service for co-allocating arbitrary types of resources, Tech. Rep. TR-0010, Institute on Resource Management and Scheduling, CoreGRID - Network of Excellence, December 2005
87. Baptiste P., Le Pape C., and Nuijten W. Constraint-based Scheduling: Applying Constraint Programming to Scheduling Problems. International Series in Operations Research and Management Science vol. 39 (2001), Kluwer Academic Publishers, Norwell, MA
88. M.D. Rodriguez Moreno, D. Borrajo Millán, D. Meziat Luna, Representing and planning tasks with time and resources, Ph.D. Thesis, Universidad de Alcalá, Spain, December 2003
89. Cesta A.O.A., and Smith S. A constrained-based method for project scheduling with time windows. J. Heuristics 8 (2002) 109-136
90. Sodan A.C., and Huang X. Adaptive time/space sharing with SCOJO. Internat. J. High Performance Comput. Netw. 4 5-6 (2006) 256-269
91. Feitelson D.G., and Rudolph L. Towards convergence in job schedulers for parallel supercomputers. IPPS'96: Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing (1996), Springer-Verlag, London, UK 1-26
92. N'Takpé T., and Suter F. Critical path and area based scheduling of parallel task graphs on heterogeneous platforms. Proceedings of the 12th International Conference on Parallel and Distributed Systems. ICPADS 2006 (2006), IEEE Computer Society Press, Minneapolis, MN, USA
93. Radulescu A., Nicolescu C., van Gemund A.J.C., and Jonker P.P. CPR: Mixed task and data parallel scheduling for distributed systems. Proceedings of the 15th International Parallel and Distributed Processing Symposium. IPDPS (2001), IEEE Computer Society Press, San Francisco, USA 39-41
94. Casanova H., Desprez F., and Suter F. From heterogeneous task scheduling to heterogeneous mixed parallel scheduling. In: Danelutto M., Laforenza D., and Vanneschi M. (Eds). Proceedings of the 10th International Euro-Par Conference. Euro-Par'04. Lecture Notes in Computer Science vol. 3149 (2004), Springer, Pisa, Italy 230-237
95. Aida K., and Casanova H. Scheduling mixed-parallel applications with advance reservations. Proceedings of the 17th IEEE International Symposium on High Performance Distributed Computing. HPDC-15 (2008), IEEE Press, Boston, MA
96. Błazewicz J., Machowiak M., Wȩglarz J., Kovalyov M., and Trystram D. Scheduling malleable tasks on parallel processors to minimize the makespan: Models and algorithms for planning and scheduling problems. Ann. Oper. Res. 129 July (2004) 65-80 (16)
97. J. Basney, M. Litzkow, T. Tannenbaum, M. Livny, Checkpoint and migration of unix processes in the condor distributed processing system, Tech. Rep. Technical Report 1346, April 1997
98. Buntinas D., Coti C., Hérault T., Lemarinier P., Pilard L., Rezmerita A., Rodriguez E., and Cappello F. Blocking vs. non-blocking coordinated checkpointing for large-scale fault tolerant MPI Protocols. Future Generation Comput. Syst. 24 1 (2008) 73-84. http://dblp.uni-trier.de/db/journals/fgcs/fgcs24.html#BuntinasCHLPRRC08
99. Pellegrini S., Giacomini F., and Ghiselli A. A practical approach for a workflow management system. CoreGRID Workshop on Grid Middleware (2007), Springer Verlag, Dresden, Germany