Stochastic DAG scheduling using a Monte Carlo approach

Journal of Parallel and Distributed Computing

Volumn 73, Issue 12, 2013, Pages 1673-1689

  Zheng, Wei ^a   Sakellariou, Rizos ^b  

^a XIAMEN UNIVERSITY   (China)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

DAG scheduling; Directed acyclic graphs; Heterogeneous computing; Monte Carlo methods

Indexed keywords

DIRECTED GRAPHS; SCHEDULING; STOCHASTIC SYSTEMS;

APPLICATION PERFORMANCE; DAG SCHEDULING; DIRECTED ACYCLIC GRAPH (DAG); EXTENSIVE SIMULATIONS; HETEROGENEOUS COMPUTING; HETEROGENEOUS COMPUTING SYSTEM; MONTE CARLO APPROACH; STOCHASTIC SCHEDULING;

MONTE CARLO METHODS;

EID: 84885960215     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2013.07.019     Document Type: Article

References (49)

1. S. Ali, H.J. Siegel, M. Maheswaran, D. Hensgen, Task execution time modeling for heterogeneous computing systems, in: Proceedings of the 9th Heterogeneous Computing Workshop, 2000, pp. 185-199. (Pubitemid 30592814)
2. J. Annis, Y. Zhao, J. Voeckler, M. Wilde, S. Kent, I. Foster, Applying chimera virtual data concepts to cluster finding in the sloan sky survey, in: Proceedings of the 2002 ACM/IEEE Conference on SuperComputing, 2002, pp. 56-69.
3. G.B. Berriman, J.C. Good, A.C. Laity, A. Bergou, J. Jacob, D.S. Katz, E. Deelman, C. Kesselman, G. Singh, M.-H. Su, and R. Williams Montage: a grid enabled image mosaic service for the national virtual observatory Astron. Soc. Pac. Conf. Ser. 314 2004 593 596
4. L. Bittencourt, R. Sakellariou, E. Madeira, DAG scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm, in: 18th Euromicro International Conference on Parallel, Distributed and Network-based Processing, PDP, 2010, pp. 27-34.
5. J. Blythe, S. Jain, E. Deelman, Y. Gil, K. Vahi, A. Mandal, K. Kennedy, Task scheduling strategies for workflow-based applications in grids, in: Proceedings of the 5th IEEE International Symposium on Cluster Computing and the Grid, vol. 2, 2005, pp. 759-767. (Pubitemid 44868396)
6. C. Boeres, G. Chochia, and P. Thanisch On the scope of applicability of the ETF algorithm Parallel Algorithms for Irregularly Structured Problems Lecture Notes in Computer Science vol. 980 1995 Springer Berlin/Heidelberg 159 164
7. D. Brown, P. Brady, A. Dietz, J. Cao, B. Johnson, and J. McNabb A case study on the use of workflow technologies for scientific analysis: gravitational wave data analysis Workflows for e-Science: Scientific Workflows for Grids 2006 39 59
8. L.-C. Canon, and E. Jeannot Evaluation and optimization of the robustness of DAG schedules in heterogeneous environments IEEE Trans. Parallel Distrib. Syst. 21 4 2010 532 546 10.1109/TPDS.2009.84
9. L. Canon, E. Jeannot, R. Sakellariou, and W. Zheng Comparative evaluation of the robustness of DAG scheduling heuristics S. Gorlatch, P. Fragopoulou, T. Priol, Grid Computing: Achievements and Prospects 2008 Springer 73 84
10. D.Z.H. Casanova, A. Legrand, F. Berman, Heuristics for scheduling parameter sweep applications in grid environments, in: Proceedings of the 9th Heterogeneous Computing Workshop, 2000, pp. 349-363. (Pubitemid 30592800)
11. B. Cirou, E. Jeannot, Triplet: a clustering scheduling algorithm for heterogeneous systems, in: Proceedings of the International Conference on Parallel Processing, 2001, pp. 231-236.
12. M. Coli, and P. Palazzari Real time pipelined system design through simulated annealing J. Syst. Archit. 42 6-7 1996 465 475 (Pubitemid 126394213)
13. G. Cordasco, G. Malewicz, and A.L. Rosenberg Extending IC-scheduling via the sweep algorithm J. Parallel Distrib. Comput. 70 2010 201 211
14. E. Deelman, D. Gannon, M. Shields, and I. Taylor Workflows and e-Science: an overview of workflow system features and capabilities Future Gener. Comput. Syst. 25 5 2009 528 540
15. A. Doǧan, F. Özgüner, Stochastic scheduling of a meta-task in heterogeneous distributed computing, in: International Conference on Parallel Processing Workshops, 2001, pp. 369-374.
16. A. Doǧan, and F. Özgüner Genetic algorithm based scheduling of meta-tasks with stochastic execution times in heterogeneous computing systems Cluster Comput. 7 2 2004 177 190
17. A. Dǒgan, R. Özgüner, LDBS: a duplication based scheduling algorithm for heterogeneous computing systems, in: Proceedings of the International Conference on Parallel Processing, 2002, pp. 352-359.
18. M.R. Garey, and D.S. Johnson Computer and Intractability: A Guide to the Theory of NP-Completeness 1979 W.H. Freeman and Co.
19. J.M. Hammersley, and D.C. Handscomb Monte Carlo Methods 1975 Methuen London
20. S.A. Jarvis, L. He, D.P. Spooner, and G.R. Nudd The impact of predictive inaccuracies on execution scheduling Perform. Eval. 60 1-4 2005 127 139 (Pubitemid 40304991)
21. A. Kamthe, S.-Y. Lee, A stochastic approach to estimating earliest start times of nodes for scheduling DAGs on heterogeneous distributed computing systems, in: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium, 2005.
22. A. Kamthe, S.-Y. Lee, Stochastic approach to scheduling multiple divisible tasks on a heterogeneous distributed computing system, in: IEEE International Parallel and Distributed Processing Symposium, 2007, pp. 1-11.
23. A.L. Lastovetsky, V. Rychkov, and M. O'Flynn Accurate heterogeneous communication models and a software tool for their efficient estimation Int. J. High Perform. Comput. Appl. 24 1 2010 34 48
24. A. Lastovetsky, and J. Twamley Towards a realistic performance model for networks of heterogeneous computers M. Ng, A. Doncescu, L. Yang, T. Leng, High Performance Computational Science and Engineering IFIP International Federation for Information Processing vol. 172 2005 Springer Boston 39 57
25. G.Q. Liu, K.L. Poh, and M. Xie Iterative list scheduling for heterogeneous computing J. Parallel Distrib. Comput. 65 5 2005 654 665
26. M.M. Lòpez, E. Heymann, M.A. Senar, Analysis of dynamic heuristics for workflow scheduling on grid systems, in: The Fifth International Symposium on Parallel and Distributed Computing, 2006, pp. 199-207.
27. M. Maheswaran, H.J. Siegel, A dynamic matching and scheduling algorithm for heterogeneous computing systems, in: Proceedings of the 7th Heterogeneous Computing Workshop, 1998, pp. 57-69.
28. A. Mahjoub, J.P. Sánchez, and D. Trystram Scheduling with uncertainties on new computing platforms Comput. Optim. Appl. 48 2011 369 398
29. G. Malewicz, I. Foster, and A.L. Rosenberg A tool for prioritizing DAGMan jobs and its evaluation J. Grid Comput. 5 2 2007 197 212 (Pubitemid 46723195)
30. H. Oh, S. Ha, A static heuristic for heterogeneous processors, in: Proceedings of European Conference on Parallel Processing, Euro-Par'96, vol. 2, 1996, pp. 573-377.
31. A. Radulescu, A.J.C. van Gemund, Fast and effective task scheduling in heterogeneous systems, in: Proceedings of the 9th Heterogeneous Computing Workshop, HCW 2000, 2000, pp. 229-238. (Pubitemid 30592810)
32. S. Ranaweera, D.P. Agrawal, A task duplication based scheduling algorithm for heterogeneous systems, in: Proceedings of the 14th International Parallel and Distributed Processing Symposium, 2000, pp. 445-450. (Pubitemid 30591189)
33. S. Ranaweera, D.P. Agrawal, A scalable task duplication based scheduling algorithm for heterogeneous systems, in: Proceedings of the International Conference on Parallel Processing, 2000, pp. 383-390.
34. R. Sakellariou, H. Zhao, A hybrid heuristic for DAG scheduling on heterogeneous systems, in: Proceedings of the 13th Heterogeneous Computing Workshop, 2004, pp. 111-124.
35. R. Sakellariou, and H. Zhao A low-cost rescheduling policy for efficient mapping of workflows on grid systems Sci. Program. 12 4 2004 253 262 (Pubitemid 40173745)
36. J.M. Schopf, F. Berman, Stochastic scheduling, in: Proceedings of 1999 ACM/IEEE Conference on Supercomputing, 1999, pp. 48-68.
37. V. Shestak, J. Smith, A. Maciejewski, and H. Siegel Stochastic robustness metric and its use for static resource allocation J. Parallel Distrib. Comput. 68 8 2008 1157 1173
38. G.C. Sih, and E.A. Lee A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architectures IEEE Trans. Parallel Distrib. Syst. 4 2 1993 175 187
39. T. Szepieniec, M. Bubak, Investigation of the DAG eligible jobs maximization algorithm in a grid, in: 9th IEEE/ACM International Conference on Grid Computing, 2008, pp. 340-345.
40. X. Tang, K. Li, G. Liao, K. Fang, and F. Wu A stochastic scheduling algorithm for precedence constrained tasks on grid Future Gener. Comput. Syst. 27 8 2011 1083 1091
41. I. Taylor, E. Deelman, D. Gannon, and M. Shields Workflows for e-Science 2007 Springer
42. H. Topcuoglu, S. Hariri, and M. Wu Performance-effective and low-complexity task scheduling for heterogeneous computing IEEE Trans. Parallel Distrib. Syst. 13 3 2002 260 274 (Pubitemid 34448780)
43. L. Wang, H.J. Siegel, V.P. Roychowdhury, and A.A. Maciejewski Task matching and scheduling in heterogeneous computing environments using a genetic-algorithm-based approach J. Parallel Distrib. Comput. 47 1 1997 8 22 (Pubitemid 127340842)
44. M. Wieczorek, A. Hoheisel, and R. Prodan Taxonomies of the multi-criteria grid workflow scheduling problem Grid Middleware and Services 2008 Springer US 237 264
45. L. Yang, J.M. Schopf, I. Foster, Conservative scheduling: using predicted variance to improve scheduling decisions in dynamic environments, in: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, 2003, pp. 31-47.
46. Y. Zhao, J. Dobson, I. Foster, L. Moreau, and M. Wilde A notation and system for expressing and executing cleanly typed workflows on messy scientific data SIGMOD Rec. 34 3 2005
47. W. Zheng, Explorations in grid workflow scheduling, Ph.D. Thesis, The University of Manchester, 2010.
48. W. Zheng, R. Sakellariou, A Monte-Carlo approach for full-ahead stochastic DAG Scheduling, in: Proceedings of the 21st Heterogeneous Computing Workshop, 2012, pp. 99-112.
49. W. Zheng, and R. Sakellariou Budget-deadline constrained workflow planning for admission control in market-oriented environments K. Vanmechelen, J. Altmann, O.F. Rana, GECON Lecture Notes in Computer Science vol. 7150 2011 Springer 105 119