Efficient scheduling of task graph collections on heterogeneous resources

IPDPS 2009 - Proceedings of the 2009 IEEE International Parallel and Distributed Processing Symposium

Volumn , Issue , 2009, Pages

  Gallet, Matthieu ^b,d,e   Marchal, Loris ^a,d,e   Vivien, Frédéric ^c,d,e  

^a CNRS   (France)

^b UNIVERSITÉ DE LYON   (France)

^c INRIA   (France)

^d UNIVERSITÉ DE LYON   (France)

^e UNIV LYON   (France)

Author keywords

Computing grids; DAGs; Heterogeneity; Scheduling; Steady state; Workflows

Indexed keywords

ALLOCATION STRATEGY; COMPLEX CONTROL; COMPUTING GRID; COMPUTING GRIDS; EFFICIENT SCHEDULING; HETEROGENEOUS RESOURCES; HEURISTIC SCHEMES; INPUT DATAS; MIXED LINEAR PROGRAMMING; OPTIMAL ALLOCATION; RUNNING TIME; SCHEDULING JOBS; SCHEDULING POLICIES; STEADY STATE; TASK GRAPH; WORK-FLOWS;

COMPUTER SCIENCE; DISTRIBUTED PARAMETER NETWORKS; HEURISTIC METHODS; LINEARIZATION; MANAGEMENT; SIMULATORS;

SCHEDULING ALGORITHMS;

EID: 70450056268     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2009.5161045     Document Type: Conference Paper

References (27)

1. I. Ahmad and Y.-K. Kwok. On exploiting task duplication in parallel program scheduling. IEEE Trans. Parallel Distrib. Syst., 9(9):872-892, 1998.
2. O. Beaumont, L. Carter, J. Ferrante, A. Legrand, and Y. Robert. Bandwidth-centric allocation of independent tasks on heterogeneous platforms. In International Parallel and Distributed Processing Symposium (IPDPS'2002). IEEE Computer Society Press, 2002.
3. O. Beaumont, A. Legrand, L. Marchal, and Y Robert. Scheduling strategies for mixed data and task parallelism on heterogeneous clusters. PPL, 13(2), 2003.
4. O. Beaumont, A. Legrand, L. Marchal, and Y Robert. Pipelining broadcasts on heterogeneous platforms. IEEE Trans. Parallel Distributed Systems, 16(4):300-313, 2005.
5. O. Beaumont, A. Legrand, L. Marchal, and Y Robert. Steady-state scheduling on heterogeneous clusters. Int. J. of Foundations of Computer Science, 16(2): 163-194, 2005.
6. D. Bertsimas and D. Gamarnik. Asymptotically optimal algorithms for job shop scheduling and packet routing. Journal of Algorithms, 33(2):296-318, 1999.
7. H. Casanova, A. Legrand, and M. Quinson. SimGrid: a generic framework for large-scale distributed experimentations. In Proceedings of IEEE UKSIM/EUROSIM'08, 2008.
8. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications, 23, Issue 3:187-200, July 2000.
9. P. Chretienne, E. G. Coffman Jr., J. K. Lenstra, and Z. Liu, editors. Scheduling Theory and its Applications. John Wiley and Sons, 1995.
10. D. Coudert, H. Rivano, and X. Roche. A combinatorial approximation algorithm for the multicommodity flow problem. In WAOA, pages 256-259, 2003.
11. ILOG CPLEX: High-performance software for mathematical programming and optimization. http: / /www. ilog. com/products/cplex/. [12] R. P. Dick, D. L. Rhodes, and W. Wolf. TGFF: task graphs for free. In CODES, pages 97-101, 1998.
12. I. T Foster and C. Kesselman, editors. The Grid2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, 2004.
13. M. Gallet, L. Marchal, and F. Vivien. Allocating series of workflows on computing grids. In ICPADS. IEEE Computer Society, 2008.
14. M. Gallet, L. Marchal, and F. Vivien. Allocating series of workflows on computing grids. Research report RR-6603, INRIA, 2008.
15. M. R. Garey and D. S. Johnson. Computers and Intractability, a Guide to the Theory of NP-Completeness. W. H. Freeman and Company, 1979.
16. C. Germain, V Breton, P. Clarysse, Y Gaudeau, T Glatard, E. Jeannot, Y Legre, C. Loomis, I. Magnin, J. Montagnat, J.-M. Moureaux, A. Osorio, X. Pennec, and R. Texier. Grid-enabling medical image analysis. Journal of Clinical Monitoring and Computing, 19(4-5):339-349, Oct. 2005.
17. T Glatard, J. Montagnat, D. Lingrand, and X. Pennec. Flexible and efficient workflow deployement of data-intensive applications on grids with MOTEUR. Int. Journal of High Performance Computing and Applications, 2008.
18. B. Hong and V Prasanna. Distributed adaptive task allocation in heterogeneous computing environments to maximize throughput. In IPDPS'2004. IEEE CS Press, 2004.
19. S. Lee, M.-K. Cho, J.-W Jung, and J.-H. K. nd Weontae Lee. Exploring protein fold space by secondary structure prediction using data distribution method on grid platform. Bioin-formatics, 20(18):3500-3507, 2004.
20. T M. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, R. M. Greenwood, T Carver, K. Glover, M. R. Pocock, A. Wipat, and P. Li. Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics, 20(17):3045-3054, 2004.
21. M. A. Palis, J.-C. Liou, and D. S. L. Wei. Task clustering and scheduling for distributed memory parallel architectures. IEEE Trans. Parallel Distrib. Syst., 7(1):46-55, 1996.
22. Pipealign. http://bips.u-strasbg.fr/PipeAlign/Documentation/.
23. J. Pitt-Francis, A. Garny, and D. Gavaghan. Enabling computer models of the heart for high-performance computers and the grid. Philosophical Transactions of the Royal Society A, 364(1843):1501-1516, June 2006.
24. B. A. Shirazi, A. R. Hurson, and K. M. Kavi. Scheduling and load balancing in parallel and distributed systems. IEEE Computer Science Press, 1995.
25. H. Topcuoglu, S. Hariri, and M.-Y Wu. Task scheduling algorithms for heterogeneous processors. In Proceedings of HCW '99, page 3, Washington, DC, USA, 1999. IEEE CS.
26. V Volkov and J. Demmel. LU, QR and Cholesky factorizations using vector capabilities of GPUs. Technical Report UCB/EECS-2008-49, U. of California, Berkeley, May 2008.
27. R. Wolski, N. Spring, and J. Hayes. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15(10):757-768, 1999.