DAGMap: Efficient and dependable scheduling of DAG workflow job in grid

Journal of Supercomputing

Volumn 51, Issue 2, 2010, Pages 201-223

  Cao, Haijun ^a   Jin, Hai ^a   Wu, Xiaoxin ^b   Wu, Song ^a   Shi, Xuanhua ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b INTEL CORPORATION   (China)

Author keywords

Adaptive scheduling; Cooperative checkpointing; Critical task; DAG Grid workflow

Indexed keywords

ADAPTIVE SCHEDULING; CHECK POINTING; CRITICAL TASKS; DEPENDENCY RELATIONSHIP; GRID RESOURCE; GRID WORKFLOWS; GROUP SCHEDULING; INDEPENDENT TASKS; JOB SCHEDULING; LIST-SCHEDULING; MAX-MIN; RESOURCE UTILIZATIONS; SALIENT FEATURES; SCHEDULING HEURISTICS; STATIC MAPPING; TWO PHASIS;

FAULT TOLERANCE; QUALITY ASSURANCE;

MANAGEMENT;

EID: 76549103994     PISSN: 09208542     EISSN: 15730484     Source Type: Journal    
DOI: 10.1007/s11227-009-0284-7     Document Type: Conference Paper

References (23)

1. Ramakrishnan A, Singh G, Zhao H, Deelman E, Sakellariou R, Vahi K, Blackburn K, Meyers D, Samidi M (2007) Scheduling data intensive workflows onto storage-constrained distributed resources. In: Proceedings of the 7th IEEE symposium on cluster computing and the grid (CCGrid'07), 2007
2. Amin K, Hategan M, Laszewski GV, Zaluzec NJ, Hampton S, Rossi A (2004) GridAnt: a client-controllable grid workflow system. In: Proc 37th Hawai'i international conf on system science, 2004
3. G Malewicz I Foster AL Rosenberg M Wilde 2007 A tool for prioritizing DAGMan jobs and its evaluation J Grid Comput 5 2 197 212 10.1007/s10723-007- 9065-9 (Pubitemid 46723195)
4. Foster I (2005) Globus toolkit version 4: software for service-oriented systems. In: Lecture notes in computer science. vol 3779. Springer, Berlin
5. The Condor Project website (2007) Available: http://www.cs.wisc.edu/ condor/
6. You SY, Kim HY, Hwang DH, Kim SC (2004) Task scheduling algorithm in GRID considering heterogeneous environment. In: Proc of the international conference on parallel and distributed processing techniques and applications (PDPTA '04), Nevada, USA, 2004, pp 240-245
7. Mandal A, Kennedy K, Koelbel C, Marin G, Mellor-Crummey J, Liu B, Johnsson L (2005) Scheduling strategies for mapping application workflows onto the grid. In: IEEE international symposium on high performance distributed computing (HPDC'05), 2005
8. Dong F, Akl SG (2006) Scheduling algorithms for grid computing: state of the art and open problems. Technical Report No. 2006-504, School of Computing, Queens University Kingston, Ontario
9. H Topcuoglu S Hariri M Wu 2002 Performance effective and low-complexity task scheduling for heterogeneous computing IEEE Trans Parallel Distrib Syst 13 3 260 274 10.1109/71.993206 (Pubitemid 34448780)
10. Muthuvelu N, Liu J, Soe NL, Venugopal SR, Sulistio A, Buyya R (2005) A dynamic job grouping-based scheduling for deploying applications with fine-grained tasks on global grids. In: Proc 3rd Australasian workshop on grid computing and e-research, Australia, 2005
11. Sakellariou R, Zhao H (2004) A hybrid heuristic for DAG scheduling on heterogeneous systems. In: Proc 13th heterogeneous computing workshop, USA, 2004
12. Maheswaran M, Siegel HJ (1998) A dynamic matching and scheduling algorithm for heterogeneous computing systems. In: Proc 7th heterogeneous computing workshop, 1998
13. Etminani K, Naghibzadeh PM (2007) A Min-Min Max-Min selective algorithm for grid task scheduling. In: Proc 3rd IEEE/IFIP international conference in Central Asia, 2007
14. TD Braun HJ Siegel N Beck LL Boloni M Maheswaran AI Reuther JP Robertson MD Theys B Yao 2001 A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems J Parallel Distrib Comput 61 6 810 837 10.1006/jpdc.2000.1714 (Pubitemid 33658407)
15. Buyya R, Murshed M (2002) GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. J Concurr Comput Pract Exp (CCPE) 1175-1220
16. Hall R, Rosenberg AL, Venkataramani A (2007) A comparison of DAG-scheduling strategies for internet-based computing. In: Proc 22nd international parallel and distributed processing symposium (IPDPS), 2007
17. Sahoo RK, Oliner AJ, Rish I, Gupta M, Moreira JE, Ma S, Vilalta R, Sivasubramaniam A (2003) Critical event prediction for proactive management in large-scale computer clusters. In: Proc of the ACM SIGKDD, international conference on knowledge discovery and data mining, 2003, pp 426-435
18. Liang Y, Zhang Y, Jette M, Sivasubramaniam A, Sahoo RK (2006) Blue gene/l failure analysis and prediction models. In: Proc of the international conference on dependable systems and networks (DSN), 2006
19. Adam JO, Larry R, Ramendra KS (2006) Cooperative checkpointing: a robust approach to large-scale systems reliability. In: Proc of the 20th annual international conference on supercomputing, 2006
20. Michael L, Todd T, Jim B, Miron L (1997) Checkpoint and migration of UNIX processes in the condor distributed processing system. University of Wisconsin-Madison Computer Sciences Technical Report 1346
21. Stellner G (1996) Cocheck: checkpointing and process migration for MPI. In: Proc of the international parallel processing symposium, 1996
22. Sudakov OO, Meshcheriakov IS, Boyko YV (2007) CHPOX: transparent checkpointing system for Linux clusters. In: Intelligent data acquisition and advanced computing systems: technology and applications (IDAACS 2007), 2007, pp 159-164
23. Maoz T, Barak A, Amar L (2008) Combining virtual machine migration with process migration for HPC on multi-clusters and grids. In: IEEE Cluster, Tsukuba, 2008