Load-balancing scatter operations for grid computing

Parallel Computing

Volumn 30, Issue 8, 2004, Pages 923-946

  Genaud, Stéphane ^a   Giersch, Arnaud ^a   Vivien, Frédéric ^b  

^a Faculté de Médecine   (France)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

Grid computing; Heterogeneous computing; Load balancing; Parallel programming; Scatter operation

Indexed keywords

BANDWIDTH; BROADCASTING; COMPUTER NETWORKS; COMPUTER PROGRAMMING; DATA HANDLING; DIGITAL LIBRARIES; HEURISTIC METHODS; STATISTICAL METHODS;

GRID COMPUTING; HETEROGENEOUS COMPUTING; LOAD-BALANCING; PARALLEL PROGRAMMING; SCATTER OPERATIONS;

PARALLEL PROCESSING SYSTEMS;

EID: 4644285150     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2004.07.005     Document Type: Article

References (30)

1. F. Almeida, D. González, L.M. Moreno, The master-slave paradigm on heterogeneous systems: a dynamic programming approach for the optimal mapping, in: 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004), IEEE CS Press, 2004, pp. 266-272.
2. D.T. Altilar, Y. Paker, Optimal scheduling algorithms for communication constrained parallel processing, in: Euro-Par 2002, Parallel Processing, 8th International Euro-Par Conference, Lecture Notes in Computer Science, vol. 2400, Springer-Verlag, 2002, pp. 197-206.
3. C. Banino, O. Beaumont, A. Legrand, Y. Robert, Scheduling strategies for master-slave tasking on heterogeneous processor grids, in: Applied Parallel Computing: Advanced Scientific Computing: 6th International Conference (PARA'02), Lecture Notes in Computer Science, vol. 2367, Springer-Verlag, 2002, pp. 423-432.
4. J.G. Barbosa, J. Tavares, A.J. Padilha, Linear algebra algorithms in heterogeneous cluster of personal computers, in: 9th Heterogeneous Computing Workshop (HCW'2000), IEEE CS Press, 2000, pp. 147-159.
5. O. Beaumont, L. Carter, J. Ferrante, A. Legrand, Y. Robert, Bandwidth-centric allocation of independent tasks on heterogeneous platforms, in: International Parallel and Distributed Processing Symposium (IPDPS'02), IEEE CS Press, 2002.
6. O. Beaumont, A. Legrand, Y. Robert, A polynomial-time algorithm for allocating independent tasks on heterogeneous fork-graphs, in: 17th International Symposium on Computer and Information Sciences (ISCIS XVII), CRC Press, 2002, pp. 115-119.
7. O. Beaumont, A. Legrand, Y. Robert, Optimal algorithms for scheduling divisible workloads on heterogeneous systems, in: 12th Heterogeneous Computing Workshop (HCW'2003), IEEE CS Press, 2003.
8. O. Beaumont, A. Legrand, Y. Robert, Scheduling divisible workloads on heterogeneous platforms, Parallel Comput. 29 (9) (2003) 1121-1152.
9. V. Bharadwaj, D. Ghose, V. Mani, T.G. Robertazzi, Scheduling Divisible Loads in Parallel and Distributed Systems, Wiley-IEEE CS Press, 1996.
10. V. Bharadwaj, D. Ghose, T.G. Robertazzi, Divisible load theory: a new paradigm for load scheduling in distributed systems, Cluster Comput. 6 (1) (2003) 7-17.
11. I. Błazewicz, M. Drozdowski, Distributed processing of divisible jobs with communication startup costs, Discrete Appl. Math. 76 (1-3) (1997) 21-41.
12. M. Cierniak, M.J. Zaki, W. Li, Compile-time scheduling algorithms for heterogeneous network of workstations, Comput. J. 40 (6) (1997) 356-372, Special Issue on Automatic Loop Parallelization.
13. R. David, S. Genaud, A. Giersch, B. Schwarz, É. Violard, Source code transformations strategies to load-balance grid applications, in: Grid Computing - GRID 2002: Third International Workshop, Lecture Notes in Computer Science, vol. 2536, Springer-Verlag, 2002, pp. 82-87.
14. P. Feautrier, Parametric integer programming, RAIRO Rech. Opér. 22 (3) (1988) 243-268.
15. I. Foster, C. Kesselman, Globus: a metacomputing infrastructure toolkit, Int. J. Supercomput. Appl. High Perform. Comput. 11 (2) (1997) 115-128.
16. I. Foster, C. Kesselman (Eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, 1999.
17. S. Genaud, A. Giersch, F. Vivien, Load-balancing scatter operations for grid computing, in: 12th Heterogeneous Computing Workshop (HCW'2003), IEEE CS Press, 2003.
18. W.L. George, Dynamic load-balancing for data-parallel MPI programs, in: Message Passing Interface Developer's and User's Conference (MPIDC'99), 1999.
19. M. Grunberg, S. Genaud, C. Mongenet, Seismic ray-tracing and earth mesh modeling on various parallel architectures, J. Supercomput. 29 (1) (2004) 27-44.
20. P. Husbands, J.C. Hoe, MPI-StarT: delivering network performance to numerical applications, in: Proceedings of the 1998 ACM/IEEE conference on Supercomputing (SC'98), IEEE CS Press, 1998.
21. N.T. Karonis, B.R. de Supinski, I. Foster, W. Gropp, E. Lusk, J. Bresnahan, Exploiting hierarchy in parallel computer networks to optimize collective operation performance, in: International Parallel and Distributed Processing Symposium (IPDPS'OO), IEEE CS Press, 2000, pp. 377-384.
22. N.T. Karonis, B. Toonen, I. Foster, MPICH-G2: a grid-enabled implementation of the message passing interface, J. Parallel Distrib. Comput. 63 (5) (2003) 551-563.
23. T. Kielmann, R.F.H. Hofman, H.E. Bal, A. Plaat, R.A.F. Bhoedjang, MagPIe: MPI's collective communication operations for clustered wide area systems, ACM SIGPLAN Notices 34 (8) (1999) 131-140.
24. H.J. Kim, G.-I. Jee, J.G. Lee, Optimal load distribution for tree network processors, IEEE Trans. Aerosp. Electron. Syst. 32 (2) (1996) 607-612.
25. A. Legrand, F. Mazoit, M. Quinson, An Application-Level Network Mapper, Research Report 2003-09, LIP, ENS Lyon, France, February 2003.
26. MPI Forum. MPI: A message passing interface standard, version 1.1. Technical report, University of Tennessee, Knoxville, TN, USA, June 1995.
27. PIP/PipLib. URL 〈http://www.prism.uvsq.fr/cedb/bastools/piplib.html〉.
28. T.G. Robertazzi, Processor equivalence for a linear daisy chain of load sharing processors, IEEE Trans. Aerosp. Electron. Syst. 29 (4) (1993) 1216-1221.
29. R. Wolski, N.T. Spring, J. Hayes, The network weather service: a distributed resource performance forecasting service for metacomputing, Future Gener. Comput. Syst. 15 (5-6) (1999) 757-768.
30. Y. Yang, H. Casanova, A multi-round algorithm for scheduling divisible workload applications: analysis and experimental evaluation, Technical Report CS2002-0721, Department of Computer Science and Engineering, University of California, San Diego, September 2002.