Developing SPMD applications with load balancing

Parallel Computing

Volumn 29, Issue 6, 2003, Pages 743-766

  Plastino, A ^a   Ribeiro, C C ^b   Rodriguez, N ^b  

^a FLUMINENSE FEDERAL UNIVERSITY   (Brazil)

^b PONTIFICAL CATHOLIC UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Data parallelism; Frameworks; Load balancing; Parallel algorithms; SPMD

Indexed keywords

COMPUTER PROGRAM LISTINGS; DATA REDUCTION; GENETIC ALGORITHMS; INTEGRATION; MATRIX ALGEBRA; PARALLEL ALGORITHMS; PROGRAM PROCESSORS;

LOAD BALANCING;

COMPUTER SCIENCE;

EID: 0038823829     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8191(03)00060-7     Document Type: Article

References (41)

1. J.N.C. Árabe, C.D. Murta, Auto-balanceamento de carga em programas paralelos, in: Proceedings of the VIII Brazilian Symposium on Computer Architecture and High Performance Processing, 1996, pp. 161-171.
2. A.C.B. de Andrade Filho, Optimizing hydrocarbon field development using a genetic algorithm based approach, Ph.D. Dissertation, Department of Petroleum Engineering, Stanford University, 1997.
3. Booch G. Object-Oriented Analysis and Design with Applications. 1994;Benjamim/Cummings.
4. Booch G., Rumbaugh J. Unified Method. 1996;Rational Software Corporation.
5. G. Burns, R. Daoud, Robust MPI message delivery through guaranteed resources, in: MPI Developers Conference, University of Notre Dame, 1995 (online document at 〈 http://www.mpi.nd.edu/downloads/mpidc95/papers/html/burns/ 〉, last visited on July 22, 2001).
6. Colajanni M., Cermele M. DAME: an environment for preserving the efficiency of data-parallel computations on distributed systems. IEEE Concurrency. 5:1997;41-55.
7. Crivelli S., Jessup E.R. The PMESC programming library for distributed-memory MIMD computers. Journal of Parallel and Distributed Computing. 57:1999;295-321.
8. Casavant T.L., Kuhl J.G. A taxonomy of scheduling in general-purpose distributed computing systems. IEEE Transactions on Software Engineering. 14:1988;141-154.
9. Cung V.-D., Martins S.L., Ribeiro C.C., Roucairol C. Strategies for the parallel implementation of metaheuristics. Ribeiro C.C., Hansen P. Essays and Surveys in Metaheuristics. 2001;263-308 Kluwer Academic Publishers.
10. Decker T. Virtual data space - a universal load balancing scheme. Lecture Notes in Computer Science. 1253:1997;159-166.
11. Dijkstra E., Seijen W., Gasteren A. Derivation of a termination detection algorithm for a distributed computation. Information Processing Letters. 16:1983;217-219.
12. Eager D.L., Lazowska E.D., Zahorjan J. Adaptive load sharing in homogeneous distributed systems. IEEE Transactions on Software Engineering. SE-12:1986;662-675.
13. Franklin M.A., Govindan V. A general matrix iterative model for dynamic load balancing. Parallel Computing. 22:1996;969-989.
14. Fonlupt C., Marquet P., Dekeyser J. Data-parallel load balancing strategies. Parallel Computing. 24:1998;1665-1684.
15. Foster I., Kesselman C., Tuecke S. The anatomy of the grid: enabling scalable virtual organizations. International Journal of Supercomputer Applications. 15(3):2001;200-222.
16. M. Furuichi, K. Taki, N. Ichiyoshi, A multi-level load balancing scheme for or-parallel exhaustive search programs on the multi-psi, in: Proceedings of the Second ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 1990, pp. 50-59.
17. Gamma E., Helm R., Johnson R., Vlissides J. Design Pattern - Elements of Reusable Object Oriented Software. 1994;Addison-Wesley.
18. W. George, Dynamic load balancing for data-parallel MPI programs, in: Proceedings of Message Passing Interface Developer's and User's Conference (MPIDC'99), 1999, pp. 95-100.
19. Guil N., Zapata E.L. Fast Hough transform on multiprocessors: a branch and bound approach. Journal of Parallel and Distributed Computing. 45:1997;82-89.
20. Holland J.H. Adaptation in Natural and Artificial Systems. 1975;University of Michigan Press.
21. Jacobson I., Christerson M., Jonsson P., Overgaard G. Object-oriented Software Engineering - A Use Case Driven Approach. 1992;Addison-Wesley.
22. Kumar V., Grama A., Gupta A., Karypis G. Introduction to Parallel Computing: Design and Analysis of Parallel Algorithms. 1994;Benjamin/Cummings.
23. Kaddoura M., Ranka S. Runtime support for parallelization of data-parallel applications on adaptive and nonuniform computational environment. Journal of Parallel and Distributed Computing. 43:1997;163-168.
24. Lee G., Lee H., Cho J. A prediction-based adaptive location policy for distributed load balancing. Journal of Systems Architecture. 42:1996;1-18.
25. Lifschitz S., Plastino A., Ribeiro C.C. Exploring load balancing in parallel processing of recursive queries. Lecture Notes in Computer Science. 1300:1997;1125-1129.
26. Mattson T.G. Scientific computation. Zomaya A.Y. Parallel and Distributed Computing Handbook. 1996;981-1002 McGraw-Hill.
27. Message Passing Interface Forum MPI: a message passing interface. Proceedings of Supercomputing'93. 1993;878-883 IEEE Computer Society.
28. S. Orlando, R. Perego, Scheduling data-parallel computations on heterogeneous and time-shared environments, in: Proceedings of Euro-Par'98, 1998, pp. 356-366.
29. Porto S.C., Kitajima J.P., Ribeiro C.C. Performance evaluation of a parallel tabu search task scheduling algorithm. Parallel Computing. 26:2000;73-90.
30. Porto S.C., Ribeiro C.C. Parallel tabu search message-passing synchronous strategies for task scheduling under precedence constraints. Journal of Heuristics. 1:1995;207-223.
31. A. Plastino, Balanceamento de carga de aplicações paralelas SPMD, Doctorate Thesis, Department of Computer Science, Catholic University of Rio de Janeiro, 2000.
32. Plastino A., Ribeiro C.C., Rodriguez N. A tool for SPMD application development with support for load balancing. D'Hollander E.H., Joubert G.R., Peters F.J., Sips H.J. Proceedings of the International Conference ParCo'99. 2000;639-646 Imperial College Press.
33. A. Plastino, C.C. Ribeiro, N. Rodriguez, A framework for SPMD applications with load balancing, in: Proceedings of the 12th Symposium on Computer Architecture and High Performance Computing (SBAC-PAD'2000), São Pedro, 2000, pp. 245-252.
34. Pree W. Design Patterns for Object-oriented Software Development. 1995;Addison-Wesley.
35. Pree W. Framework Patterns. 1996;SIG Books and Multimedia.
36. Quinn M.J. Parallel Computing: Theory and Practice. 1994;McGraw-Hill.
37. Rumbaugh J., Blaha M., Premerlani W., Eddy F., Lorensen W. Object-oriented Modeling and Design. 1991;Prentice-Hall.
38. V. Thomé, D. Vianna, R. Costa, A. Plastino, O.T. da Silveira Filho, Exploring load balancing in a scientific SPMD parallel application, in: Proceedings of the 4th International Workshop on High Performance Scientific and Engineering Computing (HPSECA2002) in conjunction with the 31th International Conference on Parallel Processing (ICPP2002), 2002, pp. 419-426.
39. Weissman J.B. Prophet: automated scheduling of SPMD programs in workstation networks. Concurrency: Practice and Experience. 11:1999;301-321.
40. Willebeek-LeMair M.A., Reeves A.P. Strategies for dynamic load balancing on highly parallel computers. IEEE Transactions on Parallel and Distributed Systems. 4:1993;979-993.
41. Zaki M.J., Li W., Parthasarathy S. Customized dynamic load balancing for a network of workstations. Journal of Parallel and Distributed Computing. 43:1997;156-162.