Design and implementation of a novel dynamic load balancing library for cluster computing

Parallel Computing

Volumn 31, Issue 7, 2005, Pages 736-756

  Banicescu, Ioana ^a,b   Cariño, Ricolindo L ^b   Pabico, Jaderick P ^a,b,c   Balasubramaniam, Mahadevan ^b  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b MISSISSIPPI STATE UNIVERSITY   (United States)

^c UNIVERSITY OF THE PHILIPPINES LOS BAÑOS   (Philippines)

Author keywords

Cluster computing; Dynamic load balancing library; Run time system

Indexed keywords

ALGORITHMS; OPTIMIZATION; PROBLEM SOLVING; PROGRAM PROCESSORS; SCHEDULING; STORAGE ALLOCATION (COMPUTER);

CLUSTER COMPUTING; DYNAMIC LOAD BALANCING LIBRARY; RUN TIME SYSTEMS; SHARED MEMORY PROCESSORS (SMP);

PARALLEL PROCESSING SYSTEMS;

EID: 22144442837     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2005.04.006     Document Type: Conference Paper

References (43)

1. J.P. Singh, Parallel hierarchical N-body methods and their implications for multiprocessors, Ph.D. thesis, Stanford University, 1993.
2. M.S. Warren, J.K. Salmon, A parallel hashed oct tree N-body algorithm, in: Proceedings of the 1993 ACM/IEEE Conference on Supercomputing, 1993, pp. 12-21.
3. A. Sohn, and H. Simon S-harp: a scalable parallel dynamic partitioner for adaptive mesh-based computations Supercomputing '98: Proceedings of the 1998 ACM/IEEE Conference on Supercomputing 1998 IEEE Computer Society p. (CDROM)
4. J. Chen, V.E. Taylor, Mesh partitioning for distributed systems: exploring optimal number of partitions with local and remote communication, in: Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing, 1999, p. (CDROM).
5. K. Schloegel, G. Karypis, V. Kumar, Dynamic repartitioning of adaptively refined meshes, in: Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing, 1999, p. (CDROM).
6. B. Maerten, D. Roose, A. Basermann, J. Fingberg, G. Lonsdale, DRAMA: a library for parallel dynamic load balancing of finite element applications, in: Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing, 1999, p. (CDROM).
7. R. Biswas, S.K. Das, D. Harvey, L. Oliker, Portable parallel programming for dynamic load balancing of unstructured grid applications, in: Proceedings of 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing, 1999, pp. 338-342.
8. S.F. Hummel, E. Schonberg, and L.E. Flynn Factoring: a method for scheduling parallel loops Communications of the ACM 35 8 1992 90 101
9. I. Banicescu, and S.F. Hummel Balancing processor loads and exploiting data locality in n-body simulations Proceedings of the 1995 ACM/IEEE Conference on Supercomputing 1995 ACM Press p. (CDROM)
10. I. Banicescu, R. Lu, Experiences with fractiling in n-body simulations, in: Proceedings of High Performance Computing 98 Symposium, 1998, pp. 121-126.
11. S.F. Hummel, J. Schmidt, R.N. Uma, J. Wein, Load-sharing in heterogeneous systems via weighted factoring, in: Proceedings of the 8th Annual ACM Symposium on Parallel Algorithms and Architectures, 1996, pp. 318-328.
12. I. Banicescu, V. Velusamy, Load balancing highly irregular computations with the adaptive factoring, in: Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS 2002)-Heterogeneous Computing Workshop, IEEE Computer Society Press, 2002, p. (CDROM).
13. I. Banicescu, V. Velusamy, and J. Devaprasad On the scalability of dynamic scheduling scientific applications with adaptive weighted factoring Cluster Computing: The Journal of Networks, Software Tools and Applications 6 3 2003 215 226
14. R.L. Cariño, I. Banicescu, R.K. Vadapalli, C.A. Weatherford, J. Zhu, Parallel adaptive quantum trajectory method for wavepacket simulations, in: Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS 2003)-PDSECA Workshop, IEEE Computer Society Press, 2003, p. (CDROM).
15. I. Foster, C. Kesselman, S. Tuecke, The Nexus task-parallel runtime system, in: Proceedings of the 1st International Workshop on Parallel Processing, McGraw-Hill, 1994, pp. 457-462.
16. P.H. Beckman, and D. Gannon Tulip: a portable run-time system for object-parallel systems IPPS '96: Proceedings of the 10th International Parallel Processing Symposium 1996 IEEE Computer Society 532 536
17. L.V. Kale, M.A. Bhandarkar, N. Jagathesan, S. Krishnan, and J. Yelon Converse: an interoperable framework for parallel programming IPPS '96: Proceedings of the 10th International Parallel Processing Symposium 1996 IEEE Computer Society 212 217
18. L.V. Kale, and S. Krishnan Charm++: a portable concurrent object oriented system based on c++ OOPSLA '93: Proceedings of the Eighth Annual Conference on Object-Oriented Programming Systems, Languages, and Applications 1993 ACM Press 91 108
19. N. Chrisochoides, I. Kodukula, K. Pingali, Data movement and control substrate for parallel scientific computing, in: Communication, Architecture, and Applications for Network-Based Parallel Computing, 1997, pp. 256-268.
20. K. Barker, N. Chrisochoides, J. Dobbelaere, D. Nave, and K. Pingali Data movement and control substrate for parallel adaptive applications Concurrency: Practice and Experience 14 2002 77 101
21. N. Chrisochoides, K. Barker, D. Nave, and C. Hawblitzel The mobile object layer: a run-time substrate for mobile adaptive and irregular computations Advances in Engineering Software 31 8-9 2000 621 637
22. K. Barker, N. Chrisochoides, An evaluation of a framework for the dynamic load balancing of highly adaptive and irregular parallel applications, in: Proceedings of the IEEE/ACM Supercomputing 2003 Conference, 2003, p. (CDROM).
23. K. Barker, Runtime support for load balancing of parallel adaptive and irregular applications, Ph.D. thesis, College of William and Mary, 2004.
24. K. Barker, A. Chernikov, N. Chrisochoides, and K. Pingali A load balancing framework for adaptive and asynchronous applications IEEE Transactions on Parallel and Distributed Computing 15 2 2004 183 192
25. Y.T. Wang, and R.J.T. Morris Load sharing in distributed systems IEEE Transactions on Computers C-34 3 1985 204 217
26. T.L. Casavant, and J.G. Kuhl A taxonomy of scheduling in general-purpose distributed computing systems IEEE Transactions on Software Engineering 14 2 1988 141 154
27. N.G. Shivaratri, P. Krueger, and M. Singhal Load distributing for locally distributed systems IEEE Computer 25 12 1992 33 44
28. D.L. Eager, E.D. Lazowska, and J. Zahorjan Adaptive load sharing in homogeneous distributed systems IEEE Transactions on Software Engineering 12 5 1996 662 675
29. R. Biswas, L. Oliker, Load balancing unstructured adaptive grids for CFD problems, in: Proceedings of the 8th SIAM Conference on Parallel Processing for Scientific Computing.
30. L. Oliker, R. Biswas, Efficient load balancing and data remapping for adaptive grid calculations, in: Proceedings of the 9th Annual ACM Symposium on Parallel Algorithms and Architectures, 1997, pp. 33-42.
31. C.P. Kruskal, and A. Weiss Allocating independent subtasks on parallel processors IEEE Transactions on Software Engineering 11 10 1985 1001 1016
32. C.D. Polychronopoulos, and D.J. Kuck Guided self-scheduling: a practical scheduling scheme for parallel supercomputers IEEE Transactions on Computers 36 12 1987 1425 1439
33. T.H. Tzen, and L.M. Ni Trapezoid self-scheduling: a practical scheduling scheme for parallel computers IEEE Transactions on Parallel Distributed Systems 4 1 1993 87 98
34. E.P. Markatos, and T.J. LeBlanc Using processor affinity in loop scheduling on shared-memory multiprocessors IEEE Transactions on Parallel and Distributed Systems 5 4 1994 379 400
35. I. Banicescu, Z. Liu, Adaptive factoring: a dynamic scheduling method tuned to the rate of weight changes, in: Proceedings of the High Performance Computing Symposium (HPC 2000), 2000, pp. 122-129.
36. R.L. Cariño, I. Banicescu, R.K. Vadapalli, C.A. Weatherford, and J. Zhu Message passing parallel adaptive quantum trajectory method L.T. Yang Y. Pan High Performance Scientific and Engineering Computing: Hardware/Software Support 2004 Kluwer Academic publishers 127 139
37. L. Rudolph, M. Slivkin-Allalouf, E. Upfal, A simple load balancing scheme for task allocation in parallel machines, in: Proceedings of the Third Annual ACM Symposium on Parallel Algorithms and Architectures, 1991, pp. 237-245.
38. R.D. Blumofe, C.E. Leiserson, Scheduling multithreaded computations by work stealing, in: Proceedings of Symposium on Foundations of Computer Science, 1994, pp. 356-368.
39. Portable runtime system consortium. URL http://www.cs.uoregon.edu/ research/paracomp/ports.
40. A.W. Appel An efficient program for many-body simulations SIAM Journal of Scientific Statistical Computing 6 1 1985 85 93
41. J.E. Barnes, and P. Hut A hierarchical O(Nlog(N)) force calculation algorithm Nature 324 6096 1986 446 449
42. L. Greengard, and V.A. Rokhlin A fast algorithm for particle simulation Journal of Computational Physics 73 2 1987 325 348
43. R.L. Cariño, Numerical integration over finite regions using extrapolation by nonlinear sequence transformations, Ph.D. thesis, La Trobe University, Australia, 1992.