A novel dynamic load balancing library for cluster computing

Proceedings - ISPDC 2004: Third International Symposium on Parallel and Distributed Computing/HeteroPar '04: Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Hete

Volumn , Issue , 2004, Pages 346-353

  Balasubramaniam, Mahadevan ^b   Barker, Kevin ^c   Banicescu, Ioana ^a,b   Chrisochoides, Nikos ^c   Pabico, Jaderick P ^b   Cariño, Ricolindo L ^b  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b MISSISSIPPI STATE UNIVERSITY   (United States)

^c William and Mary   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER COMPUTING; NETWORK OF WORKSTATIONS (NOW); RUNTIME; WEIGHTED FACTORS;

COMPUTER SOFTWARE; COST EFFECTIVENESS; DISTRIBUTED COMPUTER SYSTEMS; NATURAL SCIENCES COMPUTING; PROBLEM SOLVING; SCHEDULING;

PARALLEL PROCESSING SYSTEMS;

EID: 19644389652     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISPDC.2004.5     Document Type: Conference Paper

References (45)

1. J. P. Singh, "Parallel hierarchical N-body methods and their implications for multiprocessors," Ph.D. dissertation, Stanford University, 1993.
2. M. S. Warren and J. K. Salmon, "A parallel hashed oct tree N-body algorithm," in Proceeding of the 1993 ACM/IEEE Conference on Supercomputing, 1993, pp. 12-21.
3. A. Sohn and H. Simon, "S-HARP: A scalable parallel dynamic partitioner for adaptive mesh-based computations," in Proceedings of the IEEE/SLAM Supercomputing 98 Conference, November 7-13 1998.
4. J. Chen and V. E. Taylor, "Mesh partitioning for distributed systems: Exploring optimal number of partitions with local and remote communication," in Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing (CDROM), March 22-24 1999.
5. K. Schloegel, G. Karypis, and V. Kumar, "Dynamic repartitioning of adaptively refined meshes," in Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing (CDROM), March 22-24 1999.
6. B. Maerten, D. Roose, A. Basermann, J. Fingberg, and G. Lonsdale, "DRAMA: A library tor parallel dynamic load balancing of finite element applications," in Proceedings of 9th SIAM Conference on Parallel Processing for Scientific Computing (CDROM), March 22-24 1999.
7. R. Biswas, S. K. Das, D. Harvey, and L. Oliker, "Portable parallel programming for dynamic load balancing of unstructured grid applications," in Proceedings of 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing, April 12-16 1999, pp. 338-342.
8. S. F. Hummel, E. Schonberg, and L. E. Flynn, "Factoring: A method for scheduling parallel loops," Communications of the ACM, vol. 35, no. 8, pp. 90-101, Aug. 1992.
9. I. Banicescu and S. F. Hummel, "Balancing processor loads and exploiting data locality in n-body simulations," in Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM). ACM Press, 1995.
10. I. Banicescu and R. Lu, "Experiences with fractiling in n-body simulations," in Proceedings of High Performance Computing 98 Symposium, 1998, pp. 121-126.
11. S. F. Hummel, J. Schmidt, R. N. Uma, and J. Wein, "Load-sharing in heterogeneous systems via weighted factoring," in Proceedings of the 8th Annual ACM Symposium on Parallel Algorithms and Architectures, 1996, pp. 318-328.
12. I. Banicescu and V. Velusamy, "Load balancing highly irregular computations with the adaptive factoring," in Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS 2002) - Heterogeneous Computing Workshop. IEEE Computer Society Press, 2002.
13. I. Banicescu, V. Velusamy, and J. Devaprasad, "On the scalability of dynamic scheduling scientific applications with adaptive weighted factoring," Cluster Computing: The Journal of Networks, Software Tools and Applications, vol. 6, no. 3, pp. 215-226, 2003.
14. R. L. Cariño and I. Banicescu, "A load balancing tool for distributed parallel loops," in Proceedings of the International Workshop on Challenges of Large Applications in Distributed Environments. IEEE Computer Society Press, 2003, pp. 39-46.
15. I. Foster, C. Kesselman, and S. Tuecke, "The Nexus task-parallel runtime system," in Proceedings of the 1st International Workshop on Parallel Processing. McGraw-Hill, 1994, pp. 457-462.
16. P. Beckman and D. Cannon, "Tulip: A portable run-time system for object-parallel systems," in Proceedings of the International Parallel Processing Symposium. IEEE Press, 1996.
17. L. V. Kale, M. Bhandarkar, N. Jagathesan, S. Krishnan, and J. Yelon, "Converse: An interoperable framework for parallel programming," in Proceedings of the International Parallel and Distributed Processing Symposium 1996, 1996.
18. L. V. Kale and S. Krishnan, "CHARM++: a portable concurrent object oriented system based on c++," in Proceedings of the OOPSLA '93 Conference on Object-oriented Programming Systems, Languages and Applications, 1993, pp. 91-108.
19. N. Chrisochoides, I. Kodukula, and K. Pingali, "Data movement and control substrate for parallel scientific computing," in Communication, Architecture, and Applications for Network-Based Parallel Computing, 1997, pp. 256-268.
20. K. Barker, N. Chrisochoides, J. Dobbelaere, D. Nave, and K. Pingali, "Data movement and control substrate for parallel adaptive applications," Concurrency: Practice and Experience, vol. 14, pp. 77-101, 2002.
21. N. Chrisochoides, K. Barker, D. Nave, and C. Hawblitzel, "The mobile object layer: A run-time substrate for mobile adaptive and irregular computations," Advances in Engineering Software, vol. 31, no. 8-9, pp. 621-637, 2000.
22. K. Barker and N. Chrisochoides, "An evaluation of a framework for the dynamic load balancing of highly adaptive and irregular parallel applications," in Proceedings of the IEEE/ACM Supercomputing 2003 Conference (CDROM), 2003.
23. K. Barker, "Runtime support for load balancing of parallel adaptive and irregular applications," Ph.D. dissertation, College of William and Mary, 2004.
24. K. Barker, A. Chernikov, N. Chrisochoides, and K. Pingali, "A load balancing framework for adaptive and asynchronous applications," IEEE Trans. on Parallel and Distributed Computing, vol. 15, no. 2, pp. 183-192, 2004.
25. Y. T. Wang and R. J. T. Morris, "Load sharing in distributed systems," IEEE Transactions on Computers, vol. C-34, no. 3, pp. 204-217, Mar. 1985.
26. T. L. Casavant and J. G. Kuhl, "A taxonomy of scheduling in general-purpose distributed computing systems," IEEE Transactions on Software Engineering, vol. 14, no. 2, pp. 141-154, Feb. 1988.
27. N. G. Shivaratri, P. Krueger, and M. Singhal, "Load distributing for locally distributed systems," IEEE Computer, vol. 25, no. 12, pp. 33-44, Dec. 1992.
28. D. L. Eager, E. D. Lazowska, and J. Zahorjan, "Adaptive load sharing in homogeneous distributed systems," IEEE Transactions on Software Engineering, vol. 12, no. 5, pp. 662-675, May 1996.
29. R. Biswas and L. Oliker, "Load balancing unstructured adaptive grids for CFD problems," Proceedings of the 8th SIAM Conference on Parallel Processing for Scientific Computing, 1997.
30. L. Oliker and R. Biswas, "Efficient load balancing and data remapping for adaptive grid calculations," in Proceedings of the 9th Annual ACM Symposium on Parallel Algorithms and Architectures, 1997, pp. 33-42.
31. C. P. Kruskal and A. Weiss, "Allocating independent subtasks on parallel processors," IEEE Transactions on Software Engineering, vol. 11, no. 10, pp. 1001-1016, Oct. 1985.
32. C. D. Polychronopoulos and D. J. Kuck, "Guided self-scheduling: A practical scheduling scheme for parallel supercomputers," IEEE Transactions on Computers, vol. 36, no. 12, pp. 1425-1439, Dec. 1987.
33. T. H. Tzen and L. M. Ni, "Trapezoid self-scheduling: A practical scheduling scheme for parallel computers," IEEE Transactions on Parallel Distributed Systems, vol. 4, no. 1, pp. 87-98, Jan. 1993.
34. E. P. Markatos and T. J. LeBlanc, "Using processor affinity in loop scheduling on shared-memory multiprocessors," IEEE Transactions on Parallel and Distributed Systems, vol. 5, no. 4, pp. 379-400, Apr. 1994.
35. I. Banicescu and Z. Liu, "Adaptive factoring: A dynamic scheduling method timed to the rate of weight changes," in Proceedings of the High Performance Computing Symposium (HPC 2000), 2000, pp. 122-129.
36. R. L. Cariño, I. Banicescu, R. K. Vadapalli, C. A. Weatherford, and J. Zhu, Message Passing Parallel Adaptive Quantum Trajectory Method. Kluwer Academic publishers, 2004, pp. 127-139.
37. L. Rudolph, M. Slivkin-Allalouf, and E. Upfal, "A simple load balancing scheme for task allocation in parallel machines," in Proceedings of the Third Annual ACM Symposium on Parallel Algorithms and Architectures, 1991, pp. 237-245.
38. R. D. Blumofe and C. E. Leiserson, "Scheduling multithreaded computations by work stealing," in Proceedings of Symposium on Foundations of Computer Science, Nov. 1994, pp. 356-368.
39. "Portable runtime system consortium," http://www.cs.uoregon. edu/research/paracomp/ports/.
40. M. Balasubramaniam, "Performance analysis and evaluation of dynamic loop scheduling techniques in a competitive runtime environment for distributed memory architectures," Master's thesis, Mississippi State University, 2003.
41. E. A. Luke, I. Banicescu, and J. Lin, "The optimal effectiveness metric for parallel application analysis," Information Processing Letters-Elsevier, North Holland-Special Issue on Parallel Models, vol. 6, no. 5, pp. 223-229, 1998.
42. A. W. Appel, "An efficient program for many-body simulations," SIAM Journal of Scientific Statistical Computing, vol. 6, no. 1, pp. 85-93, 1985.
43. J. E. Barnes and P. Hut, "A hierarchical O(Nlog(N)) force calculation algorithm," Nature, vol. 324, no. 6096, pp. 446-449, 1986.
44. L. Greengard and V. A. Rokhlin, "A fast algorithm for particle simulation," Journal of Computational Physics, vol. 73, no. 2, pp. 325-348, 1987.
45. R. L. Cariño, "Numerical integration over finite regions using extrapolation by nonlinear sequence transformations," Ph.D. dissertation, La Trobe University, Australia, 1992.