Runtime Incremental Parallel Scheduling (RIPS) on distributed memory computers

IEEE Transactions on Parallel and Distributed Systems

Volumn 7, Issue 6, 1996, Pages 637-649

  Shu, Wei ^a,b   Wu, Min You ^a,b  

^a IEEE

^b the State University of New York   (United States)

Author keywords

Distributed memory computers; Incremental scheduling; Irregular and dynamic applications; Parallel scheduling; Runtime load balancing

Indexed keywords

COMPUTATIONAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; STORAGE ALLOCATION (COMPUTER);

DISTRIBUTED MEMORY COMPUTERS; RUNTIME INCREMENTAL PARALLEL SCHEDULING (RIPS); RUNTIME LOAD BALANCING;

PARALLEL PROCESSING SYSTEMS;

EID: 0030163968     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.506702     Document Type: Article

References (40)

1. J. Salmon, "Parallel Hierarchical N-Body Methods," Technical Report CRPC-90-14, Center for Research in Parallel Computing, Caltech, 1990.
2. K.M. Dragon and J.L. Gustafson, "A Low-Cost Hypercube Load Balance Algorithm," Proc. Fourth Conf. Hypercube Concurrent Com puters and Applications, pp. 583-590, 1989.
3. G. Cybenko, "Dynamic Load Balancing for Distributed Memory Multiprocessors," J. Parallel and Distributed Computing, vol. 7, pp. 279-301, 1989.
4. I. Ahmad and Y. Kwok, "A Parallel Approach to Multiprocessor Scheduling," Proc. Int'l Parallel Processing Symp., pp. 289-293, Apr. 1995.
5. M.Y. Wu, "Parallel Incremental Scheduling," Parallel Processing Letters, 1995.
6. M.Y. Wu and D.D. Gajski, "Hypertool: A Programming Aid for Message-Passing Systems," IEEE Trans. Parallel and Distributed Systems, vol. 1, pp. 330-343, July 1990.
7. H. El-Rewini and T.G. Lewis, "Scheduling Parallel Program Tasks onto Arbitrary Target Machines," J. Parallel and Distributed Computting, June 1990.
8. T. Yang, and A. Gerasoulis, "PYRROS: Static Task Scheduling and Code Generation for Message-Passing Multiprocessors," Proc. Sixth ACM Int'l Conf. Supercomputing, July 1992.
9. Y. Chung and S. Ranka, "Applications and Performance Analysis of a Compile-Time Optimization Approach for List Scheduling Algorithms on Distributed Memory Multiprocessors," Supercomputer '92, Nov. 1992.
10. I. Ahmad, Y. Kwok, and M. Wu, "Performance Comparison of Algorithms for Static Scheduling of DAGs to Multiprocessors," Proc. Second Autralasian Conf. Parallel and Real-Time Systems, Sept. 1995.
11. N.G. Shivaratri, P. Krieger, and M. Singhal, "Load Distributing for Locally Distributed Systems," Computer, vol. 25, no. 12, pp. 33-44, Dec. 1992.
12. D.L. Eager, E.D. Lazowska, and J. Zahorjan, "Adaptive Load Sharing in Homogeneous Distributed Systems," IEEE Trans. Software Eng., vol. 12, pp. 662-674, May 1986.
13. D.L. Eager, E.D. Lazowska, and J. Zahorjan, "A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing," Performance Evaluation, vol. 6, pp. 53-68, Mar. 1986.
14. J.A. Stankovic, "Simulations of Three Adaptive, Decentralized Controlled, Job Scheduling Algorithms," Computer Networks, vol. 8, pp. 199-217, June 1984.
15. T.L. Casavant and J.G. Kuhl, "Analysis of Three Dynamic Distributed Load-Balancing Strategies with Varying Global Information Requirements," Proc. Int'l Conf. Distributed Computing Systems, pp. 185-192, May 1987.
16. Y.-T. Wang and R.J.T. Morris, "Load Sharing in Distributed Systems," IEEE Trans. Computers, vol. 34, no. 3, pp. 204-217, Mar. 1985.
17. Z. Lin, "A Distributed Fair Polling Scheme Applied to Parallel Logic Programming," Int'l J. Parallel Programming, vol. 20, Aug. 1991.
18. W. Shu, "Adaptive Dynamic Process Scheduling on Distributed Memory Parallel Computers," Scientific Programming, vol. 3, pp. 341-352, 1994.
19. M.Y. Wu, "Symmetrical Hopping: A Scalable Scheduling Algorithm on Distributed Memory Machines," Concurrency: Practice and Experience, 1995.
20. M. Willebeek-LeMair and A.P. Reeves, "Strategies for Dynamic Load Balancing on Highly Parallel Computers," IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 9, pp. 979-993, Sept. 1993.
21. F.C.H. Lin and R.M. Keller, "The Gradient Model Load Balancing Method," IEEE Trans. Software Eng., vol. 13, pp. 32-38, Jan. 1987.
22. W.C. Athas, "Fine Grain Concurrent Computations," PhD thesis, Dept. of Computer Science, California Inst. of Technology, May 1987.
23. R.M. Karp and Y. Zhang, "A Randomized Parallel Branch-and-Bound Procedure," J. ACM, vol. 40, pp. 765-789, 1993.
24. S. Chakrabarti, A. Ranade, and K. Yelick, "Randomized Load Balancing for Tree Structured Computation," Proc. IEEE Scalable High Performance Computing Conf., pp. 666-673, 1994.
25. G.C. Fox, M.A. Johnson, G.A. Lyzenga, S.W. Otto, J.K. Salmon, and D.W. Walker, Solving Problems on Concurrent Processors, vol. 1. Prentice Hall, 1988.
26. M. Berger and S. Bokhari, "A Partitioning Strategy for Non-Uniform Problems on Multiprocessors," IEEE Trans. Computers, vol. 26, pp. 570-580, 1987.
27. S.B. Baden, "Dynamic Load Balancing of a Vortex Calculation Running on Multiprocessors," Technical Report vol. 22584, Lawrence Berkeley Lab., 1986.
28. J. Saltz, R. Mirchandaney, R. Smith, D. Nicol, and K. Crowley, "The PARTY Parallel Run-Time System," Proc. SIAM Conf. Parallel Processing for Scientific Computing, 1987.
29. G.C. Sih and E.A. Lee, "A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures," IEEE Trans. Parallel and Distributed Systems, vol. 4, pp. 175-187, Feb. 1993.
30. H. Shen, "Self-Adjusting Mapping: A Heuristic Mapping Algorithm for Mapping Parallel Programs onto Transputer Architectures," The Computer J., vol. 35, pp. 71-80, Feb. 1992.
31. A. Kavianpour, "Systematic Approach for Mapping Application Tasks in Hypercubes," IEEE Trans. Computers, vol. 42, no. 6, pp. 742-746, June 1993.
32. C. Yu and C.R. Das, "Disjoint Task Allocation Algorithm for MIN Machines with Minimal Conflicts," IEEE Trans. Parallel and Distributed Systems, vol. 6, no. 4, pp. 373-387, Apr. 1995.
33. R. Koeninger, M. Furtney, and M. Walker, "A Shared Memory MPP from Cray Research," Digital Technical J., vol. 6, nu. 2, pp. 8-21, 1994.
34. M.Y. Wu, "On Runtime Parallel Scheduling," Technical Report 95-34, Dept. of Computer Science, State Univ. of New York at Buffalo, Apr. 1995.
35. R.E. Korf, "Depth-First Iterative-Deepening: An Optimal Admissible Tree Search," Artificial Intelligence, vol. 27, pp. 97-109, Sept. 1985.
36. V.N. Rao and V. Kumar, "Parallel Depth-First Search, Part I: Implementation," Int'l J. Parallel Programming, vol. 16, no. 6, pp. 479-499, 1987.
37. W.F. van Gunsteren and H.J.C. Berendsen, "GROMOS: GROningen MOlecular Simulation Sofware," technical report, Laboratory of Physical Chemistry, Univ. of Groningen, Nijenborgh, The Netherlands, 1988.
38. R.v. Hanxleden and K. Kennedy, "Relaxing SIMD Control Flow Constraints Using Loop Transformations," Technical Report CRPC-TR92207, Center for Research on Parallel Computation, Rice Univ., Apr. 1992.
39. J. Shen and J.A. McCammon, "Molecular Dynamics Simulation of Superoxide Interacting with Superoxide Dismutase," Chemical Physics, vol. 158, pp. 191-198, 1991.
40. M. Willebeek-LeMair, personal communication, 1995.