On runtime parallel scheduling for processor load balancing

IEEE Transactions on Parallel and Distributed Systems

Volumn 8, Issue 2, 1997, Pages 173-186

  Wu, Min You ^a,b  

^a IEEE   (United States)

^b the State University of New York   (United States)

Author keywords

Distributed memory computers; Hypercubes; Load balancing; Meshes; Runtime parallel scheduling; Scheduling algorithms; Trees

Indexed keywords

ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC NETWORK TOPOLOGY; PERFORMANCE; PROGRAM PROCESSORS; SCHEDULING;

DISTRIBUTED MEMORY COMPUTERS; MESH NETWORK; PROCESSOR LOAD BALANCING; RUNTIME PARALLEL SCHEDULING; SCHEDULING ALGORITHMS;

PARALLEL PROCESSING SYSTEMS;

EID: 0031076923     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.577261     Document Type: Article

References (35)

1. H. El-Rewini and T.G. Leweis, "Scheduling Parallel Program Tasks onto Arbitrary Target Machines," J. Parallel and Distributed Computing, June 1990.
2. M.Y. Wu and D.D. Gajski, "Hypertool: A Programming Aid for Message-Passing Systems," IEEE Trans. Parallel and Distributed Systems, vol. 1, no. 3, pp. 330-343, July 1990.
3. T. Yang and A. Gerasoulis, "PYRROS: Static Task Scheduling and Code Generation for Message-Passing Machines," Proc. Sixth ACM Int'l Conf. Supercomputing, July 1992.
4. Y.C. Chung and S. Ranka, "Applications and Performance Analysis of a Compile-Time Optimization Approach for List Scheduling Algorithms on Distributed Memory Multiprocessors," Proc. Supercomputer '92, Nov. 1992.
5. D.L. Eager, E.D. Lazowska, and J. Zahorjan, "Adaptive Load Sharing in Homogeneous Distributed Systems," IEEE Trans. Software Eng., vol. 12, no. 5, pp. 662-674, May 1986.
6. D.L. Eager, E.D. Lazowska, and J. Zahorjan, "A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing," Performance Evaluation, vol. 6, no. 1, pp. 53-68, Mar. 1986.
7. N.G. Shivaratri, P. Krieger, and M. Singhal, "Load Distributing for Locally Distributed Systems," Computer, vol. 25, no. 12, pp. 33-44, Dec. 1992.
8. S. Ranka, Y. Won, and S. Sahni, "Programming a Hypercube Multicomputer," IEEE Software, pp. 69-77, Sept. 1988.
9. G. Cybenko, "Dynamic Load Balancing for Distributed Memory Multiprocessors," J. Parallel and Distributed Computing, vol. 7, pp. 279-301, 1989.
10. D.M. Nicol, "Communication Efficient Global Load Balancing," Proc. Scalable High Performance Computing Conf., pp. 292-299, Apr. 1992.
11. W. Shu and M.Y. Yu, "Runtime Incremental Parallel Scheduling (RIPS) on Distributed Memory Computers," IEEE Trans. Parallel and Distributed Systems, vol. 7, no. 6, pp. 637-649, June 1996.
12. I. Ahmad and Y.K. Kwok, "A Parallel Approach to Multiprocessor Scheduling," Int'l Parallel Procesiing Symp., pp. 289-293, Apr. 1995.
13. M.Y. Wu, "An Efficient Parallel Scheduling Algorithm," Proc. IEEE Symp. Parallel and Distributed Processing, Oct. 1996.
14. G.E. Blelloch, Vector Models for Data-Parallel Computing. The MIT Press, 1990.
15. E.L. Lawler, Combinatorial Optimization: Networks and Matroids. Holt, Rinehar and Winston, 1976.
16. M. Willebeek-LeMair and A.P. Reeves, "Strategies for Dynamic Load Balancing on Highly Parallel Computers," IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 9, pp. 979-993, Sept. 1993.
17. S.H. Hosseini, B. Litow, M. Malkawi, J. McPherson, and K. Vairavan, "Analysis of a Graph Coloring Based Distributed Load Balancing Algorithm" J. Parallel and Distributed Computing, vol. 10, pp. 160-166, 1990.
18. Y.K. Kwok and I. Ahmad, "Dynamic Critical-Path Scheduling: An Effective Technique for Allocating Task Graphs to Multiprocessors," IEEE Trans. Parallel and Distributed Systems, vol. 7, no. 5, pp. 506-521, May 1996.
19. J.A. Stankovic, "Simulations of Three Adaptive, Decentralized Controlled, Job Scheduling Algorithms," Computer Networks, vol. 8, no. 3, pp. 199-217, June 1984.
20. T.L. Casavant and J.G. Kuhl, "Analysis of Three Dynamic Distributed Load-Balancing Strategies with Varying Global Information Requirements," Proc. Int'l Conf. Distributed Computing System, pp. 185-192, May 1987.
21. Y.-T. Wang and R.J.T. Morris, "Load Sharing in Distributed Systems," IEEE Trans. Computers, vol. 34, no. 3, pp. 204-217, Mar. 1985.
22. W. Shu, "Adaptive Dynamic Process Scheduling on Distributed Memory Parallel Computers," Scientific Programming, vol. 3, pp. 341-352, 1994.
23. R.D. Blumofe and C.E. Leiserson, "Scheduling Multithreaded Computations by Work Stealing," Proc. 35th Ann. Symp. Foundation of Computer Science, pp. 356-368, Nov. 1994.
24. F.C.H. Lin and R.M. Keller, "The Gradient Model Load Balancing Method," IEEE Software Eng., vol. 13, no. 1, pp. 32-38, Jan. 1987.
25. W.C. Athas, "Fine Grain Concurrent Computations," PhD thesis, Dept. of Computer Science, California Inst. of Technology, May 1987.
26. R.M. Karp and Y. Zhang, "A Randomized Parallel Branch-and-Bound Procedure," J. ACM, vol. 40, pp. 765-789, 1993.
27. S. Chakrabarti, A. Ranade, and K. Yelick, "Randomized Load Balancing for Tree Structured Computation," Proc. IEEE Scalable High Performance Computing Conf., pp. 666-673, 1994.
28. G.C. Fox, M.A. Johnson, G.A. Lyzenga, S.W. Otto, J.K. Salmon, and D.W. Walker, Solving Problems on Concurrent Processors, vol. 1. Prentice Hall, 1988.
29. J.K. Salmon, "Parallel Hierarchical N-Body Methods," Technical Report CRPC-90-14, Center for Research in Parallel Computing, California Inst. of Technology, 1990.
30. K.M. Dragon and J.L. Gustafson, "A Low-Cost Hypercube Load Balance Algorithm," Proc. Fourth Conf. Hypercube Concurrent Computers and Applications, pp. 583-590, 1989.
31. M.J. Berger and S. Bokhari, "A Partitioning Strategy for Non-Uniform Problems on Multiprocessors," IEEE Trans. Computers, vol. 26, pp. 570-580, 1987.
32. S.B. Baden, "Dynamic Load Balancing of a Vortex Calculation Running on Multiprocessors," Technical Report vol. 22584, Lawrence Berkeley Laboratory, 1986.
33. J. Salz, R. Mirchandaney, R. Smith, D. Nicol, and K. Crowley, "The PARTY Parallel Run-Time System," Proc. SIAM Conf. Parallel Processing for Scientific Computing, SIAM, 1987.
34. C.Z. Xu and F.C.M. Lau, "The Generalized Dimension Exchange Method for Load-Balancing in k-Ary n-Cubes and Variants," J. Parallel and Distributed Computing, vol. 24, no. 1, pp. 72-85, Jan. 1995.
35. A. Gerasoulis, J. Jiao, and T. Yang, "Experience with Graph Scheduling for Mapping Irregular Scientific Computation," Proc. First Workshop Solving Irregular Problems on Distributed Memory Machines in Conjunction with Int'l Parallel Processing Symp., pp. 1-8, Apr. 1995.