Distributed loop-scheduling schemes for heterogeneous computer systems

Concurrency and Computation: Practice and Experience

Volumn 18, Issue 7, 2006, Pages 771-785

  Chronopoulos, Anthony T ^a   Penmatsa, Satish ^a   Xu, Jianhua ^b   Ali, Siraj ^a  

^a University of Texas at San Antonio   (United States)

^b NOKIA RESEARCH CENTER   (United States)

Author keywords

Heterogeneous distributed systems; Loop scheduling; Master slave model

Indexed keywords

MATHEMATICAL MODELS; MULTIPROCESSING PROGRAMS; PARALLEL PROCESSING SYSTEMS; SCHEDULING;

CONCURRENT PROGRAMMING; HETEROGENEOUS DISTRIBUTED SYSTEMS; LOOP SCHEDULING; MASTER-SLAVE MODEL;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33646841658     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.960     Document Type: Article

References (25)

1. Fann YW, Yang CT, Tseng SS, Tsai CJ. An intelligent parallel loop scheduling for parallelizing compilers. Journal of Information Science and Engineering 2000; 16:169-200.
2. Bull JM. Feedback guided dynamic loop scheduling: Algorithms and experiments. Proceedings of the 4th International Euro-Par Conference, Southampton, U.K., 1998 (Lecture Notes in Computer Science, vol. 1470). Springer: Berlin, 1998; 377-382.
3. Hancock DJ, Bull JM, Ford RW, Freeman TL. An investigation of feedback guided dynamic scheduling of nested loops. Proceedings of the International Workshops on Parallel Processing, Toronto, Canada, August 2000, Sadayappan P (ed.). IEEE Press: Piscataway, NJ, 2000; 315-321.
4. Banicescu I, Liu Z. Adaptive factoring: A dynamic scheduling method tuned to the rate of weight changes. Proceedings of the High Performance Computing Symposium 2000, Washington, DC, 2000. The Society for Modeling and Simulation International (SCS): San Diego, CA, 2000; 122-129.
5. Banicescu I, Velusamy V, Devaprasad J. On the scalability of dynamic scheduling scientific applications with adaptive weighted factoring. Cluster Computing 2003; 6:215-226.
6. Barbosa J, Tavares J, Padilha AJ. Linear algebra algorithms in a heterogeneous cluster of personal computers. Proceedings of the 9th Heterogeneous Computing Workshop (HCW 2000), Cancun, Mexico, May 2000. IEEE Computer Society Press: Los Alamitos, CA, 2000; 147-159.
7. Cierniak M, Li W, Zaki MJ. Loop scheduling for heterogeneity. Proceedings of the 4th IEEE International Symposium on High Performance Distributed Computing, Washington, DC, August 1995. IEEE Computer Society Press: Los Alamitos, CA, 1995; 78-85.
8. Chronopoulos AT, Andonie R, Benche M, Grosu D. A class of distributed self-scheduling schemes for heterogeneous clusters. Proceedings of the 3rd IEEE International Conference on Cluster Computing (CLUSTER 2001), Newport Beach, CA, 8-11 October 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001.
9. Dandamudi SP. The effect of scheduling discipline on dynamic load sharing in heterogeneous distributed systems. Proceedings of the 5th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS'97), Haifa, Israel, January 1997. IEEE Press: Piscataway, NJ, 1997.
10. Dandamudi SP, Thyagaraj TK. A hierarchical processor scheduling policy for distributed-memory multicomputer systems. Proceedings of the 4th International Conference on High-Performance Computing 1997; 218-223.
11. Goumas G, Drosinos N, Athanasaki M, Koziris N. Compiling tiled iteration spaces for clusters. Proceedings of the IEEE International Conference on Cluster Computing, Chicago, IL, 2002. IEEE Computer Society Press: Los Alamitos, CA, 2002; 360-369.
12. Hummel SF, Schmidt J, Uma RN, Wein J. Load-sharing in heterogeneous systems via weighted factoring. Proceedings of the 8th Annual ACM Symposium on Parallel Algorithms and Architectures, Padua, Italy, 1996. ACM Press: New York, 1996; 318-328.
13. Kee Y, Ha S. A robust dynamic load-balancing scheme for data parallel application on message passing architecture. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'98), vol. 2, Las Vegas, NM, 1998. CSREA Press: Athens, GA, 1998; 974-980.
14. Kim TH, Purtilo JM. Load balancing for parallel loops in workstation clusters. Proceedings of the International Conference on Parallel Processing, vol. III, Bloomingdale, IL, 1996. IEEE Press: Piscataway, NJ, 1996; 182-190.
15. Markatos EP, LeBlanc TJ. Using processor affinity in loop scheduling on shared-memory multiprocessors. IEEE Transactions on Parallel and Distributed Systems 1994; 5(4):379-400.
16. Philip T, Das CR. Evaluation of loop scheduling algorithms on distributed memory systems. Proceedings of the International Conference on Parallel and Distributed Computing Systems, Washington, DC, 13-16 October 1997. IASTED: Calgary, AB, 1997.
17. Yan Y, Jin C, Zhang X. Adaptively scheduling parallel loops in distributed shared-memory systems. IEEE Transactions on Parallel and Distributed Systems 1997; 8(1):70-81.
18. Yang CT, Chang SC. A parallel loop self-scheduling on extremely heterogeneous PC clusters. Proceedings of the International Conference on Computational Science (ICCS 2003), Melbourne, Australia and St. Petersburg, Russia, 2003 (Lecture Notes in Computer Science, vol. 2660). Springer: Berlin, 2003; 1079-1088.
19. Xu J, Chronopoulos AT. Distributed self-scheduling for heterogeneous workstation clusters. Proceedings of the 12th International Conference on Parallel and Distributed Computing Systems, Fort Lauderdale, FL, 18-20 August 1999. ISCA: Cary, NC, 1999; 211-217.
20. Tzen TH, Ni LM. Trapezoid self-scheduling: A practical scheduling scheme for parallel compilers. IEEE Transactions on Parallel and Distributed Systems 1993; 4(1):87-98.
21. Mandelbrot BB. Fractal Geometry of Nature. W. H. Freeman: New York, 1988.
22. Wolfe M. High Performance Compilers for Parallel Computing. Addison-Wesley: Reading, MA, 1996.
23. Polychronopoulos CD, Kuck D. Guided self-scheduling: A practical scheduling scheme for parallel supercomputers. IEEE Transactions on Computers 1987; 36:1425-1439.
24. Freeman TL, Hancock DJ, Bull JM, Ford RW. Feedback guided scheduling of nested loops. Proceedings of the 5th International Applied Parallel Computing (PARA) Workshop, Bergen, Norway, 2000 (Lecture Notes in Computer Science, vol. 1947). Springer: Berlin, 2001; 149-159.
25. Pachecho P. Parallel Programming with MPI. Morgan Kaufmann: San Mateo, CA, 1997.