Using hybrid MPI and OpenMP programming to optimize communications in parallel loop self-scheduling schemes for multicore PC clusters

Journal of Supercomputing

Volumn 60, Issue 1, 2012, Pages 31-61

  Wu, Chao Chin ^a   Lai, Lien Fu ^a   Yang, Chao Tung ^b   Chiu, Po Hsun ^a  

^a NATIONAL CHANGHUA UNIVERSITY OF EDUCATION   (Taiwan)

^b TUNGHAI UNIVERSITY   (Taiwan)

Author keywords

Cluster computing; Hybrid programming; MPI programming; Multicore architecture; OpenMP programming; Parallel loop scheduling

Indexed keywords

COMMUNICATION OVERHEADS; COMPUTING NODES; HETEROGENEOUS CLUSTERS; HYBRID PROGRAMMING; INTER-NODE COMMUNICATION; MPI PROCESS; MULTI CORE; MULTICORE ARCHITECTURES; PARALLEL LOOPS; PC CLUSTERS; PROCESSOR CORES; PROGRAMMING MODELS; SECOND LEVEL; SELF-SCHEDULING; SHARED MEMORIES;

APPLICATION PROGRAMMING INTERFACES (API); CLUSTER COMPUTING; COMMUNICATION; CORE LEVELS; OPTIMIZATION; SOFTWARE ARCHITECTURE;

MULTICORE PROGRAMMING;

EID: 84858079019     PISSN: 09208542     EISSN: 15730484     Source Type: Journal    
DOI: 10.1007/s11227-009-0271-z     Document Type: Article

References (22)

1. M Baker R Buyya 1999 Cluster computing: the commodity supercomputer Int J Softw Pract Exp 29 6 551 575 10.1002/(SICI)1097-024X(199905)29:6<551::AID- SPE248>3.0.CO;2-C
2. O Beaumont H Casanova A Legrand Y Robert Y Yang 2005 Scheduling divisible loads on star and tree networks: results and open problems IEEE Trans Parallel Distrib Syst 16 207 218 10.1109/TPDS.2005.35 (Pubitemid 40351818)
3. Bennett BH, Davis E, Kunau T, Wren W (2000) Beowulf parallel processing for dynamic loadbalancing. In: Proceedings of IEEE aerospace conference, 2000, vol 4, pp 389-395 (Pubitemid 32838172)
4. CA Bohn GB Lamont 2002 Load balancing for heterogeneous clusters of PCs Future Gener Comput Syst 18 389 400 10.1016/S0167-739X(01)00058-9 (Pubitemid 33034524)
5. Cheng K-W, Yang C-T, Lai C-L, Chang S-C (2004) A parallel loop self-scheduling on grid computing environments. In: Proceedings of the 2004 IEEE international symposium on parallel architectures, algorithms and networks, KH, China, May 2004, pp 409-414
6. Chronopoulos AT, Andonie R, Benche M, Grosu D (2001) A class of loop self-scheduling for heterogeneous clusters. In: Proceedings of the 2001 IEEE international conference on cluster computing, 2001, pp 282-291
7. He Y, Ding HQ (2002) MPI and OpenMP paradigms on cluster of SMP architectures: the vacancy tracking algorithm for multi-dimensional array transposition. In: Proceedings of the 2002 ACM/IEEE conference on supercomputing, 2002, pp 1-14
8. SF Hummel E Schonberg LE Flynn 1992 Factoring: a method scheme for scheduling parallel loops Commun ACM 35 90 101 10.1145/135226.135232
9. Introduction to the Mandelbrot set (2008) http://www.ddewey.net/ mandelbrot/
10. Li H, Tandri S, Stumm M, Sevcik KC (1993) Locality and loop scheduling on NUMA multiprocessors. In: Proceedings of the 1993 international conference on parallel processing, vol II, 1993, pp 140-147
11. CD Polychronopoulos D Kuck 1987 Guided self-scheduling: a practical scheduling scheme for parallel supercomputers IEEE Trans Comput 36 12 1425 1439 10.1109/TC.1987.5009495 (Pubitemid 18537642)
12. Post E, Goosen HA (2001) Evaluation the parallel performance of a heterogeneous system. In: Proceedings of 5th international conference and exhibition on high-performance computing in the Asia-Pacific region (HPC Asia 2001)
13. Rosenberg R, Norton G, Novarini JC, Anderson W, Lanzagorta M (2006) Modeling pulse propagation and scattering in a dispersive medium: performance of MPI/OpenMP hybrid code. In: Proceedings of the ACM/IEEE conference on supercomputing, 2006, pp 47-47
14. W-C Shih C-T Yang S-S Tseng 2007 A performance-based parallel loop scheduling on grid environments J Supercomput 41 3 247 267 10.1007/s11227-007- 0115-7 (Pubitemid 47115201)
15. Sterling T, Bell G, Kowalik JS (2002) Beowulf cluster computing with Linux. MIT Press, Cambridge
16. Tang P, Yew PC (1986) Processor self-scheduling for multiple-nested parallel loops. In: Proceedings of the 1986 international conference on parallel processing, 1986, pp 528-535 (Pubitemid 17486447)
17. The Scalable Computing Laboratory (SCL) (2008) http://www.scl.ameslab. gov/
18. TH Tzen LM Ni 1993 Trapezoid self-scheduling: a practical scheduling scheme for parallel compilers IEEE Trans Parallel Distrib Syst 4 87 98 10.1109/71.205655
19. C-T Yang S-C Chang 2004 A parallel loop self-scheduling on extremely heterogeneous PC clusters J Inf Sci Eng 20 2 263 273
20. C-T Yang K-W Cheng K-C Li 2005 An enhanced parallel loop self-scheduling scheme for cluster environments J Supercomput 34 3 315 335 10.1007/s11227-005- 0787-9 (Pubitemid 41312627)
21. Yang C-T, Cheng K-W, Shih W-C (2007) On development of an efficient parallel loop self-scheduling for grid computing environments. Parallel Comput 33(7-8):467-487 (Pubitemid 47077514)
22. C-T Yang W-C Shih S-S Tseng 2008 Dynamic partitioning of loop iterations on heterogeneous PC clusters J Supercomput 44 1 1 23 10.1007/s11227-007-0146-0 (Pubitemid 351665232)