Two-tree algorithms for full bandwidth broadcast, reduction and scan

Parallel Computing

Volumn 35, Issue 12, 2009, Pages 581-594

  Sanders, Peter ^a   Speck, Jochen ^a   Träff, Jesper Larsson ^b  

^a UNIVERSITY OF KARLSRUHE   (Germany)

^b NEC LABORATORIES EUROPE   (Germany)

Author keywords

Bipartite edge coloring; Broadcast; Message passing parallel programming; Parallel prefix (scan); Reduction

Indexed keywords

BROADCAST; BROADCAST MESSAGES; EDGE COLORING; PARALLEL PREFIX; PARALLEL PREFIX (SCAN);

ALGORITHMS; BANDWIDTH; BINARY TREES; COLORING; MESSAGE PASSING; TERMINOLOGY;

PARALLEL PROGRAMMING;

EID: 71549164097     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2009.09.001     Document Type: Article

References (24)

1. Bar-Noy A., and Kipnis S. Broadcasting multiple messages in simultaneous send/receive systems. Discrete Applied Mathematics 55 2 (1994) 95-105
2. Bar-Noy A., Kipnis S., and Schieber B. Optimal multiple message broadcasting in telephone-like communication systems. Discrete Applied Mathematics 100 1-2 (2000) 1-15
3. M. Barnett, S. Gupta, D.G. Payne, L. Schuler, R. van de Geijn, J. Watts, Building a high-performance collective communication library, in: Supercomputing'94, 1994, pp. 107-116.
4. E.W. Chan, M.F. Heimlich, A. Purkayastha, R.A. van de Geijn, On optimizing collective communication, in: Cluster 2004, 2004.
5. Gropp W., Lusk E., Doss N., and Skjellum A. A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22 6 (1996) 789-828
6. H.H. Happe, B. Vinter, Improving TCP/IP multicasting with message segmentation, in: Communicating Process Architectures (CPA 2005), 2005.
7. Hillis W.D., and Steele J.GuyL. Data parallel algorithms. Communications of the ACM 29 12 (1986) 1170-1183
8. JáJá J. An Introduction to Parallel Algorithms (1992), Addison-Wesley
9. Jia B. Process cooperation in multiple message broadcast. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 14th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4757 (2007), Springer-Verlag 27-35
10. Johnsson S.L., and Ho C.-T. Optimum broadcasting and personalized communication in hypercubes. IEEE Transactions on Computers 38 9 (1989) 1249-1268
11. T. Kieritz, Doppelte Fibonacchi-Bäume, Unpublished manuscript, Universität Karlsruhe, 2008.
12. Kwon O.-H., and Chwa K.-Y. Multiple message broadcasting in communication networks. Networks 26 (1995) 253-261
13. Mayr E.W., and Plaxton C.G. Pipelined parallel prefix computations, and sorting on a pipelined hypercube. Journal of Parallel and Distributed Computing 17 (1993) 374-380
14. Pješivac-Grbović J., Angskun T., Bosilca G., Fagg G.E., Gabriel E., and Dongarra J. Performance analysis of MPI collective operations. Cluster Computing 10 2 (2007) 127-143
15. Rabenseifner R., and Träff J.L. More efficient reduction algorithms for message-passing parallel systems. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 11th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 3241 (2004), Springer-Verlag 36-46
16. H. Ritzdorf, J.L. Träff, Collective operations in NEC's high-performance MPI libraries, in: International Parallel and Distributed Processing Symposium (IPDPS 2006), 2006, p. 100.
17. Sanders P., and Sibeyn J.F. A bandwidth latency tradeoff for broadcast and reduction. Information Processing Letters 86 1 (2003) 33-38
18. Sanders P., and Träff J.L. Parallel prefix (scan) algorithms for MPI. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 13th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4192 (2006), Springer-Verlag 49-57
19. Santos E.E. Optimal and near-optimal algorithms for k-item broadcast. Journal of Parallel and Distributed Computing 57 2 (1999) 121-139
20. Snir M., Otto S., Huss-Lederman S., Walker D., and Dongarra J. MPI - The Complete Reference. The MPI Core. second ed. vol. 1 (1998), MIT Press
21. Thakur R., Gropp W.D., and Rabenseifner R. Improving the performance of collective operations in MPICH. International Journal on High Performance Computing Applications 19 (2004) 49-66
22. Träff J.L. A simple work-optimal broadcast algorithm for message-passing parallel systems. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 11th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 3241 (2004), Springer-Verlag 173-180
23. Träff J.L., and Ripke A. Optimal broadcast for fully connected processor-node networks. Journal of Parallel and Distributed Computing 68 7 (2008) 887-901
24. van de Geijn R. On global combine operations. Journal of Parallel and Distributed Computing 22 (1994) 324-328