Optimal broadcast for fully connected processor-node networks

Journal of Parallel and Distributed Computing

Volumn 68, Issue 7, 2008, Pages 887-901

  Träff, Jesper Larsson ^a   Ripke, Andreas ^a  

^a NEC LABORATORIES EUROPE   (Germany)

Author keywords

Bidirectional communication model; Broadcast; Fully connected communication network; MPI (Message Passing Interface); SMP cluster

Indexed keywords

GRAPH THEORY; MESSAGE PASSING; PATTERN RECOGNITION; PROGRAM PROCESSORS; TELECOMMUNICATION NETWORKS;

BIDIRECTIONAL COMMUNICATION; BIDIRECTIONAL COMMUNICATION MODELS; FULLY CONNECTED COMMUNICATION NETWORK; MESSAGE PASSING INTERFACE (MPI);

RADIO BROADCASTING;

EID: 44449164332     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2007.12.001     Document Type: Article

References (36)

1. Alexandrov A., Ionescu M.F., Schauser K.E., and Scheiman C.J. LogGP: Incorporating long messages into the LogP model for parallel computation. Journal of Parallel and Distributed Computing 44 1 (1997) 71-79
2. Bar-Noy A., Bruck J., Ho C.-T., Kipnis S., and Schieber B. Computing global combine operations in the multiport postal model. IEEE Transactions on Parallel and Distributed Systems 6 8 (1995) 896-900
3. Bar-Noy A., and Kipnis S. Broadcasting multiple messages in simultaneous send/receive systems. Discrete Applied Mathematics 55 2 (1994) 95-105
4. Bar-Noy A., and Kipnis S. Designing broadcasting algorithms in the postal model for message-passing systems. Mathematical Systems Theory 27 5 (1994) 431-452
5. Bar-Noy A., Kipnis S., and Schieber B. Optimal multiple message broadcasting in telephone-like communication systems. Discrete Applied Mathematics 100 1-2 (2000) 1-15
6. Barnett M., Gupta S., Payne D.G., Schuler L., van de Geijn R., and Watts J. Building a high-performance collective communication library. Supercomputing'94 (1994) pp. 107-116
7. Barnett M., Payne D.G., van de Geijn R.A., and Watts J. Broadcasting on meshes with wormhole routing. Journal of Parallel and Distributed Computing 35 2 (1996) 111-122
8. Bruck J., Coster L.D., Dewulf N., Ho C.-T., and Lauwereins R. On the design and implementation of broadcast and global combine operations using the postal model. IEEE Transactions on Parallel and Distributed Systems 7 3 (1996) 256-265
9. J. Bruck, R. Cypher, C.-T. Ho, Multiple message broadcasting with generalized fibonacci trees, in: Symposium on Parallel and Distributed Processing (SPDP), 1992, pp. 424-431
10. Buntinas D., Panda D.K., Duato J., and Sadayappan P. Broadcast/multicast over myrinet using nic-assisted multidestination messages. Network-Based Parallel Computing: Communication, Architecture, and Applications (CANPC 2000) (2000) pp. 115-129
11. E. Chan, R.A. van de Geijn, W. Gropp, R. Thakur, Collective communication on architectures that support simultaneous communication over multiple link, in: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), 2006, pp. 2-11
12. E.W. Chan, M.F. Heimlich, A. Purkayastha, R.A. van de Geijn, On optimizing collective communication, in: IEEE International Conference on Cluster Computing (CLUSTER 2004), 2004
13. Culler D.E., Karp R.M., Patterson D., Sahay A., Santos E.E., Schauser K.E., Subramonian R., and von Eicken T. LogP: A practical model of parallel computation. Communications of the ACM 39 11 (1996) 78-85
14. Fraigniaud P., and Lazard E. Methods and problems of communication in usual networks. Discrete Applied Mathematics 53 1-3 (1994) 79-133
15. Gołebiewski M., Ritzdorf H., Träff J.L., and Zimmermann F. The MPI/SX implementation of MPI for NEC's SX-6 and other NEC platforms. NEC Research & Development 44 1 (2003) 69-74
16. Gropp W., and Lusk E. Reproducible measurements of MPI performance characteristics. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 6th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 1697 (1999) 11-18
17. Hedetniemi S.M., Hedetniemi T., and Liestman A.L. A survey of gossiping and broadcasting in communication networks. Networks 18 (1988) 319-349
18. T. Hoefler, C. Siebert, W. Rehm, A practically constant-time MPI broadcast algorithm for large-scale InfiniBand clusters with multicast, in: Workshop on Communication Architecture for Clusters (CAC) held in conjunction with International Parallel and Distributed Processing Symposium (IPDPS 2007), 2007
19. Jia B. Process cooperation in multiple message broadcast. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 14th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4757 (2007), Springer-Verlag 27-35
20. Johnsson S.L., and Ho C.-T. Optimum broadcasting and personalized communication in hypercubes. IEEE Transactions on Computers 38 9 (1989) 1249-1268
21. Juhász S., and Kovács F. Asynchronous distributed broadcasting in cluster environment. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 11th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 3241 (2004) 164-172
22. Kwon O.-H., and Chwa K.-Y. Multiple message broadcasting in communication networks. Networks 26 (1995) 253-261
23. J. Liu, A.R. Mamidala, D.K. Panda, Fast and scalable MPI-level broadcast using InfiniBand's hardware multicast support, in: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), 2004
24. P. Patarasu, A. Faraj, X. Yuan, Pipelined broadcast on ethernet switched clusters, in: International Parallel and Distributed Processing Symposium (IPDPS 2006), 2006, p. 128
25. J. Pješivac-Grbović, T. Angskun, G. Bosilca, G.E. Fagg, E. Gabriel, J. Dongarra, Performance analysis of MPI collective operations, in: International Parallel and Distributed Processing Symposium (IPDPS 2005), Workshop on Performance Modeling, Evaluation, and Optimization of Parallel and Distributed Systems (PMEO), 2005
26. H. Ritzdorf, J.L. Träff, Collective operations in NEC's high-performance MPI libraries, in: International Parallel and Distributed Processing Symposium (IPDPS 2006), 2006, p. 100
27. Sanders P., and Sibeyn J.F. A bandwidth latency tradeoff for broadcast and reduction. Information Processing Letters 86 1 (2003) 33-38
28. Santos E.E. Optimal and near-optimal algorithms for k-item broadcast. Journal of Parallel and Distributed Computing 57 2 (1999) 121-139
29. Snir M., Otto S., Huss-Lederman S., Walker D., and Dongarra J. MPI-The Complete Reference. second edition. The MPI Core vol. 1 (1998), MIT Press
30. Thakur R., Gropp W.D., and Rabenseifner R. Improving the performance of collective operations in MPICH. International Journal on High Performance Computing Applications 19 (2004) 49-66
31. V. Tipparaju, J. Nieplocha, D.K. Panda, Fast collective operations using shared and remote memory access protocols on clusters, in: 17th International Parallel and Distributed Processing Symposium (IPDPS03), 2003, p. 84
32. Träff J.L. A simple work-optimal broadcast algorithm for message-passing parallel systems. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 11th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 3241 (2004), Springer 173-180
33. Träff J.L., and Ripke A. An optimal broadcast algorithm adapted to SMP-clusters. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 12th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 666 (2005), Springer 48-56
34. Träff J.L., and Ripke A. Optimal broadcast for fully connected networks. High Performance Computing and Communications (HPCC'05). Lecture Notes in Computer Science vol. 3726 (2005), Springer 45-56
35. Watts J., and van de Geijn R.A. A pipelined broadcast for multidimensional meshes. Parallel Processing Letters 5 (1995) 281-292
36. M.-S. Wu, R.A. Kendall, K. Wright, Optimizing collective communications on SMP clusters, in: 34th International Conference on Parallel Processing (ICPP 2005), 2005, pp. 399-407