A practically constant-time MPI broadcast algorithm for large-scale InfiniBand clusters with multicast

Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

Volumn , Issue , 2007, Pages

  Hoefler, Torsten ^a,b   Siebert, Christian ^a   Rehm, Wolfgang ^a  

^a CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

^b INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); DATA COMMUNICATION EQUIPMENT; MULTICASTING; NATURAL SCIENCES COMPUTING; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING;

HARDWARE MULTICAST OPERATION; INFINIBAND CLUSTER SYSTEMS; OPEN MPI FRAMEWORK; PARALLEL SCIENTIFIC APPLICATIONS;

ALGORITHMS;

EID: 34548793392     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2007.370475     Document Type: Conference Paper

References (26)

1. M. Blum, L. Blum, and M. Shub. A simple unpredictable pseudo-random number generator. SIAM Journal on Computing, 15(2):364-383, May 1986.
2. H. A. Chen, Y. O. Carrasco, and A. W. Apon. MPI Collective Operations over IP Multicast. In Proceedings of the 15 IPDPS 2000 Workshops on Parallel and Distributed Processing, pages 51-60, London, UK. Springer-Verlag.
3. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall. Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation. In Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004.
4. M. Gerla, P. Palnati, and S. Walton. Multicasting protocols for high-speed, wormhole-routing local area networks. In SIGCOMM '96: Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, pages 184-193, New York, 1996. ACM Press.
5. S. Gorlatch. Send-receive considered harmful: Myths and realities of message passing. ACM Trans. Program. Lang. Syst., 26(1):47-56, 2004.
6. S. Hanna, B. Patel, and M. Shah. Multicast Address Dynamic Client Allocation Protocol (MADCAP). RFC 2730 (Proposed Standard), Dec. 1999.
7. S. P. Kini, J. Liu, J. Wu, P. Wyckoff, and D. K. Panda. Fast and Scalable Barrier Using RDMA and Multicast Mechanisms for InfiniBand-Based Clusters. In Recent Advances in Parallel Virtual Machine and Message Passing Interface, 10th European PVM/MPI Users' Group Meeting, Venice, Italy, September 29 - October 2, 2003, Proceedings, pages 369-378, 2003.
8. J. Liu, A. Mamidala, and D. Panda. Fast and Scalable MPI-Level Broadcast using InfiniBand's Hardware Multicast Support, 2003.
9. A. Mamidala, J. Liu, and D. Panda. Efficient Barrier and Allreduce on IBA clusters using hardware multicast and adaptive algorithms, 2004.
10. A. R. Mamidala, H. Jin, and D. K. Panda. Efficient Hardware Multicast Group Management for Multiple MPI Communicators over InfiniBand. In Recent Advances in Parallel Virtual Machine and Message Passing Interface, 12th European PVM/MPI Users' Group Meeting, Sorrento, Italy, September 18-21, 2005, Proceedings, volume 3666 of Lecture. Notes in Computer Science, pages 388-398. Springer.
11. Message Passing Interface Forum. MPI: A Message Passing Interface Standard. 1995.
12. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface. Technical Report, University of Tennessee, Knoxville, 1997.
13. M. Mosch. Integration einer neuen InfiniBand-Schnittstelle in die vorhandene InfiniBand MPICH2 Software. Technical report, Chemnitz University of Technology, 2006.
14. L. M. Ni. Should Scalable Parallel Computers Support Efficient Hardware Multicasting? In International Conference on Parallel Processing, Workshops, pages 2-7, 1995.
15. N. Nupairoj and L. M. Ni. Benchmarking of Multicast Communication Services. Technical Report MSU-CPS-ACS-103, Department of Computer Science, Michigan State University, 1995.
16. Pallas GmbH. Pallas MPI Benchmarks - PMB, Part MPI-I. Technical report, 2000.
17. J. Pjesivac-Grbovic, T. Angskun, G. Bosilca, G. E. Fagg, E. Gabriel, and J. J. Dongarra. Performance Analysis of MPI Collective Operations. In Proceedings of the 19th International Parallel and Distributed Processing Symposium, 4th International Workshop on Performance Modeling, Evaluation, and Optimization of Parallel and Distributed Systems (PMEO-PDS 05), Denver, CO, April 2005.
18. R. Rabenseifner. Automatic MPI Counter Profiling. In 42nd CUG Conference, 2000.
19. C. Siebert. Efficient Broadcast for Multicast-Capable Interconnection Networks. Master's thesis, Chemnitz University of Technology, 2006.
20. J. M. Squyres and A. Lumsdaine. The Component Architecture of Open MPI: Enabling Third-Party Collective Algorithms. In Proceedings, 18th ACM International Conference on Supercomputing, Workshop on Component Models and Systems for Grid Applications, St. Malo, France, 2004.
21. The InfiniBand Trade Association. Infiniband Architecture Specification Volume 1, Release 1.2, 2004.
22. TOP500 List. http://www.top500.org/, November 2006.
23. K. Verstoep, K. Langendoen, and H. Bal. Efficient Reliable Multicast on Myrinet. In Proceedings of the 1996 International Conference on Parallel Processing, pages 156-165, Washington, DC, USA.
24. W. Yu, D. Buntinas, and D. K. Panda. High Performance and Reliable NIC-Based Multicast over Myrinet/GM-2, 2003.
25. W. Yu, S. Sur, and D. K. Panda. High Performance Broadcast Support in La-Mpi Over Quadrics. International Journal of High Performance Computing Applications, 19(4):453-463, 2005.
26. X. Yuan, S. Daniels, A. Faraj, and A. Karwande. Group Management Schemes for Implementing MPI Collective Communication over IP-Multicast, 2002.