On using connection-oriented vs. connection-less transport for performance and scalability of collective and one-sided operations: Trade-offs and impact

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2007, Pages 46-54

  Mamidala, Amith R ^a   Narravula, Sundeep ^a   Vishnu, Abhinav ^a   Santhanaraman, Gopal ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University

Author keywords

RDMA; Reliable connection; Send recv; Unreliable datagram

Indexed keywords

DATA STORAGE EQUIPMENT; DATA STRUCTURES; MATHEMATICAL MODELS; PARALLEL PROGRAMMING; SEMANTICS;

CHANNEL SEMANTICS; NETWORK PRIMITIVES; RELIABLE CONNECTION; TRANSPORT MODES;

COMMUNICATION SYSTEMS;

EID: 34548021134     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1229428.1229437     Document Type: Conference Paper

References (19)

1. Rajeev Thakur and William Gropp. Improving the Performance of Collective Operations in MPICH. In Euro PVM/MPI Conference, 2003.
2. Sayantan Sur, Hyun-Wook Jin and Dhabaleswar K. Panda. Efficient and Scalable All-to-All Exchange for InfiniBand-based Clusters. In International Conference on Parallel Processing (ICPP), 2004.
3. Amith. R. Mamidala, Jiuxing Liu and Dhabaleswar K. Panda. Efficient Barrier and Allreduce on IBA clusters using hardware multicast and adaptive algorithms. In IEEE Cluster Computing, 2004.
4. Network-Based Computing Laboratory. MVAPICH: MPI for InfiniBand, http://nowlab.cse.ohio-state.edu/projects/mpi-.iba/index.html.
5. Abhinav Vishnu, Gopal K. Santhanaraman, Wei Huang, HyunWook Jin and Dhabaleswar K. Panda. Supporting MPI-2 One Sided Communication on Multi-Rail InfiniBand Clusters: Design Challenges and Performance Benefits. In International Conference on High Performance Computing, HiPC, 2005.
6. UC Berkeley/LBNL. Berkeley UPC - Unified Parallel C, http://upc.lbl.gov/.
7. Christian Bell, Dan Bonachea, Rajesh Nishtala and Katherine Yelick. Optimizing Bandwidth Limited Problems Using One-Sided Communication and Overlap Support. In IEEE International Parallel and Distributed Processing Symposium, IPDPS, 2006.
8. Rajeev Sivaram, Rama K. Govindaraju, Peter Hochschild, Robert Blackmore and Piyush Chaudhary. Breaking the connection: RDMA deconstructed. In IEEE Hot Interconnects, HOTI, 2005.
9. InfiniBand Trade Association. InfiniBand Architecture Specification, Release 1.1 November,2002, http://www.infi.ni.bandta.org.
10. Jehoshua Brück, Ching-Tien Ho, Shlomo Kipnis, Eli Upfal and Derrick Weathersby. Efficient Algorithms for All-to-All Communications in Multlport Message-Passing Systems. In IEEE Transactions in Parallel and Distributed Systems, Volume 8, number 11, November, 1997.
11. William Gropp, Ewing Lusk, Nathan Doss and Anthony Skjellum. A High-Performance, Portable Implementation of the MPI, Message Passing Interface Standard. Argonne National Laboratory and Mississippi State University, 1996.
12. Rajeev Thakur, Rolf Rabenseifner, and William Gropp. Optimization of Collective Communication Operations in MPICH. In Int'l Journal of High Performance Computing Applications, (19)1:49-66, Spring 2005.
13. Weihang Jiang, Jiuxing Liu, Hyun-Wook Jin, Dhabaleswar K. Panda, Darius Buntinas, Rajeev Thakur, and William Gropp. Efficient Implementation of MPI-2 Passive One-Sided Communication on InfiniBand Clusters. In Proceedings of the I lth European PVM/MPI Users ' Group Meeting (Euro PVM/MPI 2004), Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science, LNCS 3241, Springer September 2004, pp. 68-76.
14. Rajeev Thakur, William Gropp, and Brian Toonen. Minimizing Synchronization Overhead in the Implementation of MPI One-Sided Communication. In Proceedings of the. 11th European PVM/MPI Users ' Group Meeting (Euro PVM/MPI 2004), Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science, LNCS 3241, Springer, September 2004, pp. 57-67.
15. Weihang Jiang, Jiuxing Liu, Hyun-Wook Jin, Dhabaleswar K. Panda, William Gropp, and Rajeev Thakur. High Performance MPI-2 Onesided Communication over Infiniband. In Proceedings of the 4th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2004), April' 2004.
16. Amith R. Mamidala, Abhinav Vishnu and Dhabaleswar K. Panda. Efficient Shared Memory and RDMA based design for MPI_Allgather over InfiniBand. In Proceedings of EuroPVM/MPI, September 2006.
17. Wei-Yu Chen, Costin Iancu and Katherine Yelick. Communication Optimizations for Fine-grained UPC Applications. In 14th International Conference on Parallel Architectures and Compilation Techniques (PACT), 2005.
18. Costin Iancu, Parry Husbands and Paul Hargrove. HUNTing the Overlap. In 14th International Conference on Parallel Architectures and Compilation Techniques (PACT), 2005.
19. Wei-Yu Chen, Dan Bonachea, Jason Duell, Parry Husbands, Costin Iancu, and Katherine Yelick. A Performance Analysis of the Berkeley UPC Compiler. In 17th Annual International Conference on Supercomputing (ICS), 2003.