High performance RDMA-based MPI implementation over InfiniBand

International Journal of Parallel Programming

Volumn 32, Issue 3, 2004, Pages 167-198

  Liu, Jiuxing ^a   Wu, Jiesheng ^a   Panda, Dhabaleswar K ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

Clusters; InfiniBand; MPI; Parallel computing; Parallel programming; RDMA

Indexed keywords

CLUSTERS; INFINIBAND; MPI; PARALLEL PROGRAMMING; REMOTE DIRECT MEMORY ACCESS (RDMA);

BANDWIDTH; BENCHMARKING; COMMUNICATION SYSTEMS; COMPUTATIONAL COMPLEXITY; COMPUTER HARDWARE; DATA COMMUNICATION SYSTEMS;

PARALLEL PROCESSING SYSTEMS;

EID: 3042721503     PISSN: 08857458     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:IJPP.0000029272.69895.c1     Document Type: Conference Paper

References (27)

1. T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser, Active Messages: A Mechanism for Integrated Communication and Computation, International Symposium on Computer Architecture, pp. 256-266 (1992).
2. M. Blumrich, C. Dubnicki, E. W. Felten, K. Li, and M. R. Mesarina, Virtual-Memory-Mapped Network Interfaces, IEEE Micro, 15(1):21-28 (Feb. 1995).
3. S. Pakin, M. Lauria, and A. Chien, High Performance Messaging on Workstations: Illinois Fast Messages (FM), Proceedings of the Supercomputing (1995).
4. T. von Eicken, A. Basu, V. Buch, and W. Vogels, U-Net: A User-level Network Interface for Parallel and Distributed Computing, A CM Symposium on Operating Systems Principles, pp. 40-53 (1995).
5. D. Dunning, G. Regnier, G. McAlpine, D. Cameron, B. Shubert, F. Berry, A. Merritt, E. Gronke, and C. Dodd, The Virtual Interface Architecture, IEEE Micro, 18(2):66-76 (March/April 1998).
6. InfiniBand Trade Association, InfiniBand Architecture Specification, Release 1.1, http://www.infinibandta.org (November 2002).
7. Lawrence Berkeley National Laboratory, MVICH: MPI for Virtual Interface Architecture, http://www.nersc.gov/research/FTG/mvich/index.html (August 2001).
8. J. Liu, J. Wu, S. P. Kinis, D. Buntinas, W. Yu, B. Chandrasekaran, R. Noronha, P. Wyckoff, and D. K. Panda, MPI over InfiniBand: Early Experiences, Technical Report, OSU-CISRC-10/02-TR25, Computer and Information Science, the Ohio State University (January 2003).
9. R. Dimitrov and A. Skjellum, An Efficient MPI Implementation for Virtual Interface (VI) Architecture-Enabled Cluster Computing, http://www.mpi-softtech. com/publications/ (1998).
10. M. Banikazemi, R. K. Govindaraju, R. Blackmore, and D. K. Panda, MPI-LAPI: An Efficient Implementation of MPI for IBM RS/6000 SP Systems, IEEE Transactions on Parallel and Distributed Systems, 12(10):1081-1093 (October 2001).
11. H. Tezuka, F. O'Carroll, A. Hori, and Y. Ishikawa, Pin-down Cache: A Virtual Memory Management Technique for Zero-copy Communication, Proceedings of 12th International Parallel Processing Symposium, pp. 308-315 (1998).
12. J. S. Vetter and F. Mueller, Communication Characteristics of Large-Scale Scientific Applications for Contemporary Cluster Architectures, Int'l Parallel and Distributed Processing Symposium (IPDPS '02) (April 2002).
13. J. Wu, J. Liu, P. Wyckoff, and D. K. Panda, Impact of On-Demand Connection Management in MPI over VIA, Proceedings of the IEEE International Conference on Cluster Computing, pp. 152-159 (September 2002).
14. R. Gupta, P. Balaji, D. K. Panda, and J. Nieplocha, Efficient Collective Operations using Remote Memory Operations on VIA-Based Clusters, Int'l Parallel and Distributed Processing Symposium (IPDPS '03) (April 2003).
15. Mellanox Technologies, Mellanox InfiniBand InfiniHost MT23108 Adapters, http://www.mellanox.com (July 2002).
16. W. Gropp, E. Lusk, N. Doss, and A. Skjellum, A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard, Parallel Computing, 22(6):789-828 (1996).
17. NASA, NAS Parallel Benchmarks, http://www.nas.nasa.gov/Software/NPB/.
18. D. E. Culler, R. M. Karp, D. A. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian, and T. von Eicken, LogP: Towards a Realistic Model of Parallel Computation, Principles Practice of Parallel Programming, pp. 1-12 (1993).
19. R. Martin, A. Vahdat, D. Culler, and T. Anderson, Effects of Communication Latency, Overhead, and Bandwidth in a Cluster Architecture, Proceedings of the International Symposium on Computer Architecture, pp. 152-159 (1997).
20. Pallas, Pallas MPI Benchmarks, http://www.pallas.com/e/products/pmb/.
21. S. J. Sistare and C. J. Jackson, Ultra-High Performance Communication with MPI and the Sun Fire Link Interconnect, Proceedings of the Supercomputing (2002).
22. P. Husbands and J. C. Hoe, MPI-StarT: Delivering Network Performance to Numerical Applications, Proceedings of the Supercomputing (1998).
23. R. Brightwell and A. Skjellum, MPICH on the T3D: A Case Study of High Performance Message Passing, 1996 MPI Developers Conference (July 1996).
24. Y. Zhou, A. Bilas, S. Jagannathan, C. Dubnicki, J. F. Philbin, and K. Li, Experiences with VI Communication for Database Storage, Proceedings of International Symposium on Computer Architecture'02, pp. 257-268 (2002).
25. K. Magoutis, S. Addetia, A. Fedorova, M. Seltzer, J. Chase, A. Gallatin, R. Kisley, R. Wickremesinghe, and E. Gabber, Structure and Performance of the Direct Access File System, Proceedings of USENIX 2002 Annual Technical Conference, Monterey, CA, pp. 1-14 (June 2002).
26. E. V. Carrera, S. Rao, L. Iftode, and R. Bianchini, User-Level Communication in Cluster-Based Servers, Proceedings of the Eighth Symposium on High-Performance Architecture (HPCA'02), pp. 275-286 (February 2002).
27. F. J. Alfaro, J. L. Sanchez, J. Duato, and C. R. Das, A Strategy to Compute the Infiniband Arbitration Tables, Int'l Parallel and Distributed Processing Symposium (IPDPS '02) (April 2002).