High-performance and scalable MPI over InfiniBand with reduced memory usage: An in-depth performance analysis

Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, SC'06

Volumn , Issue , 2006, Pages

  Sur, Sayantan ^a   Koop, Matthew J ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University

Author keywords

[No Author keywords available]

Indexed keywords

MEMORY USAGE; MESSAGE PASSING INTERFACE (MPI); PERFORMANCE ANALYSIS; PROGRAMMING MODELS;

COMPUTER PROGRAMMING; DATA STORAGE EQUIPMENT; LARGE SCALE SYSTEMS; MATHEMATICAL MODELS; MESSAGE PASSING; SCALABILITY;

INTERFACES (COMPUTER);

EID: 34548276069     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1188455.1188565     Document Type: Conference Paper

References (26)

1. Sadaf R. Alam, Jeffrey S. Vetter, Pratul K. Agarwal, and AI Geist Performance characterization of molecular dynamics techniques for biomolecular simulations. In Symposium on Principles and practice of parallel programming, pages 59-68, New York, NY, USA, 2006. ACM Press.
2. D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, D. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga. The NAS parallel benchmarks, volume 5, pages 63-73, Fall 1991.
3. T.Davis. University of Florida Sparse Matrix Collection. http://www.cise.ufl.edu/research/sparse/matrices.
4. J. Dongarra. Performance of Various Computers Using Standard Linear Equations Software. Technical Report CS-89-85, University of Tennessee, 1989.
5. Edgar Gabriel, Graham E. Fagg, George Bosilca, Thara Angskun, Jack J. Dongarra, Jeffrey M. Squyres, Vishal Sahay, Prabhanjan Kambadur, Brian Barrett, Andrew Lumsdaine, Ralph H. Castain, David J. Daniel, Richard L. Graham, and Timothy S. Woodall. Open MPI: Goals, concept, and design of a next generation MPI implementation. In Proceedings, 11th European PVM/MPI Users' Group Meeting, pages 97-104, Budapest, Hungary, September 2004.
6. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. A HighPerformance, Portable Implementation of the MPI, Message Passing Interface Standard. Technical, report, Argonne National Laboratory and Mississippi State University.
7. InfiniBand Trade Association. InfiniBand Trade Association. http://www.infinibandta.com.
8. J. Vetter and C. Chambreau. mpiP: Lightweight, Scalable MPI Profiling. http://www.llnl.gov/CASC/mpip/.
9. Lawrence Berkeley National Laboratory. MVICH: MPI for Virtual Interface Architecture. http://www.nersc.gov/research/FTG/mvich/index.html, August 2001.
10. X. Li and J. Demmel. SuperL DIST: A scalable distributed-memory sparse direct solver for unsymmetric linear systems. ACM Trans. Mathematical Software, 29(2): 110-140, 2003.
11. J. Liu, B. Chandrasekaran, J. Wu, W. Jiang, S. Kini, W. Yu, D. Buntinas, P. Wyckoff, and D. K. Panda. Performance Comparison of MPI Implementations over InfiniBand, Myrinet and Quadrics. In Supercomputing(SC), 2003.
12. J. Liu, J. Wu, and D. K. Panda. High performance RDMA-based MPI implementation over InfiniBand. Int'l Journal of Parallel Programming, 32(3), June 2004.
13. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface, Jul 1997.
14. NAS Project: Columbia. Columbia Supercomputer. http://www.nas.nasa.gov/ About/ Projects/Columbia/columbia.html.
15. Network-Based Computing Laboratory. MPI over InfiniBand Project. http://nowlab.cse.oh.iostate.edu/projects/mpi-iba/.
16. Open Fabrics Alliance. Open Fabrics Enterprise Distribution. http://www.open.fabrics.org/.
17. Open InfiniBand Alliance. Open Source InfiniBand Software Stack, http://www.openib.org/.
18. J. C. Phillips, G. Zheng, S. Kumar, and L. V. Kale. NAMD: Biomolecular Simulation on Thousands of Processors. In Supercomputing, 2002.
19. Sandia National Laboratories. Thunderbird Linux Cluster, http://www.cs.sandia.gov/platforms/ Thunderbird.html.
20. J. Shalf, S. Kamil, L. Oliker, and David Skinner. Analyzing UltraScale Application Communication Requirements for a Reconfigurable Hybrid Interconnect. In Supercomputing, 2005.
21. G. Shipman, T. Woodall, R. Graham, and A. Maccabe. Infiniband Scalability in Open MPI. In International Parallel and Distributed Processing Symposium (IPDPS), 2006.
22. S. Sur, L. Chai, H.-W. Jin, and D. K. Panda. Shared Receive Queue Based Scalable MPI Design for InfiniBand Clusters. In International Parallel and Distributed Processing Symposium (IPDPS), 2006.
23. S. Sur, H.-W. Jin, L. Chai, and D. K. Panda. RDMA Read Based Rendezvous Protocol for MPI over InfiniBand: Design Alternatives and Benefits. In Symposium on Principles and Practice of Parallel Programming (PPOPP), 2006.
24. The Top 500 Project. The Top 500. http://www.top500.org/.
25. Xiaoye Sherry Li, James Demmel, John R. Gilbert. SuperLU. http://crd.Ibl.gov/~x.iaoye/SuperLU/.
26. W. Yu, Q. Gao, and D. K. Panda. Adaptive Connection Management for Scalable MPI over InfiniBand. In International Parallel and Distributed Processing Symposium (IPDPS), 2006.