Automatic generation and tuning of MPI collective communication routines

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2005, Pages 393-402

  Faraj, Ahmad ^a   Yuan, Xin ^a  

^a Florida State University   (United States)

Author keywords

Cluster of Workstations; Empirical; MPI; Tuning System

Indexed keywords

CLUSTER OF WORKSTATIONS; EMPIRICAL; MESSAGE PASSING INTERFACE (MPI); TUNING SYSTEMS;

ALGORITHMS; AUTOMATION; COMPUTATION THEORY; COMPUTER ARCHITECTURE; TOPOLOGY;

INFORMATION THEORY;

EID: 32844458895     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1088149.1088202     Document Type: Conference Paper

References (23)

1. J. Bilmes, K. Asanovic, C. Chin, and J. Demmel. Optimizing Matrix Multiply using PHiPAC: a Portable, High-Performance, ANSI C Coding Methodology. In Proceedings of the ACM SIGARC International Conference on SuperComputing, 1997.
2. J. Bruck, C. Ho, S. Kipnis, E. Upfal, and D. Weathersby. Efficient Algorithms for All-to-all Communications in Multiport Message-Passing Systems. IEEE Transactions on Parallel and Distributed Systems, 8(11):1143-1156, Nov. 1997.
3. A. Faraj, P. Patarasuk, and X. Yuan. Bandwidth Efficient All-to-All Broadcast on Switched Clusters. Technical Report, Department of Computer Science, Florida State University, May 2005.
4. A. Faraj and X. Yuan. Message Scheduling for All-to-all Personalized Communication on Ethernet Switched Clusters. IEEE IPDPS, April 2005.
5. NASA Parallel Benchmarks. Available at http://www.nas.nasa.gov/NAS/NPB.
6. M. Frigo and S. Johnson. FFTW: An Adaptive Software Architecture for the FFT. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 3, page 1381, 1998.
7. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard. In MPI Developers Conference, 1995.
8. W. Gropp and E. Lusk. Reproducible Measurements of MPI Performance Characteristics. Technical Report ANL/MCS-P755-0699, Argonne National Labratory, Argonne, IL, June 1999.
9. LAM/MPI Parallel Computing. http://www.lam-mpi.org.
10. M. Lauria and A. Chien. MPI-FM: High Performance MPI on Workstation Clusters. Journal of Parallel and Distributed Computing, 40(1), January 1997.
11. L. V. Kale, S. Kumar, K. Varadarajan, "A Framework for Collective Personalized Communication," IPDPS'03, April 2003.
12. A. Karwande, X. Yuan, and D.K. Lowenthal. CC-MPI: A Compiled Communication Capable MPI Prototype for Ethernet Switched Clusters. In ACM SIGPLAN PPoPP, pages 95-106, June 2003.
13. T. Kielmann, et. al. Magpie: MPI's Collective Communication Operations for Clustered Wide Area Systems. In ACM SIGPLAN PPoPP, pages 131-140, May 1999.
14. R. Rabenseifner. A new optimized MPI reduce and allreduce algorithms. Available at http://www.hlrs.de/organization/par/services/models /mpi/myreduce.html, 1997.
15. The MPI Forum. The MPI-2: Extensions to the Message Passing Interface, July 1997. Available at http://www.mpi-forum.org/docs/mpi-20-html/mpi2-report. html.
16. MPICH - A Portable Implementation of MPI. http://www.mcs.anl.gov/mpi/ mpich.
17. H. Ogawa and S. Matsuoka. OMPI: Optimizing MPI Programs Using Partial Evaluation. In Supercomputing'96, November 1996.
18. I. Rosenblum, J. Adler, and S. Brandon. Multi-processor molecular dynamics using the Brenner potential: Parallelization of an implicit multi-body potential. International Journal of Modern Physics, C 10(1):189-203, Feb. 1999.
19. S. Sistare, R. vandeVaart, and E. Loh. Optimization of MPI Collectives on Clusters of Large Scape SMPs. In Proceedings of SC99: High Performance Networking and Computing, 1999.
20. H. Tang, K. Shen, and T. Yang. Program Transformation and Runtime Support for Threaded MPI Execution on Shared-Memory Machines. ACM Transactions on Programming Languages and Systems, 22(4):673-700, July 2000.
21. R. Thakur, R. Rabenseifner, and W. Gropp. Optimizing of Collective Communication Operations in MPICH. ANL/MCS-P1140-0304, Mathematics and Computer Science Division, Argonne National Laboratory, March 2004.
22. S. S. Vadhiyar, G. E. Fagg, and J. Dongarra. Automatically Tuned Collective Communications. In Proceedings of SC'00: High Performance Networking and Computing, 2000.
23. R. C. Whaley and J. Dongarra. Automatically tuned linear algebra software. In SuperComputing'98: High Performance Networking and Computing, 1998.