Optimization of collective reduction operations

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3036, Issue , 2004, Pages 1-9

  Rabenseifner, Rolf ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Collective Operations; Message Passing; MPI; Reduction

Indexed keywords

ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; REDUCTION;

COLLECTIVE COMMUNICATIONS; COLLECTIVE OPERATIONS; MESSAGE PASSING INTERFACE; MESSAGE PASSING INTERFACE STANDARDS; MPI; MPI IMPLEMENTATIONS; REDUCTION ALGORITHMS; REDUCTION OPERATION;

MESSAGE PASSING;

EID: 33746653525     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-24685-5_1     Document Type: Article

References (13)

1. V. Baĺa, J. Bruck, R. Cypher, P. Elustondo, A. Ho, C.-T. Ho, S. Kipnis and M. Snir, CCL: A portable and tunable collective communication library for scalable parallel computers, in IEEE Transactions on Parallel and Distributed Systems, Vol.6, No.2, Feb. 1995, pp 154-164.
2. M. Barnett, S. Gupta, D. Payne, L. Shuler, R. van de Gejin, and J. Watts, Interprocessor collective communication library (InterCom), in Proceedings of Supercomputing '94, Nov. 1994.
3. Edward K. Blum, Xin Wang, and Patrick Leung, Architectures and message-passing algorithms for cluster computing: Design and performance, in Parallel Computing 26 (2000) 313-332.
4. J. Bruck, C.-T. Ho, S. Kipnis, E. Upfal, and D. Weathersby, Efficient algorithms for all-to-all communications in multipart message-passing systems, in IEEE Transactions on Parallel and Distributed Systems, Vol. 8, No. 11, Nov. 1997, pp 1143-1156.
5. E. Gabriel, M. Resch, and R. Ruble, Implementing MPI with optimized algorithms for metacomputing, in Proceedings of the MPIDC'99, Atlanta, USA, March 1999, pp 31-41.
6. Message Passing Interface Forum. MPI: A Message-Passing Interface Standard, Rel. 1.1, June 1995, www.mpi-forum.org.
7. N. Karonis, B. de Supinski, I. Foster, W. Gropp, E. Lusk, and J. Bresnahan, Exploiting hierarchy in parallel computer networks to optimize collective operation performance, in Proceedings of the 14th International Parallel and Distributed Processing Symposium (IPDPS '00), 2000, pp 377-384.
8. Thilo Kielmann, Rutger F. II. Hofman, Henri E. Bal, Aske Plaat, Raoul A. F. Bhoedjang, MPI's reduction operations in clustered wide area systems, in Proceedings of the Message Passing Interface Developer's and User's Conference 1999 (MPIDC'99), Atlanta, USA, March 1999, pp 43-52.
9. Man D. Knies, F. Ray Barriuso, William J. Harrod, George B. Adams III, SLICC: A low latency interface for collective communications, in Proceedings of the 1994 conference on Supercomputing, Washington, D.C., Nov. 14-18, 1994, pp 89-96.
10. Rolf Rabenseifner, A new optimized MPI reduce and allreduce algorithm, Nov. 1997. http://www.hlrs.de/mpi/myreduce.html
11. Rolf Rabenseifner, Automatic MPI counter profiling of all users: First results on a CRAY T3E 900-512, Proceedings of the Message Passing Interface Developer's and User's Conference 1999 (MPIDC'99), Atlanta, USA, March 1999, pp 77-85. http://www.hlrs.de/people/rabenseifner/publ/publications.html
12. Rajeev Thakur and William D. Gropp, Improving the performance of collective operations in MPICH, in Recent Advances in Parallel Virtual Machine and Message Passing Interface, proceedings of the 10th European PVM/MPI Users' Group Meeting, LNCS 2840, J. Dongarra, D. Laforenza, S. Orlando (Eds.), 2003, 257-267.
13. Sathish S. Vadhiyar, Graham E. Fagg, and Jack Dongarra, Automatically tuned collective communications, in Proceedings of SC2000, Nov. 2000.