More efficient reduction algorithms for non-power-of-two number of processors in message-passing parallel systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3241, Issue , 2004, Pages 36-46

  Rabenseifner, Rolf ^a,b   Träff, Jesper Larsson ^a,b  

^a UNIVERSITY OF STUTTGART   (Germany)

^b NEC LABORATORIES EUROPE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; PARALLEL PROCESSING SYSTEMS; VECTORS;

COMPUTATION TIME; MESSAGE PASSING INTERFACE; MESSAGE PASSING SYSTEMS; MESSAGE TRANSFERS; PARALLEL SYSTEM; REDUCTION ALGORITHMS; REDUCTION OPERATION; SMALL VECTORS;

MESSAGE PASSING;

EID: 34548696258     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-30218-6_13     Document Type: Article

References (16)

1. M. Barnett, S. Gupta, D. Payne, L. Shuler, R. van de Gejin, and J. Watts, Inter-processor collective communication library (InterCom), Proceedings of Super-computing '94, Nov. 1994.
2. A. Bar-Noy, J. Bruck, C.-T. Ho, S. Kipnis, and B. Schieber. Computing global combine operations in the multiport postal model. IEEE Transactions on Parallel and Distributed Systems, 6(8):896-900, 1995.
3. A. Bar-Noy, S. Kipnis, and B. Schieber. An optimal algorithm for computing census functions in message-passing systems. Parallel Processing Letters, 3(1):19-23, 1993.
4. E. K. Blum, X. Wang, and P. Leung. Architectures and message-passing algorithms for cluster computing: Design and performance. Parallel Computing 26 (2000) 313-332.
5. J. Bruck and C.-T. Ho. Efficient global combine operations in multi-port message-passing systems. Parallel Processing Letters, 3(4):335-346, 1993.
6. J. Bruck, C.-T. Ho, S. Kipnis, E. Upfal, and D. Weathersby. Efficient algorithms for all-to-all communications in multiport message-passing systems. IEEE Transactions on Parallel and Distributed Systems, 8(11):1143-1156, Nov. 1997.
7. E. Gabriel, M. Resch, and R. Rühle, Implementing MPI with optimized algorithms for metacomputing, Proceedings of the MPIDC'99, Atlanta, USA, pp 31-41.
8. N. Karonis, B. de Supinski, I. Foster, W. Gropp, E. Lusk, and J. Bresnahan, Exploiting hierarchy in parallel computer networks to optimize collective operation performance, Proceedings of the 14th International Parallel and Distributed Processing Symposium (IPDPS '00), 2000, pp 377-384.
9. T. Kielmann, R. F. H. Hofman, H. E. Bal, A. Plaat, R. A. F. Bhoedjang, MPI's reduction operations in clustered wide area systems, Proceedings of the MPIDC'99, Atlanta, USA, March 1999, pp 43-52.
10. A. D. Knies, F. Ray Barriuso, W. J. H., G. B. Adams III, SLICC: A low latency interface for collective communications, Proceedings of the 1994 conference on Supercomputing, Washington, D.C., Nov. 14-18, 1994, pp 89-96.
11. Howard Pritchard, Jeff Nicholson, and Jim Schwarzmeier, Optimizing MPI Collectives for the Cray X1, Proceeding of the CUG 2004 conference, Knoxville, Tennessee, USA, May, 17-21, 2004 (personal communication).
12. R. Rabenseifner, Automatic MPI counter profiling of all users: First results on a CRAY T3E 900-512, Proceedings of the Message Passing Interface Developer's and User's Conference 1999 (MPIDC'99), Atlanta, USA, March 1999, pp 77-85.
13. R. Rabenseifner. Optimization of collective reduction operations. M. Bubak et al. (Eds.): International Conference on Computational Science (ICCS 2004), volume 3036 of Lecture Notes in Computer Science, pages 1-9, 2004.
14. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra. MPI - The Complete Reference, volume 1, The MPI Core. MIT Press, second edition, 1998.
15. R. Thakur and W. D. Gropp. Improving the performance of collective operations in MPICH. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 10th European PVM/MPI Users' Group Meeting, volume 2840 of Lecture Notes in Computer Science, pages 257-267, 2003.
16. R. van de Geijn. On global combine operations. Journal of Parallel and Distributed Computing, 22:324-328, 1994.