Parallel prefix (scan) algorithms for MPI

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4192 LNCS, Issue , 2006, Pages 49-57

  Sanders, Peter ^a   Träff, Jesper Larsson ^b  

^a UNIVERSITY OF KARLSRUHE   (Germany)

^b NEC LABORATORIES EUROPE   (Germany)

Author keywords

Cluster of SMPs; Collective communication; MPI implementation; Pipelining; Prefix sum

Indexed keywords

ALGORITHMS; DATA STRUCTURES; PARALLEL PROCESSING SYSTEMS; TREES (MATHEMATICS);

BIDIRECTIONAL INTERCONNECTS; COLLECTIVE COMMUNICATION; PARALLEL PREFIX; PIPELINING;

INTERFACES (COMPUTER);

EID: 33750229934     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11846802_15     Document Type: Conference Paper

References (11)

1. S. Bae, D. Kim, and S. Ranka. Vector prefix and reduction computation on coarsegrained, distributed memory machines. In International Parallel Processing Symposium/Symposium on Parallel and Distributed Processing (IPPS/SPDP 1998), pages 321-325, 1998.
2. G. E. Blelloch. Scans as primitive parallel operations. IEEE Transactions on Computers, 38(11):1526-1538, 1989.
3. W. Gropp, S. Huss-Lederman, A. Lumsdaine, E. Lusk, B. Nitzberg, W. Saphir, and M. Snir. MPI - The Complete Reference, volume 2, The MPI Extensions. MIT Press, 1998.
4. W. D. Hillis and J. Guy L. Steele. Data parallel algorithms. Communications of the ACM, 29(12):1170-1183, 1986.
5. J. JáJá. An Introduction to Parallel Algorithms. Addison-Wesley, 1992.
6. Y.-C. Lin and C.-S. Yeh. Efficient parallel prefix algorithms on multiport message-passing systems. Information Processing Letters, 71:91-95, 1999.
7. E. W. Mayr and C. G. Plȧxton. Pipelined parallel prefix computations, and sorting on a pipelined hypercube. Journal of Parallel and Distributed Computing, 17:374-380, 1993.
8. P. Sanders and J. F. Sibeyn. A bandwidth latency tradeoff for broadcast and reduction. Information Processing Letters, 86(1):33-38, 2003.
9. E. E. Santos. Optimal and efficient algorithms for summing and prefix summing on parallel machines. Journal of Parallel and Distributed Computing, 62(4):517-543, 2002.
10. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra. MPI - The Complete Reference, volume 1, The MPI Core. MIT Press, second edition, 1998.
11. J. Worringen. Pipelining and overlapping for MPI collective operations. In 28th Annual IEEE Conference on Local Computer Networks (LCN 2003), pages 548-557, 2003.