Efficient implementation of reduce-scatter in MPI

Journal of Systems Architecture

Volumn 49, Issue 3, 2003, Pages 89-108

  Bernaschi, Massimo ^a   Iannello, Giulio ^b   Lauria, Mario ^c  

^a CNR   (Italy)

^b UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^c OHIO STATE UNIVERSITY   (United States)

Author keywords

Collective communication primitives; MPI; Parallel algorithms; Performance characterization

Indexed keywords

PARALLEL ALGORITHMS; VECTORS;

COLLECTIVE COMMUNICATION PRIMITIVES;

PARALLEL PROCESSING SYSTEMS;

EID: 0141732229     PISSN: 13837621     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1383-7621(03)00059-6     Document Type: Article

References (23)

1. A. Alexandrov, M. Ionescu, K.E. Schauser, C. Scheiman, LogGP: incorporating long messages into the LogP model - one step closer towards a realistic model of parallel computation, Proceedings of the 7th Annual ACM Symposium on Parallel Algorithms and Architectures, 17-19 July 1995, pp. 95-105.
2. Bala V., Bruck J., Cypher R., Elustondo P., Ho A., Ho C.T., Kipnis S., Snir M. CCL: a portable and tunable collective communication library for scalable parallel computers. IEEE Transactions on Parallel and Distributed Systems. 6(2):1995;154-164.
3. Barnett M., Littlefield R., Payne D.G., van de Geijn R. Global combine on mesh architectures with wormhole. Proceedings of 7th International Parallel Processing Symposium, 13-16 April. 1993;156-162 IEEE Computer Society Press, Newport Beach, CA.
4. M. Barnett, S. Gupta, D.G. Payne, L. Shuler, R. van de Geijn, J. Watts, Building a high-performance collective communication library, Proceedings of Supercomputing '94, Washington, DC, 14-18 November 1994, pp. 107-116.
5. A. Bar-Noy, S. Kipnis, Designing Broadcasting Algorithms in the Postal Model for Message-Passing Systems, Math. Systems Theory, vol. 27, no. 5, pp. 431-452, 1994, also appeared in Proceedings of the 4th Annual ACM Symposium on Parallel Algorithms and Architectures, June 1992, pp. 11-22.
6. A. Bar-Noy, S. Kipnis, Designing Broadcasting Algorithms in the Postal Model for Message-Passing Systems, Math. Systems Theory, vol. 27, no. 5, pp. 431-452, 1994, also appeared in Proceedings of the 4th Annual ACM Symposium on Parallel Algorithms and Architectures, June 1992, pp. 11-22.
7. Bar-Noy A., Kipnis S., Schieber B. Optimal computation of census functions in the postal model. Discrete Applied Mathematics. 58:1995;213-222.
8. Bernaschi M., Iannello G. Collective communication operations: Experimental results vs. theory. Concurrency: Practice and Experience. 10(5):1998;359-386.
9. J. Bruck, C.T. Ho, S. Knipis. D. Weathersby, Efficient Algorithms for All-to-All Communications in Multi-Port Message-Passing Systems, Proceedings of the 6th Annual ACM Symposium on Parallel Algorithms and Architectures, June 1994, pp. 298-309.
10. Boden N.J., Cohen D., Felderman R.E., Kalawik A.E., Seitz C.L., Seizovic J.N., Su W.-K. Myrinet - a gigabit-per-second local-area network. IEEE Micro. 15(1):1995;29-36.
11. S.H. Bokhari, H. Berryman, Complete exchange on a circuit switched mesh, Proceedings of Scalable high Performance Computing Conference, 1992, pp. 300-306.
12. D.E. Culler, R.M. Karp, D.A. Patterson, A. Sahay, K.E. Schauser, E. Santos, R. Subramonian, T. von Eicken, LogP: towards a realistic model of parallel computation, Proceedings of the 4th SIGPLAN Symposium on Principles and Practices of Parallel Programming. ACM, May 1993, pp. 1-12.
13. Graham R.L., Knuth D.E., Patashnik O. Concrete Mathematics: A Foundation for Computer Science. 1988;Addison-Wesley, Reading, MA. pp. 1-657.
14. W. Gropp, E. Lusk, N. Doss, A. Skjellum, A High Performance, Portable Implementation of the MPI Message Passing Interface Standard, Tech. Rep. Argonne National Laboratories, Available at: http://www.mcs.anl.gov/mpi/mpicharticle/paper.html.
15. Iannello G. Efficient algorithms for the reduce-scatter operation in LogGP. IEEE Transactions on Parallel and Distributed Systems. 8(9):1997;970-982.
16. R. Blackmore, Algorithms Development Group, IBM Poughkeepsie, personal communication, February 1998.
17. Lauria M., Chien A. MPI-FM: High performance MPI on workstation clusters. Journal of Parallel and Distributed Computing. 40(1):1997;4-18.
18. Message Passing Interface Forum, Document for standard message-passing interface, Tech. Rep. CS-93-214, University of Tennessee, November 1993.
19. H. Franke, C.E. Wu, M. Riviere, P. Pattnik, M. Snir, MPI Programming Environment for IBM SP1/SP2, Proceedings of the International Symposium on Computer Architecture, 1995, pp. 127-135.
20. R.M. Karp, A. Sahay, E.E. Santos, K.E. Schauser, Optimal Broadcast and Summation in the LogP Model, Proceedings of the 5th Annual ACM Symposium on Parallel Algorithms and Architectures, June 1993, pp. 142-153.
21. IBM AIX PVMe User's Guide and Subroutine Reference, SH23-0019-01.
22. S. Bae, D. Kim, S. Ranka. Vector Prefix and Reduction Computation on Coarse-Grained, Distributed-Memory Parallel Machines. In: Proc. of the First Merged International, Parallel Processing Symposium and Symposium on Parallel and Distributed Processing, IPPS/SPDP 1998, Orlando, FL, April 1998, pp. 321-325.
23. N.S. Sundar, D.N. Jayasimha, D.K. Panda, P. Sadayappan, Complete Exchange in 2D Meshes, Proceedings of Scalable High Performance Computing Conference, Knoxville, Tennessee, 23-25 May 1994, pp. 406-413.