Efficient algorithms for all-to-all communications in multiport message-passing systems

IEEE Transactions on Parallel and Distributed Systems

Volumn 8, Issue 11, 1997, Pages 1143-1156

  Bruck, Jehoshua ^a,b   Ho, Ching Tien ^a,c   Kipnis, Shlomo ^a,d   Upfal, Eli ^a,c   Weathersby, Derrick ^e  

^a IEEE   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c IBM ALMADEN RESEARCH CENTER   (United States)

^d News Datacom Research Ltd   (Israel)

^e University of Washington   (United States)

Author keywords

All to all broadcast; All to all personalized communication; Complete exchange; Concatenation operation; Distributed memory system; Index operation; Message passing system; Multiscatter gather; Parallel system

Indexed keywords

BROADCASTING; COMPUTATIONAL COMPLEXITY; DATA COMMUNICATION SYSTEMS; DATA STORAGE EQUIPMENT; DATA TRANSFER; INDEXING (OF INFORMATION); MATHEMATICAL MODELS; PARALLEL PROCESSING SYSTEMS; PERSONAL COMMUNICATION SYSTEMS; TOPOLOGY;

ALL TO ALL BROADCAST; ALL TO ALL PERSONALIZED COMMUNICATIONS; DISTRIBUTED MEMORY SYSTEMS; MULTIPORT MESSAGE PASSING SYSTEMS;

PARALLEL ALGORITHMS;

EID: 0031269329     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.642949     Document Type: Article

References (31)

1. V. Bala, J. Bruck, R. Bryant, R. Cypher, P. deJong, P. Elustondo, D. Frye, A. Ho, C.-T. Ho, G. Irwin, S. Kipnis, R. Lawrence, and M. Snir, "The IBM External User Interface for Scalable Parallel Systems," Parallel Computing, vol. 20, no. 4, pp. 445-462, Apr. 1994.
2. V. Bala, J. Bruck, R. Cypher, P. Elustondo, A. Ho, C.-T. Ho, S. Kipnis, and M. Snir, "CCL: A Portable and Tunable Collective Communication Library for Scalable Parallel Computers," IEEE Trans. Parallel and Distributed Systems, vol. 6, no. 2, pp. 154-164, Feb. 1995.
3. A. Bar-Noy and S. Kipnis, "Designing Broadcasting Algorithms in the Postal Model for Message-Passing Systems," Mathematical Systems Theory, vol. 27, no. 5, pp. 431-452, Sept./Oct. 1994.
4. L. Bhuyan and D. Agrawal, "Generalized Hypercube and Hyperbus Structures for a Computer Network," IEEE Trans. Computers, vol. 33, no. 4, pp. 323-333, Apr. 1984.
5. S. Bokhari, "Multiphase Complete Exchange on a Circuit-Switched Hypercube," Proc. 1991 Int'l Conf. Parallel Processing, vol. I, pp. 525-528, Aug. 1991.
6. J. Bruck, R. Cypher, L. Gravano, A. Ho, C.-T. Ho, S. Kipnis, S. Konstantinidou, M. Snir, and E. Upfal, "Survey of Routing Issues for the Vulcan Parallel Computer," IBM Research Report, RJ-8839, June 1992.
7. J. Bruck, R. Cypher, and C.-T. Ho, "Fault-Tolerant Meshes and Hypercubes with Minimal Numbers of Spares," IEEE Trans. Computers, vol. 42, no. 9, pp. 1,089-1,104, Sept. 1993.
8. C.Y. Chu, "Comparison of Two-dimensional FFT Methods on the Hypercubes," Proc. Third Conf. Hypercube Concurrent Computers and Applications, pp. 1,430-1,437, 1988.
9. D. Culler, R. Karp, D. Patterson, A. Sahay, K.E. Schauser, E. Santos, R. Subramonian, and T. von Eicken, "LogP: Towards a Realistic Model of Parallel Computation," Proc. Fourth SIGPLAN Symp. Principles and Practices Parallel Programming, ACM, May 1993.
10. W.J. Dally, A. Chien, S. Fiske, W. Horwat, J. Keen, M. Larivee, R. Lethin, P. Nuth, S. Wills, P. Carrick, and G. Fyler, "The J-Machine: a Fine-Grain Concurrent Computer," Proc. Information Processing '89, pp. 1,147-1,153, 1989.
11. B. Elspas and J. Turner, "Graphs with Circulant Adjacency Matrices," J. Combinatorial Theory, no. 9, pp. 297-307, 1970.
12. G. Fox, M. Johnsson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker, Solving Problems on Concurrent Processors, Vol. I. Prentice Hall, 1988.
13. P. Fraigniaud and E. Lazard, "Methods and Problems of Communication in Usual Networks," Discrete Applied Math., vol. 53, pp. 79-133, 1994.
14. G.A. Geist, M.T. Heath, B.W. Peyton, and P.H. Worley, "A User's Guide to PICL: A Portable Instrumented Communication Library," ORNL Technical Report no. ORNL/TM-11616, Oct. 1990.
15. G.A. Geist and V.S. Sunderam, "Network Based Concurrent Computing on the PVM System," ORNL Technical Report no. ORNL/TM-11760, June 1991.
16. S.M. Hedetniemi, S.T. Hedetniemi, and A.L. Liestman, "A Survey of Gossiping and Broadcasting in Communication Networks," Networks, vol. 18, pp. 319-349, 1988.
17. R. Hempel, "The ANL/GMD Macros (PARMACS) in FORTRAN for Portable Parallel Programming Using the Message Passing Programming Model, User's Guide and Reference Manual," technical memorandum, Gesellschaft für Mathematik und Datenverabeitung mbH, West Germany.
18. C.-T. Ho and M.T. Raghunath, "Efficient Communication Primitives on Hypercubes," Concurrency: Practice and Experience, vol. 4, no. 6, pp. 427-458, Sept. 1992.
19. S.L Johnsson and C.-T. Ho, "Matrix Multiplication on Boolean Cubes Using Generic Communication Primitives," Parallel Processing and Medium-Scale Multiprocessors, A. Wouk, ed., pp. 108-156. SIAM, 1989.
20. S.L. Johnsson and C.-T. Ho, "Spanning Graphs for Optimum Broadcasting and Personalized Communication in Hypercubes," IEEE Trans. Computers, vol. 38, no. 9, pp. 1,249-1,268, Sept. 1989.
21. S.L. Johnsson and C.-T. Ho, "Optimizing Tridiagonal Solvers for Alternating Direction Methods on Boolean Cube Multiprocessors," SIAM J. Scientific and Statistical Computing, vol. 11, no. 3, pp. 563-592, 1990.
22. S.L. Johnsson, C.-T. Ho, M. Jacquemin, and A. Ruttenberg, "Computing Fast Fourier Transforms on Boolean Cubes and Related Networks," Advanced Algorithms and Architectures for Signal Processing II, vol. 826, pp. 223-231. Soc. Photo-Optical Instrumentation Engineers, 1987.
23. O.A. McBryan and E.F. Van de Velde, "Hypercube Algorithms and Implementations," SIAM J. Scientific and Statistical Computing, vol. 8, no. 2, pp. 227-287, Mar. 1987.
24. Message Passing Interface Forum, MPI: A Message-Passing Interface Standard, May 1994.
25. J.F. Palmer "The NCUBE Family of Parallel Supercomputers," Proc. Int'l Conf. Computer Design, 1986.
26. F.P. Preparata and J.E. Vuillemin, "The Cube Connected Cycles: A Versatile Network for Parallel Computation," Comm. ACM, vol. 24, no. 5, pp. 300-309, May 1981.
27. A. Skjellum and A.P. Leung, "Zipcode: A Portable Multicomputer Communication Library Atop the Reactive Kernel," Proc. Fifth Distributed Memory Computing Conf., pp. 328-337, Apr. 1990.
28. P.N. Swarztrauber, "The Methods of Cyclic Reduction, Fourier Analysis, and the FACR Algorithm for the Discrete Solution of Poisson's Equation on a Rectangle," SIAM Rev., vol. 19, pp. 490-501, 1977.
29. Connection Machine CM-5 Technical Summary. Thinking Machines Corporation, 1991.
30. L.G. Valiant, "A Bridging Model for Parallel Computation," Comm. ACM, vol. 33, no. 8, pp. 103-111, Aug. 1990.
31. Express 3.0 Introductory Guide. Parasoft Corporation, 1990.